-- Logs begin at Sat 2022-04-30 20:01:17 UTC, end at Sat 2022-04-30 22:41:47 UTC. -- Apr 30 20:58:51.922994 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 20:58:51.932222 ncdv-master-1 devstack@n-api.service[114997]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 30 20:58:51 2022] *** Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: nodename: ncdv-master-1 Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: machine: x86_64 Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: clock source: unix Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: pcre jit disabled Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: detected number of CPU cores: 4 Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: current working directory: / Apr 30 20:58:51.934290 ncdv-master-1 devstack@n-api.service[114997]: detected binary path: /usr/bin/uwsgi-core Apr 30 20:58:51.935008 ncdv-master-1 devstack@n-api.service[114997]: your processes number limit is 47680 Apr 30 20:58:51.935008 ncdv-master-1 devstack@n-api.service[114997]: your memory page size is 4096 bytes Apr 30 20:58:51.935008 ncdv-master-1 devstack@n-api.service[114997]: detected max file descriptor number: 2048 Apr 30 20:58:51.935008 ncdv-master-1 devstack@n-api.service[114997]: lock engine: pthread robust mutexes Apr 30 20:58:51.935008 ncdv-master-1 devstack@n-api.service[114997]: thunder lock: enabled Apr 30 20:58:51.935008 ncdv-master-1 devstack@n-api.service[114997]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 20:58:51.935008 ncdv-master-1 devstack@n-api.service[114997]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 30 20:58:51.983642 ncdv-master-1 devstack@n-api.service[114997]: Python main interpreter initialized at 0x556bd4e899c0 Apr 30 20:58:51.983642 ncdv-master-1 devstack@n-api.service[114997]: python threads support enabled Apr 30 20:58:51.983642 ncdv-master-1 devstack@n-api.service[114997]: your server socket listen backlog is limited to 100 connections Apr 30 20:58:51.983642 ncdv-master-1 devstack@n-api.service[114997]: your mercy for graceful operations on workers is 90 seconds Apr 30 20:58:51.983974 ncdv-master-1 devstack@n-api.service[114997]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 20:58:51.984049 ncdv-master-1 devstack@n-api.service[114997]: *** Operational MODE: preforking *** Apr 30 20:58:51.984281 ncdv-master-1 devstack@n-api.service[114997]: *** uWSGI is running in multiple interpreter mode *** Apr 30 20:58:51.984281 ncdv-master-1 devstack@n-api.service[114997]: spawned uWSGI master process (pid: 114997) Apr 30 20:58:51.984452 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 30 20:58:51.985828 ncdv-master-1 devstack@n-api.service[114997]: spawned uWSGI worker 1 (pid: 114998, cores: 1) Apr 30 20:58:51.985828 ncdv-master-1 devstack@n-api.service[114997]: spawned uWSGI worker 2 (pid: 114999, cores: 1) Apr 30 20:58:51.985828 ncdv-master-1 devstack@n-api.service[114997]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 20:58:53.259123 ncdv-master-1 devstack@n-api.service[114999]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 30 20:58:53.260277 ncdv-master-1 devstack@n-api.service[114998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 30 20:58:53.997406 ncdv-master-1 devstack@n-api.service[114998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:58:53.997406 ncdv-master-1 devstack@n-api.service[114998]: from cryptography.utils import int_from_bytes Apr 30 20:58:53.997721 ncdv-master-1 devstack@n-api.service[114999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:58:53.997721 ncdv-master-1 devstack@n-api.service[114999]: from cryptography.utils import int_from_bytes Apr 30 20:58:53.997878 ncdv-master-1 devstack@n-api.service[114998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:58:53.997878 ncdv-master-1 devstack@n-api.service[114998]: from cryptography.utils import int_from_bytes Apr 30 20:58:53.997991 ncdv-master-1 devstack@n-api.service[114999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:58:53.997991 ncdv-master-1 devstack@n-api.service[114999]: from cryptography.utils import int_from_bytes Apr 30 20:58:56.595954 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 20:58:56.596543 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 20:58:56.596807 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 20:58:56.597019 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 20:58:56.597275 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 20:58:56.597427 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 20:58:56.597850 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.597927 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 20:58:56.597994 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.598247 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 20:58:56.598349 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.598651 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 20:58:56.598757 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.598911 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 20:58:56.599060 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.599288 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.599612 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.599906 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.600019 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.600249 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.600511 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.600780 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.600898 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.601140 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.601463 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.601651 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.601769 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.602094 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.602392 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.602514 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.602706 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.603030 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.603268 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.603386 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.603829 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.603948 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.604397 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.604556 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.604871 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.605167 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.605273 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.605608 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.605906 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.606005 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.606256 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.606562 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.606667 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.606871 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.607198 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.607409 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.607532 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.607896 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.608132 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.608228 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.608518 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.608833 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.608956 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.609256 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.609548 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.609663 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.609885 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.610210 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.610431 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.610540 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.610825 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.611151 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.611283 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.611471 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.611789 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.612018 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.612120 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.612398 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.612704 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.612869 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.613010 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.613332 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.613612 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.613741 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.613950 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.614235 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.614545 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.614868 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.615022 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.615185 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.615510 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.615762 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.615904 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.615999 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.616317 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.616583 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.616695 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.616927 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.617234 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.617504 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.617618 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.617849 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.618156 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.618410 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.618521 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.618747 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.619056 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.619254 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.619356 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.619669 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.619963 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.620067 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.620275 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.620591 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.620824 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.620987 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.621239 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.621540 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.621714 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.622200 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.622340 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.622526 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.622836 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.623062 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.623165 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.623461 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.623766 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.624004 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.624128 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.624344 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.624455 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.624665 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.624755 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.624988 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.625077 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.625290 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.625426 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.625539 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.625850 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.626160 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.626318 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.626477 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.626782 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.626881 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.627087 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.627186 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.627388 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.627489 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.627686 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.627773 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.627988 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.628083 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.628291 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.628414 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.628594 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.628901 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.628995 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.629279 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.629373 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.629502 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.629633 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.630455 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.630648 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.630744 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.631004 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.631107 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.631314 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.631403 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.631639 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.631735 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.631957 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.632051 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.632200 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.632402 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.632531 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.632745 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.632847 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.633057 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.633156 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.633369 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.633457 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.633662 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.633795 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.634010 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.634105 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.634378 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.634475 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.634640 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.634735 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.634946 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.635046 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.635253 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.635351 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.635562 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.635651 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.635867 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.635955 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.636173 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.636263 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.636478 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.636606 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.636781 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.636904 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.637139 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.637282 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.637415 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.637539 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.637694 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.637847 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.638069 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.638204 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.638390 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.638527 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.638693 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.638815 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.638992 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.639123 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.639291 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.639420 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.639721 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.639859 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.639983 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.640122 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.640268 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.640401 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.640584 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.640715 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.640902 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.641033 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.641238 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.641375 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.641513 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.641635 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.641839 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.641979 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.642157 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.642288 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.642495 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.642611 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.642804 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.642960 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.643063 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.643293 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.643421 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.643605 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.643717 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.643949 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.644064 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.644255 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.644355 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.644562 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.644664 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.644870 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.644969 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.645173 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.645269 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.646071 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.646180 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.646383 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.646473 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.646694 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.646800 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.646999 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.647112 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.647305 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.647436 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.647611 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.647757 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.647921 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.648090 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.648228 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.648409 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.648535 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.648728 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.648892 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.649049 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.649166 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.649389 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.649483 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.649845 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.649931 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.650103 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.650217 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.650413 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.650499 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.650736 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.650832 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.651041 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.651126 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.651346 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.651438 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.651669 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.651755 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.651976 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.652061 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.652282 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.652382 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.652605 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.652701 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.652911 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.652997 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.653212 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.653501 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.653670 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.653842 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.654011 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.654158 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.654297 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.654433 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.654580 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.654725 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.654869 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.655012 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.655149 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.655295 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.655436 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.655696 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.655856 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.656007 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.656166 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.656320 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.656474 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.656618 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.656765 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.656903 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.657041 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.657189 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.657337 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.657475 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.657613 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.657750 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.657931 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.658091 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.658313 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.658554 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.658681 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.658876 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.658975 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:58:56.659187 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.659275 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.659494 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.659580 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.659901 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.660218 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.660313 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.660561 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.660649 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.660909 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.660999 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.661251 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.661345 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.661566 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.661650 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.661902 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.662024 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.662229 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.662571 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.662812 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.662931 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.663184 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.663500 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.663671 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.663818 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.664126 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.664232 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.664494 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.664602 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.664758 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.664847 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.665048 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.665141 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.665373 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.665483 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.665686 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.665809 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.666031 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.666126 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.666360 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.666472 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.666669 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.666765 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.666976 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.667079 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.667305 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.667415 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.669804 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.669917 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670008 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670088 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670158 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670235 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670304 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670370 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670436 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670501 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670580 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670656 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670723 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670796 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670871 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670938 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.670938 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671068 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671136 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671201 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671266 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671338 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671414 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671488 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671561 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671628 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671693 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.671763 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.672249 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.672398 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.672538 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.672677 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.672815 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.672961 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.672961 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.673233 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.673378 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.673516 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.673672 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.673917 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.674065 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.674210 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.674349 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.674486 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.674709 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.674863 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675002 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675149 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675288 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675425 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675562 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675708 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675846 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.675983 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.676120 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.676256 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.676394 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.676564 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.676710 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.676857 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.677011 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.677150 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.677300 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.677450 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.677677 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.677855 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.678012 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.678151 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.678302 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.678442 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.678589 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.678729 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.678866 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.679013 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.679160 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.679298 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.679442 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.679589 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.679734 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.679871 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.680017 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.680162 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.680306 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.683955 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.684135 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.684307 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.684468 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.684619 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.684849 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.684996 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.685136 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.685284 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.685423 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.685560 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.685698 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.685860 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.686000 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.686150 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.686296 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.686446 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.686592 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.686730 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.686915 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.687069 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.687216 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.687367 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.687509 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.687647 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.687794 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.687933 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.688070 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.688226 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.688381 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.688532 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.688683 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.688822 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.688961 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.689099 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.689243 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.689389 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.689539 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.689678 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.689875 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.690029 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.690180 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.690325 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.690472 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.690618 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.690756 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.690893 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.691031 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.691178 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.691317 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.691454 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.691591 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.691728 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.691864 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.692021 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.692732 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.692879 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.693025 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.693163 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.693301 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.693447 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.693585 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.693722 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.693901 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.694073 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.694073 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.694425 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.694587 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.694725 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.694879 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.695086 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.695244 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.695384 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.695530 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.695669 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.695806 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.695952 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.696099 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.697049 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.697226 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.697371 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.697511 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.697656 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.697837 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.697990 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.698130 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.698267 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.698406 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.698542 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.698689 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.698835 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.698974 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.699123 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.701106 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.701269 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.701433 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.701580 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.701732 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.701901 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.702053 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.702203 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.702342 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.702480 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.702626 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.702765 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.702915 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.703068 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.703207 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.703344 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.703481 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.703623 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.703759 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.703902 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.704040 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.704175 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.704331 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.704460 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.704597 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.704758 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.704893 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.705042 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.705148 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.705334 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.705479 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.705913 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706077 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706225 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706364 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706364 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706702 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706702 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706986 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.706986 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.707244 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.707380 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.707525 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.707525 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.707820 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.708487 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.708629 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.708773 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.708921 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.709060 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.709208 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.709353 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.709491 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.709637 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.709793 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.709943 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.710081 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.710218 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.710354 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.710500 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.710638 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.710774 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.710911 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.711065 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.711203 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.711349 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.711487 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.711623 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.711768 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.711905 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.712043 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.712189 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.712333 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.712333 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.712599 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.712738 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.712894 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.713034 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.713171 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.713313 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.713451 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.713596 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.713742 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.713944 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.714084 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.714222 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.714358 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.714526 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.714677 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.714825 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.714968 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.715117 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.715268 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.715413 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.715413 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.715691 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.715828 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.715965 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.716101 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.716239 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.716376 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.716533 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.716671 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.716814 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.716959 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.717103 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.717103 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.717376 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.717514 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.717658 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.717930 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.718075 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.718221 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.718360 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.718514 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.718651 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.718651 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.718918 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.719070 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.719207 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.719358 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.719496 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.719641 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.719778 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.719924 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.720061 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.720197 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.720352 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.720490 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.720641 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.720788 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.720926 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.721063 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.721208 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.721345 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.721497 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.721635 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.721819 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.721964 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.722101 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.722248 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.722397 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.722555 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.722731 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.722874 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.723019 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.723170 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.723323 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.723975 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.724120 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.724257 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.724393 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.724541 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.724689 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.724827 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.724971 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.725109 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.725246 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.725396 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.725535 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.725680 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.725838 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.725979 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.726116 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.726266 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.726414 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.726550 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.726695 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.726695 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.726955 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.727102 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.727239 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.727376 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.727513 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.727649 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.727786 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.727943 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.728082 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.728237 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.728374 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.728512 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.728662 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.728810 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.728947 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.729084 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.729228 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.729375 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.729521 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.729744 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.729908 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.730046 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.730197 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.730335 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.730482 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.730628 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.730766 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.730903 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.731039 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.731176 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.731319 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.731470 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.731608 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.731752 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.731901 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.732038 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.732175 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.732320 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.732457 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.732606 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.732744 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.732880 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.733024 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.733170 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.733307 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.733443 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.733586 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.733740 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.733942 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.734083 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.734226 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.734371 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.734508 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.734645 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.734790 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.734928 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.735066 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.735202 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.735339 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.735476 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.735631 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.735813 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.735955 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.736094 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.736245 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.736391 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.736528 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.736666 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.736801 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.736938 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.737082 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.737229 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.737366 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.737513 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.737650 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.737856 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.738002 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.738153 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.738293 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.738430 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.738568 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.738712 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.738857 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.739004 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.739684 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.739837 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.739974 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.740111 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.740256 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.740395 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.740531 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.740668 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.740803 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.740940 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.741086 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.741224 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.741361 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.741497 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.741643 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.741798 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.741954 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.742093 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.742229 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.742365 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.742503 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.742640 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.742786 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.742924 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.743060 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.743060 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.743318 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.743465 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.743616 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.743754 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.743904 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.744042 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.744178 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.744328 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.744465 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.744603 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.744747 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.744884 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.745021 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.745168 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.745316 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.745452 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.745596 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.745734 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.745929 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.746078 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.746217 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.746353 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.746489 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.746626 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.746761 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.746907 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.747045 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.747191 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.747328 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.747464 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.747609 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.747747 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.747893 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.748039 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.748177 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.748313 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.748458 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.748603 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.748741 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.748888 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.749025 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.749161 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.749307 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.749444 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.749581 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.749717 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.749877 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.750014 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.750163 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.750300 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.750451 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.750588 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.750735 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.750882 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.751020 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.751156 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.751299 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.751452 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.751597 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.751748 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.751900 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.752045 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.752196 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.752340 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.752482 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.752649 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.752802 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.752947 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.753091 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.753234 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.753377 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.753529 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.753674 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.753838 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.753838 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.754115 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.754275 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.754421 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.754577 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.754748 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.754748 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755022 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755184 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755336 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755480 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755624 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755767 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755910 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.755910 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.756199 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.756356 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.756508 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.756652 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.756795 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.757012 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.757159 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.757303 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.757446 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.757589 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.757741 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.757954 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.758101 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.758244 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.758399 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.758542 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.758700 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.758845 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.759000 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.759144 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.759290 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.759433 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.759589 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.759589 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.759861 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.760004 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.760154 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.760154 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.760452 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.760604 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.760749 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.760891 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.761034 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.761186 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.761339 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.761485 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.761629 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.761797 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.761948 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.762104 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.762268 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.762421 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.762566 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.762717 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.762862 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.763014 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.763158 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.763302 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.763446 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.763603 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.763747 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.763900 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.764056 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.764199 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.764343 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.764486 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.764486 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.764769 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.764769 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.765049 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.765193 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.765336 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.765490 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.765635 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.765881 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.766044 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.766044 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.766317 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.766470 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.766616 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.766759 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.766903 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.767047 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.767190 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.767342 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.767486 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.767631 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.767780 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.767939 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.768092 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.768237 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.768380 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.768532 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.768677 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.768677 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.768966 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.769110 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.769253 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.769397 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.769540 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.769685 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.769873 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.770042 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.770199 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.770853 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.770999 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.771143 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.771287 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.771431 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.771583 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.771729 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.771874 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.772019 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.772173 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.772324 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.772477 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.772628 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.772780 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.772926 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.773070 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.773223 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.773368 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.773519 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.773664 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.773823 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.773973 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.774140 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.774286 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.774437 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.774581 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.774733 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.774879 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.775033 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.775178 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.775330 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.775474 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.775619 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.775762 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.775916 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.776072 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.776216 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.776360 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.776505 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.776657 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.776802 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.776946 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.777092 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.777236 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.777379 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.777532 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.777678 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.777889 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.778049 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.778195 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.778350 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.778505 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.778650 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.778794 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.778939 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779093 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779238 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779396 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779543 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779688 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779688 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779990 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.779990 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.780274 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.780417 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.780568 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.780712 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.780865 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.781019 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.781188 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.781334 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.781478 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.781621 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.781792 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.781956 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.782101 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.782246 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.782390 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.782533 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.782677 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.782830 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.782974 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.783124 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.783270 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.783422 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.783575 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.783730 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.783874 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.784018 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.784168 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.784313 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.784467 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.784612 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.784755 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.784907 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.785052 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.785195 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.785347 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.785503 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.785647 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.785808 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.786007 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.786639 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.786797 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.786982 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.787133 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.787277 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.787429 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.787583 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.787728 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.787872 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.788026 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.788170 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.788323 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.788477 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.788623 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.788847 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.788995 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.789149 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.789294 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.789448 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.789594 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.789738 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.789931 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.790087 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.790231 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.790388 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.790540 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.790540 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.790814 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.790958 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.791116 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.791261 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.791405 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.791548 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.791694 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.791836 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.792000 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.792145 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.792289 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.792432 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.792575 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.792727 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.792880 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793035 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793180 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793330 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793481 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793626 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793810 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793963 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.793963 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.794245 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.794395 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.794555 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.794709 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.794854 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.795011 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.795157 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.795302 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.795521 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.795679 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.795824 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.795968 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.796111 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.796255 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.796408 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.796552 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.796704 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.796863 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.797022 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.797247 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.797415 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.797573 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.797573 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.797872 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.798019 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.798180 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.798180 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.798474 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.798619 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.798771 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.798925 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.799080 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.799226 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.799369 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.799526 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.799671 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.799823 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.799968 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.800113 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.800265 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.800419 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.800572 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.800726 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.800871 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.801022 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.801168 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.801322 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.801467 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.801652 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.801895 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.802046 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.802192 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.802343 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.802501 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.802654 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.802798 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.802798 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.803069 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.803214 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.803383 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.803540 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.803685 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.803836 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.804024 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.804178 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.804339 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.804492 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.804637 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.804781 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.804932 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.805077 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.805231 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.805392 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.805537 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.805689 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.805856 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.806013 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.806158 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.806302 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.806456 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.806600 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.806745 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.806897 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.807042 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.807195 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.807339 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.807493 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.807638 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.807791 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.807936 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.808080 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.808224 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.808378 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.808533 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.808681 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.808834 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.808979 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.809133 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.809277 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.809430 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.809575 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.809719 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.809886 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.810034 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.810179 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.810335 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.810490 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.810636 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.810781 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.810935 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.811093 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.811238 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.811382 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.811526 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.811670 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.811823 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.811977 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.812122 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.812266 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.812409 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.812553 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.812708 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.812862 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.813008 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.813159 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.813305 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.813449 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.813603 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.813749 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.813961 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.814114 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.814274 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.814420 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.814574 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.814730 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.814875 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.815018 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.815161 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.815305 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.815457 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.815601 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.815745 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.815745 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.816019 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.816163 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.816316 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.816471 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.816624 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.816768 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.816913 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.817066 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.817239 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.817385 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.817528 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.817673 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.817853 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.818015 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.818161 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.818316 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.818479 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.818625 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.818778 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.818933 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819079 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819223 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819380 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819526 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819670 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819773 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819856 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.819943 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820024 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820103 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820196 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820279 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820358 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820437 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820516 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820595 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820731 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.820819 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.821047 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.821136 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.821428 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.821579 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.821786 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.821960 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.822109 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.822281 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.822428 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.822616 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.822799 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.822949 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.823036 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.823257 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.823353 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.823565 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.823653 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.823874 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.823961 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.824236 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.824406 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.824507 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.824713 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.824844 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.825028 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.825167 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.825341 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.825487 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.825656 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.825823 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.825994 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.826125 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.826307 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.826451 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.826614 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.826733 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.826944 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.827031 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.827252 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.827341 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.827558 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.827658 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.827866 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.827953 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.828180 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.828267 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.828488 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.828583 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.828795 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.828894 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.829102 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.829190 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.829407 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.829495 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.829717 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.829838 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.830047 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.830134 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.830360 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.830456 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.830921 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.831033 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.831228 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.831316 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.831539 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.831629 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.831851 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.831946 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.832165 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.832308 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.832451 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.832588 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.833335 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.833484 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.833629 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.833787 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.833977 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.834108 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.834291 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.834443 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.834617 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.834755 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.834932 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.835019 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.835248 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.835336 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.835556 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.835642 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.835882 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.835976 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.836191 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.836435 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.836529 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.836774 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.836865 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.837097 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.837197 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.837435 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.837532 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.837803 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.837928 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.838077 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.838198 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.838386 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.838506 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.838694 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.838822 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.839019 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.839140 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.839335 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.839462 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.839633 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.839766 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.839941 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.840060 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.840249 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.840363 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.840551 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.840679 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.840857 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.840994 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.841148 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.841276 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.841449 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.841587 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.841772 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.841903 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.842073 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.842201 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.842377 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.842525 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.842687 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.842850 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.843006 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.843165 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.843336 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.843498 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.843678 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.843830 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.843987 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.844147 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.844316 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.844479 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.844647 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.844817 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.844980 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.845138 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.845307 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.845470 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.845627 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.845879 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.846091 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.846274 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.846450 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.846621 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.846770 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.846933 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.847092 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.847259 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.847422 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.847579 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.847736 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.847892 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.848052 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.848216 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.848377 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.848590 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.849229 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.849553 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.849712 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.849901 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.850068 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.850222 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.850382 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.850543 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.850710 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.850873 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.851029 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.851191 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.851360 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.851521 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.851689 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.851851 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.852008 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.852167 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.852324 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.852487 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.852658 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.852820 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.852979 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.853139 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.853296 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.853534 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.853720 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.853903 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.854127 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.854279 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.854430 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.854604 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.854767 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.854923 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.855087 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.855255 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.855416 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.855588 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.855760 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.855922 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.856079 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.856234 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.856391 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.856554 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.856714 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.856877 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.857036 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.857192 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.857358 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.857525 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.857691 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.857865 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.858023 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.858177 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.858348 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.858512 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.858668 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.858825 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.858982 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.859139 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.859303 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.859467 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.859627 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.859782 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.859782 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.860102 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.860265 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.860420 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.860577 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.860731 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.860888 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861055 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861222 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861384 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861384 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 20:58:56.861698 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861698 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861698 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861698 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861698 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.861698 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.862606 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.862606 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.862606 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.863056 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.863056 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.863370 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.863678 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.863987 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.864320 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.864629 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.864941 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.865243 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.865568 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.865916 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.866219 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.866548 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.866856 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.867184 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.867504 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.867816 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.868140 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.868449 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.868755 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.869067 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.869373 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.869682 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.870034 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.870357 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.870679 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.871003 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.871329 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.871651 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.872006 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.872310 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.872651 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.872976 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.873284 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.873590 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.873916 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:58:56.874158 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 20:58:56.884443 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_db.sqlalchemy.engines [None req-33597146-0d28-436d-9063-73b44bcd492e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:56.897670 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_db.sqlalchemy.engines [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:56.947484 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.context [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=114999) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 20:58:56.952358 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_concurrency.lockutils [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 20:58:56.953998 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_concurrency.lockutils [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 20:58:56.954782 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_concurrency.lockutils [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 20:58:56.956986 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_concurrency.lockutils [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 20:58:56.959764 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.context [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=114998) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 20:58:56.964138 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 20:58:56.965675 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 20:58:56.966518 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 20:58:56.967795 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_db.sqlalchemy.engines [None req-33597146-0d28-436d-9063-73b44bcd492e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:56.968498 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 20:58:56.970660 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_db.sqlalchemy.engines [None req-33597146-0d28-436d-9063-73b44bcd492e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:56.980805 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_db.sqlalchemy.engines [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:56.983473 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_db.sqlalchemy.engines [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:57.139131 ncdv-master-1 devstack@n-api.service[114999]: DEBUG oslo_db.sqlalchemy.engines [None req-33597146-0d28-436d-9063-73b44bcd492e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:57.142858 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_db.sqlalchemy.engines [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:58:57.558735 ncdv-master-1 devstack@n-api.service[114999]: WARNING keystonemiddleware.auth_token [None req-33597146-0d28-436d-9063-73b44bcd492e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 20:58:57.565349 ncdv-master-1 devstack@n-api.service[114999]: WARNING keystonemiddleware.auth_token [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 20:58:57.593395 ncdv-master-1 devstack@n-api.service[114998]: WARNING keystonemiddleware.auth_token [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 20:58:57.600051 ncdv-master-1 devstack@n-api.service[114998]: WARNING keystonemiddleware.auth_token [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 20:58:57.908078 ncdv-master-1 devstack@n-api.service[114999]: WARNING keystonemiddleware.auth_token [None req-33597146-0d28-436d-9063-73b44bcd492e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 20:58:57.913324 ncdv-master-1 devstack@n-api.service[114999]: WARNING keystonemiddleware.auth_token [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 20:58:57.918517 ncdv-master-1 devstack@n-api.service[114999]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bd4e899c0 pid: 114999 (default app) Apr 30 20:58:57.920562 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 20:58:57.921732 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-33597146-0d28-436d-9063-73b44bcd492e None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Apr 30 20:58:57.922156 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Sat Apr 30 20:58:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 20:58:57.939765 ncdv-master-1 devstack@n-api.service[114998]: WARNING keystonemiddleware.auth_token [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 20:58:57.945494 ncdv-master-1 devstack@n-api.service[114998]: WARNING keystonemiddleware.auth_token [None req-0ce07f9b-306a-4c4f-9f24-056e819d97ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 20:58:57.950849 ncdv-master-1 devstack@n-api.service[114998]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bd4e899c0 pid: 114998 (default app) Apr 30 21:00:20.711009 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:20.711993 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-33597146-0d28-436d-9063-73b44bcd492e None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Apr 30 21:00:20.712561 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:21.149462 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-efe35b59-c79d-4c57-8210-10731a2abdbf admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:21.184862 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-efe35b59-c79d-4c57-8210-10731a2abdbf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465609 Apr 30 21:00:21.185631 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:00:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:00:23.614187 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-33597146-0d28-436d-9063-73b44bcd492e None None] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:23.615170 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-33597146-0d28-436d-9063-73b44bcd492e None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Apr 30 21:00:23.617870 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:23.676669 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-b25c6f1e-6692-43c3-bf51-567c854d3a39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "ram": 256, "swap": 0}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:23.694649 ncdv-master-1 devstack@n-api.service[114998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:00:23.694649 ncdv-master-1 devstack@n-api.service[114998]: warnings.warn(msg) Apr 30 21:00:23.766686 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-b25c6f1e-6692-43c3-bf51-567c854d3a39 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.142084 Apr 30 21:00:23.771582 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:00:24.006568 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-a4940fba-231b-4be6-9098-eaf2a07cb2b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:24.009053 ncdv-master-1 devstack@n-api.service[114999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:00:24.009053 ncdv-master-1 devstack@n-api.service[114999]: warnings.warn(msg) Apr 30 21:00:24.120830 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-a4940fba-231b-4be6-9098-eaf2a07cb2b2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.345686 Apr 30 21:00:24.121728 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Apr 30 21:00:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:00:26.512940 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-b25c6f1e-6692-43c3-bf51-567c854d3a39 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:26.514061 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-b25c6f1e-6692-43c3-bf51-567c854d3a39 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 30 21:00:26.514466 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:26.618937 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-cb376683-58b1-4b19-850f-f3f134bff6f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "disk": 5}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:26.637666 ncdv-master-1 devstack@n-api.service[114999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:00:26.637666 ncdv-master-1 devstack@n-api.service[114999]: warnings.warn(msg) Apr 30 21:00:26.797079 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-cb376683-58b1-4b19-850f-f3f134bff6f7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.276654 Apr 30 21:00:26.797796 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:00:26.809894 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-2d08b3bc-e449-4b04-be97-1c7f1e6cf4e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:26.811663 ncdv-master-1 devstack@n-api.service[114998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:00:26.811663 ncdv-master-1 devstack@n-api.service[114998]: warnings.warn(msg) Apr 30 21:00:26.937855 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-2d08b3bc-e449-4b04-be97-1c7f1e6cf4e0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131764 Apr 30 21:00:26.938641 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Apr 30 21:00:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:00:29.366676 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-cb376683-58b1-4b19-850f-f3f134bff6f7 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:29.367690 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-cb376683-58b1-4b19-850f-f3f134bff6f7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Apr 30 21:00:29.368422 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:29.431484 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-8d144159-7b97-4ef1-9e0c-af1bbfdc27bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:29.528589 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-8d144159-7b97-4ef1-9e0c-af1bbfdc27bb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153971 Apr 30 21:00:29.529550 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:00:29.541315 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-681cb2c1-a17d-4acf-9549-fefdc93938c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:29.630521 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-681cb2c1-a17d-4acf-9549-fefdc93938c1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092769 Apr 30 21:00:29.631265 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Apr 30 21:00:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:00:32.405001 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-8d144159-7b97-4ef1-9e0c-af1bbfdc27bb admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:32.406054 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-8d144159-7b97-4ef1-9e0c-af1bbfdc27bb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Apr 30 21:00:32.406670 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:32.478123 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-d743f12a-6949-4657-b990-88ca333bfff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:32.595079 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-d743f12a-6949-4657-b990-88ca333bfff6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.181266 Apr 30 21:00:32.602387 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:00:32.610161 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-4d3b06b0-c96b-4582-8fbf-d3875ec98306 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:32.721931 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-4d3b06b0-c96b-4582-8fbf-d3875ec98306 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113753 Apr 30 21:00:32.721931 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Apr 30 21:00:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:00:35.744971 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-d743f12a-6949-4657-b990-88ca333bfff6 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:35.746031 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-d743f12a-6949-4657-b990-88ca333bfff6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Apr 30 21:00:35.746439 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:35.805905 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-74bbfbd2-ba60-4dca-a98f-5b9577982a34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:36.000737 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-74bbfbd2-ba60-4dca-a98f-5b9577982a34 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.232755 Apr 30 21:00:36.000737 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:00:36.000991 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-018a6b8a-31e7-45e8-8125-2c5b152a23b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:36.240141 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-018a6b8a-31e7-45e8-8125-2c5b152a23b4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.246481 Apr 30 21:00:36.240872 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Apr 30 21:00:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:00:38.733038 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-74bbfbd2-ba60-4dca-a98f-5b9577982a34 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:38.734587 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-74bbfbd2-ba60-4dca-a98f-5b9577982a34 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Apr 30 21:00:38.736592 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:38.794535 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-af7510a5-9d8c-4658-af2f-3fe2a00f7052 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:38.818039 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-af7510a5-9d8c-4658-af2f-3fe2a00f7052 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077024 Apr 30 21:00:38.818708 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:00:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:00:41.265966 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-74bbfbd2-ba60-4dca-a98f-5b9577982a34 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:41.266972 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-74bbfbd2-ba60-4dca-a98f-5b9577982a34 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Apr 30 21:00:41.267372 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:41.330490 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-cc4b9d55-a80c-4d1a-8398-697b05562cea admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "id": "1", "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny"}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:41.439509 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-cc4b9d55-a80c-4d1a-8398-697b05562cea admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.166146 Apr 30 21:00:41.440215 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:00:41.453188 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-3c9f5369-d044-474a-981c-99d57f47210d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:41.540117 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-3c9f5369-d044-474a-981c-99d57f47210d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091476 Apr 30 21:00:41.540880 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Apr 30 21:00:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:00:44.199781 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-cc4b9d55-a80c-4d1a-8398-697b05562cea admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:44.200845 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-cc4b9d55-a80c-4d1a-8398-697b05562cea admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Apr 30 21:00:44.201258 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:44.262541 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-629b170a-6015-452c-a817-be5dcc40834c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "vcpus": 1, "ram": 2048}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:44.341875 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-629b170a-6015-452c-a817-be5dcc40834c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133661 Apr 30 21:00:44.342435 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:00:44.354700 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-1d4f4ab0-805b-44f9-8e12-37d212fbfbf5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:44.491685 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-1d4f4ab0-805b-44f9-8e12-37d212fbfbf5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140592 Apr 30 21:00:44.509707 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Apr 30 21:00:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:00:47.185207 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-629b170a-6015-452c-a817-be5dcc40834c admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:47.186272 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-629b170a-6015-452c-a817-be5dcc40834c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Apr 30 21:00:47.186686 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:47.259709 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-991be9b0-67d3-48bb-b809-d0952a0d7cc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:47.359594 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-991be9b0-67d3-48bb-b809-d0952a0d7cc3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.165094 Apr 30 21:00:47.361209 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:00:47.373676 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-34a9d326-9540-4e25-86b6-fd25f6b6860f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:47.770253 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-34a9d326-9540-4e25-86b6-fd25f6b6860f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.400209 Apr 30 21:00:47.771119 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Apr 30 21:00:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:00:50.204763 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-991be9b0-67d3-48bb-b809-d0952a0d7cc3 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:50.205900 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-991be9b0-67d3-48bb-b809-d0952a0d7cc3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Apr 30 21:00:50.206495 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:50.267020 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-494f94fb-cd36-4ed5-8faa-49684ada24d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:50.392080 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-494f94fb-cd36-4ed5-8faa-49684ada24d0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.173152 Apr 30 21:00:50.392080 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:00:50.399779 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-feb7915d-bcfa-46fe-849c-690a9b66505e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:50.510779 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-feb7915d-bcfa-46fe-849c-690a9b66505e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114931 Apr 30 21:00:50.511444 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Apr 30 21:00:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:00:52.916694 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-494f94fb-cd36-4ed5-8faa-49684ada24d0 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:00:52.918403 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-494f94fb-cd36-4ed5-8faa-49684ada24d0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 Apr 30 21:00:52.918801 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:00:52.983037 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-f60ca41d-5814-4367-b534-057d1011a5a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:53.113898 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-f60ca41d-5814-4367-b534-057d1011a5a3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.164228 Apr 30 21:00:53.113898 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Apr 30 21:00:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:00:53.114297 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9a39365f-9508-4985-aa62-b4ef4c44c4f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:00:53.208381 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9a39365f-9508-4985-aa62-b4ef4c44c4f1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101487 Apr 30 21:00:53.209268 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Apr 30 21:00:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:01:19.015375 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-f60ca41d-5814-4367-b534-057d1011a5a3 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:19.016950 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-f60ca41d-5814-4367-b534-057d1011a5a3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Apr 30 21:01:19.017344 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:19.072720 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-4a2f3c3b-7ce2-4f1b-ba13-ec8d89eff0e0 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:19.089925 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-4a2f3c3b-7ce2-4f1b-ba13-ec8d89eff0e0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066655 Apr 30 21:01:19.090442 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:01:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:01:20.502777 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-f60ca41d-5814-4367-b534-057d1011a5a3 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:20.503831 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-f60ca41d-5814-4367-b534-057d1011a5a3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Apr 30 21:01:20.504228 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:20.755339 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-2987dfd2-27cd-4fda-bc6a-41b34895906d admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:20.760768 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.wsgi [None req-2987dfd2-27cd-4fda-bc6a-41b34895906d admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 21:01:20.761320 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-2987dfd2-27cd-4fda-bc6a-41b34895906d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:01:20.762144 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-2987dfd2-27cd-4fda-bc6a-41b34895906d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057232 Apr 30 21:01:20.762687 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:01:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:20.772503 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-9e96a808-9fca-46b3-ac9a-b37ce4a38a6d admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:20.794023 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-9e96a808-9fca-46b3-ac9a-b37ce4a38a6d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024903 Apr 30 21:01:20.794612 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:01:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:01:20.804766 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-ceb4c369-a98f-4bf0-af2f-1a989de58bf0 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:20.826602 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-ceb4c369-a98f-4bf0-af2f-1a989de58bf0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025146 Apr 30 21:01:20.827194 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:01:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:01:20.838400 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-ac1cd959-058f-475f-abdb-93a4f2d64f3a admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:20.844767 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.wsgi [None req-ac1cd959-058f-475f-abdb-93a4f2d64f3a admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 21:01:20.845322 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-ac1cd959-058f-475f-abdb-93a4f2d64f3a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:01:20.846156 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-ac1cd959-058f-475f-abdb-93a4f2d64f3a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011383 Apr 30 21:01:20.846856 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:01:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:22.130123 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-ceb4c369-a98f-4bf0-af2f-1a989de58bf0 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:22.131122 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-ceb4c369-a98f-4bf0-af2f-1a989de58bf0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Apr 30 21:01:22.132212 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:22.326379 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-02728dc0-410f-4616-a490-908d55502961 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:22.332390 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.wsgi [None req-02728dc0-410f-4616-a490-908d55502961 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 21:01:22.332970 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-02728dc0-410f-4616-a490-908d55502961 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:01:22.333792 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-02728dc0-410f-4616-a490-908d55502961 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058538 Apr 30 21:01:22.334306 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:01:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:22.344339 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-20815eb3-dd79-460a-a0ac-8023c142d648 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:22.357954 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-20815eb3-dd79-460a-a0ac-8023c142d648 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017795 Apr 30 21:01:22.358491 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:01:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:01:22.367545 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-df6d307a-161c-4799-8d6f-8f0f46a93bbb admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:22.380683 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-df6d307a-161c-4799-8d6f-8f0f46a93bbb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016629 Apr 30 21:01:22.381186 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:01:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:01:22.390067 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-15a7046d-60a3-4ca5-a385-0a42c3497032 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:22.395658 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.wsgi [None req-15a7046d-60a3-4ca5-a385-0a42c3497032 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 21:01:22.396208 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-15a7046d-60a3-4ca5-a385-0a42c3497032 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:01:22.396981 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-15a7046d-60a3-4ca5-a385-0a42c3497032 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010386 Apr 30 21:01:22.397464 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:01:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:23.691593 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-df6d307a-161c-4799-8d6f-8f0f46a93bbb admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:23.692589 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-df6d307a-161c-4799-8d6f-8f0f46a93bbb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Apr 30 21:01:23.692980 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:23.885729 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-ea26e2ac-3eb9-42f7-b3d7-0145110e6192 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:23.891058 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.wsgi [None req-ea26e2ac-3eb9-42f7-b3d7-0145110e6192 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 21:01:23.891618 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-ea26e2ac-3eb9-42f7-b3d7-0145110e6192 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:01:23.892404 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-ea26e2ac-3eb9-42f7-b3d7-0145110e6192 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058019 Apr 30 21:01:23.892910 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:01:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:23.902348 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-24dacfc9-ef12-400a-b4a8-c0bbcdbda22c admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:23.915494 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-24dacfc9-ef12-400a-b4a8-c0bbcdbda22c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016781 Apr 30 21:01:23.917333 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:01:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:01:23.926332 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:23.939733 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017909 Apr 30 21:01:23.940409 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:01:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:01:23.950072 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-f9464882-2b4a-49f8-b94a-e8fdce638b9d admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:23.959280 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.wsgi [None req-f9464882-2b4a-49f8-b94a-e8fdce638b9d admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 21:01:23.959855 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-f9464882-2b4a-49f8-b94a-e8fdce638b9d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:01:23.960656 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-f9464882-2b4a-49f8-b94a-e8fdce638b9d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014544 Apr 30 21:01:23.961189 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:01:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:25.241966 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:25.242965 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Apr 30 21:01:25.243360 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:25.437463 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-27868db3-b32c-47da-8268-bfdfb4db1d32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:01:25.546405 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-27868db3-b32c-47da-8268-bfdfb4db1d32 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.159654 Apr 30 21:01:25.548298 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Apr 30 21:01:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:01:26.824188 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:26.825187 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Apr 30 21:01:26.825856 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:27.021824 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-d231a554-e1ac-4aa3-8f92-957d260faa05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:01:27.102792 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-d231a554-e1ac-4aa3-8f92-957d260faa05 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.132383 Apr 30 21:01:27.103261 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Apr 30 21:01:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:01:28.386876 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:28.387904 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Apr 30 21:01:28.388327 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:28.582588 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-4aed3cf8-245a-4c80-8695-85da68f5d166 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:01:28.668067 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-4aed3cf8-245a-4c80-8695-85da68f5d166 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.137145 Apr 30 21:01:28.668599 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Apr 30 21:01:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:01:29.967582 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:29.969294 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Apr 30 21:01:29.969691 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:30.162554 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-f9c51cdc-d187-411e-ba06-c9d3c393b569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:01:30.240361 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-f9c51cdc-d187-411e-ba06-c9d3c393b569 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.128825 Apr 30 21:01:30.240893 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Apr 30 21:01:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:01:31.507535 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:31.508557 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Apr 30 21:01:31.508955 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:01:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:01:31.715364 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-4dcdf797-f886-4ad7-84f0-2d44f807da92 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:01:31.734183 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-4dcdf797-f886-4ad7-84f0-2d44f807da92 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076984 Apr 30 21:01:31.734647 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Sat Apr 30 21:01:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:02:36.738397 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:02:36.738397 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-9054b0de-df4b-498b-bd23-f7204e216d25 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 30 21:02:36.738397 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Sat Apr 30 21:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:02:36.759648 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-15e4bede-9225-418b-94b5-97ead246ed3c admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:02:36.779446 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-15e4bede-9225-418b-94b5-97ead246ed3c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070710 Apr 30 21:02:36.779911 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:02:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:02:36.802993 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-358b2bf7-f6ac-47fc-bced-e215f265ca7d admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:02:36.811505 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-358b2bf7-f6ac-47fc-bced-e215f265ca7d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013026 Apr 30 21:02:36.812102 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Sat Apr 30 21:02:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:02:36.823512 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-347462ff-7cda-4c46-a058-f2a6c642d790 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:02:36.831757 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-347462ff-7cda-4c46-a058-f2a6c642d790 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012056 Apr 30 21:02:36.832258 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Sat Apr 30 21:02:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:02:36.843028 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-b0df9383-e468-4370-aa9f-36313aaaccb7 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:02:36.850444 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-b0df9383-e468-4370-aa9f-36313aaaccb7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010919 Apr 30 21:02:36.850968 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Sat Apr 30 21:02:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:02:36.861609 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-0e17211e-3ea9-43a3-88b4-218c9363b9f5 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:02:36.868912 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-0e17211e-3ea9-43a3-88b4-218c9363b9f5 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010670 Apr 30 21:02:36.869422 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Sat Apr 30 21:02:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:04:26.948696 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-32091525-1b69-410b-b412-d405365942a9 tempest-verify_tempest_config-279512230 tempest-verify_tempest_config-279512230-project] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:04:26.950652 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-32091525-1b69-410b-b412-d405365942a9 tempest-verify_tempest_config-279512230 tempest-verify_tempest_config-279512230-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104612 Apr 30 21:04:26.951177 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:04:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:08:30.612374 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-0e17211e-3ea9-43a3-88b4-218c9363b9f5 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:08:30.613406 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-0e17211e-3ea9-43a3-88b4-218c9363b9f5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Apr 30 21:08:30.613813 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:08:30.877196 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-87ac16ed-fa7a-4fe4-b676-4fc4ef420074 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:08:30.878385 ncdv-master-1 devstack@n-api.service[114998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:08:30.878385 ncdv-master-1 devstack@n-api.service[114998]: warnings.warn(msg) Apr 30 21:08:30.879573 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-87ac16ed-fa7a-4fe4-b676-4fc4ef420074 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:08:30.880008 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-87ac16ed-fa7a-4fe4-b676-4fc4ef420074 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:08:30.880787 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-87ac16ed-fa7a-4fe4-b676-4fc4ef420074 admin admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:08:30.881212 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-87ac16ed-fa7a-4fe4-b676-4fc4ef420074 admin admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:08:30.920298 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-87ac16ed-fa7a-4fe4-b676-4fc4ef420074 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.161454 Apr 30 21:08:30.920846 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:08:30 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:08:32.205670 ncdv-master-1 devstack@n-api.service[114999]: DEBUG nova.api.openstack.wsgi [None req-0e17211e-3ea9-43a3-88b4-218c9363b9f5 admin admin] Calling method '>' {{(pid=114999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:08:32.206692 ncdv-master-1 devstack@n-api.service[114999]: INFO nova.api.openstack.requestlog [None req-0e17211e-3ea9-43a3-88b4-218c9363b9f5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Apr 30 21:08:32.207084 ncdv-master-1 devstack@n-api.service[114999]: [pid: 114999|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Apr 30 21:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:08:32.403290 ncdv-master-1 devstack@n-api.service[114998]: DEBUG nova.api.openstack.wsgi [None req-416a40b2-cbef-4d70-9e3e-d09ea2565081 admin admin] Calling method '>' {{(pid=114998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:08:32.404487 ncdv-master-1 devstack@n-api.service[114998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:08:32.404487 ncdv-master-1 devstack@n-api.service[114998]: warnings.warn(msg) Apr 30 21:08:32.407128 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-416a40b2-cbef-4d70-9e3e-d09ea2565081 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:08:32.407571 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-416a40b2-cbef-4d70-9e3e-d09ea2565081 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:08:32.408381 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-416a40b2-cbef-4d70-9e3e-d09ea2565081 admin admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:08:32.408831 ncdv-master-1 devstack@n-api.service[114998]: DEBUG oslo_concurrency.lockutils [None req-416a40b2-cbef-4d70-9e3e-d09ea2565081 admin admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:08:32.430731 ncdv-master-1 devstack@n-api.service[114998]: INFO nova.api.openstack.requestlog [None req-416a40b2-cbef-4d70-9e3e-d09ea2565081 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.078937 Apr 30 21:08:32.431209 ncdv-master-1 devstack@n-api.service[114998]: [pid: 114998|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:08:32 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:09:21.497681 ncdv-master-1 devstack@n-api.service[114997]: Sat Apr 30 21:09:21 2022 - graceful shutdown triggered... Apr 30 21:09:21.498235 ncdv-master-1 devstack@n-api.service[114998]: Gracefully killing worker 1 (pid: 114998)... Apr 30 21:09:21.497845 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Apr 30 21:09:21.499219 ncdv-master-1 devstack@n-api.service[114999]: Gracefully killing worker 2 (pid: 114999)... Apr 30 21:09:22.497891 ncdv-master-1 devstack@n-api.service[114997]: worker 1 buried after 1 seconds Apr 30 21:09:22.497891 ncdv-master-1 devstack@n-api.service[114997]: worker 2 buried after 1 seconds Apr 30 21:09:22.497891 ncdv-master-1 devstack@n-api.service[114997]: goodbye to uWSGI. Apr 30 21:09:22.499571 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Apr 30 21:09:22.500689 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Apr 30 21:09:22.503473 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 21:09:22.531422 ncdv-master-1 devstack@n-api.service[130653]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 30 21:09:22 2022] *** Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: nodename: ncdv-master-1 Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: machine: x86_64 Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: clock source: unix Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: pcre jit disabled Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: detected number of CPU cores: 4 Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: current working directory: / Apr 30 21:09:22.533326 ncdv-master-1 devstack@n-api.service[130653]: detected binary path: /usr/bin/uwsgi-core Apr 30 21:09:22.534089 ncdv-master-1 devstack@n-api.service[130653]: your processes number limit is 47680 Apr 30 21:09:22.534089 ncdv-master-1 devstack@n-api.service[130653]: your memory page size is 4096 bytes Apr 30 21:09:22.534089 ncdv-master-1 devstack@n-api.service[130653]: detected max file descriptor number: 2048 Apr 30 21:09:22.534089 ncdv-master-1 devstack@n-api.service[130653]: lock engine: pthread robust mutexes Apr 30 21:09:22.534089 ncdv-master-1 devstack@n-api.service[130653]: thunder lock: enabled Apr 30 21:09:22.534089 ncdv-master-1 devstack@n-api.service[130653]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 21:09:22.534089 ncdv-master-1 devstack@n-api.service[130653]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 30 21:09:22.583948 ncdv-master-1 devstack@n-api.service[130653]: Python main interpreter initialized at 0x55b388a6e9c0 Apr 30 21:09:22.583948 ncdv-master-1 devstack@n-api.service[130653]: python threads support enabled Apr 30 21:09:22.583948 ncdv-master-1 devstack@n-api.service[130653]: your server socket listen backlog is limited to 100 connections Apr 30 21:09:22.583948 ncdv-master-1 devstack@n-api.service[130653]: your mercy for graceful operations on workers is 90 seconds Apr 30 21:09:22.584381 ncdv-master-1 devstack@n-api.service[130653]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 21:09:22.584381 ncdv-master-1 devstack@n-api.service[130653]: *** Operational MODE: preforking *** Apr 30 21:09:22.584629 ncdv-master-1 devstack@n-api.service[130653]: *** uWSGI is running in multiple interpreter mode *** Apr 30 21:09:22.584629 ncdv-master-1 devstack@n-api.service[130653]: spawned uWSGI master process (pid: 130653) Apr 30 21:09:22.584837 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 30 21:09:22.585479 ncdv-master-1 devstack@n-api.service[130653]: spawned uWSGI worker 1 (pid: 130670, cores: 1) Apr 30 21:09:22.586045 ncdv-master-1 devstack@n-api.service[130653]: spawned uWSGI worker 2 (pid: 130671, cores: 1) Apr 30 21:09:22.586392 ncdv-master-1 devstack@n-api.service[130653]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 21:09:23.884931 ncdv-master-1 devstack@n-api.service[130670]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 30 21:09:23.888955 ncdv-master-1 devstack@n-api.service[130671]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 30 21:09:24.705163 ncdv-master-1 devstack@n-api.service[130670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 21:09:24.705163 ncdv-master-1 devstack@n-api.service[130670]: from cryptography.utils import int_from_bytes Apr 30 21:09:24.705469 ncdv-master-1 devstack@n-api.service[130670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 21:09:24.705469 ncdv-master-1 devstack@n-api.service[130670]: from cryptography.utils import int_from_bytes Apr 30 21:09:24.706145 ncdv-master-1 devstack@n-api.service[130671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 21:09:24.706145 ncdv-master-1 devstack@n-api.service[130671]: from cryptography.utils import int_from_bytes Apr 30 21:09:24.706473 ncdv-master-1 devstack@n-api.service[130671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 21:09:24.706473 ncdv-master-1 devstack@n-api.service[130671]: from cryptography.utils import int_from_bytes Apr 30 21:09:27.201207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 21:09:27.201983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 21:09:27.202098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 21:09:27.202389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 21:09:27.203153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 21:09:27.203570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.203908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.204240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.204570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.204911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.205235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.205438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 21:09:27.205848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.205944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 21:09:27.206029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.206240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.206337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 21:09:27.206505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.206657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 21:09:27.206830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.206934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 21:09:27.207163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.207269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.207492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.207595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.207808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.207920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.208132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.208309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.208464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.208618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.208770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.208925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.209088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.209233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.209385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.209536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.209897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.211335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.211335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.211808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.212029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.212251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.212477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.212693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.212909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.213146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.213382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.213624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.213887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.214099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.214308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.214530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.214737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.214965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.215184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.215401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.215620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.215825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.215825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.216258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.216258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.216653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.216848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.217048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.217203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.217353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.217528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.217680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.217856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.221496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.221678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.221873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.222034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.222190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.222343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.222515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.223360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.223526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.223696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.223853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.224017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.224169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.224320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.224464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.224615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.224768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.224921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.225091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.225091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.225384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.225546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.225701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.225903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.226052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.226205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.226349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.226500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.226657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.226810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.226961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.227124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.227273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.227417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.227571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.227724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.227867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.228011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.228011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.228305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.228456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.228609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.228777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.228921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.229070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.229225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.229377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.229520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.229671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.229872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.230020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.230183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.230327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.230478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.230621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.230781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.230934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.231984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.232267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.232419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.232573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.232744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.233662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.233862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.234042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.234191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.234350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.234503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.234654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.234797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.234939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.235089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.235256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.235402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.235560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.235715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.235868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.236020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.236164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.236307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.236450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.236593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.236735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.236893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.237959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.238246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.238246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.238526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.238670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.238821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.238964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.239117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.239268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.239425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.239575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.239719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.239868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.240010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.240160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.240311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.240453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.240601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.240750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.240903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.241045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.241283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.241440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.241592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.241736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.241930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.242090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.242234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.242385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.242528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.242678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.242831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.243784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.243943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.249989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.250987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.251163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.251317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.251465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.251611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.251763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.251906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.252069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.252229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.252380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.252531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.252692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.252843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.252994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.253170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.253349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.253556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.253723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.253917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.254080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.254236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.254389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.254542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.254685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.254829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.254978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.255128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.255281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.255426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.255587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.255731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.255873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.256025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.256186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.256338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.256494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.256652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.256796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.256949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.257099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.257412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.257574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.257733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.257922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.258076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.258227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.258392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.258537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.258695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.261914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.262090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.262255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.262411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.262566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.262727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.262873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.263017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.263169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.263313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.263483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.263627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.263779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.263931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.264082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.264226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.264379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.264532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.264676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.264827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.264970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.265113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.265795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.265992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.266142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.266467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.266618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.266769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.267001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.267149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.267292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.267444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.267595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.267748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.267900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.268056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.268206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.268350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.268500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.268654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.268805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.268987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.269168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.269357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:09:27.269536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.269886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.270794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.270963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.271124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.271276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.271429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.271589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.271742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.271892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.272136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.274421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.274610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.274771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.274918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.275070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.275234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.275397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.275555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.275717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.275873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.276032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.276185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.276330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.276523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.276682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.276837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.276983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.277134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.277291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.277436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.277610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.277790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.277953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.278098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.278250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.278396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.278549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.278701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.278853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.278997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.282440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.283327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.283486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.283637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.283792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.283946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.284101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.284254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.284399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.284551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.284707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.284852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.285005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.285162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.285306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.285450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.285593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.285747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.285948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.286095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.286247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.286391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.286533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.286691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.286836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.287003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.287003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.287284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.287435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.287587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.287738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.287892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.288043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.288195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.288339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.288490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.288686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.288835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.288989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.289139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.289290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.289478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.289653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.289857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.290019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.290163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.291409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.291585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.291732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.291877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.292022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.292185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.292340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.292492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.292635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.292778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.292930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.293084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.293240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.293395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.293553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.293705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.293886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.294032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.294197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.294350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.294503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.294647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.294789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.294932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.295825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.297052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.298259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.299585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.301540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.301540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.301540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.301540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.302310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.302481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.302481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.302781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.302933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.303103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.303265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.303424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.303585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.303751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.303951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.304256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.304414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.304563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.304715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.304872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.305030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.305198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.305361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.305518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.305680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.305680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.306018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.306184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.306335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.306495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.306646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.306646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.306943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.307101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.307270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.307515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.307675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.307826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.307991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.308142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.308292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.308450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.308600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.308750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.309001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.309159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.309321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.309484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.309635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.309846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.310018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.310018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.310304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.310454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.310603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.311139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.311723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.311885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.312066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.312232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.312407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.312569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.312729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.312888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.313041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.313191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.313351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.313515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.313673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.313857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.314020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.314211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.314368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.314539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.314691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.314849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.315000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.315158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.315309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.315479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.315640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.315799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.315969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.316129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.316290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.316458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.316611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.316768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.316919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.317382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.317555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.317707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.317917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.318079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.318229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.318390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.318557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.318707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.318869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.319129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.319289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.319440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.319603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.319754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.319905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.320055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.320205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.320370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.320520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.320678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.320848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.322023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.322205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.322374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.322527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.322685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.322835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.322994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.323146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.323307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.323467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.323626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.323786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.323945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.324108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.324275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.324436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.324589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.324766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.324993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.325184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.325346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.325346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.325346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.325346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.325983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.325983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.326307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.326458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.326616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.326776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.326929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.326929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.327233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.327393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.327554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.328242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.328404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.328569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.328733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.328885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.329044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.329298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.329463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.329629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.329809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.329966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.330126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.330284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.330448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.330599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.330757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.330919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.331070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.331622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.332209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.332380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.332542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.332695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.332854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.333015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.333176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.333334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.333493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.333651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.333872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.334979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.336198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.336371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.336538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.336690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.336848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.336999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.337151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.337309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.337470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.337629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.337629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.337979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.338139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.338139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.338139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.338139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.338139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.338139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.338139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.339137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.339308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.339548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.339710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.339872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.340030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.340197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.340351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.340509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.340660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.340811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.341147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.341328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.342199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.342568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.342730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.342897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.343059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.343220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.343928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.344095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.344257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.344436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.344599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.344751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.344901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.345058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.345216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.345388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.345540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.345691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.345879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.346033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.346191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.346364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.346527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.346680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.346837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.346995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.347484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.348662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.348662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.348971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.349136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.349296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.349454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.349706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.349895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.350048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.350218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.350377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.350529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.350679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.350838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.350996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.351157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.351316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.351475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.351742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.352404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.352780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.352943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.353094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.353252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.353411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.353570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.353730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.353907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.354073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.355216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.356374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.357583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.358776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.358776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.358776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.358776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.359383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.359541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.359723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.359958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.360121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.360281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.360444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.360594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.360594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.360902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.361052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.361210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.361363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.361514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.361689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.361990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.362605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.362968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.363129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.363300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.363463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.363463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.363768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.363920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.364078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.364228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.364389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.364539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.364689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.364847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.365005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.365178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.365330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.365481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.365639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.365806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.365964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.366127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.366295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.366454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.366690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.366856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.366856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.367150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.367312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.367463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.367628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.367788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.367946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.368097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.368246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.368402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.368561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.368713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.368870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.369028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.369185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.369357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.369522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.369681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.369872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.370108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.370266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.370427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.370593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.370848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.371005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.371155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.371313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.371474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.371644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.371798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.371973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.372218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.372848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.373227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.373393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.373545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.373704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.373882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.374048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.374213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.374421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.374601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.374756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.374915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.375067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.375232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.375391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.375541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.375691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.375840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.376494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.377787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.377787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.378112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.378264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.378995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.379181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.379342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.379494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.379494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.379872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.379872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.380356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.380522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.380684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.380842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.381001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.381160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.381322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.381494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.381645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.381851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.382020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.382200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.382475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.383208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.383581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.383750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.383902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.384063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.384214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.384365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.384528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.384679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.384830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.384995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.385154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.385306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.385457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.385607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.385785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.385955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.386116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.386116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.386526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.386526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.386818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.386984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.387762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.388897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.388897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.388897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.388897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.388897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.388897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.388897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.389940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.390111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.390894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.391079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.391462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.391624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.391786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.391946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.392107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.392259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.392259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.392661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.393541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.393541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.394139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.394319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.394476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.394669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.394811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.394952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.394952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.395219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.395359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.395359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.395591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.395719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.395976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.396859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.397945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.398914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.399914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.400940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.401086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.401255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.401364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.401608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.401701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.401947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.402421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.402585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.402818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.402961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.403324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.403681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.403819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.404139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.404139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.404407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.404700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.404912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.404912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.404912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.405322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.405454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.405593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.405739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.406540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.406709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.406709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.406995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.407310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.407653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.407997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.408344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.408669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.408998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.409329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.409658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.410024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.410790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.410790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.411087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.411304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.411637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.411968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.412121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.412292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.412514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.412618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.412877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.412985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.413454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.413615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.413615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.413814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.413933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.414071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.414285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.414408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.414582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.414690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.414906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.415193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.415307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.415543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.415688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.415915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.416045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.416261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.416373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.416593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.416688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.416954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.417098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.417254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.417390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.417584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.421615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.421750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.421994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.422933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.423722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.424909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.425831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.426921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.427067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.427159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.427284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.427425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.427706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.427813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.428038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.428131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.428372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.428592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.428720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.428935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.429071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.429281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.429420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.429615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.429834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.429989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.430117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.430323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.430442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.430671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.430805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.431011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.431127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.431524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.431650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.431836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.431943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.432160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.432487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.432607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.432802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.433079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.433249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.433578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.433729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.434098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.434436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.434534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.434648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.434934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.435189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.435547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.435709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.435873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.436210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.436304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.436543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.436871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.436965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.437217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.437510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.437605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.437879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.438144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.438239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.438510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.438712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.438816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.439133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.439282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.439449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.439772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.439864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.440092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.440395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.440517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.440715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.440956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.441053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.441377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.441702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.441841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.442305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.442406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.442626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.442853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.443163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.443267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.443478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.443595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.443794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.443952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.444106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.444596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.444596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.444822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.444822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.445016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.445105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.445199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.445436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.445553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.445747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.445901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.446085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.446223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.446399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.446535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.446719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.446856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.447083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.447177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.447415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.447730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.448042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.448369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.448751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.448845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.449087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.449185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.449429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.449554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.449746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.449946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.450129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.450262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.450446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.450550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.450898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.451168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.458583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.458583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.458583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.458583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.458583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.459999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.460886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.461974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.462977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.463856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.464919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.465983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.466855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.467276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.467455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.467706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.467853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.468030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.468030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.468288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.468938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.469040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.469130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.469299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.469451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.469635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.469832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.469995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.470230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.470325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.470573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.470669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.470892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.470993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.471212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.471315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.471546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.471741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.471894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.472233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.472481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.472577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.472806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.472949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.473126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.473263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.473449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.473587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.473848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.474007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.474155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.475101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.475245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.475382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.475517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.475663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.475800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.475932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.476064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.476219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.476361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.476505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.476639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.476771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.476938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.477251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.477478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.477609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.477750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.477927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.478074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.478235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.478463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.478615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.479743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.479899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.480051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.480201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.480336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.480481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.480622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.480754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.480896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.481038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.481179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.481318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.481459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.481591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.481723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.481898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.482916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.483873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.484977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.485099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.485219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.485347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.485470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.485584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.485715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.487322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.487653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.487799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.487917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.488057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.488188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.488310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.488449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.488757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.488899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.489962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.490879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.491965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.492913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.493040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.493154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.493279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.493401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.493522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 21:09:27.493645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.494043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.494449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.494701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.495023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.495344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.495670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.496125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.496306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.496625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.496945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.497274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.497597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.497949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.498267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.498591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.498911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.499269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.499635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.500008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.500292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.500610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.500943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.501271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.501606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.501962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.502290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.502653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.502986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.503562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.503911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.504246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.504598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.504941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.505264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.505588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.506539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.506539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.506862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.506960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.507202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.507528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.507935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.508230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.508472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.508815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.509127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.509452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.509859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.510120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.510447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.510808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.511142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.511475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.511806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.512292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.512780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.513129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.513266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.513505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.513863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.514212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.525816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_db.sqlalchemy.engines [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.526793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.527430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.529932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.530482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.530482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.530715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.532227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.532227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.532227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.532709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.532874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.533173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.533484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.533841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.534228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.534558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.534917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.535379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.535708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.536049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.536390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.536730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.537064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.537401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.537747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.538099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.538409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.538752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.539059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.539386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.539716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.540048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.540391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.540733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.541075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.541416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.541807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.542140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.542501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.542844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.543174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.543503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.543826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:09:27.544083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 21:09:27.570311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:27.584318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.context [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=130670) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 21:09:27.588801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:09:27.590531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:09:27.591318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:09:27.593296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:09:27.613080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_db.sqlalchemy.engines [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:27.614492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_db.sqlalchemy.engines [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:27.641955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.context [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=130671) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 21:09:27.646434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:09:27.648092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:09:27.648930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:09:27.650936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:09:27.661906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:27.664206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:27.785052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_db.sqlalchemy.engines [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:27.832860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:09:28.106710 ncdv-master-1 devstack@n-api.service[130670]: WARNING keystonemiddleware.auth_token [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 21:09:28.113719 ncdv-master-1 devstack@n-api.service[130670]: WARNING keystonemiddleware.auth_token [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 21:09:28.153226 ncdv-master-1 devstack@n-api.service[130671]: WARNING keystonemiddleware.auth_token [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 21:09:28.160292 ncdv-master-1 devstack@n-api.service[130671]: WARNING keystonemiddleware.auth_token [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 21:09:28.455137 ncdv-master-1 devstack@n-api.service[130670]: WARNING keystonemiddleware.auth_token [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 21:09:28.460338 ncdv-master-1 devstack@n-api.service[130670]: WARNING keystonemiddleware.auth_token [None req-105c20e1-2ae6-418e-b5c9-88782f5fbca4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 21:09:28.465681 ncdv-master-1 devstack@n-api.service[130670]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b388a6e9c0 pid: 130670 (default app) Apr 30 21:09:28.502590 ncdv-master-1 devstack@n-api.service[130671]: WARNING keystonemiddleware.auth_token [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 21:09:28.507821 ncdv-master-1 devstack@n-api.service[130671]: WARNING keystonemiddleware.auth_token [None req-f9fad6d1-8908-4f4d-b74a-a30af61d0232 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 21:09:28.513197 ncdv-master-1 devstack@n-api.service[130671]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b388a6e9c0 pid: 130671 (default app) Apr 30 21:10:17.708516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '.version_select at 0x7fdc231d8940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:17.710538 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:17.710538 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:17.719146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=130670) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 30 21:10:17.719988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:17.720433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:17.747902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:17.748809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:17.768071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:17.768961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:17.775682 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-090cc314-a7f2-401e-b699-e4b39fdba72a tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.598066 Apr 30 21:10:17.776498 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Apr 30 21:10:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:17.796075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f14d3745-498f-45e1-8228-2ee89f99b713 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1166405573", "name": "tempest-test_aggregate-1492183748"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:17.830181 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:17.830181 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:17.831318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.aggregate [None req-f14d3745-498f-45e1-8228-2ee89f99b713 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid 60ae367b-da2e-41cb-803a-4ab0d15bfaf0 for aggregate {{(pid=130670) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:10:17.962307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f14d3745-498f-45e1-8228-2ee89f99b713 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.169871 Apr 30 21:10:17.965797 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2/2] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Apr 30 21:10:17 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:17.973416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf4039d6-3f97-446b-9946-b18a4cea147d tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:17.974213 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:17.974213 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:17.987651 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf4039d6-3f97-446b-9946-b18a4cea147d tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.018054 Apr 30 21:10:17.988364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3/3] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:10:17 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:18.001372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e43e080b-8d0e-406a-9e49-ed513c6ace04 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:18.003555 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:18.003555 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:18.012321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e43e080b-8d0e-406a-9e49-ed513c6ace04 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:18.012789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e43e080b-8d0e-406a-9e49-ed513c6ace04 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:18.696676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-156b23a5-9dc1-4978-a1f2-00fcc330fa36 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2024698946", "id": 50566522, "os-flavor-access:is_public": "False"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:18.714599 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:18.714599 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:18.810864 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-156b23a5-9dc1-4978-a1f2-00fcc330fa36 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 1.469398 Apr 30 21:10:18.811640 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1/4] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:17 2022] POST /compute/v2.1/flavors => generated 425 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:18.812805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-156b23a5-9dc1-4978-a1f2-00fcc330fa36 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:18.813713 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-156b23a5-9dc1-4978-a1f2-00fcc330fa36 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001147 Apr 30 21:10:18.814205 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 885 bytes} [Sat Apr 30 21:10:18 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 30 21:10:19.077594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Calling method '.version_select at 0x7fdc22fec280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:19.079240 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:19.079240 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:19.085468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=130671) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 30 21:10:19.086787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:19.087228 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e43e080b-8d0e-406a-9e49-ed513c6ace04 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.092206 Apr 30 21:10:19.087819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:19.088094 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 4/6] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:10:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:19.124347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:19.124814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:19.137685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:19.138182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:19.145237 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0982e757-6893-4609-a6f7-0723cb17c617 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.329814 Apr 30 21:10:19.153798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3/7] 10.222.0.23 () {60 vars in 1207 bytes} [Sat Apr 30 21:10:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:19.273014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-da0cb907-dbff-4b17-aa73-2fd6beb9414f tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-807880170", "id": 130262477, "os-flavor-access:is_public": "True"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:19.274942 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:19.274942 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:19.382921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-da0cb907-dbff-4b17-aa73-2fd6beb9414f tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.293308 Apr 30 21:10:19.384072 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 5/8] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:10:19 2022] POST /compute/v2.1/flavors => generated 467 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:19.395216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a049611-cc3d-4186-a86a-a64c79515999 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "48505b349722444abdc832bcb0090b28"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:19.396944 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:19.396944 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:19.428701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-819e8065-5535-43e0-859e-3c8383bf87ba tempest-AZAdminNegativeTestJSON-1885024483 tempest-AZAdminNegativeTestJSON-1885024483-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:19.429683 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:19.429683 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:19.430667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-819e8065-5535-43e0-859e-3c8383bf87ba tempest-AZAdminNegativeTestJSON-1885024483 tempest-AZAdminNegativeTestJSON-1885024483-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '6996dc31623e433db17e2f0587a32a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609b6e89fbbe40388f92ad00268eebdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:19.431340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-819e8065-5535-43e0-859e-3c8383bf87ba tempest-AZAdminNegativeTestJSON-1885024483 tempest-AZAdminNegativeTestJSON-1885024483-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:19.432351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-819e8065-5535-43e0-859e-3c8383bf87ba tempest-AZAdminNegativeTestJSON-1885024483 tempest-AZAdminNegativeTestJSON-1885024483-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.285577 Apr 30 21:10:19.433155 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 4/9] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Apr 30 21:10:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 287 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:19.598194 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a049611-cc3d-4186-a86a-a64c79515999 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/50566522/action" status: 200 len: 95 microversion: 2.1 time: 0.212819 Apr 30 21:10:19.599215 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 6/10] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:10:19 2022] POST /compute/v2.1/flavors/50566522/action => generated 95 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:10:19.645173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-76580920-c33c-4b73-a8cf-3db2cbeef84e tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-464082284", "ram": 512, "vcpus": 1, "disk": 10, "id": 939898537, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:19.646797 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:19.646797 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:19.735964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ab01b79-8eba-410a-b489-e215c386f465 tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:19.737648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ab01b79-8eba-410a-b489-e215c386f465 tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:19.738126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ab01b79-8eba-410a-b489-e215c386f465 tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:19.738931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ab01b79-8eba-410a-b489-e215c386f465 tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:19.739369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ab01b79-8eba-410a-b489-e215c386f465 tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:19.774029 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-76580920-c33c-4b73-a8cf-3db2cbeef84e tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.339590 Apr 30 21:10:19.775154 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 5/11] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:19 2022] POST /compute/v2.1/flavors => generated 412 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:19.790340 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ab01b79-8eba-410a-b489-e215c386f465 tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.189991 Apr 30 21:10:19.794462 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1163 bytes} [Sat Apr 30 21:10:19 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:19.796197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ee2ecd2-1fb2-4601-b426-2bf156d61ebf tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:19.798004 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:19.798004 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:19.846726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1072784676", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "availability_zone": "tempest-test_az-1166405573"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:19.875237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:19.875965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:19.877070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:19.877907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:20.081406 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0ee2ecd2-1fb2-4601-b426-2bf156d61ebf tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/130262477/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.288987 Apr 30 21:10:20.082984 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 8/13] 10.222.0.23 () {62 vars in 1261 bytes} [Sat Apr 30 21:10:19 2022] POST /compute/v2.1/flavors/130262477/os-extra_specs => generated 62 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:20.411938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8985c3d4-fba6-4392-880c-1cd2a799ae00 tempest-FlavorsAccessTestJSON-1186842955 tempest-FlavorsAccessTestJSON-1186842955-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:20.434847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:10:20.448863 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8985c3d4-fba6-4392-880c-1cd2a799ae00 tempest-FlavorsAccessTestJSON-1186842955 tempest-FlavorsAccessTestJSON-1186842955-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.364028 Apr 30 21:10:20.459728 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 9/14] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:20 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:20.569440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-102fbf2e-4ab4-4d82-8e73-0a9925587324 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:20.587045 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-102fbf2e-4ab4-4d82-8e73-0a9925587324 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] HTTP exception thrown: Flavor 939898537 has no extra specs with key hw:cpu_thread_policy. Apr 30 21:10:20.587857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-102fbf2e-4ab4-4d82-8e73-0a9925587324 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Returning 404 to user: Flavor 939898537 has no extra specs with key hw:cpu_thread_policy. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:20.593732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-102fbf2e-4ab4-4d82-8e73-0a9925587324 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] 10.222.0.23 "GET /compute/v2.1/flavors/939898537/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.132532 Apr 30 21:10:20.594972 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 10/15] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:10:20 2022] GET /compute/v2.1/flavors/939898537/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:20.601863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3162c2e2-8ccd-465f-93c7-1364978187ed tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:20.602868 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:20.602868 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:20.604318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3162c2e2-8ccd-465f-93c7-1364978187ed tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:20.605092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3162c2e2-8ccd-465f-93c7-1364978187ed tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:20.606181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3162c2e2-8ccd-465f-93c7-1364978187ed tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:20.607978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3162c2e2-8ccd-465f-93c7-1364978187ed tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:20.638338 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3162c2e2-8ccd-465f-93c7-1364978187ed tempest-AZAdminV2TestJSON-2003402423 tempest-AZAdminV2TestJSON-2003402423-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 702 microversion: 2.1 time: 0.041785 Apr 30 21:10:20.639165 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 11/16] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Apr 30 21:10:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 702 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:20.643914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dcf6b205-2e9e-41de-b49a-aa4e4037266c tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:20.645706 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:20.645706 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:20.713215 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dcf6b205-2e9e-41de-b49a-aa4e4037266c tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/130262477" status: 202 len: 0 microversion: 2.86 time: 0.072537 Apr 30 21:10:20.713790 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 12/17] 10.222.0.23 () {60 vars in 1198 bytes} [Sat Apr 30 21:10:20 2022] DELETE /compute/v2.1/flavors/130262477 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:10:20.721495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e319f8af-ab35-4fcd-9ae9-54928ce0b4dc tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "48505b349722444abdc832bcb0090b28"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:20.722970 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:20.722970 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:20.832482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:10:20.832998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:10:20.833409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:10:20.833859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:10:20.834275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:10:20.847883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:20.848333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:20.849148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:20.849620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:20.881099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Getting quotas for project 1d316cd4e4d043ba9da2707b8006acd4. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:10:20.887326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Getting quotas for user 09f28e171049411c847508fe7521b56b and project 1d316cd4e4d043ba9da2707b8006acd4. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:10:20.898690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:10:20.901474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:10:21.034389 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-807555ad-0a86-4c0f-ba11-7f15db9200e7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257689 Apr 30 21:10:21.035452 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 6/18] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:10:21.041469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e1a700b7-059e-4e19-88a7-2f75a2563af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:21.043396 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:21.043396 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:21.044602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e1a700b7-059e-4e19-88a7-2f75a2563af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'fe00c7f2ec9f4d2b847741a188e301db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b06682f7ad42eea575a158f9c4d75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:21.046127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e1a700b7-059e-4e19-88a7-2f75a2563af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:21.047146 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e1a700b7-059e-4e19-88a7-2f75a2563af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] 10.222.0.23 "POST /compute/v2.1/flavors/939898537/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.010399 Apr 30 21:10:21.048140 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 7/19] 10.222.0.23 () {60 vars in 1220 bytes} [Sat Apr 30 21:10:21 2022] POST /compute/v2.1/flavors/939898537/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:21.055168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a4f84e8-d97e-48c1-b1ea-cb992f2ae2c8 tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.101369 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a4f84e8-d97e-48c1-b1ea-cb992f2ae2c8 tempest-FlavorMetadataValidation-2037280168 tempest-FlavorMetadataValidation-2037280168-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.86 time: 0.051602 Apr 30 21:10:21.101972 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 8/20] 10.222.0.23 () {60 vars in 1186 bytes} [Sat Apr 30 21:10:21 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:21.109069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e94990f6-c0e4-431d-9c1f-a025bea6d516 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.109685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e94990f6-c0e4-431d-9c1f-a025bea6d516 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:21.210026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e94990f6-c0e4-431d-9c1f-a025bea6d516 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:21.223507 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e94990f6-c0e4-431d-9c1f-a025bea6d516 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1243 microversion: 2.1 time: 0.119825 Apr 30 21:10:21.224079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 9/21] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:21 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1243 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:21.228547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73481f0b-7376-4788-a1a6-d611cb66138c tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:21.229822 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:21.229822 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:21.358890 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73481f0b-7376-4788-a1a6-d611cb66138c tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/939898537/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.132548 Apr 30 21:10:21.358890 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 10/22] 10.222.0.23 () {60 vars in 1220 bytes} [Sat Apr 30 21:10:21 2022] POST /compute/v2.1/flavors/939898537/os-extra_specs => generated 66 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:10:21.370869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-919f25e1-d904-44b2-9ab0-54a8052faa56 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.372219 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:21.372219 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:21.373778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-919f25e1-d904-44b2-9ab0-54a8052faa56 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'fe00c7f2ec9f4d2b847741a188e301db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b06682f7ad42eea575a158f9c4d75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:21.374690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-919f25e1-d904-44b2-9ab0-54a8052faa56 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:21.375729 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-919f25e1-d904-44b2-9ab0-54a8052faa56 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008936 Apr 30 21:10:21.376786 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:10:21 2022] DELETE /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:10:21.391558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4dd0fbc5-f437-4dd0-89ad-8047b303e20d tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:21.416344 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4dd0fbc5-f437-4dd0-89ad-8047b303e20d tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/939898537/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030668 Apr 30 21:10:21.416949 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 12/24] 10.222.0.23 () {60 vars in 1220 bytes} [Sat Apr 30 21:10:21 2022] POST /compute/v2.1/flavors/939898537/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:10:21.426509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20aec78f-049a-4274-9f5d-ae76b2366b00 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:21.427785 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:21.427785 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:21.428640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20aec78f-049a-4274-9f5d-ae76b2366b00 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'fe00c7f2ec9f4d2b847741a188e301db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b06682f7ad42eea575a158f9c4d75f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:21.429285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20aec78f-049a-4274-9f5d-ae76b2366b00 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:21.430142 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20aec78f-049a-4274-9f5d-ae76b2366b00 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454 tempest-FlavorsExtraSpecsNegativeTestJSON-1445329454-project] 10.222.0.23 "PUT /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007484 Apr 30 21:10:21.430672 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 13/25] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:10:21 2022] PUT /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:10:21.440777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-562a260f-6a65-418e-8f04-9d08f4a01487 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.448286 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-562a260f-6a65-418e-8f04-9d08f4a01487 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] HTTP exception thrown: Flavor 939898537 has no extra specs with key hw:cpu_thread_policy. Apr 30 21:10:21.448888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-562a260f-6a65-418e-8f04-9d08f4a01487 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Returning 404 to user: Flavor 939898537 has no extra specs with key hw:cpu_thread_policy. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:21.450082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-562a260f-6a65-418e-8f04-9d08f4a01487 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/939898537/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.014018 Apr 30 21:10:21.450443 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:10:21 2022] DELETE /compute/v2.1/flavors/939898537/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:10:21.468227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-155d50b7-d7b6-4dfc-8280-1e17208a976f tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:21.471259 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-155d50b7-d7b6-4dfc-8280-1e17208a976f tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] HTTP exception thrown: Request body and URI mismatch Apr 30 21:10:21.471839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-155d50b7-d7b6-4dfc-8280-1e17208a976f tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:21.472803 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-155d50b7-d7b6-4dfc-8280-1e17208a976f tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016786 Apr 30 21:10:21.473349 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 15/27] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:10:21 2022] PUT /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:21.488806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f611848b-9d1c-4349-8a21-9e8a1ba65ab7 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:21.490408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f611848b-9d1c-4349-8a21-9e8a1ba65ab7 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:21.490968 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f611848b-9d1c-4349-8a21-9e8a1ba65ab7 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012207 Apr 30 21:10:21.491775 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 16/28] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:10:21 2022] PUT /compute/v2.1/flavors/939898537/os-extra_specs/hw:numa_nodes => generated 117 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:10:21.500010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5d094b9c-90a7-4f12-9f0f-5e42c6514df8 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.500782 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:21.500782 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:21.547419 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e319f8af-ab35-4fcd-9ae9-54928ce0b4dc tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/50566522/action" status: 200 len: 21 microversion: 2.1 time: 0.830139 Apr 30 21:10:21.552322 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 13/29] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:10:20 2022] POST /compute/v2.1/flavors/50566522/action => generated 21 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:10:21.557502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d57c6161-d588-4fc9-87af-482edf960218 tempest-FlavorsAccessTestJSON-1186842955 tempest-FlavorsAccessTestJSON-1186842955-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.581485 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d57c6161-d588-4fc9-87af-482edf960218 tempest-FlavorsAccessTestJSON-1186842955 tempest-FlavorsAccessTestJSON-1186842955-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.027819 Apr 30 21:10:21.582218 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 14/30] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:21 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:21.597398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7bf2732d-78c0-426c-a9fb-c6b41914dc49 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.646059 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5d094b9c-90a7-4f12-9f0f-5e42c6514df8 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/939898537" status: 202 len: 0 microversion: 2.1 time: 0.149543 Apr 30 21:10:21.651368 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 17/31] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:10:21 2022] DELETE /compute/v2.1/flavors/939898537 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:21.658734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0273807f-3268-4d43-86b8-90a5d17af885 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.681668 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0273807f-3268-4d43-86b8-90a5d17af885 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584 tempest-FlavorsExtraSpecsNegativeTestJSON-1365085584-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028275 Apr 30 21:10:21.682312 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 18/32] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:21.690913 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7bf2732d-78c0-426c-a9fb-c6b41914dc49 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/50566522" status: 202 len: 0 microversion: 2.1 time: 0.097362 Apr 30 21:10:21.691777 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 15/33] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:10:21 2022] DELETE /compute/v2.1/flavors/50566522 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:10:21.699877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-639afa3c-4a9c-484f-b4bf-4986a875ec64 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.718625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-639afa3c-4a9c-484f-b4bf-4986a875ec64 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022375 Apr 30 21:10:21.719211 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 19/34] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:21.735245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-843c1877-9bf9-4aab-a984-309ad6688bd6 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-403240128", "id": 1601040738, "os-flavor-access:is_public": "False"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:21.767926 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:21.767926 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:21.858242 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-843c1877-9bf9-4aab-a984-309ad6688bd6 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.120313 Apr 30 21:10:21.858242 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 16/35] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:21 2022] POST /compute/v2.1/flavors => generated 430 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:21.864594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd55c6f5-2648-476b-a996-ea25849fca54 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.865358 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:21.865358 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:21.877516 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd55c6f5-2648-476b-a996-ea25849fca54 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1601040738/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.016409 Apr 30 21:10:21.888037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b25dc85-1551-47d5-ab01-1ab51de00370 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.890759 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 20/36] 10.222.0.23 () {58 vars in 1208 bytes} [Sat Apr 30 21:10:21 2022] GET /compute/v2.1/flavors/1601040738/os-flavor-access => generated 21 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:10:21.954227 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b25dc85-1551-47d5-ab01-1ab51de00370 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1601040738" status: 202 len: 0 microversion: 2.1 time: 0.069525 Apr 30 21:10:21.960515 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 17/37] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:21 2022] DELETE /compute/v2.1/flavors/1601040738 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:10:21.965666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8897035a-a153-4f35-b709-3fc90795ce93 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:21.985409 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8897035a-a153-4f35-b709-3fc90795ce93 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023508 Apr 30 21:10:21.986487 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 21/38] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:22.240905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-39626a50-5ba4-4ac1-92df-2a061ad3453c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:22.241749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-39626a50-5ba4-4ac1-92df-2a061ad3453c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:23.704501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-39626a50-5ba4-4ac1-92df-2a061ad3453c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:23.721612 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-39626a50-5ba4-4ac1-92df-2a061ad3453c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1243 microversion: 2.1 time: 1.484636 Apr 30 21:10:23.722328 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 18/39] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:22 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1243 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:24.739294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:24.740928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:24.747940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:24.748594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:24.749694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:24.750771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:24.980660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:24.994619 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e929a8b4-52cf-400a-9820-2889622f92fe tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1299 microversion: 2.1 time: 0.259076 Apr 30 21:10:25.002124 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 22/40] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:24 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:26.016140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:26.017583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:26.024235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:26.024914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:26.043477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:26.044280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:26.401057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:26.420834 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8924ed90-6e32-4764-b10c-991c11ed7b75 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.408047 Apr 30 21:10:26.431393 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:26 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:27.438583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:27.439308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:27.447565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:27.448126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:27.449186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:27.449703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:27.601909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:27.610400 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-81185392-9e1c-433c-9037-f9a9baf55357 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.176313 Apr 30 21:10:27.612398 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 23/42] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:27 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:28.627534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:28.628397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:28.635240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:28.635849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:28.641736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:28.642335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:28.862967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:28.871411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8785e315-3d3e-4ae3-9ee1-1e30a2061f63 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.248664 Apr 30 21:10:28.874377 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:28 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:29.847640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Calling method '.version_select at 0x7fdc22633f70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:29.849641 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:29.849641 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:29.850891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.851352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:29.866610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.867366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:29.891305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:29.892497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:29.905668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.906806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:29.907958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.908690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:29.913466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.913980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:29.934805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.935960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:29.952547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.953006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:29.966990 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0fb5114a-09df-4a8f-9413-5623c2164c6a tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.634474 Apr 30 21:10:29.968296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 24/44] 10.222.0.23 () {60 vars in 1242 bytes} [Sat Apr 30 21:10:29 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:29.983139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Calling method '.version_select at 0x7fdc21e0adc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:29.986552 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:29.986552 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:29.986985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:29.988297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:30.012548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:30.013103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:30.041955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:30.042494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:30.058803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:30.059508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:30.074165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:30.081970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:30.086851 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d58e3275-0782-49db-a0b5-d13cf7d7ae55 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.108084 Apr 30 21:10:30.087799 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 25/45] 10.222.0.23 () {60 vars in 1221 bytes} [Sat Apr 30 21:10:29 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:30.097904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e133dbf1-7915-44df-bbbc-13fe0c335ad3 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Calling method '.version_select at 0x7fdc21d35c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:30.100931 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:30.100931 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:30.102310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e133dbf1-7915-44df-bbbc-13fe0c335ad3 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:30.106837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e133dbf1-7915-44df-bbbc-13fe0c335ad3 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:30.125098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:30.133060 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-31ac2a6f-b308-4de9-b62c-3960f74f0a24 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.246290 Apr 30 21:10:30.135013 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 21/46] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:29 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:30.137613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e133dbf1-7915-44df-bbbc-13fe0c335ad3 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:30.138896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e133dbf1-7915-44df-bbbc-13fe0c335ad3 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:30.146024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e133dbf1-7915-44df-bbbc-13fe0c335ad3 tempest-HypervisorAdminV253TestBase-2075848479 tempest-HypervisorAdminV253TestBase-2075848479-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/d6889c2f-3e87-4073-83b9-34d81b139ce4" status: 200 len: 792 microversion: 2.53 time: 0.051833 Apr 30 21:10:30.146877 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 26/47] 10.222.0.23 () {60 vars in 1297 bytes} [Sat Apr 30 21:10:30 2022] GET /compute/v2.1/os-hypervisors/d6889c2f-3e87-4073-83b9-34d81b139ce4 => generated 792 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:10:31.152388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:31.153022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:31.163731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:31.164482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:31.165611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:31.166286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:31.327430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:31.336322 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c94417b6-56a6-4183-9750-64c71b764e8d tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.187873 Apr 30 21:10:31.337515 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 22/48] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:31 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:32.399121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c9779ff3-3453-45de-80c8-5a38743908a8 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-141804643", "id": 2116968555, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:32.401671 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:32.401671 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:32.524743 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c9779ff3-3453-45de-80c8-5a38743908a8 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.637650 Apr 30 21:10:32.525339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 27/49] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:31 2022] POST /compute/v2.1/flavors => generated 429 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:32.530441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:32.531027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:32.536944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:32.537400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:32.538213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:32.538685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:32.730318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:32.746815 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-336430e3-202b-429d-a05e-b5b9e86635b0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.220376 Apr 30 21:10:32.758997 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 28/50] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:32 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:32.765924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0596a23b-ffdd-4169-a71a-950d3ad4f258 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:32.767402 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:32.767402 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:32.861944 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0596a23b-ffdd-4169-a71a-950d3ad4f258 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2116968555" status: 202 len: 0 microversion: 2.1 time: 0.101351 Apr 30 21:10:32.862542 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 29/51] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:32 2022] DELETE /compute/v2.1/flavors/2116968555 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:32.871531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d93ff4f5-b71d-4929-8eed-9cb9a355f406 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:32.909258 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d93ff4f5-b71d-4929-8eed-9cb9a355f406 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041924 Apr 30 21:10:32.909962 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 30/52] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:32.932545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0cc22db-824a-4de2-b3f7-1ba0bff5e37a tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1518842831", "id": 188007467, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:32.934847 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:32.934847 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:33.058571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Calling method '.version_select at 0x7fdc215b64c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:33.059648 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:33.059648 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:33.061380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:33.061878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:33.088910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:33.089612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:33.101575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:33.102444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:33.114362 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e10e7de6-600d-488c-a23b-6a23d27eea05 tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.785848 Apr 30 21:10:33.115670 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 23/53] 10.222.0.23 () {60 vars in 1186 bytes} [Sat Apr 30 21:10:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:33.126695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ffeb516-ddb7-49b3-9010-697198c4a23f tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Calling method '.version_select at 0x7fdc21571b80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:33.127740 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:33.127740 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:33.131667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ffeb516-ddb7-49b3-9010-697198c4a23f tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:33.132908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ffeb516-ddb7-49b3-9010-697198c4a23f tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:33.160554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ffeb516-ddb7-49b3-9010-697198c4a23f tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:33.161395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ffeb516-ddb7-49b3-9010-697198c4a23f tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:33.168629 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ffeb516-ddb7-49b3-9010-697198c4a23f tempest-HypervisorAdminV228Test-346443889 tempest-HypervisorAdminV228Test-346443889-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.046439 Apr 30 21:10:33.170597 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 24/54] 10.222.0.23 () {60 vars in 1192 bytes} [Sat Apr 30 21:10:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:10:33.398279 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0cc22db-824a-4de2-b3f7-1ba0bff5e37a tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.469498 Apr 30 21:10:33.406488 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 31/55] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:33.415436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15023da3-ca0d-44ea-8f7a-f396fdadb26b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:33.434767 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15023da3-ca0d-44ea-8f7a-f396fdadb26b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.022994 Apr 30 21:10:33.435453 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 32/56] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:33 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:33.454167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02d9a31e-5e09-41be-8089-216e23b65b3c tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:33.769156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02d9a31e-5e09-41be-8089-216e23b65b3c tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/188007467" status: 202 len: 0 microversion: 2.1 time: 0.322611 Apr 30 21:10:33.769768 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 33/57] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:10:33 2022] DELETE /compute/v2.1/flavors/188007467 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:10:33.774781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:33.778103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:33.781671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:33.782230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:33.783170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:33.783735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:33.940869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:33.952063 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1cc8bd5d-32d5-48d5-83de-9cb0175dafb1 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.181134 Apr 30 21:10:33.953259 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 34/58] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:33 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:33.957650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15b91522-de00-4c22-a0b1-5c432bfa9744 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:33.977990 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15b91522-de00-4c22-a0b1-5c432bfa9744 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023240 Apr 30 21:10:33.978667 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 35/59] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:33.994422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-657619fc-464a-4fc6-8c34-06d13a447129 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2119022085", "id": 1179665439, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:33.996233 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:33.996233 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:34.093645 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-657619fc-464a-4fc6-8c34-06d13a447129 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.103340 Apr 30 21:10:34.105951 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 36/60] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:33 2022] POST /compute/v2.1/flavors => generated 429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:34.105951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9f9aec46-e896-4d08-ba1f-f76835dba293 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.106564 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:34.106564 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:34.199172 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9f9aec46-e896-4d08-ba1f-f76835dba293 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1179665439" status: 202 len: 0 microversion: 2.1 time: 0.098181 Apr 30 21:10:34.200746 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 37/61] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:34 2022] DELETE /compute/v2.1/flavors/1179665439 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:10:34.244045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-57ebf7d2-31b6-433d-b170-3b155d6cade3 tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1672087248", "id": 1283800661, "os-flavor-access:is_public": "True"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:34.245631 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:34.245631 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:34.308281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21d03f43-6d54-43f3-95b7-eef1ca80083d tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1796031657", "id": 241999148, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:34.327404 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-57ebf7d2-31b6-433d-b170-3b155d6cade3 tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 1.100108 Apr 30 21:10:34.334774 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 25/62] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:10:33 2022] POST /compute/v2.1/flavors => generated 449 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:10:34.339519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bfb6ee67-a3b1-4311-a340-d835082ac6f7 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.372548 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bfb6ee67-a3b1-4311-a340-d835082ac6f7 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.036593 Apr 30 21:10:34.373352 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 26/63] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:34.408955 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21d03f43-6d54-43f3-95b7-eef1ca80083d tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.205777 Apr 30 21:10:34.411079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 38/64] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:10:34 2022] POST /compute/v2.1/flavors => generated 465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:34.416692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3f36fa68-7483-44e8-80e3-136810aa3e01 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1525313148", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:34.496898 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3f36fa68-7483-44e8-80e3-136810aa3e01 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.084549 Apr 30 21:10:34.497539 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 39/65] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:34 2022] POST /compute/v2.1/flavors => generated 507 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:34.550091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ba88b32-8b9b-4b60-9878-e6e2706abaf3 tempest-FlavorsV255TestJSON-132534331 tempest-FlavorsV255TestJSON-132534331-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.563033 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ba88b32-8b9b-4b60-9878-e6e2706abaf3 tempest-FlavorsV255TestJSON-132534331 tempest-FlavorsV255TestJSON-132534331-project] 10.222.0.23 "GET /compute/v2.1/flavors/1283800661" status: 200 len: 449 microversion: 2.55 time: 0.188414 Apr 30 21:10:34.570469 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 27/66] 10.222.0.23 () {60 vars in 1198 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors/1283800661 => generated 449 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:34.576171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7455c310-1fc0-47f9-bc22-b1022f84143d tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.577449 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:34.577449 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:34.631302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5d1015d6-5f61-41f4-ab71-3349c2dc1027 tempest-FlavorsV261TestJSON-1493620646 tempest-FlavorsV261TestJSON-1493620646-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.642473 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5d1015d6-5f61-41f4-ab71-3349c2dc1027 tempest-FlavorsV261TestJSON-1493620646 tempest-FlavorsV261TestJSON-1493620646-project] 10.222.0.23 "GET /compute/v2.1/flavors/241999148" status: 200 len: 465 microversion: 2.61 time: 0.143214 Apr 30 21:10:34.643091 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 40/67] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors/241999148 => generated 465 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:34.647525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7a27f7e-e4bc-4d13-b8a9-cb8bf318f35e tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] Action: 'update', calling method: .version_select at 0x7fdc2345dd30>, body: {"flavor": {"description": "new"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:34.658336 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:34.658336 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:34.684712 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7455c310-1fc0-47f9-bc22-b1022f84143d tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/bd137948-246e-472e-a6a2-edf41e45d6f9" status: 202 len: 0 microversion: 2.1 time: 0.112778 Apr 30 21:10:34.685439 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 28/68] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:10:34 2022] DELETE /compute/v2.1/flavors/bd137948-246e-472e-a6a2-edf41e45d6f9 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:34.690476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5e98807-6180-408b-9413-31a2b6a12f48 tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] Action: 'update', calling method: .version_select at 0x7fdc2345cd30>, body: {"flavor": {"description": "new"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:34.700591 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:34.700591 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:34.762614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7a27f7e-e4bc-4d13-b8a9-cb8bf318f35e tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1283800661" status: 200 len: 450 microversion: 2.55 time: 0.118444 Apr 30 21:10:34.770103 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 41/69] 10.222.0.23 () {62 vars in 1218 bytes} [Sat Apr 30 21:10:34 2022] PUT /compute/v2.1/flavors/1283800661 => generated 450 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:34.775053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f03c273-c65d-4462-b748-d2e1001befaa tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.808912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5e98807-6180-408b-9413-31a2b6a12f48 tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/241999148" status: 200 len: 466 microversion: 2.61 time: 0.122102 Apr 30 21:10:34.810016 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 29/70] 10.222.0.23 () {62 vars in 1215 bytes} [Sat Apr 30 21:10:34 2022] PUT /compute/v2.1/flavors/241999148 => generated 466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:34.813861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f03c273-c65d-4462-b748-d2e1001befaa tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5824 microversion: 2.1 time: 0.039852 Apr 30 21:10:34.826422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ba3c2713-8dbe-49d8-b4df-23ad229c7137 tempest-FlavorsV255TestJSON-132534331 tempest-FlavorsV255TestJSON-132534331-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.827499 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 42/71] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors/detail => generated 5824 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:34.833571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-140105b9-6dac-4b7b-ab85-d585a9e7be2c tempest-FlavorsV261TestJSON-1493620646 tempest-FlavorsV261TestJSON-1493620646-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.856244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ba3c2713-8dbe-49d8-b4df-23ad229c7137 tempest-FlavorsV255TestJSON-132534331 tempest-FlavorsV255TestJSON-132534331-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6162 microversion: 2.55 time: 0.044931 Apr 30 21:10:34.858514 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 30/72] 10.222.0.23 () {60 vars in 1186 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors/detail => generated 6162 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:34.866933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68fbf06b-2544-4027-a004-1321c156cb1e tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1509311323", "id": "949de566-4009-49f4-80fe-a2434364320c", "os-flavor-access:is_public": "True"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:34.881326 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-140105b9-6dac-4b7b-ab85-d585a9e7be2c tempest-FlavorsV261TestJSON-1493620646 tempest-FlavorsV261TestJSON-1493620646-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6706 microversion: 2.61 time: 0.052389 Apr 30 21:10:34.885136 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 43/73] 10.222.0.23 () {60 vars in 1186 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors/detail => generated 6706 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:34.898634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7a3c0d1-f0aa-4c05-b142-fe67570a9bd8 tempest-FlavorsV255TestJSON-132534331 tempest-FlavorsV255TestJSON-132534331-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.920919 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7a3c0d1-f0aa-4c05-b142-fe67570a9bd8 tempest-FlavorsV255TestJSON-132534331 tempest-FlavorsV255TestJSON-132534331-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3423 microversion: 2.55 time: 0.034374 Apr 30 21:10:34.929823 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 44/74] 10.222.0.23 () {60 vars in 1165 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors => generated 3423 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:34.929823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84910191-7782-41ed-ae14-0ba8a00cabd7 tempest-FlavorsV261TestJSON-1493620646 tempest-FlavorsV261TestJSON-1493620646-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.946869 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84910191-7782-41ed-ae14-0ba8a00cabd7 tempest-FlavorsV261TestJSON-1493620646 tempest-FlavorsV261TestJSON-1493620646-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3423 microversion: 2.61 time: 0.023734 Apr 30 21:10:34.947458 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 45/75] 10.222.0.23 () {60 vars in 1165 bytes} [Sat Apr 30 21:10:34 2022] GET /compute/v2.1/flavors => generated 3423 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:34.952740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-360e91d2-8c31-48da-8b85-f7aa2804ddf2 tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:34.963485 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68fbf06b-2544-4027-a004-1321c156cb1e tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.104803 Apr 30 21:10:34.964492 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 31/76] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:34 2022] POST /compute/v2.1/flavors => generated 507 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:34.980718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ca28109-20fb-41db-be44-8f8d2c20a538 tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:35.092240 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-360e91d2-8c31-48da-8b85-f7aa2804ddf2 tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1283800661" status: 202 len: 0 microversion: 2.55 time: 0.137155 Apr 30 21:10:35.092240 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 46/77] 10.222.0.23 () {60 vars in 1201 bytes} [Sat Apr 30 21:10:34 2022] DELETE /compute/v2.1/flavors/1283800661 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:10:35.093354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:35.094309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:35.107521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:35.111077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:35.117364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:35.117364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:35.205700 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ca28109-20fb-41db-be44-8f8d2c20a538 tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/241999148" status: 202 len: 0 microversion: 2.61 time: 0.239907 Apr 30 21:10:35.207405 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 32/78] 10.222.0.23 () {60 vars in 1198 bytes} [Sat Apr 30 21:10:34 2022] DELETE /compute/v2.1/flavors/241999148 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:10:35.214522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32404796-2183-4388-933a-458caf840256 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:35.302407 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32404796-2183-4388-933a-458caf840256 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/949de566-4009-49f4-80fe-a2434364320c" status: 202 len: 0 microversion: 2.1 time: 0.093051 Apr 30 21:10:35.303648 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 33/79] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:10:35 2022] DELETE /compute/v2.1/flavors/949de566-4009-49f4-80fe-a2434364320c => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:35.308624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f699ded8-65d4-4396-91c9-eeb0af835830 tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:35.335936 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f699ded8-65d4-4396-91c9-eeb0af835830 tempest-FlavorsV255TestJSON-930621153 tempest-FlavorsV255TestJSON-930621153-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.030993 Apr 30 21:10:35.340573 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 34/80] 10.222.0.23 () {60 vars in 1186 bytes} [Sat Apr 30 21:10:35 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:35.345996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a79909bd-9ce0-4089-a259-07f05b738a39 tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:35.374543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:35.382628 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8cd2516f-b532-4df2-bd97-0f7e7e71d298 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.294131 Apr 30 21:10:35.386498 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a79909bd-9ce0-4089-a259-07f05b738a39 tempest-FlavorsV261TestJSON-933533187 tempest-FlavorsV261TestJSON-933533187-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.048203 Apr 30 21:10:35.391665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 35/81] 10.222.0.23 () {60 vars in 1186 bytes} [Sat Apr 30 21:10:35 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:10:35.393178 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 47/82] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:35 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:35.403424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a20df410-d7f5-4d60-8d12-21eb2a3c541b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:35.421550 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a20df410-d7f5-4d60-8d12-21eb2a3c541b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026647 Apr 30 21:10:35.422156 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 36/83] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:35.438465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19eb2813-c1b7-42fe-a3e1-64086c4d8626 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-137531924", "id": 714833985, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:35.440751 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:35.440751 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:35.548873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19eb2813-c1b7-42fe-a3e1-64086c4d8626 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.114656 Apr 30 21:10:35.556965 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 48/84] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:35 2022] POST /compute/v2.1/flavors => generated 410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:35.570917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5df00ba8-4a86-4241-a22b-cfed16ff7c7d tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:35.583928 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5df00ba8-4a86-4241-a22b-cfed16ff7c7d tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/714833985" status: 200 len: 410 microversion: 2.1 time: 0.015270 Apr 30 21:10:35.586512 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 37/85] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:10:35 2022] GET /compute/v2.1/flavors/714833985 => generated 410 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:36.343553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2eae21d4-5ba3-4d8d-b409-475b879e223e tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:36.366055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2eae21d4-5ba3-4d8d-b409-475b879e223e tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.772642 Apr 30 21:10:36.367038 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 49/86] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:35 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:36.385554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2bda6eff-c702-4a48-a4db-a1dd189e4b69 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:36.410615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:36.412802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:36.430698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:36.431991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:36.434748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:36.437514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:36.472394 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2bda6eff-c702-4a48-a4db-a1dd189e4b69 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/714833985" status: 202 len: 0 microversion: 2.1 time: 0.094314 Apr 30 21:10:36.473411 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 38/87] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:10:36 2022] DELETE /compute/v2.1/flavors/714833985 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:36.482589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a435fbc0-d611-4078-ad6b-2915b6fd0cec tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:36.506883 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a435fbc0-d611-4078-ad6b-2915b6fd0cec tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028813 Apr 30 21:10:36.518028 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 39/88] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:36.818159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:36.836534 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-10c733ba-4e4d-4f00-a27c-1dfa0b759233 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.439666 Apr 30 21:10:36.837129 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 50/89] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:36 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:36.846628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da448f7c-eff7-46fc-b182-bc03db83e7b0 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1754364689", "id": 416842431, "os-flavor-access:is_public": "False"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:36.849123 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:36.849123 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:37.005177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-48b3c7eb-1bd5-436c-acfe-361d1e317486 req-972c8cbf-42ad-4db1-b188-713e84e53026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7cc847f-428a-4411-9236-547787fa5ffa", "tag": "d75ae72c-55f4-407f-b3db-9ce0924402b2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:37.017674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-48b3c7eb-1bd5-436c-acfe-361d1e317486 req-972c8cbf-42ad-4db1-b188-713e84e53026 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:37.018200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-48b3c7eb-1bd5-436c-acfe-361d1e317486 req-972c8cbf-42ad-4db1-b188-713e84e53026 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:37.040146 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-48b3c7eb-1bd5-436c-acfe-361d1e317486 req-972c8cbf-42ad-4db1-b188-713e84e53026 service nova] Creating event network-changed:d75ae72c-55f4-407f-b3db-9ce0924402b2 for instance c7cc847f-428a-4411-9236-547787fa5ffa on nch2-master-1 Apr 30 21:10:37.040696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-48b3c7eb-1bd5-436c-acfe-361d1e317486 req-972c8cbf-42ad-4db1-b188-713e84e53026 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:10:37.041838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23056a4a-117f-48db-803c-ec2cda6dac9d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:37.042292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23056a4a-117f-48db-803c-ec2cda6dac9d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:37.043147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23056a4a-117f-48db-803c-ec2cda6dac9d None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:37.043595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23056a4a-117f-48db-803c-ec2cda6dac9d None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:37.052257 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.rpcapi [None req-23056a4a-117f-48db-803c-ec2cda6dac9d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 30 21:10:37.053119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23056a4a-117f-48db-803c-ec2cda6dac9d None None] Releasing lock "compute-rpcapi-router" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:10:37.068775 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da448f7c-eff7-46fc-b182-bc03db83e7b0 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.225441 Apr 30 21:10:37.069194 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 51/90] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:36 2022] POST /compute/v2.1/flavors => generated 427 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.076081 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23056a4a-117f-48db-803c-ec2cda6dac9d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.555314 Apr 30 21:10:37.077111 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 40/91] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.081918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-727897b2-9ac3-496e-a9ad-2b6918c9591a tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "416842431"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:37.091819 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-727897b2-9ac3-496e-a9ad-2b6918c9591a tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] HTTP exception thrown: Flavor 416842431 could not be found. Apr 30 21:10:37.092408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-727897b2-9ac3-496e-a9ad-2b6918c9591a tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] Returning 400 to user: Flavor 416842431 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:37.093233 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-727897b2-9ac3-496e-a9ad-2b6918c9591a tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.017373 Apr 30 21:10:37.097991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 52/92] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:37 2022] POST /compute/v2.1/servers => generated 80 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:37.104541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ef9cc464-0c5a-491f-9b2d-ed8d2cc91ddc tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.105461 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:37.105461 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:37.211920 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ef9cc464-0c5a-491f-9b2d-ed8d2cc91ddc tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/416842431" status: 202 len: 0 microversion: 2.1 time: 0.110765 Apr 30 21:10:37.213120 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 41/93] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:10:37 2022] DELETE /compute/v2.1/flavors/416842431 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:37.229254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-47073e0c-03a3-49d0-b03c-b3494d83b2cf tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.265925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-47073e0c-03a3-49d0-b03c-b3494d83b2cf tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041463 Apr 30 21:10:37.277991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 53/94] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:37.287262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1fc6f80c-e95c-4b66-ad64-0e7a3a2cbfe7 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1716223425", "id": 268524834, "os-flavor-access:is_public": "False"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:37.290218 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:37.290218 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:37.360885 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1fc6f80c-e95c-4b66-ad64-0e7a3a2cbfe7 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.080013 Apr 30 21:10:37.361485 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 42/95] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:37 2022] POST /compute/v2.1/flavors => generated 412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.374282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d2082179-6645-40c2-8015-11442410368b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1887385202", "id": 1892426250, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:37.457175 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d2082179-6645-40c2-8015-11442410368b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.087283 Apr 30 21:10:37.462856 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 54/96] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:37 2022] POST /compute/v2.1/flavors => generated 414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.473306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9cf349c9-ab4b-4d51-b1c7-afb1bd5e7d2a tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.499180 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9cf349c9-ab4b-4d51-b1c7-afb1bd5e7d2a tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.029639 Apr 30 21:10:37.499704 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 43/97] 10.222.0.23 () {58 vars in 1168 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.516287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f446b2c4-d27a-4128-bae2-96453cecf6c4 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.535191 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f446b2c4-d27a-4128-bae2-96453cecf6c4 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.025686 Apr 30 21:10:37.535778 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 55/98] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.547147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1906b9af-6006-4d6f-9d19-729607a034c7 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.556450 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1906b9af-6006-4d6f-9d19-729607a034c7 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.013657 Apr 30 21:10:37.569526 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 44/99] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.574488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c746c77a-5b6f-4394-a95e-02614cb0355a tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.583583 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c746c77a-5b6f-4394-a95e-02614cb0355a tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.012768 Apr 30 21:10:37.588094 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 56/100] 10.222.0.23 () {58 vars in 1168 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:37.594741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a83e610c-4fcd-40ca-ac63-1f6c05d34a46 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.617276 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a83e610c-4fcd-40ca-ac63-1f6c05d34a46 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.026235 Apr 30 21:10:37.618078 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 45/101] 10.222.0.23 () {58 vars in 1168 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:37.632718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8fcc64e2-24bf-4dd6-867e-41845e90e4c3 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.661867 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8fcc64e2-24bf-4dd6-867e-41845e90e4c3 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.032911 Apr 30 21:10:37.668043 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 57/102] 10.222.0.23 () {58 vars in 1174 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:37.678153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2da4b9c1-235b-4bad-9d83-925b48318f87 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.702523 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2da4b9c1-235b-4bad-9d83-925b48318f87 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.028247 Apr 30 21:10:37.703721 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 46/103] 10.222.0.23 () {58 vars in 1172 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:37.720186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ceb9c38f-c807-452a-9998-b64d32347115 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.754334 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ceb9c38f-c807-452a-9998-b64d32347115 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.040323 Apr 30 21:10:37.754864 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 58/104] 10.222.0.23 () {58 vars in 1168 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:37.769100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ef4c1fb1-455c-4c65-98f9-7f4f67e3f8bb tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.857790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.858619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:37.865094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:37.865547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:37.866359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:37.866805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:37.947677 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ef4c1fb1-455c-4c65-98f9-7f4f67e3f8bb tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1892426250" status: 202 len: 0 microversion: 2.1 time: 0.182222 Apr 30 21:10:37.948902 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 47/105] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:37 2022] DELETE /compute/v2.1/flavors/1892426250 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:37.956456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1bf29f20-09f3-4de1-b7c9-2cba2a2f2642 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:37.989738 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1bf29f20-09f3-4de1-b7c9-2cba2a2f2642 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036493 Apr 30 21:10:37.990103 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 48/106] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:38.004843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e6b2d17-e753-4ba4-9b15-616f86f50f98 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:38.005917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:38.013727 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cb3a1b9-3da8-4a36-b9bb-745d63bf28d7 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.160562 Apr 30 21:10:38.024626 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 59/107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:37 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:38.142594 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e6b2d17-e753-4ba4-9b15-616f86f50f98 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/268524834" status: 202 len: 0 microversion: 2.1 time: 0.141156 Apr 30 21:10:38.143452 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 49/108] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:10:38 2022] DELETE /compute/v2.1/flavors/268524834 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:38.151498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea951481-83c6-404f-9bca-43806d2ae525 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:38.171681 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea951481-83c6-404f-9bca-43806d2ae525 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023971 Apr 30 21:10:38.172269 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 60/109] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:38.191369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-13a596fe-ce73-4089-97e0-5c2bb986cbf4 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2117427686", "id": 457571957, "os-flavor-access:is_public": "False"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:38.285068 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-13a596fe-ce73-4089-97e0-5c2bb986cbf4 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.098743 Apr 30 21:10:38.290888 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 50/110] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:38 2022] POST /compute/v2.1/flavors => generated 412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:38.296312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fdc3b874-7aff-4f36-a48c-1e1c51db3217 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:38.314185 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fdc3b874-7aff-4f36-a48c-1e1c51db3217 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022053 Apr 30 21:10:38.315069 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 61/111] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:38.328968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1e4f40a-8e3c-4d3c-b0a3-4c7309b4fa55 tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:38.348134 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e1e4f40a-8e3c-4d3c-b0a3-4c7309b4fa55 tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023025 Apr 30 21:10:38.348698 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 51/112] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:38.363973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fdffcf87-6376-4f18-a9da-b27fc6bc933f tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:38.364820 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:38.364820 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:38.443635 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fdffcf87-6376-4f18-a9da-b27fc6bc933f tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/457571957" status: 202 len: 0 microversion: 2.1 time: 0.083284 Apr 30 21:10:38.444235 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 62/113] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:10:38 2022] DELETE /compute/v2.1/flavors/457571957 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:38.452672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-844e7a45-f719-4855-94cb-13ff7c24dc3b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:38.471260 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-844e7a45-f719-4855-94cb-13ff7c24dc3b tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022810 Apr 30 21:10:38.471837 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 52/114] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:38.487943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b599b494-c73a-4f0f-b761-8dca98df9023 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2133138571", "id": 1784674487, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:38.489369 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:38.489369 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:38.568864 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b599b494-c73a-4f0f-b761-8dca98df9023 tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.084624 Apr 30 21:10:38.571500 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 63/115] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:38 2022] POST /compute/v2.1/flavors => generated 414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:38.580433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b4bbaab-2038-4f30-9ae9-894e24d05b36 tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:38.605357 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b4bbaab-2038-4f30-9ae9-894e24d05b36 tempest-FlavorsAdminTestJSON-2071606774 tempest-FlavorsAdminTestJSON-2071606774-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.028688 Apr 30 21:10:38.606201 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 53/116] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:38 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:38.621728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0b10bba-5545-40b2-97b4-85187680c82d tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:39.004677 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0b10bba-5545-40b2-97b4-85187680c82d tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1784674487" status: 202 len: 0 microversion: 2.1 time: 0.387431 Apr 30 21:10:39.005311 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 64/117] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:38 2022] DELETE /compute/v2.1/flavors/1784674487 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:39.017827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bf11326e-be17-4bfa-a5ba-25f0ee902e1e tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:39.039592 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bf11326e-be17-4bfa-a5ba-25f0ee902e1e tempest-FlavorsAdminTestJSON-1384904845 tempest-FlavorsAdminTestJSON-1384904845-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026772 Apr 30 21:10:39.039742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:39.040471 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 54/118] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:39.040579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:39.046750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:39.047145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:39.047922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:39.048368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:39.186421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:39.194306 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-52c52584-3dd1-4cdb-8cc2-3f0d1dd63fe4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.158424 Apr 30 21:10:39.195006 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 65/119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:39 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:40.212118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:40.212926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:40.219567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:40.220021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:40.220810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:40.221258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:40.368838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:40.376811 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45cada0b-df26-4ce2-9905-6019abad30cc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.168649 Apr 30 21:10:40.377380 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 66/120] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:40 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:40.684352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-afa2a36a-930a-4e50-9890-c474b678445f tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Calling method '.version_select at 0x7fdc214bca60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:40.690536 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:40.690536 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:40.690536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-afa2a36a-930a-4e50-9890-c474b678445f tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '97204941595d4b758b0e9f1f0ec0d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89134e53ab740b2915cbd6b096d33c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:40.690536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-afa2a36a-930a-4e50-9890-c474b678445f tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:40.690536 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-afa2a36a-930a-4e50-9890-c474b678445f tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.636095 Apr 30 21:10:40.690907 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 55/121] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Apr 30 21:10:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 637 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:40.698647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd386222-4c76-4a7c-8b1c-0eba36cd71bd tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Calling method '.version_select at 0x7fdc21ca64c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:40.699510 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:40.699510 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:40.701192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd386222-4c76-4a7c-8b1c-0eba36cd71bd tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '97204941595d4b758b0e9f1f0ec0d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89134e53ab740b2915cbd6b096d33c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:40.701871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd386222-4c76-4a7c-8b1c-0eba36cd71bd tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:40.702660 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd386222-4c76-4a7c-8b1c-0eba36cd71bd tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.007932 Apr 30 21:10:40.703145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 67/122] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:40 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:40.711815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbf8c7e9-2e6f-47ac-809b-74f4f7d3d3b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Calling method '.version_select at 0x7fdc2150c8b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:40.713621 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:40.713621 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:40.713887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cbf8c7e9-2e6f-47ac-809b-74f4f7d3d3b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '97204941595d4b758b0e9f1f0ec0d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89134e53ab740b2915cbd6b096d33c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:40.714526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbf8c7e9-2e6f-47ac-809b-74f4f7d3d3b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:40.715375 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cbf8c7e9-2e6f-47ac-809b-74f4f7d3d3b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.007350 Apr 30 21:10:40.715861 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 56/123] 10.222.0.23 () {58 vars in 1178 bytes} [Sat Apr 30 21:10:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:41.393252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:41.394075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:41.400783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.401536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.402542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.403170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.459023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Calling method '.version_select at 0x7fdc21d1e700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:41.462819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.463511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.507686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.513631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.527185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.527771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.534948 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9cb13de-d11d-4da2-9e9a-705ef0a701eb tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.813701 Apr 30 21:10:41.539230 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 68/124] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:41.546383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6051c5cc-e8f2-4cb4-9237-48e2f6b363c1 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Calling method '.version_select at 0x7fdc21ca6ee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:41.547376 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:41.547376 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:41.549061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6051c5cc-e8f2-4cb4-9237-48e2f6b363c1 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '97204941595d4b758b0e9f1f0ec0d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89134e53ab740b2915cbd6b096d33c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:41.550202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6051c5cc-e8f2-4cb4-9237-48e2f6b363c1 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:41.551148 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6051c5cc-e8f2-4cb4-9237-48e2f6b363c1 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009513 Apr 30 21:10:41.553802 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 69/125] 10.222.0.23 () {58 vars in 1172 bytes} [Sat Apr 30 21:10:41 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:10:41.563998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf14b039-565e-4768-b2a3-c31ecab7e19c tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Calling method '.version_select at 0x7fdc226339d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:41.566691 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-cf14b039-565e-4768-b2a3-c31ecab7e19c tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] HTTP exception thrown: Hypervisor with ID 'ad6aeb3f-1d93-4700-831b-f6bc7a14c801' could not be found. Apr 30 21:10:41.567562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf14b039-565e-4768-b2a3-c31ecab7e19c tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Returning 404 to user: Hypervisor with ID 'ad6aeb3f-1d93-4700-831b-f6bc7a14c801' could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:41.568971 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cf14b039-565e-4768-b2a3-c31ecab7e19c tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/ad6aeb3f-1d93-4700-831b-f6bc7a14c801/uptime" status: 404 len: 123 microversion: 2.1 time: 0.010123 Apr 30 21:10:41.573502 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 70/126] 10.222.0.23 () {58 vars in 1277 bytes} [Sat Apr 30 21:10:41 2022] GET /compute/v2.1/os-hypervisors/ad6aeb3f-1d93-4700-831b-f6bc7a14c801/uptime => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:41.579559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Calling method '.version_select at 0x7fdc22633f70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:41.580403 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:41.580403 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:41.582742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.582742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.598039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.598669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.612644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:41.622628 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82a36d6c-65d3-4629-9c85-d88db5cb5d62 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.233638 Apr 30 21:10:41.632019 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 57/127] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:41 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:41.635685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:41.636226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:41.644604 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-72aa5b69-edf5-4574-a86e-5c3fc9dc6286 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.070005 Apr 30 21:10:41.645413 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 71/128] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:41.656613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd7c0117-8e68-4f96-ae23-da3db70e60b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Calling method '.version_select at 0x7fdc214fb700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:41.657440 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:41.657440 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:41.660585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd7c0117-8e68-4f96-ae23-da3db70e60b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '97204941595d4b758b0e9f1f0ec0d6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89134e53ab740b2915cbd6b096d33c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:41.660585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd7c0117-8e68-4f96-ae23-da3db70e60b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:41.660585 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd7c0117-8e68-4f96-ae23-da3db70e60b4 tempest-HypervisorAdminNegativeTestJSON-705392535 tempest-HypervisorAdminNegativeTestJSON-705392535-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.008931 Apr 30 21:10:41.662330 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 58/129] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:10:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:41.673906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f69832b-257f-471b-b89a-27eb16c830f7 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Calling method '.version_select at 0x7fdc21ca6f70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:41.674983 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:41.674983 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:41.676172 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-7f69832b-257f-471b-b89a-27eb16c830f7 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] HTTP exception thrown: Hypervisor with ID 'c75d51f7-3fb9-4d64-aaff-e45ccd8bbbd2' could not be found. Apr 30 21:10:41.676903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f69832b-257f-471b-b89a-27eb16c830f7 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] Returning 404 to user: Hypervisor with ID 'c75d51f7-3fb9-4d64-aaff-e45ccd8bbbd2' could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:41.679235 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7f69832b-257f-471b-b89a-27eb16c830f7 tempest-HypervisorAdminNegativeTestJSON-973717859 tempest-HypervisorAdminNegativeTestJSON-973717859-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/c75d51f7-3fb9-4d64-aaff-e45ccd8bbbd2" status: 404 len: 123 microversion: 2.1 time: 0.008224 Apr 30 21:10:41.684066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 72/130] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:10:41 2022] GET /compute/v2.1/os-hypervisors/c75d51f7-3fb9-4d64-aaff-e45ccd8bbbd2 => generated 123 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:42.639311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:42.639920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:42.647105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:42.647587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:42.648522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:42.648958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:42.920804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:42.928397 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b44588c-bb70-4c2b-917a-752ec699b86b tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.292775 Apr 30 21:10:42.928962 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 59/131] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:42 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:43.946942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:43.947747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:43.956722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:43.957684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:43.958816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:43.959583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:44.098696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:44.106246 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fab9d14f-9b6f-4a76-8d29-0fd913915e64 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.164889 Apr 30 21:10:44.107094 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 73/132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:43 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:44.498472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0c906975-c3a3-4c8f-8390-fce7609ea8cc req-ec377600-779c-4b8a-9e9d-381363acd115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cc847f-428a-4411-9236-547787fa5ffa", "name": "network-vif-plugged", "status": "completed", "tag": "d75ae72c-55f4-407f-b3db-9ce0924402b2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:44.508074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0c906975-c3a3-4c8f-8390-fce7609ea8cc req-ec377600-779c-4b8a-9e9d-381363acd115 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:44.508957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0c906975-c3a3-4c8f-8390-fce7609ea8cc req-ec377600-779c-4b8a-9e9d-381363acd115 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:44.521521 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0c906975-c3a3-4c8f-8390-fce7609ea8cc req-ec377600-779c-4b8a-9e9d-381363acd115 service nova] Creating event network-vif-plugged:d75ae72c-55f4-407f-b3db-9ce0924402b2 for instance c7cc847f-428a-4411-9236-547787fa5ffa on nch2-master-1 Apr 30 21:10:44.530088 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0c906975-c3a3-4c8f-8390-fce7609ea8cc req-ec377600-779c-4b8a-9e9d-381363acd115 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.518509 Apr 30 21:10:44.530700 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 60/133] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:45.123675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:45.124436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:45.130833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:45.131286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:45.132085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:45.132518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:45.289525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:45.296941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7241d006-2c1d-4c23-8e48-9d4d0140b945 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.177272 Apr 30 21:10:45.297498 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 74/134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:45 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:46.313828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:46.314434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:46.320848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:46.321301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:46.322121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:46.322563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:46.340094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1979547860", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:46.445269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:10:46.613372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:46.625317 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9eb0578c-7afe-4309-aef4-4fecf91abbe6 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1339 microversion: 2.1 time: 0.315976 Apr 30 21:10:46.636318 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 75/135] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:46 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1339 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:46.721789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:10:46.722204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:10:46.722678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:10:46.723096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:10:46.723507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:10:46.738261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:46.743527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:46.743527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:46.743527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:46.775124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Getting quotas for project 039dadc3df264018a5bcb0ece1751446. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:10:46.782881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Getting quotas for user eda37dd9b3304fa9a9734f12ffaea8e7 and project 039dadc3df264018a5bcb0ece1751446. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:10:46.794814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:10:46.797961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:10:46.919209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cb7e0192-9f72-4e26-a285-e0ae4958c3b8 tempest-InstanceUsageAuditLogTestJSON-163338714 tempest-InstanceUsageAuditLogTestJSON-163338714-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:46.919977 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:46.919977 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:46.970444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-53304df7-5abe-4373-b86e-eef2afb51238 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014707 Apr 30 21:10:46.970584 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 61/136] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:10:47.155092 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cb7e0192-9f72-4e26-a285-e0ae4958c3b8 tempest-InstanceUsageAuditLogTestJSON-163338714 tempest-InstanceUsageAuditLogTestJSON-163338714-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-30 21:10:46" status: 200 len: 318 microversion: 2.1 time: 0.527347 Apr 30 21:10:47.156028 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 76/137] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:10:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-30%2021%3A10%3A46 => generated 318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:47.169257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-454eaad1-9bf1-42b3-b321-fd31605cb3cc tempest-InstanceUsageAuditLogTestJSON-163338714 tempest-InstanceUsageAuditLogTestJSON-163338714-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:47.171045 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:47.171045 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:47.185539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-454eaad1-9bf1-42b3-b321-fd31605cb3cc tempest-InstanceUsageAuditLogTestJSON-163338714 tempest-InstanceUsageAuditLogTestJSON-163338714-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.020855 Apr 30 21:10:47.189883 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 77/138] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Apr 30 21:10:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:47.220845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e3dc6ae-7a7c-45fc-9b54-6be259022bfd tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc2150cb80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:47.222972 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:47.222972 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:47.224586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3dc6ae-7a7c-45fc-9b54-6be259022bfd tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.225107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3dc6ae-7a7c-45fc-9b54-6be259022bfd tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.226606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3dc6ae-7a7c-45fc-9b54-6be259022bfd tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.227462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3dc6ae-7a7c-45fc-9b54-6be259022bfd tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.267082 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e3dc6ae-7a7c-45fc-9b54-6be259022bfd tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.295114 Apr 30 21:10:47.274555 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 62/139] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:10:46 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:47.278654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7b2fc8db-42ff-44a2-afb5-4cc9d731c866 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc226339d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:47.280697 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:47.280697 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:47.282289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b2fc8db-42ff-44a2-afb5-4cc9d731c866 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.282992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b2fc8db-42ff-44a2-afb5-4cc9d731c866 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.284340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b2fc8db-42ff-44a2-afb5-4cc9d731c866 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.285910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b2fc8db-42ff-44a2-afb5-4cc9d731c866 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.318996 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7b2fc8db-42ff-44a2-afb5-4cc9d731c866 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.043956 Apr 30 21:10:47.321356 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 78/140] 10.222.0.23 () {58 vars in 1138 bytes} [Sat Apr 30 21:10:47 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:47.334940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b889e63-9414-4ac1-b9ec-6ff68cd28b28 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc21658b80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:47.334940 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:47.334940 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:47.335709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b889e63-9414-4ac1-b9ec-6ff68cd28b28 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.335955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b889e63-9414-4ac1-b9ec-6ff68cd28b28 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.338078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b889e63-9414-4ac1-b9ec-6ff68cd28b28 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.338543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b889e63-9414-4ac1-b9ec-6ff68cd28b28 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.358655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1189943470", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:47.389937 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b889e63-9414-4ac1-b9ec-6ff68cd28b28 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.061595 Apr 30 21:10:47.390558 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 63/141] 10.222.0.23 () {58 vars in 1144 bytes} [Sat Apr 30 21:10:47 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:10:47.433338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:10:47.648734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:47.649614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:47.654680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:10:47.655345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:10:47.655882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:10:47.656353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:10:47.656824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.657029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:10:47.657292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.658185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.658630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.666464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.667097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.668053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.668678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.687878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Getting quotas for project 039dadc3df264018a5bcb0ece1751446. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:10:47.692961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Getting quotas for user eda37dd9b3304fa9a9734f12ffaea8e7 and project 039dadc3df264018a5bcb0ece1751446. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:10:47.705881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:10:47.708011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:10:47.824136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:47.841495 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-786acbfb-bd19-49dd-8c07-52e4a03ed3b4 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1489 microversion: 2.1 time: 0.198952 Apr 30 21:10:47.847696 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e6c994a0-0a20-453d-965b-06f1f78326da tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494866 Apr 30 21:10:47.848493 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 79/142] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:10:47.858392 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 64/143] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:47 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1489 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:47.858850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d7b9e1e-efa7-4c7d-90b8-712a21b09583 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:47.859469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d7b9e1e-efa7-4c7d-90b8-712a21b09583 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:47.869173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-53c971c6-dbe8-459f-9ed0-9230df2617c9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:47.870047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53c971c6-dbe8-459f-9ed0-9230df2617c9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:47.875741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7b9e1e-efa7-4c7d-90b8-712a21b09583 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.876251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7b9e1e-efa7-4c7d-90b8-712a21b09583 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.877119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7b9e1e-efa7-4c7d-90b8-712a21b09583 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:47.877608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7b9e1e-efa7-4c7d-90b8-712a21b09583 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:47.946713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-53c971c6-dbe8-459f-9ed0-9230df2617c9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:47.963823 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-53c971c6-dbe8-459f-9ed0-9230df2617c9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1214 microversion: 2.1 time: 0.103727 Apr 30 21:10:47.964552 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 65/144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:47 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:48.369518 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d7b9e1e-efa7-4c7d-90b8-712a21b09583 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1640 microversion: 2.1 time: 0.515000 Apr 30 21:10:48.377791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 80/145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:47 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1640 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:48.385400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:48.385943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:48.392896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:48.393481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:48.394171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:48.394689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:48.440866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:10:48.880440 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a1ea2bb3-0709-48dd-82f2-9f2365e78ae9 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 204 len: 0 microversion: 2.1 time: 0.491323 Apr 30 21:10:48.881140 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 66/146] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:10:48 2022] DELETE /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:10:48.891704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:48.892384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:48.909476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:48.919462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:48.920409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:48.920894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:48.983235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:48.984594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:48.993084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:48.993635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:48.994627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:48.995227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.084770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:49.097968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:49.098512 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-536da322-bc00-40b2-8010-2aaa6517922c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1218 microversion: 2.1 time: 0.120246 Apr 30 21:10:49.100891 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 67/147] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:48 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:49.107517 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-32898234-52a8-47ae-b9e7-f2535f511f90 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1495 microversion: 2.1 time: 0.221959 Apr 30 21:10:49.108581 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 81/148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:48 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1495 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:49.512475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Calling method '.version_select at 0x7fdc21373d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:49.514012 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:49.514012 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:49.515461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.515922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.534655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.535118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.546855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.547489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.553987 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ddea5d6-c308-4930-ba55-cc5b03bdacfc tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.179681 Apr 30 21:10:49.554565 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 68/149] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:49.720698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8de7cb92-fe12-4398-9b4e-b521a3f49f28 tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] Calling method '.version_select at 0x7fdc21c45f70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:49.723452 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:49.723452 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:49.725919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8de7cb92-fe12-4398-9b4e-b521a3f49f28 tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4e868be9f2a740c781ca1c9ea9fce7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd580c43cfbec4a03a83610ca67748abe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:49.727039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8de7cb92-fe12-4398-9b4e-b521a3f49f28 tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:49.728274 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8de7cb92-fe12-4398-9b4e-b521a3f49f28 tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.166669 Apr 30 21:10:49.729878 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 82/150] 10.222.0.23 () {58 vars in 1208 bytes} [Sat Apr 30 21:10:49 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:49.739206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c437e7ba-9f4d-4a8b-a89b-478b0aaf1748 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Calling method '.version_select at 0x7fdc21365160>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:49.740206 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:49.740206 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:49.741664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c437e7ba-9f4d-4a8b-a89b-478b0aaf1748 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.742430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c437e7ba-9f4d-4a8b-a89b-478b0aaf1748 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.755966 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c437e7ba-9f4d-4a8b-a89b-478b0aaf1748 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Apr 30 21:10:49.756793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c437e7ba-9f4d-4a8b-a89b-478b0aaf1748 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:49.757832 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c437e7ba-9f4d-4a8b-a89b-478b0aaf1748 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.022819 Apr 30 21:10:49.758586 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 69/151] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:10:49 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:49.767830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Calling method '.version_select at 0x7fdc21cb61f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:49.771167 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:49.771167 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:49.772724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.773356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.790011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.791017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.819703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.820458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.832495 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5bde5fc9-a0a8-4edd-8aa2-487340fd2dc1 tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067871 Apr 30 21:10:49.833588 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 83/152] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:49.844438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1d7e1873-13f5-44e5-bf25-92b5102f8f2c tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] Calling method '.version_select at 0x7fdc21365af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:49.845236 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:49.845236 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:49.846942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1d7e1873-13f5-44e5-bf25-92b5102f8f2c tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4e868be9f2a740c781ca1c9ea9fce7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd580c43cfbec4a03a83610ca67748abe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:49.848895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1d7e1873-13f5-44e5-bf25-92b5102f8f2c tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:49.848895 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1d7e1873-13f5-44e5-bf25-92b5102f8f2c tempest-HypervisorAdminNegativeUnderV252Test-577316308 tempest-HypervisorAdminNegativeUnderV252Test-577316308-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008558 Apr 30 21:10:49.850019 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 70/153] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:10:49 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:49.859659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6034cd4-5865-4ab4-b9f4-497761ad227a tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Calling method '.version_select at 0x7fdc21c453a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:49.860461 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:49.860461 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:49.861649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6034cd4-5865-4ab4-b9f4-497761ad227a tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:49.862134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6034cd4-5865-4ab4-b9f4-497761ad227a tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:49.876037 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b6034cd4-5865-4ab4-b9f4-497761ad227a tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] HTTP exception thrown: No hypervisor matching '38131269-af0e-4871-a923-ab9f834f8425' could be found. Apr 30 21:10:49.876037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6034cd4-5865-4ab4-b9f4-497761ad227a tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] Returning 404 to user: No hypervisor matching '38131269-af0e-4871-a923-ab9f834f8425' could be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:49.876037 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6034cd4-5865-4ab4-b9f4-497761ad227a tempest-HypervisorAdminNegativeUnderV252Test-361737097 tempest-HypervisorAdminNegativeUnderV252Test-361737097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/38131269-af0e-4871-a923-ab9f834f8425/servers" status: 404 len: 123 microversion: 2.1 time: 0.017140 Apr 30 21:10:49.876037 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 84/154] 10.222.0.23 () {58 vars in 1280 bytes} [Sat Apr 30 21:10:49 2022] GET /compute/v2.1/os-hypervisors/38131269-af0e-4871-a923-ab9f834f8425/servers => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:50.116819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:50.118381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:50.124285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:50.124734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:50.125359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:50.126537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:50.126921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:50.130474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:50.136524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:50.137061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:50.140482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:50.141224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:50.299168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:50.308692 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ee8a3da-4ada-4206-90a9-ecf87b589449 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1266 microversion: 2.1 time: 0.195974 Apr 30 21:10:50.320445 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 71/155] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:50 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:50.549708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a787e9b-b259-4c3f-9627-af6668dc9c47 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1813836259", "id": 1426776308, "os-flavor-access:is_public": "False"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:50.551313 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:50.551313 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:50.629342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a787e9b-b259-4c3f-9627-af6668dc9c47 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.307487 Apr 30 21:10:50.630014 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 72/156] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:50 2022] POST /compute/v2.1/flavors => generated 439 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:50.641660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad7d4d4f-ec42-46cf-b115-025347dfb50a tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f95aa68d4ae04f178ec0c2539b6b81e9"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:50.642976 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:50.642976 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:50.680665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:50.690770 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f1ac1f56-7c42-4245-9620-6c5c53d6a8e0 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1495 microversion: 2.1 time: 0.570275 Apr 30 21:10:50.691828 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 85/157] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:50 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1495 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:50.799745 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad7d4d4f-ec42-46cf-b115-025347dfb50a tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1426776308/action" status: 200 len: 97 microversion: 2.1 time: 0.162642 Apr 30 21:10:50.801693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 73/158] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Apr 30 21:10:50 2022] POST /compute/v2.1/flavors/1426776308/action => generated 97 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:10:50.811650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16de64cf-ab96-496d-80fd-204dccf20e61 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f95aa68d4ae04f178ec0c2539b6b81e9"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:50.814167 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:50.814167 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:51.054169 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-16de64cf-ab96-496d-80fd-204dccf20e61 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project f95aa68d4ae04f178ec0c2539b6b81e9 combination. Apr 30 21:10:51.055071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16de64cf-ab96-496d-80fd-204dccf20e61 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project f95aa68d4ae04f178ec0c2539b6b81e9 combination. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:51.056760 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16de64cf-ab96-496d-80fd-204dccf20e61 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1426776308/action" status: 409 len: 152 microversion: 2.1 time: 0.250601 Apr 30 21:10:51.057727 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 86/159] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Apr 30 21:10:50 2022] POST /compute/v2.1/flavors/1426776308/action => generated 152 bytes in 252 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:10:51.071863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-772df106-002a-4b2a-a62a-d0dd64c2864e tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f95aa68d4ae04f178ec0c2539b6b81e9"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:51.073382 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:51.073382 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:51.309630 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-772df106-002a-4b2a-a62a-d0dd64c2864e tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1426776308/action" status: 200 len: 21 microversion: 2.1 time: 0.241521 Apr 30 21:10:51.311999 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 74/160] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Apr 30 21:10:51 2022] POST /compute/v2.1/flavors/1426776308/action => generated 21 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:10:51.323520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aac5fb6c-af31-4e14-838b-96a6f242fb48 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:51.324776 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:51.324776 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:51.333626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:51.335482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:51.342266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:51.342727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:51.344460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:51.345078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:51.433402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:51.443155 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-150a02ba-ed7a-459c-8cb8-0209069697a5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1272 microversion: 2.1 time: 0.119004 Apr 30 21:10:51.443829 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 75/161] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:51 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:51.467537 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aac5fb6c-af31-4e14-838b-96a6f242fb48 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1426776308" status: 202 len: 0 microversion: 2.1 time: 0.148581 Apr 30 21:10:51.471491 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 87/162] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:51 2022] DELETE /compute/v2.1/flavors/1426776308 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:10:51.477013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8af98c47-145a-4f36-90ee-62e37f2a3f77 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:51.532729 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8af98c47-145a-4f36-90ee-62e37f2a3f77 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056640 Apr 30 21:10:51.536144 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 76/163] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:51.557602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-38ef979a-a0e2-4fe2-9398-8394c6872315 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-321770151", "id": 2071389396, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:51.559337 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:51.559337 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:51.711379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:51.712806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:51.719562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:51.720024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:51.720808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:51.721438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:51.791764 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-38ef979a-a0e2-4fe2-9398-8394c6872315 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.238776 Apr 30 21:10:51.800080 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 88/164] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:51 2022] POST /compute/v2.1/flavors => generated 437 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:51.806100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-175f474d-3040-46d6-8963-6eb056b7d614 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:51.807468 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:51.807468 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:51.815471 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-175f474d-3040-46d6-8963-6eb056b7d614 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] HTTP exception thrown: Access list not available for public flavors. Apr 30 21:10:51.819644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-175f474d-3040-46d6-8963-6eb056b7d614 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:51.821240 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-175f474d-3040-46d6-8963-6eb056b7d614 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/2071389396/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.019407 Apr 30 21:10:51.827677 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 89/165] 10.222.0.23 () {58 vars in 1208 bytes} [Sat Apr 30 21:10:51 2022] GET /compute/v2.1/flavors/2071389396/os-flavor-access => generated 91 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:10:51.834394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca36d44a-64b9-4f45-824a-9cc97b63bd0f tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:51.972118 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca36d44a-64b9-4f45-824a-9cc97b63bd0f tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2071389396" status: 202 len: 0 microversion: 2.1 time: 0.142636 Apr 30 21:10:51.976129 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 90/166] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:51 2022] DELETE /compute/v2.1/flavors/2071389396 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:51.984038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4fe16643-14bc-4e93-b5c8-d4f8104dfcf0 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:52.054119 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4fe16643-14bc-4e93-b5c8-d4f8104dfcf0 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076682 Apr 30 21:10:52.055326 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 91/167] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:52.082522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6919b046-fb60-438d-ab67-ed97d28c2cb6 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-699197742", "id": 599282113, "os-flavor-access:is_public": "False"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:52.093706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:52.110563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-66cd14c5-bf90-4e2d-bb53-58e973633ddc tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1495 microversion: 2.1 time: 0.406204 Apr 30 21:10:52.114039 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 77/168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:51 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1495 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:52.141555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0512cef9-9d46-4349-acd2-ec2c2550a599 req-9f683e01-821f-4465-af00-c7e2cb8d82de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cc847f-428a-4411-9236-547787fa5ffa", "name": "network-vif-deleted", "tag": "d75ae72c-55f4-407f-b3db-9ce0924402b2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:52.154774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0512cef9-9d46-4349-acd2-ec2c2550a599 req-9f683e01-821f-4465-af00-c7e2cb8d82de service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:52.155529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0512cef9-9d46-4349-acd2-ec2c2550a599 req-9f683e01-821f-4465-af00-c7e2cb8d82de service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:52.169333 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6919b046-fb60-438d-ab67-ed97d28c2cb6 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.096133 Apr 30 21:10:52.170237 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 92/169] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:52 2022] POST /compute/v2.1/flavors => generated 435 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:52.184847 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0512cef9-9d46-4349-acd2-ec2c2550a599 req-9f683e01-821f-4465-af00-c7e2cb8d82de service nova] Creating event network-vif-deleted:d75ae72c-55f4-407f-b3db-9ce0924402b2 for instance c7cc847f-428a-4411-9236-547787fa5ffa on nch2-master-1 Apr 30 21:10:52.203597 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0512cef9-9d46-4349-acd2-ec2c2550a599 req-9f683e01-821f-4465-af00-c7e2cb8d82de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064630 Apr 30 21:10:52.204690 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 78/170] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:52.751942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b835ac5-2561-4a48-8eeb-5cc94ec0c34d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f95aa68d4ae04f178ec0c2539b6b81e9"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:52.756472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b835ac5-2561-4a48-8eeb-5cc94ec0c34d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '495127048d1c4852982dfc79bbab6d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95aa68d4ae04f178ec0c2539b6b81e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:52.757316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b835ac5-2561-4a48-8eeb-5cc94ec0c34d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:52.758948 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b835ac5-2561-4a48-8eeb-5cc94ec0c34d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] 10.222.0.23 "POST /compute/v2.1/flavors/599282113/action" status: 403 len: 130 microversion: 2.1 time: 0.580296 Apr 30 21:10:52.763813 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 93/171] 10.222.0.23 () {60 vars in 1196 bytes} [Sat Apr 30 21:10:52 2022] POST /compute/v2.1/flavors/599282113/action => generated 130 bytes in 587 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:10:52.769538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:52.770270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:52.789554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:52.790096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:52.791119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:52.791408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:52.812584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-694738268", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "101af96d-46b7-4982-b0ed-3b0af2fa0ddf"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:52.894593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] validate_networks() for [('101af96d-46b7-4982-b0ed-3b0af2fa0ddf', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:10:53.235839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:53.251104 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aac8d483-7736-46c8-af98-e48d5f4ce7d9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.486125 Apr 30 21:10:53.256375 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 94/172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:52 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:53.279760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cfc91b8-937b-4dbc-aa8e-89743f3262e0 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:53.283231 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:53.283231 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:53.392004 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cfc91b8-937b-4dbc-aa8e-89743f3262e0 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/599282113" status: 202 len: 0 microversion: 2.1 time: 0.132262 Apr 30 21:10:53.393065 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 95/173] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:10:53 2022] DELETE /compute/v2.1/flavors/599282113 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:53.398710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:53.399522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:53.412419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:53.413447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:53.414630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:53.416382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:53.458879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:53.459638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:53.461710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lazy-loading 'fault' on Instance uuid c7cc847f-428a-4411-9236-547787fa5ffa {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:10:53.521738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f28e171049411c847508fe7521b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d316cd4e4d043ba9da2707b8006acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:53.531355 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21f35fdf-aa11-4d9f-beec-14e9a4e6a086 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 200 len: 1329 microversion: 2.1 time: 0.136653 Apr 30 21:10:53.532691 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 96/174] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:53 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 1329 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:53.538092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e406a151-08cc-437c-9290-42c9209a983c tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:53.567710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e406a151-08cc-437c-9290-42c9209a983c tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033705 Apr 30 21:10:53.569627 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 97/175] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:53.586856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0bec57e8-55de-4b17-ba6a-25711d4fb842 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1970655335", "id": 1651872934, "os-flavor-access:is_public": "False"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:53.588797 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:53.588797 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:53.678844 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0bec57e8-55de-4b17-ba6a-25711d4fb842 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.095732 Apr 30 21:10:53.679470 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 98/176] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:53 2022] POST /compute/v2.1/flavors => generated 439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:53.690092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-62840897-5ed6-40c3-9f7e-6c4febda471c tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f95aa68d4ae04f178ec0c2539b6b81e9"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:53.691805 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:53.691805 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:53.877397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:10:53.878232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:10:53.878735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:10:53.879149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:10:53.879562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:10:53.889860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:53.890312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:53.891161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:53.891895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:53.913720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:10:53.920425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for user 8bd54cdc115e4ae9b202bd06c7658e4a and project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:10:53.935555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:10:53.938462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:10:54.025470 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-62840897-5ed6-40c3-9f7e-6c4febda471c tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1651872934/action" status: 200 len: 97 microversion: 2.1 time: 0.333045 Apr 30 21:10:54.025470 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 99/177] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Apr 30 21:10:53 2022] POST /compute/v2.1/flavors/1651872934/action => generated 97 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:10:54.035571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-043f1037-e6cb-48b5-84fb-6a00c8084f5d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f95aa68d4ae04f178ec0c2539b6b81e9"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:54.036835 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:54.036835 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:54.040579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-043f1037-e6cb-48b5-84fb-6a00c8084f5d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '495127048d1c4852982dfc79bbab6d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95aa68d4ae04f178ec0c2539b6b81e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:54.041464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-043f1037-e6cb-48b5-84fb-6a00c8084f5d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:54.044829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-043f1037-e6cb-48b5-84fb-6a00c8084f5d tempest-FlavorsAccessNegativeTestJSON-1983516751 tempest-FlavorsAccessNegativeTestJSON-1983516751-project] 10.222.0.23 "POST /compute/v2.1/flavors/1651872934/action" status: 403 len: 133 microversion: 2.1 time: 0.015209 Apr 30 21:10:54.050543 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 100/178] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Apr 30 21:10:54 2022] POST /compute/v2.1/flavors/1651872934/action => generated 133 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:10:54.058752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d17bf63b-86d7-4e66-a4f5-bb156c03247a tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f95aa68d4ae04f178ec0c2539b6b81e9"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:54.091052 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-27b0aa56-5686-4177-82d7-5b05a71e38dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.658867 Apr 30 21:10:54.092918 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 79/179] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:10:54.103780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49eb2fd3-8b16-486f-b3ca-6668774a642a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:54.104711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49eb2fd3-8b16-486f-b3ca-6668774a642a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:54.160403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49eb2fd3-8b16-486f-b3ca-6668774a642a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:54.168430 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49eb2fd3-8b16-486f-b3ca-6668774a642a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1210 microversion: 2.1 time: 0.068681 Apr 30 21:10:54.169009 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 80/180] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:54 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1210 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:54.232176 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d17bf63b-86d7-4e66-a4f5-bb156c03247a tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1651872934/action" status: 200 len: 21 microversion: 2.1 time: 0.178005 Apr 30 21:10:54.233176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 101/181] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Apr 30 21:10:54 2022] POST /compute/v2.1/flavors/1651872934/action => generated 21 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:10:54.248553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d81f2cf4-b734-4a9e-b561-6a5cf04fa7b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:54.249521 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:54.249521 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:54.279314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:54.279314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:54.290641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:54.300616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:54.300616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:54.300616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:54.375665 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d81f2cf4-b734-4a9e-b561-6a5cf04fa7b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1651872934" status: 202 len: 0 microversion: 2.1 time: 0.133855 Apr 30 21:10:54.379412 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 81/182] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:10:54 2022] DELETE /compute/v2.1/flavors/1651872934 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:54.387523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46d0b8b1-642b-4a9f-9614-bef56f2404b5 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:54.419984 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46d0b8b1-642b-4a9f-9614-bef56f2404b5 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038156 Apr 30 21:10:54.420894 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 82/183] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:54.437887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8744401-a51e-4c8a-b604-23d00339b4e2 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1790218231", "id": 78502087, "os-flavor-access:is_public": "False"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:54.440318 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:54.440318 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:54.537162 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8744401-a51e-4c8a-b604-23d00339b4e2 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.103862 Apr 30 21:10:54.537805 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 83/184] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:54 2022] POST /compute/v2.1/flavors => generated 433 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:54.549522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-485917d3-415c-4017-8e5d-93ab6f78d16e tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1484aade54a74d308ccdd09ff23e6aa4"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:54.550771 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:54.550771 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:54.595553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:54.616318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4d36315a-62a1-4b1a-a827-c5155f2b074f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.343597 Apr 30 21:10:54.617564 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 102/185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:54 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:54.630331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:54.632375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:54.641926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:54.642524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:54.643317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:54.643760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:54.661325 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] HTTP exception thrown: Instance c7cc847f-428a-4411-9236-547787fa5ffa could not be found. Apr 30 21:10:54.661985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Returning 404 to user: Instance c7cc847f-428a-4411-9236-547787fa5ffa could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:54.662872 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0284c79f-6292-4d48-bf15-4e246a627d36 tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 404 len: 111 microversion: 2.1 time: 0.043062 Apr 30 21:10:54.663367 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 103/186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:54 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:54.672692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f31c2ea-93a8-4656-bf6f-dfbaca9f735c tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:54.674438 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:54.674438 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:54.707551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f31c2ea-93a8-4656-bf6f-dfbaca9f735c tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:54.708007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f31c2ea-93a8-4656-bf6f-dfbaca9f735c tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:54.894480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-485917d3-415c-4017-8e5d-93ab6f78d16e tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] HTTP exception thrown: Flavor access not found for 36 / 1484aade54a74d308ccdd09ff23e6aa4 combination. Apr 30 21:10:54.895174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-485917d3-415c-4017-8e5d-93ab6f78d16e tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Returning 404 to user: Flavor access not found for 36 / 1484aade54a74d308ccdd09ff23e6aa4 combination. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:10:54.895910 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-485917d3-415c-4017-8e5d-93ab6f78d16e tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/78502087/action" status: 404 len: 124 microversion: 2.1 time: 0.350508 Apr 30 21:10:54.900259 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 84/187] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:10:54 2022] POST /compute/v2.1/flavors/78502087/action => generated 124 bytes in 356 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:10:54.904938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd262a45-cd6f-4a2e-82b2-a8c0bf721a67 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:55.010100 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd262a45-cd6f-4a2e-82b2-a8c0bf721a67 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/78502087" status: 202 len: 0 microversion: 2.1 time: 0.108667 Apr 30 21:10:55.013725 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 85/188] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:10:54 2022] DELETE /compute/v2.1/flavors/78502087 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:10:55.023327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2747e6c-8d85-435d-8b93-9ab4ce31d29f tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:55.049333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2747e6c-8d85-435d-8b93-9ab4ce31d29f tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032131 Apr 30 21:10:55.064104 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 86/189] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:10:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:55.186133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3fcca1f1-d9d3-45ac-82ed-4f3a39458734 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:55.186767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3fcca1f1-d9d3-45ac-82ed-4f3a39458734 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:55.264210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3fcca1f1-d9d3-45ac-82ed-4f3a39458734 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:55.282402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3fcca1f1-d9d3-45ac-82ed-4f3a39458734 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1210 microversion: 2.1 time: 0.100494 Apr 30 21:10:55.284102 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 87/190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:55 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:55.462253 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f31c2ea-93a8-4656-bf6f-dfbaca9f735c tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.793513 Apr 30 21:10:55.463084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 104/191] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:10:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:55.476979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98496c8d-441f-497b-b0e5-5de977448ff1 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:55.478044 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:55.478044 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:55.583530 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98496c8d-441f-497b-b0e5-5de977448ff1 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.112952 Apr 30 21:10:55.584390 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 88/192] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:10:55 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:10:55.599629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6355c241-04e2-47c8-b74c-e8d40f46e05a tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1852909944"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:55.599629 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:55.599629 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:55.600737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-6355c241-04e2-47c8-b74c-e8d40f46e05a tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Generated uuid 57255cbc-5ab1-4a45-a949-15da67e693f7 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:10:55.633446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:55.639542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:55.641149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:55.641609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:55.642444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:55.642889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:55.740806 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6355c241-04e2-47c8-b74c-e8d40f46e05a tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.148838 Apr 30 21:10:55.741895 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 105/193] 10.222.0.23 () {62 vars in 1204 bytes} [Sat Apr 30 21:10:55 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:10:55.781027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f76c9395-bb77-4cdf-b0ed-5c307fa4086b tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2134312054"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:55.871123 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:55.871123 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:55.941395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:55.949579 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e2cd629-c41f-41ed-a170-94048e854c41 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.319886 Apr 30 21:10:55.950170 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 89/194] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:55 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:10:55.982908 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f76c9395-bb77-4cdf-b0ed-5c307fa4086b tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 299 microversion: 2.41 time: 0.202289 Apr 30 21:10:55.982908 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 106/195] 10.222.0.23 () {62 vars in 1209 bytes} [Sat Apr 30 21:10:55 2022] PUT /compute/v2.1/os-aggregates/2 => generated 299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:55.993680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6620b455-1f38-490f-bce1-641c0216621b tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:55.995854 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:55.995854 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:56.009635 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6620b455-1f38-490f-bce1-641c0216621b tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 299 microversion: 2.41 time: 0.022853 Apr 30 21:10:56.018592 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 107/196] 10.222.0.23 () {60 vars in 1189 bytes} [Sat Apr 30 21:10:55 2022] GET /compute/v2.1/os-aggregates/2 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:56.027661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2c8eea7-4e79-4cd9-b360-255ce9d62eeb tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:56.028987 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:56.028987 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:56.038624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2c8eea7-4e79-4cd9-b360-255ce9d62eeb tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:56.039291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2c8eea7-4e79-4cd9-b360-255ce9d62eeb tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:56.189229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-583773431", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c1b131fa-a537-4b70-82cc-dbac26cd0254"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:56.261193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] validate_networks() for [('c1b131fa-a537-4b70-82cc-dbac26cd0254', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:10:56.287789 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2c8eea7-4e79-4cd9-b360-255ce9d62eeb tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.41 time: 0.264035 Apr 30 21:10:56.288551 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 108/197] 10.222.0.23 () {62 vars in 1231 bytes} [Sat Apr 30 21:10:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:56.301070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:56.301838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:56.318610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:56.319063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:56.319855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:56.323643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:56.434689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:56.444250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-129ae507-b302-44a5-a78b-faf6d039424a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1228 microversion: 2.1 time: 0.147552 Apr 30 21:10:56.450426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 109/198] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:56 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:56.457492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3193c704-721b-47d0-b8b0-f8748e33dfa6 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:56.458877 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:56.458877 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:56.469733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3193c704-721b-47d0-b8b0-f8748e33dfa6 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:56.470482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3193c704-721b-47d0-b8b0-f8748e33dfa6 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:56.799999 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3193c704-721b-47d0-b8b0-f8748e33dfa6 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.41 time: 0.348344 Apr 30 21:10:56.808588 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 110/199] 10.222.0.23 () {62 vars in 1231 bytes} [Sat Apr 30 21:10:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:10:57.018223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1044774595", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:57.061351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:10:57.061913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:10:57.062435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:10:57.062676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:10:57.063090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:10:57.078022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.078432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.082199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.082690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.090627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:10:57.112999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:10:57.118530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for user 6e275a4d32754fe9a164bd79c3774b97 and project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:10:57.138790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:10:57.141315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:10:57.343158 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-34cdb988-5cea-4191-84e2-7ce7f9e994ec tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391523 Apr 30 21:10:57.344077 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 90/200] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:10:57.348652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45d880f2-847f-4101-b658-8cda783cea18 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:57.349414 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:57.349414 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:57.476207 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45d880f2-847f-4101-b658-8cda783cea18 tempest-AggregatesAdminTestV241-414190846 tempest-AggregatesAdminTestV241-414190846-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.130875 Apr 30 21:10:57.482647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 91/201] 10.222.0.23 () {60 vars in 1192 bytes} [Sat Apr 30 21:10:57 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:57.498552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:57.499598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:57.518145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.518799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.528870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.529515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.673010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:10:57.673633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:10:57.674138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:10:57.674627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:10:57.675136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:10:57.686581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.687104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.687993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.688531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.710376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:10:57.714666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for user cce42480cd844664991774f07ca47e79 and project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:10:57.726125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:10:57.728628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:10:57.762241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:57.771946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ffdf870-e73d-43f5-af1f-a85c6b5486a2 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.293967 Apr 30 21:10:57.781885 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 92/202] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:57 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:57.786743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9197f516-84b6-4727-bdca-b236ecc87271 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:57.787551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9197f516-84b6-4727-bdca-b236ecc87271 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:57.888877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9197f516-84b6-4727-bdca-b236ecc87271 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:57.903238 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9197f516-84b6-4727-bdca-b236ecc87271 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1207 microversion: 2.1 time: 0.120176 Apr 30 21:10:57.906881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 93/203] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:57 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1207 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:57.913987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:57.918433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:57.927359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.928158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.929136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:57.929727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:57.997332 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a7be373-2e63-4c6c-ad6e-7618a644ce52 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183210 Apr 30 21:10:58.003281 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 111/204] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:10:58.008248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f74e29e0-3079-4bb7-8813-f7223f70c796 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1703633411"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:58.013733 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:58.013733 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:58.019970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-f74e29e0-3079-4bb7-8813-f7223f70c796 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid c3bbdbab-43d7-4808-a797-92bbb60f1de0 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:10:58.118208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:58.130896 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8f2682bc-d534-4464-a988-9ed771070a85 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1268 microversion: 2.1 time: 0.222325 Apr 30 21:10:58.150767 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 94/205] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:57 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1268 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:58.176882 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f74e29e0-3079-4bb7-8813-f7223f70c796 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.172048 Apr 30 21:10:58.178308 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 112/206] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:10:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:58.185998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb1130bf-6a81-41e0-aaaf-d630ddf3ece7 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:58.189169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bb1130bf-6a81-41e0-aaaf-d630ddf3ece7 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:58.336114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bb1130bf-6a81-41e0-aaaf-d630ddf3ece7 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:58.348675 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb1130bf-6a81-41e0-aaaf-d630ddf3ece7 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1213 microversion: 2.1 time: 0.165886 Apr 30 21:10:58.348675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 113/207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:58 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:58.359359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d5f267e-e060-468c-b49e-0c6353507c6f tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:58.362499 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:58.362499 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:58.398347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d5f267e-e060-468c-b49e-0c6353507c6f tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:58.399262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d5f267e-e060-468c-b49e-0c6353507c6f tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:58.432897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e982da2e-d6db-4f39-b925-06505cd6ed29 req-79b020b6-4cfa-4f9d-83b6-28f9af36c27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b1f705-0c2a-4bd9-af97-caf3ba66ca37", "tag": "ac2b59b7-f6ea-45a4-b2fc-ad1e92f9f8e6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:58.451972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e982da2e-d6db-4f39-b925-06505cd6ed29 req-79b020b6-4cfa-4f9d-83b6-28f9af36c27d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:58.454183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e982da2e-d6db-4f39-b925-06505cd6ed29 req-79b020b6-4cfa-4f9d-83b6-28f9af36c27d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:58.475012 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e982da2e-d6db-4f39-b925-06505cd6ed29 req-79b020b6-4cfa-4f9d-83b6-28f9af36c27d service nova] Creating event network-changed:ac2b59b7-f6ea-45a4-b2fc-ad1e92f9f8e6 for instance 10b1f705-0c2a-4bd9-af97-caf3ba66ca37 on nch1-master-1 Apr 30 21:10:58.486302 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e982da2e-d6db-4f39-b925-06505cd6ed29 req-79b020b6-4cfa-4f9d-83b6-28f9af36c27d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331970 Apr 30 21:10:58.487057 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 95/208] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:58.706099 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d5f267e-e060-468c-b49e-0c6353507c6f tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.356095 Apr 30 21:10:58.709584 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 114/209] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:10:58 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:58.720668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-edf075c0-a340-4955-8f13-d40b30acdba1 req-6b24f6b8-9a29-42a8-8671-bc811f532fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4888131-7f37-4758-8e35-816d07886e96", "tag": "9c97a0a6-0f63-4385-8a0e-e905cd2c4f48"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:58.732038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c73c2f25-f498-467a-9a6a-f577ee4b4703 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:58.734684 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:58.734684 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:58.737196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-edf075c0-a340-4955-8f13-d40b30acdba1 req-6b24f6b8-9a29-42a8-8671-bc811f532fc4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:58.740950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-edf075c0-a340-4955-8f13-d40b30acdba1 req-6b24f6b8-9a29-42a8-8671-bc811f532fc4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:58.752926 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c73c2f25-f498-467a-9a6a-f577ee4b4703 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.029784 Apr 30 21:10:58.755464 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 115/210] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:10:58 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:58.766562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0d3d4012-253c-4ac3-81df-52d57ba23bbb tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:58.768263 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:58.768263 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:58.774447 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-edf075c0-a340-4955-8f13-d40b30acdba1 req-6b24f6b8-9a29-42a8-8671-bc811f532fc4 service nova] Creating event network-changed:9c97a0a6-0f63-4385-8a0e-e905cd2c4f48 for instance e4888131-7f37-4758-8e35-816d07886e96 on nch1-master-1 Apr 30 21:10:58.778317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d3d4012-253c-4ac3-81df-52d57ba23bbb tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:58.779032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d3d4012-253c-4ac3-81df-52d57ba23bbb tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:58.789239 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-edf075c0-a340-4955-8f13-d40b30acdba1 req-6b24f6b8-9a29-42a8-8671-bc811f532fc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073238 Apr 30 21:10:58.791055 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 96/211] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:58.796875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:58.797845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:58.804521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:58.805287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:58.806271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:58.806872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:59.146446 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0d3d4012-253c-4ac3-81df-52d57ba23bbb tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.385755 Apr 30 21:10:59.153625 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 116/212] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:10:58 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:10:59.159656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:59.160279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:59.166784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:59.167627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:59.168455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:59.168949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:59.328747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:59.336485 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-644db0ae-7e62-455f-86f5-50d72f8208a7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1211 microversion: 2.1 time: 0.181099 Apr 30 21:10:59.337062 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 117/213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:59 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1211 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:59.342155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:59.342757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:59.348994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:59.349621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:59.350430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:59.350866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:59.399433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:59.407453 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f5b0ded-9dba-4977-830b-c8c03f3f04ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.614645 Apr 30 21:10:59.407999 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 97/214] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:58 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:59.422884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-92defc2e-6800-4b77-bc5c-10d83e848db8 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:59.425507 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:59.425507 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:59.493996 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-92defc2e-6800-4b77-bc5c-10d83e848db8 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.075146 Apr 30 21:10:59.494833 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 98/215] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:10:59 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:10:59.502223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:10:59.503236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:10:59.518330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:59.518330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:59.518330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:59.518330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:10:59.598572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:59.606129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:10:59.620099 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92fa370b-a6a2-4dfd-9abf-d049564eab50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.272421 Apr 30 21:10:59.620535 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2dae9f8-dbac-47df-bd7a-d2529f77650f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1217 microversion: 2.1 time: 0.120353 Apr 30 21:10:59.622105 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 99/216] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:59 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:59.626545 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 118/217] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:10:59 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:10:59.628925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb6ce42d-404d-4d57-80fa-28eb482da7ee tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1313954988"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:59.641599 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:59.641599 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:10:59.644605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.aggregate [None req-eb6ce42d-404d-4d57-80fa-28eb482da7ee tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid a18a9278-1515-4c2a-9353-bdc25bc8399a for aggregate {{(pid=130670) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:10:59.778053 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb6ce42d-404d-4d57-80fa-28eb482da7ee tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.154300 Apr 30 21:10:59.779534 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 100/218] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:10:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:10:59.789316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8d03397-8847-4a81-a618-f0922db47dd6 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:10:59.790836 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:59.790836 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:10:59.814599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8d03397-8847-4a81-a618-f0922db47dd6 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:10:59.815297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8d03397-8847-4a81-a618-f0922db47dd6 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.199264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8d03397-8847-4a81-a618-f0922db47dd6 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.413680 Apr 30 21:11:00.199864 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 119/219] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:10:59 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:00.210027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a777583e-81ce-4577-bca9-8e4e2a8c2b44 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:00.210794 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:00.210794 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:00.219676 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a777583e-81ce-4577-bca9-8e4e2a8c2b44 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013123 Apr 30 21:11:00.227180 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 101/220] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:11:00 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:00.232732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2329e2ca-f0d3-4d4e-9df4-1cccf9039e0e tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:00.234239 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:00.234239 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:00.252008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2329e2ca-f0d3-4d4e-9df4-1cccf9039e0e tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.252469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2329e2ca-f0d3-4d4e-9df4-1cccf9039e0e tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.353056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:00.353989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:00.360376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.360838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.361621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.362343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.431676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:00.452543 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3175a585-cf6f-4bc1-86ae-763f331f5954 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1259 microversion: 2.1 time: 0.103610 Apr 30 21:11:00.453223 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 102/221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:00 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1259 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:00.467427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:00.468044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:00.473909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.474429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.475741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.476090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.544159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2329e2ca-f0d3-4d4e-9df4-1cccf9039e0e tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.315428 Apr 30 21:11:00.549871 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 120/222] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:11:00 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:00.557543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac48ce40-a27f-4df0-bb21-713918728c35 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:00.558603 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:00.558603 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:00.676848 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac48ce40-a27f-4df0-bb21-713918728c35 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.124614 Apr 30 21:11:00.677603 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 121/223] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:00 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 30 21:11:00.688051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:00.690071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:00.699507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.700174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.701212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.701836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.800903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:00.816843 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bf65de28-6e3f-497e-b683-5cafe6300c6e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.353105 Apr 30 21:11:00.817644 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 103/224] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:00 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:00.822409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:00.823177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:00.829497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.829977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:00.830811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:00.831242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.033347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:01.041788 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3223192e-d199-45f2-b2f2-bb9d0894da4a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1265 microversion: 2.1 time: 0.222346 Apr 30 21:11:01.042638 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 104/225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:00 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:01.063525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5779bc92-ec9d-4c5e-a6b8-db733c463377 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1415449164"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:01.066369 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:01.066369 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:01.067478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.aggregate [None req-5779bc92-ec9d-4c5e-a6b8-db733c463377 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid 0b71c606-7f1b-4ca4-9d42-b6584d3f1c8a for aggregate {{(pid=130670) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:01.159160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:01.167065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e72fdfc0-1b23-4cef-9966-965271bc52d9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.487972 Apr 30 21:11:01.167642 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 122/226] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:00 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:01.181572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-35e87b32-c09e-4c9b-8f18-169e19be8e8e req-7e89fc34-6b7a-4d55-9542-e5b072812591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae6c5822-07aa-4e1d-9424-ee70b0405349", "tag": "ac54aba9-ad17-45b1-8ed2-985784924902"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:01.190080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5779bc92-ec9d-4c5e-a6b8-db733c463377 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.146010 Apr 30 21:11:01.192342 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 105/227] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:01.204393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-35e87b32-c09e-4c9b-8f18-169e19be8e8e req-7e89fc34-6b7a-4d55-9542-e5b072812591 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.204593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a0c7ba12-cf46-467e-88ba-1af7d35e6776 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:01.205175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-35e87b32-c09e-4c9b-8f18-169e19be8e8e req-7e89fc34-6b7a-4d55-9542-e5b072812591 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.206501 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:01.206501 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:01.221031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0c7ba12-cf46-467e-88ba-1af7d35e6776 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.222722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0c7ba12-cf46-467e-88ba-1af7d35e6776 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.234345 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-35e87b32-c09e-4c9b-8f18-169e19be8e8e req-7e89fc34-6b7a-4d55-9542-e5b072812591 service nova] Creating event network-changed:ac54aba9-ad17-45b1-8ed2-985784924902 for instance ae6c5822-07aa-4e1d-9424-ee70b0405349 on nch2-master-1 Apr 30 21:11:01.235281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-35e87b32-c09e-4c9b-8f18-169e19be8e8e req-7e89fc34-6b7a-4d55-9542-e5b072812591 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:11:01.236585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d89c472-7a6a-46f0-bf41-fd82cfe50d77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.237209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d89c472-7a6a-46f0-bf41-fd82cfe50d77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.238851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d89c472-7a6a-46f0-bf41-fd82cfe50d77 None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.240250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d89c472-7a6a-46f0-bf41-fd82cfe50d77 None None] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.251125 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.compute.rpcapi [None req-2d89c472-7a6a-46f0-bf41-fd82cfe50d77 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 30 21:11:01.252226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d89c472-7a6a-46f0-bf41-fd82cfe50d77 None None] Releasing lock "compute-rpcapi-router" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:11:01.284604 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d89c472-7a6a-46f0-bf41-fd82cfe50d77 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114947 Apr 30 21:11:01.285968 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 123/228] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:01.473879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:01.475320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:01.493835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.496780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.498534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.501396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.573315 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a0c7ba12-cf46-467e-88ba-1af7d35e6776 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.372733 Apr 30 21:11:01.574026 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 106/229] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:11:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:11:01.580947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:01.589065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6bf4be0b-8f4b-4260-9fb1-708b9c1e787a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1265 microversion: 2.1 time: 0.122832 Apr 30 21:11:01.589644 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 124/230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:01 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:01.599448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e7e7a864-6356-440b-9404-24c6717d97ff tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:01.599448 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:01.599448 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:01.604629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7e7a864-6356-440b-9404-24c6717d97ff tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.605297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7e7a864-6356-440b-9404-24c6717d97ff tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.833048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:01.833633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:01.844770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.845216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.846026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:01.851183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:01.904929 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e7e7a864-6356-440b-9404-24c6717d97ff tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.321898 Apr 30 21:11:01.906071 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 107/231] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:11:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:01.917325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0bda799c-bc11-4593-89d0-dd4567893e32 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:01.918353 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:01.918353 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:01.987913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:01.995491 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-691952b3-adc3-4e13-9d3a-5f3da972e5e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.166422 Apr 30 21:11:01.996152 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 125/232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:01 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:02.018876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0bda799c-bc11-4593-89d0-dd4567893e32 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.106854 Apr 30 21:11:02.019466 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 108/233] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:01 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 30 21:11:02.032631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b7458f1-d0c0-41e7-9cd1-a0971029fe09 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-812021539"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:02.034097 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.034097 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:02.034956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-5b7458f1-d0c0-41e7-9cd1-a0971029fe09 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid 0eb9a170-eda3-4482-8ee3-67f00e34b484 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:02.062063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.062807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:02.069299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.069903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.070747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.071256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.145309 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b7458f1-d0c0-41e7-9cd1-a0971029fe09 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.116775 Apr 30 21:11:02.146133 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 126/234] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.151730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:02.156381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3284447d-9c8e-4038-a037-3d971484ec54 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc21adb280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.157263 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.157263 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:02.158438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3284447d-9c8e-4038-a037-3d971484ec54 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.158895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3284447d-9c8e-4038-a037-3d971484ec54 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.160277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3284447d-9c8e-4038-a037-3d971484ec54 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.160277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3284447d-9c8e-4038-a037-3d971484ec54 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.160925 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6703346-acf4-426b-9d24-60a18f036475 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1271 microversion: 2.1 time: 0.101938 Apr 30 21:11:02.169667 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 109/235] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:02.174495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7bd57c76-cfca-4de6-b7a0-a96aee51bcba tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.177238 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.177238 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.184627 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3284447d-9c8e-4038-a037-3d971484ec54 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.032560 Apr 30 21:11:02.185443 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 127/236] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.194155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.194771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:02.201839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.202383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.203152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.203624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.253928 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7bd57c76-cfca-4de6-b7a0-a96aee51bcba tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.083034 Apr 30 21:11:02.257804 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 110/237] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:02.262527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-650d9fcb-7883-4930-9973-5ed7c6f56950 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc212c4d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.264664 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.264664 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.266098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-650d9fcb-7883-4930-9973-5ed7c6f56950 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.266702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-650d9fcb-7883-4930-9973-5ed7c6f56950 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.267652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-650d9fcb-7883-4930-9973-5ed7c6f56950 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.268244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-650d9fcb-7883-4930-9973-5ed7c6f56950 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.295675 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-650d9fcb-7883-4930-9973-5ed7c6f56950 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.036468 Apr 30 21:11:02.296512 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 111/238] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.301477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e07be316-d52b-445d-9d9f-a732e7c2853b tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.302451 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.302451 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.308547 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-e07be316-d52b-445d-9d9f-a732e7c2853b tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Apr 30 21:11:02.309125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e07be316-d52b-445d-9d9f-a732e7c2853b tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:02.310024 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e07be316-d52b-445d-9d9f-a732e7c2853b tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.012399 Apr 30 21:11:02.313966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 112/239] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:02.321045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d00b77f3-d698-4296-a104-6dfb2899ed0c tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc2129e040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.321045 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.321045 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.321843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d00b77f3-d698-4296-a104-6dfb2899ed0c tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.322302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d00b77f3-d698-4296-a104-6dfb2899ed0c tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.323121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d00b77f3-d698-4296-a104-6dfb2899ed0c tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.323567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d00b77f3-d698-4296-a104-6dfb2899ed0c tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.350784 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d00b77f3-d698-4296-a104-6dfb2899ed0c tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.035633 Apr 30 21:11:02.351756 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 113/240] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.356367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fbc9f717-1107-41e3-b5a5-46454ccd3e79 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.357334 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.357334 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.373238 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-fbc9f717-1107-41e3-b5a5-46454ccd3e79 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Apr 30 21:11:02.373654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fbc9f717-1107-41e3-b5a5-46454ccd3e79 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:02.374662 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fbc9f717-1107-41e3-b5a5-46454ccd3e79 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.021859 Apr 30 21:11:02.376714 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 114/241] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:02.386726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de5e43ca-b7ea-464a-8385-68cd8fcff500 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc21365160>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.387710 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.387710 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.396506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de5e43ca-b7ea-464a-8385-68cd8fcff500 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.396895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de5e43ca-b7ea-464a-8385-68cd8fcff500 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.401239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:02.412019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de5e43ca-b7ea-464a-8385-68cd8fcff500 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.412593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de5e43ca-b7ea-464a-8385-68cd8fcff500 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.413725 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-86639bcc-2628-4383-9388-6a64c365ae5d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.227032 Apr 30 21:11:02.415995 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 128/242] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:02.423346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f032af10-00c2-410b-ab3c-462c8e9c9d86 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-88049222", "name": "tempest-test_aggregate-177554111"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:02.448046 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.448046 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:02.450544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-f032af10-00c2-410b-ab3c-462c8e9c9d86 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid e4f90be2-1ab4-4a0e-8afe-5453da981733 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:02.454047 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de5e43ca-b7ea-464a-8385-68cd8fcff500 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.076047 Apr 30 21:11:02.454630 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 115/243] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.473255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d92d73dc-c83d-4b37-81a6-0ebf402d73d6 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Calling method '.version_select at 0x7fdc2129e670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.474643 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.474643 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.481575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d92d73dc-c83d-4b37-81a6-0ebf402d73d6 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.482458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d92d73dc-c83d-4b37-81a6-0ebf402d73d6 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.496410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d92d73dc-c83d-4b37-81a6-0ebf402d73d6 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.496953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d92d73dc-c83d-4b37-81a6-0ebf402d73d6 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.515115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d92d73dc-c83d-4b37-81a6-0ebf402d73d6 tempest-HostsAdminTestJSON-897425466 tempest-HostsAdminTestJSON-897425466-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.046779 Apr 30 21:11:02.515976 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 116/244] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.582313 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f032af10-00c2-410b-ab3c-462c8e9c9d86 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.165067 Apr 30 21:11:02.583306 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 129/245] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Apr 30 21:11:02 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.593494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec2c4488-2fc7-4b8d-a0ef-8bec435c69cc tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.594319 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.594319 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.631079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.631966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:02.639847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.640554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.641435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:02.642094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:02.707676 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec2c4488-2fc7-4b8d-a0ef-8bec435c69cc tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.118095 Apr 30 21:11:02.708254 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 117/246] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:02.717142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c07f50e9-4c72-4cde-a694-01d2486d44d2 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.720260 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.720260 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.726607 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c07f50e9-4c72-4cde-a694-01d2486d44d2 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Apr 30 21:11:02.727192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c07f50e9-4c72-4cde-a694-01d2486d44d2 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:02.728219 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c07f50e9-4c72-4cde-a694-01d2486d44d2 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.015870 Apr 30 21:11:02.728966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 118/247] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:11:02.738466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-00efb1af-94cf-453f-883d-e868c10e31dd tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.739263 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.739263 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.751181 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-00efb1af-94cf-453f-883d-e868c10e31dd tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Apr 30 21:11:02.751989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-00efb1af-94cf-453f-883d-e868c10e31dd tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:02.753104 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-00efb1af-94cf-453f-883d-e868c10e31dd tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.019710 Apr 30 21:11:02.760073 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 119/248] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:11:02.765592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a0d65e93-9437-4a71-9de5-739bc6bde06f tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-69583935"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:02.767467 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.767467 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.767912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.aggregate [None req-a0d65e93-9437-4a71-9de5-739bc6bde06f tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid 259f6dc5-d4e4-4f3d-bf2f-3b049a602bbd for aggregate {{(pid=130670) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:02.869204 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a0d65e93-9437-4a71-9de5-739bc6bde06f tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.107719 Apr 30 21:11:02.878062 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 120/249] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:02 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.889440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0eb6b1f1-f5f0-4f65-a79c-e395c694c17e tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:02.891768 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.891768 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:02.904558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0eb6b1f1-f5f0-4f65-a79c-e395c694c17e tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 225 microversion: 2.1 time: 0.022577 Apr 30 21:11:02.905366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 121/250] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/os-aggregates/8 => generated 225 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:02.928362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4f324d7-85b7-4bdc-9ad4-83376c70c363 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:02.930391 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:02.930391 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:03.038013 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d4f324d7-85b7-4bdc-9ad4-83376c70c363 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 263 microversion: 2.1 time: 0.114368 Apr 30 21:11:03.043730 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 122/251] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Apr 30 21:11:02 2022] POST /compute/v2.1/os-aggregates/8/action => generated 263 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:03.046715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:03.047382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:03.068698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:03.068698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:03.071542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:03.073262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:03.187256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:03.199785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a467d697-86db-41c1-946b-f2068124f174 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.595827 Apr 30 21:11:03.202213 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 130/252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:02 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:03.209516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e99550f6-092e-49f0-9e58-f317f6270413 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:03.211135 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:03.211135 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:03.220289 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e99550f6-092e-49f0-9e58-f317f6270413 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 239 microversion: 2.1 time: 0.016678 Apr 30 21:11:03.221333 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 131/253] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:11:03 2022] GET /compute/v2.1/os-aggregates/8 => generated 239 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:03.227021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:03.229626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:03.235861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:03.238100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:03.238382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:03.238804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:03.616741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:03.638548 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d7c736d9-1cb6-431f-b721-9487b288b03e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.597900 Apr 30 21:11:03.639134 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 123/254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:03 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:03.643739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34ab53d2-9920-4158-8adb-9a6f10921a69 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:03.645397 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:03.645397 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:03.756872 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-34ab53d2-9920-4158-8adb-9a6f10921a69 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.116223 Apr 30 21:11:03.758018 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 124/255] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:03 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:03.772048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:03.772048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:03.787424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:03.787877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:03.794637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:03.795357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:03.810281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:03.821312 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-05321f8d-8c57-418e-84fc-37855168dbe1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.596783 Apr 30 21:11:03.822183 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 132/256] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:03 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:03.830185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c973ce2b-398e-49fc-9427-ad082662be17 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1485980617", "availability_zone": "tempest-test_az-868140776"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:03.844305 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:03.844305 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:03.845681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-c973ce2b-398e-49fc-9427-ad082662be17 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid 6cea4d34-614e-499c-b7b5-6f0a283bcfa7 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:04.008741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c973ce2b-398e-49fc-9427-ad082662be17 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.183915 Apr 30 21:11:04.010209 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 133/257] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Apr 30 21:11:03 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:04.041220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b5eb9a0-0d63-4a2d-96aa-b57bbe359946 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1485980617_new", "availability_zone": "tempest-test_az-868140776_new"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:04.046000 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:04.046000 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:04.198817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:04.207589 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ce44e14a-b785-461a-9623-c34b55aed175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.448527 Apr 30 21:11:04.211143 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:03 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:04.225610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:04.226408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:04.232597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:04.233337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:04.234491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:04.235144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:04.249800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b5eb9a0-0d63-4a2d-96aa-b57bbe359946 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:04.251411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b5eb9a0-0d63-4a2d-96aa-b57bbe359946 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:04.390723 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8b5eb9a0-0d63-4a2d-96aa-b57bbe359946 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.373716 Apr 30 21:11:04.392092 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 134/259] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:11:04 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:04.403489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82163cd6-146e-4f80-bfd3-ffb892c0ed6c tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:04.406809 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:04.406809 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:04.437337 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-82163cd6-146e-4f80-bfd3-ffb892c0ed6c tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.035023 Apr 30 21:11:04.440288 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 135/260] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:11:04 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:04.462764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b5c4c9c3-3041-49a8-903e-644eb2af2e66 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:04.463459 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:04.463459 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:04.564522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:04.575238 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a9951e2-62af-486d-8434-b20c0c0c5565 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.352105 Apr 30 21:11:04.585968 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 126/261] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:04 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:04.595374 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b5c4c9c3-3041-49a8-903e-644eb2af2e66 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.136427 Apr 30 21:11:04.595994 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 136/262] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:04.605235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3617a2dc-4575-4475-aa5f-eebcef73c9e5 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-411412863"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:04.606729 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:04.606729 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:04.608204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.aggregate [None req-3617a2dc-4575-4475-aa5f-eebcef73c9e5 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Generated uuid a6b69bf9-f79c-4ad1-a2ca-ed142def548f for aggregate {{(pid=130670) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:04.658710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:04.664896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:04.678478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:04.679820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:04.681488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:04.681586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:04.721294 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3617a2dc-4575-4475-aa5f-eebcef73c9e5 tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.119664 Apr 30 21:11:04.735578 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 127/263] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:04.753885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e16f1f6e-8ee5-423e-8877-333302f415cf tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:04.755490 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:04.755490 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:04.797744 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e16f1f6e-8ee5-423e-8877-333302f415cf tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.055869 Apr 30 21:11:04.806583 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:11:04 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:04.817233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-29f9c517-479f-4c1f-80ab-0a9634b90877 req-65384916-1781-46d1-a9b3-ddc55897e51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53e9e70-9d1f-4677-b6e5-19e0a393b42a", "tag": "064011e5-feea-444d-a97a-9f2180c4839e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:04.854014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-29f9c517-479f-4c1f-80ab-0a9634b90877 req-65384916-1781-46d1-a9b3-ddc55897e51c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:04.856223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-29f9c517-479f-4c1f-80ab-0a9634b90877 req-65384916-1781-46d1-a9b3-ddc55897e51c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:04.876553 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-29f9c517-479f-4c1f-80ab-0a9634b90877 req-65384916-1781-46d1-a9b3-ddc55897e51c service nova] Creating event network-changed:064011e5-feea-444d-a97a-9f2180c4839e for instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a on nch2-master-1 Apr 30 21:11:04.890677 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-29f9c517-479f-4c1f-80ab-0a9634b90877 req-65384916-1781-46d1-a9b3-ddc55897e51c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079022 Apr 30 21:11:04.893287 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 129/265] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:04.902849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2be13bb2-402c-4829-9ba4-c5560688a9cb tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:04.906731 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:04.906731 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:05.023302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:05.035349 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8bc00c2e-b6f3-484e-bc4e-18c7a66fad82 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.383348 Apr 30 21:11:05.036664 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 137/266] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:04 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:05.046165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:05.048778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:05.055877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.056702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.057669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.058375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.227281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:05.227281 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ce0bcfb-d211-4803-8d3f-a916e45b49dc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.163201 Apr 30 21:11:05.227281 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 138/267] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:05 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:05.233410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:05.234073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:05.240684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.241465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.248611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.248611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.355019 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2be13bb2-402c-4829-9ba4-c5560688a9cb tempest-AggregatesAdminTestJSON-1078595410 tempest-AggregatesAdminTestJSON-1078595410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.459410 Apr 30 21:11:05.359346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 130/268] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:04 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:05.375612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:05.376949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:05.384240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.384998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.387606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.388349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.407122 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] HTTP exception thrown: Instance c7cc847f-428a-4411-9236-547787fa5ffa could not be found. Apr 30 21:11:05.407954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Returning 404 to user: Instance c7cc847f-428a-4411-9236-547787fa5ffa could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:05.408988 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-243ea6b7-aafb-4e75-9df2-45509df3417c tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 404 len: 111 microversion: 2.1 time: 0.046119 Apr 30 21:11:05.410067 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 131/269] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:11:05 2022] DELETE /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:05.422094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:05.423356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] [instance: c7cc847f-428a-4411-9236-547787fa5ffa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:05.431554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.432586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.433666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.434561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.463621 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] HTTP exception thrown: Instance c7cc847f-428a-4411-9236-547787fa5ffa could not be found. Apr 30 21:11:05.463621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] Returning 404 to user: Instance c7cc847f-428a-4411-9236-547787fa5ffa could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:05.464556 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3cc8f37a-a57a-4637-a7ad-012f38ad902f tempest-AggregatesAdminTestJSON-1511174372 tempest-AggregatesAdminTestJSON-1511174372-project] 10.222.0.23 "GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa" status: 404 len: 111 microversion: 2.1 time: 0.049999 Apr 30 21:11:05.466706 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 132/270] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:05 2022] GET /compute/v2.1/servers/c7cc847f-428a-4411-9236-547787fa5ffa => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:11:05.495892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:05.518718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa1a7daa-2569-4b64-bfa2-b2619123762d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.278260 Apr 30 21:11:05.518718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 139/271] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:05 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:05.594387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:05.595175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:05.604561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.605591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.606658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.607870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.738761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1006e177-f5a7-4024-9b12-6d0824399236 req-bdcaa8ed-ed8d-46a1-8315-24bcf7aca134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b1f705-0c2a-4bd9-af97-caf3ba66ca37", "name": "network-vif-plugged", "status": "completed", "tag": "ac2b59b7-f6ea-45a4-b2fc-ad1e92f9f8e6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:05.747439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1006e177-f5a7-4024-9b12-6d0824399236 req-bdcaa8ed-ed8d-46a1-8315-24bcf7aca134 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:05.755523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1006e177-f5a7-4024-9b12-6d0824399236 req-bdcaa8ed-ed8d-46a1-8315-24bcf7aca134 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:05.787854 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1006e177-f5a7-4024-9b12-6d0824399236 req-bdcaa8ed-ed8d-46a1-8315-24bcf7aca134 service nova] Creating event network-vif-plugged:ac2b59b7-f6ea-45a4-b2fc-ad1e92f9f8e6 for instance 10b1f705-0c2a-4bd9-af97-caf3ba66ca37 on nch1-master-1 Apr 30 21:11:05.828086 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1006e177-f5a7-4024-9b12-6d0824399236 req-bdcaa8ed-ed8d-46a1-8315-24bcf7aca134 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072779 Apr 30 21:11:05.831517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 140/272] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 30 21:11:05.992846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:05.996445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-355108a3-06f7-45d2-8b22-0a3b2d09c2b9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.407634 Apr 30 21:11:05.997489 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 133/273] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:05 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:06.066808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:06.067650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:06.075079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:06.076014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:06.076663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:06.077111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:06.237534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:06.238743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:06.242045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:06.247272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:06.248014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:06.249340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:06.250109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:06.261688 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-896f1f4e-8b2c-421b-a820-334361af9e64 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.211839 Apr 30 21:11:06.262795 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 141/274] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:06 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:06.413525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:06.423751 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9e07d645-573c-452c-9735-22e2d8adcea1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.192461 Apr 30 21:11:06.434494 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 134/275] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:06 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:06.526042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:06.526656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:06.533788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:06.535174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:06.536673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:06.537347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:06.682156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:06.689651 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1061077-c238-4f4a-a902-a2e953d34e75 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.167531 Apr 30 21:11:06.690306 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 142/276] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:06 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:06.917208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-fe04394e-d007-4843-bb7c-05681a6ddf34 req-53c9b295-7362-4df6-9feb-36b7b3b03a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63136ef9-512e-4d74-9427-5db9addb1129", "tag": "5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:06.933738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fe04394e-d007-4843-bb7c-05681a6ddf34 req-53c9b295-7362-4df6-9feb-36b7b3b03a5c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:06.941298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fe04394e-d007-4843-bb7c-05681a6ddf34 req-53c9b295-7362-4df6-9feb-36b7b3b03a5c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:06.968744 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-fe04394e-d007-4843-bb7c-05681a6ddf34 req-53c9b295-7362-4df6-9feb-36b7b3b03a5c service nova] Creating event network-changed:5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b for instance 63136ef9-512e-4d74-9427-5db9addb1129 on nch2-master-1 Apr 30 21:11:06.980844 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-fe04394e-d007-4843-bb7c-05681a6ddf34 req-53c9b295-7362-4df6-9feb-36b7b3b03a5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068424 Apr 30 21:11:06.987774 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 135/277] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:07.111417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7176915e-bbed-4316-86bd-dec20541ec42 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.112981 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.112981 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:07.114196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7176915e-bbed-4316-86bd-dec20541ec42 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.115267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7176915e-bbed-4316-86bd-dec20541ec42 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.118582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7176915e-bbed-4316-86bd-dec20541ec42 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.118582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7176915e-bbed-4316-86bd-dec20541ec42 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.167479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7176915e-bbed-4316-86bd-dec20541ec42 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.171024 Apr 30 21:11:07.168069 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 136/278] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:11:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:11:07.172470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.173492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:07.180658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.181341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.182154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.182591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.229573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d84585c2-f344-4673-8218-8a6809592f02 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Calling method '.version_select at 0x7fdc21cb6700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.230881 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.230881 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:07.232182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84585c2-f344-4673-8218-8a6809592f02 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.232667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84585c2-f344-4673-8218-8a6809592f02 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.233811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84585c2-f344-4673-8218-8a6809592f02 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.234253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84585c2-f344-4673-8218-8a6809592f02 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.304249 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d84585c2-f344-4673-8218-8a6809592f02 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.377626 Apr 30 21:11:07.308274 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 143/279] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:11:06 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:07.320586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f29d9678-bbf0-444b-add9-0fb98569154b tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-822200662"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:07.321114 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.321114 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:07.322277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-f29d9678-bbf0-444b-add9-0fb98569154b tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 20b86732-7be5-442d-8e63-6919f6d34ccc for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:07.343625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.353348 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-437c46bf-fba8-4078-8b4d-7ffa776edce9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.184271 Apr 30 21:11:07.354693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 137/280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:07.361052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.361909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:07.370028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.370489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.371284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.371730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.406195 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f29d9678-bbf0-444b-add9-0fb98569154b tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094943 Apr 30 21:11:07.407160 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 144/281] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:07.517562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.526828 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb16181f-3d60-40df-b283-10d12c23491f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1314 microversion: 2.1 time: 0.170793 Apr 30 21:11:07.527810 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 138/282] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:07.541269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a2b3b3e0-c71f-4d4d-8e27-cba7b90ffaeb tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:07.543519 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.543519 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:07.551886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20d9aeff-3a2e-4c00-b9cc-fba4afb2e89f tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Calling method '.version_select at 0x7fdc21cb68b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.551886 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.551886 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:07.551886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20d9aeff-3a2e-4c00-b9cc-fba4afb2e89f tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '3478c1ac1faf4179958ac373ffafbf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1116d3f443d04b31b6f74174f0427f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.551886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20d9aeff-3a2e-4c00-b9cc-fba4afb2e89f tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:07.552862 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20d9aeff-3a2e-4c00-b9cc-fba4afb2e89f tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.140881 Apr 30 21:11:07.552862 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 145/283] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 143 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:07.558563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2b3b3e0-c71f-4d4d-8e27-cba7b90ffaeb tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.559233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2b3b3e0-c71f-4d4d-8e27-cba7b90ffaeb tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.564000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.566627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:07.576479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.576479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.577074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.577583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.728662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.737457 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3efcbab3-1d32-4eca-91e2-b09f508c399f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.185077 Apr 30 21:11:07.738074 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 146/284] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:07.742973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fcaac76a-424b-4c19-b86b-1d00e6665ebd tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Calling method '.version_select at 0x7fdc21aa2550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.744048 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.744048 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:07.745399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fcaac76a-424b-4c19-b86b-1d00e6665ebd tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '3478c1ac1faf4179958ac373ffafbf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1116d3f443d04b31b6f74174f0427f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.746270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fcaac76a-424b-4c19-b86b-1d00e6665ebd tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:07.747318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fcaac76a-424b-4c19-b86b-1d00e6665ebd tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.008075 Apr 30 21:11:07.747983 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 147/285] 10.222.0.23 () {58 vars in 1190 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:07.752836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.753587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:07.761500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.761995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.762782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.763261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.866396 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a2b3b3e0-c71f-4d4d-8e27-cba7b90ffaeb tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.336987 Apr 30 21:11:07.867089 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 139/286] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:07.871599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12c3180a-868a-4473-8eaf-aafc71f6c266 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Calling method '.version_select at 0x7fdc2130e700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.872439 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.872439 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:07.880284 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-12c3180a-868a-4473-8eaf-aafc71f6c266 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 30 21:11:07.880878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12c3180a-868a-4473-8eaf-aafc71f6c266 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:07.881690 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12c3180a-868a-4473-8eaf-aafc71f6c266 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.013659 Apr 30 21:11:07.886084 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 140/287] 10.222.0.23 () {58 vars in 1211 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:07.892485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3caa4b5a-b64e-4ae3-9927-6ed4f92bcdd3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:07.894117 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.894117 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:07.902346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.902664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3caa4b5a-b64e-4ae3-9927-6ed4f92bcdd3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.903128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3caa4b5a-b64e-4ae3-9927-6ed4f92bcdd3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.910844 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fcc2024e-b3e0-412f-9d6c-77ea7938995f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.161664 Apr 30 21:11:07.914110 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 148/288] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:07.916473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-59ed719d-ac6a-4484-90d4-c1ae8f6c3053 req-fd99d5fa-f170-4e02-8ce2-80b5eb71d014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4888131-7f37-4758-8e35-816d07886e96", "name": "network-vif-plugged", "status": "completed", "tag": "9c97a0a6-0f63-4385-8a0e-e905cd2c4f48"}, {"server_uuid": "ae6c5822-07aa-4e1d-9424-ee70b0405349", "name": "network-vif-plugged", "status": "completed", "tag": "ac54aba9-ad17-45b1-8ed2-985784924902"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:07.926158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-59ed719d-ac6a-4484-90d4-c1ae8f6c3053 req-fd99d5fa-f170-4e02-8ce2-80b5eb71d014 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:07.926770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-59ed719d-ac6a-4484-90d4-c1ae8f6c3053 req-fd99d5fa-f170-4e02-8ce2-80b5eb71d014 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:07.940499 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-59ed719d-ac6a-4484-90d4-c1ae8f6c3053 req-fd99d5fa-f170-4e02-8ce2-80b5eb71d014 service nova] Creating event network-vif-plugged:9c97a0a6-0f63-4385-8a0e-e905cd2c4f48 for instance e4888131-7f37-4758-8e35-816d07886e96 on nch1-master-1 Apr 30 21:11:07.941691 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-59ed719d-ac6a-4484-90d4-c1ae8f6c3053 req-fd99d5fa-f170-4e02-8ce2-80b5eb71d014 service nova] Creating event network-vif-plugged:ac54aba9-ad17-45b1-8ed2-985784924902 for instance ae6c5822-07aa-4e1d-9424-ee70b0405349 on nch2-master-1 Apr 30 21:11:07.951532 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-59ed719d-ac6a-4484-90d4-c1ae8f6c3053 req-fd99d5fa-f170-4e02-8ce2-80b5eb71d014 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038426 Apr 30 21:11:07.952131 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 149/289] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:07.957311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ab67316-7602-4e48-8a1b-82301d74028b tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Calling method '.version_select at 0x7fdc21adba60>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.958402 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.958402 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:07.960696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6ab67316-7602-4e48-8a1b-82301d74028b tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '3478c1ac1faf4179958ac373ffafbf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1116d3f443d04b31b6f74174f0427f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.960696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ab67316-7602-4e48-8a1b-82301d74028b tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:07.960948 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6ab67316-7602-4e48-8a1b-82301d74028b tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.007733 Apr 30 21:11:07.961410 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 150/290] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:07.971318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2434d88e-1769-40e3-b5c6-85a2e10cc572 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Calling method '.version_select at 0x7fdc21b160d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.971904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3caa4b5a-b64e-4ae3-9927-6ed4f92bcdd3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] HTTP exception thrown: Aggregate 11 already has host nch2-master-1. Apr 30 21:11:07.972730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3caa4b5a-b64e-4ae3-9927-6ed4f92bcdd3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 409 to user: Aggregate 11 already has host nch2-master-1. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:07.973622 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3caa4b5a-b64e-4ae3-9927-6ed4f92bcdd3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.085064 Apr 30 21:11:07.977558 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 141/291] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Apr 30 21:11:07.978250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-2434d88e-1769-40e3-b5c6-85a2e10cc572 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 30 21:11:07.978967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2434d88e-1769-40e3-b5c6-85a2e10cc572 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:07.980264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2434d88e-1769-40e3-b5c6-85a2e10cc572 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.012748 Apr 30 21:11:07.981012 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 151/292] 10.222.0.23 () {58 vars in 1190 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:11:07.988415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0a29a2d8-34f6-4954-8bbc-8f958b35be3e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:07.992697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3df706ee-b670-4af7-a7ef-889b29e4aba5 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Calling method '.version_select at 0x7fdc21adb550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:07.993507 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.993507 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:07.994760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3df706ee-b670-4af7-a7ef-889b29e4aba5 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '3478c1ac1faf4179958ac373ffafbf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1116d3f443d04b31b6f74174f0427f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:07.995471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3df706ee-b670-4af7-a7ef-889b29e4aba5 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:07.996281 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3df706ee-b670-4af7-a7ef-889b29e4aba5 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008030 Apr 30 21:11:07.998571 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:07.998571 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:08.000860 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 152/293] 10.222.0.23 () {58 vars in 1196 bytes} [Sat Apr 30 21:11:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:11:08.005500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88bc108f-c96c-461c-bab9-c4b90f5d6838 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Calling method '.version_select at 0x7fdc21cb6700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.017381 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-88bc108f-c96c-461c-bab9-c4b90f5d6838 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 30 21:11:08.018802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88bc108f-c96c-461c-bab9-c4b90f5d6838 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.019732 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-88bc108f-c96c-461c-bab9-c4b90f5d6838 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017823 Apr 30 21:11:08.019857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a29a2d8-34f6-4954-8bbc-8f958b35be3e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.020437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a29a2d8-34f6-4954-8bbc-8f958b35be3e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.024449 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 153/294] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:08.042151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-95eec6c2-3988-4571-a994-69d84ae556ed tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Calling method '.version_select at 0x7fdc21b16670>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.043105 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:08.043105 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:08.047343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-95eec6c2-3988-4571-a994-69d84ae556ed tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '3478c1ac1faf4179958ac373ffafbf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1116d3f443d04b31b6f74174f0427f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:08.048624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-95eec6c2-3988-4571-a994-69d84ae556ed tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.049469 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-95eec6c2-3988-4571-a994-69d84ae556ed tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.024060 Apr 30 21:11:08.056019 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 154/295] 10.222.0.23 () {58 vars in 1193 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:08.062545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1810d840-94aa-4921-8080-85aa9ad2d8fb tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Calling method '.version_select at 0x7fdc21cb6d30>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.079626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1810d840-94aa-4921-8080-85aa9ad2d8fb tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 30 21:11:08.081995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1810d840-94aa-4921-8080-85aa9ad2d8fb tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.083038 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1810d840-94aa-4921-8080-85aa9ad2d8fb tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.026004 Apr 30 21:11:08.083732 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 155/296] 10.222.0.23 () {58 vars in 1214 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:08.093929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd539f12-cd17-4884-b533-d86ecfdacbe1 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Action: 'update', calling method: .version_select at 0x7fdc21b16310>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:08.095121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd539f12-cd17-4884-b533-d86ecfdacbe1 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.095920 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd539f12-cd17-4884-b533-d86ecfdacbe1 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.006932 Apr 30 21:11:08.096426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 156/297] 10.222.0.23 () {60 vars in 1189 bytes} [Sat Apr 30 21:11:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:11:08.106107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-acddfe50-bb17-4393-85a4-42a08d3943ba tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Action: 'update', calling method: .version_select at 0x7fdc21adb5e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:08.107824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-acddfe50-bb17-4393-85a4-42a08d3943ba tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.108631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-acddfe50-bb17-4393-85a4-42a08d3943ba tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.006663 Apr 30 21:11:08.109850 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 157/298] 10.222.0.23 () {60 vars in 1189 bytes} [Sat Apr 30 21:11:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:11:08.120094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89c01fdc-27a7-4ba1-bf72-2dae2ba25dd8 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Action: 'update', calling method: .version_select at 0x7fdc21cb6d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:08.120094 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:08.120094 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:08.121006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89c01fdc-27a7-4ba1-bf72-2dae2ba25dd8 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '3478c1ac1faf4179958ac373ffafbf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1116d3f443d04b31b6f74174f0427f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:08.121647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89c01fdc-27a7-4ba1-bf72-2dae2ba25dd8 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.122542 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89c01fdc-27a7-4ba1-bf72-2dae2ba25dd8 tempest-HostsAdminNegativeTestJSON-1670987144 tempest-HostsAdminNegativeTestJSON-1670987144-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.007809 Apr 30 21:11:08.123164 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 158/299] 10.222.0.23 () {60 vars in 1189 bytes} [Sat Apr 30 21:11:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:11:08.148745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8656b344-9bc8-48f6-a11c-c597f786d31e tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Action: 'update', calling method: .version_select at 0x7fdc21aa2a60>, body: {"status": null, "maintenance_mode": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:08.149001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8656b344-9bc8-48f6-a11c-c597f786d31e tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.150724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8656b344-9bc8-48f6-a11c-c597f786d31e tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.018765 Apr 30 21:11:08.156862 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 159/300] 10.222.0.23 () {60 vars in 1189 bytes} [Sat Apr 30 21:11:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:11:08.162492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15a8607d-7caa-468d-a130-927b822e43c7 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Action: 'update', calling method: .version_select at 0x7fdc21aa2e50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:08.165062 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.hosts [None req-15a8607d-7caa-468d-a130-927b822e43c7 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Enabling host nonexistent_hostname. Apr 30 21:11:08.174879 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-15a8607d-7caa-468d-a130-927b822e43c7 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 30 21:11:08.175810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15a8607d-7caa-468d-a130-927b822e43c7 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.177448 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15a8607d-7caa-468d-a130-927b822e43c7 tempest-HostsAdminNegativeTestJSON-1069504430 tempest-HostsAdminNegativeTestJSON-1069504430-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017748 Apr 30 21:11:08.177448 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 160/301] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:11:08 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:08.339785 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0a29a2d8-34f6-4954-8bbc-8f958b35be3e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.358632 Apr 30 21:11:08.342702 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 142/302] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:08.352761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4eb3e69-a1e2-4229-b6e7-03c4a79b4bed tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.359275 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:08.359275 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:08.376441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.382530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:08.394445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.401151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.401151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.401151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.456266 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4eb3e69-a1e2-4229-b6e7-03c4a79b4bed tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.106695 Apr 30 21:11:08.460966 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 161/303] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:08 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 30 21:11:08.466057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ea58ec3-766c-4203-b223-31d73a2c5dd2 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1757760946"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:08.467677 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:08.467677 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:08.470072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-4ea58ec3-766c-4203-b223-31d73a2c5dd2 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 56d23a44-2540-4dd1-93de-dbee85dc5799 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:08.553971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:08.564366 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6432f1f6-91c2-474f-867b-957bd9534e5d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.192703 Apr 30 21:11:08.567620 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 143/304] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:08.570333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.570949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:08.573268 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ea58ec3-766c-4203-b223-31d73a2c5dd2 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.109767 Apr 30 21:11:08.579748 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 162/305] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:08.583983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.584444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.585278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.585955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.743838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:08.753397 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-25894370-6569-479c-a57a-47af739f4a3a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1464 microversion: 2.1 time: 0.186633 Apr 30 21:11:08.753880 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 144/306] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:08.771358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.771358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:08.776908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.777363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.778339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.778840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.913288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d46effa0-3c72-43a0-a88e-14f8abdd164b tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:08.916039 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:08.916039 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:08.918099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d46effa0-3c72-43a0-a88e-14f8abdd164b tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6cce227116e649da826de3541b2b2cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2470a634e4b3b96df66931847dae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:08.922013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d46effa0-3c72-43a0-a88e-14f8abdd164b tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:08.924024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d46effa0-3c72-43a0-a88e-14f8abdd164b tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.343209 Apr 30 21:11:08.925718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 163/307] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:08 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 345 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:08.931350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:08.934035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.935667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:08.941800 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4eded0d-ae6a-46bc-9848-5b28910869f0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.175552 Apr 30 21:11:08.942390 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 145/308] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:08.947494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:08.949183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.950171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.951078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:08.954399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.954990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.957224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.957871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:08.958800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:08.959418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:09.341482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:09.359478 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c73c378c-b146-4f25-bcfd-329be7c995e6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1310 microversion: 2.1 time: 0.415223 Apr 30 21:11:09.360436 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 146/309] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1310 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:09.369052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5e8f3e5-079b-40c3-ae53-b58d0e304433 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:09.371826 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:09.371826 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:09.393850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:09.402781 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f9e417fd-dfb0-46d7-8139-d2b31feeafeb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1314 microversion: 2.1 time: 0.475706 Apr 30 21:11:09.404055 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 164/310] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:08 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:09.505443 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5e8f3e5-079b-40c3-ae53-b58d0e304433 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.143747 Apr 30 21:11:09.506596 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 147/311] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:09 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:09.516757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92a6b4d5-34ff-4e19-8cc2-1743b726b36a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-865883324"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:09.518461 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:09.518461 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:09.536972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-92a6b4d5-34ff-4e19-8cc2-1743b726b36a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid d13121f5-2e85-4107-b917-67e066fe8b0f for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:09.583137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:09.583785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:09.600997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:09.606110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:09.606110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:09.606110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:09.660629 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92a6b4d5-34ff-4e19-8cc2-1743b726b36a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.148420 Apr 30 21:11:09.670048 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 165/312] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:09.678144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1264284220"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:09.686256 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:09.686256 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:09.708214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:09.709866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:09.727722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:09.728447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:09.739810 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1264284220 could not be found. Apr 30 21:11:09.740856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1264284220 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:09.744618 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-54211673-3162-4de9-a4a0-7252063d0128 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.070694 Apr 30 21:11:09.745604 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 166/313] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:09 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:09.758000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5198f6c3-7e11-4839-8dca-efe065da6b15 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:09.759122 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:09.759122 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:09.816778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:09.824422 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7eb128b2-2d8e-42bd-b3a6-b0089d37677a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.246287 Apr 30 21:11:09.824978 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 148/314] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:09 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:09.845707 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5198f6c3-7e11-4839-8dca-efe065da6b15 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.094557 Apr 30 21:11:09.846289 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 167/315] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:09 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 30 21:11:09.859867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b440fac6-954d-4ce8-90e1-12a423014c8d tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:09.861117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b440fac6-954d-4ce8-90e1-12a423014c8d tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:09.861951 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b440fac6-954d-4ce8-90e1-12a423014c8d tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.006790 Apr 30 21:11:09.866457 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 149/316] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Apr 30 21:11:09 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:11:09.871666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b94e2263-64f5-4d20-ae4a-23c74ae73ae0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:09.873481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b94e2263-64f5-4d20-ae4a-23c74ae73ae0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:09.874324 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b94e2263-64f5-4d20-ae4a-23c74ae73ae0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.006645 Apr 30 21:11:09.874855 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 168/317] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:09 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:11:09.901297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f40fc1e-8fa2-4d61-a35c-1e285c1d80b8 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2013066500"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:09.904981 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:09.904981 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:09.907549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9f40fc1e-8fa2-4d61-a35c-1e285c1d80b8 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6cce227116e649da826de3541b2b2cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2470a634e4b3b96df66931847dae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:09.909654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f40fc1e-8fa2-4d61-a35c-1e285c1d80b8 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:09.911465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f40fc1e-8fa2-4d61-a35c-1e285c1d80b8 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.020672 Apr 30 21:11:09.913847 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 150/318] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:09 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:09.938252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-665785c8-2cc7-49a2-ab75-bc0f52524a17 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-680329143"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:09.938252 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:09.938252 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:09.938252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-665785c8-2cc7-49a2-ab75-bc0f52524a17 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 0800c39d-c727-41b7-ae27-dd8626970f28 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:09.960792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:09.961427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:09.971470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:09.974735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:09.975778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:09.976599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:10.095906 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-665785c8-2cc7-49a2-ab75-bc0f52524a17 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.175423 Apr 30 21:11:10.099985 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 169/319] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:10.107522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ff34640-e83c-467d-b27d-a9b7b733ee2a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-680329143"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:10.108989 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:10.108989 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:10.109877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-4ff34640-e83c-467d-b27d-a9b7b733ee2a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 77bee2e1-4c51-4457-89fe-a5686c9a9f55 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:10.118382 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-4ff34640-e83c-467d-b27d-a9b7b733ee2a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-680329143 already exists. Apr 30 21:11:10.118980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ff34640-e83c-467d-b27d-a9b7b733ee2a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-680329143 already exists. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:10.120343 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ff34640-e83c-467d-b27d-a9b7b733ee2a tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.016862 Apr 30 21:11:10.121866 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 170/320] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:10 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 19 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:11:10.135906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d402d8f6-66e0-4253-834f-a0b2a1443bd6 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:10.136865 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:10.136865 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:10.205066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:10.213975 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11d204b7-910f-475d-83f6-d86a74b5aa5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.259183 Apr 30 21:11:10.223861 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 151/321] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:09 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:10.253879 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d402d8f6-66e0-4253-834f-a0b2a1443bd6 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.121541 Apr 30 21:11:10.259006 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 171/322] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:10 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:10.264136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-819bc7dd-f24f-4b66-8a48-7821d3b2ddb6 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-693148851"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:10.265476 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:10.265476 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:10.266443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.aggregate [None req-819bc7dd-f24f-4b66-8a48-7821d3b2ddb6 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 1962202b-fbb6-4f26-8f6b-d81366c47c67 for aggregate {{(pid=130670) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:10.388683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:10.389992 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-819bc7dd-f24f-4b66-8a48-7821d3b2ddb6 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.124903 Apr 30 21:11:10.391354 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 152/323] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:10.392304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:10.411928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7eebd55a-6152-4d27-98bb-211278fc9472 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:10.413038 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:10.413038 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:10.414275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:10.416732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:10.418550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7eebd55a-6152-4d27-98bb-211278fc9472 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6cce227116e649da826de3541b2b2cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2470a634e4b3b96df66931847dae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:10.419733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:10.422056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:10.425516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7eebd55a-6152-4d27-98bb-211278fc9472 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:10.427097 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7eebd55a-6152-4d27-98bb-211278fc9472 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.028408 Apr 30 21:11:10.427792 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 153/324] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:10 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:11:10.432732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:10.448819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:10.459094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:10.459702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:10.460599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:10.461331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:10.742265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:10.750884 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ca420c5-1140-49f6-85f9-d0d1a91eb487 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1464 microversion: 2.1 time: 0.321939 Apr 30 21:11:10.751830 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 154/325] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:10 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:10.753025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:10.757283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e719bf7-a2d7-42d1-bbc7-b60581f68876 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:10.758775 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:10.758775 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:10.764184 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c50b562-085c-40ca-9f8d-86aca83af25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1494 microversion: 2.1 time: 0.390694 Apr 30 21:11:10.776344 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 172/326] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:10 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1494 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:10.846510 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e719bf7-a2d7-42d1-bbc7-b60581f68876 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.093354 Apr 30 21:11:10.847874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 155/327] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:10 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:10.855979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:10.856658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:10.870175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:10.870636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:10.871433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:10.871882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.051949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85ae1f21-7331-47ae-a82e-d27cf29adbdd tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.052575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-85ae1f21-7331-47ae-a82e-d27cf29adbdd tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:11.060599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85ae1f21-7331-47ae-a82e-d27cf29adbdd tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.061060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85ae1f21-7331-47ae-a82e-d27cf29adbdd tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.061929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85ae1f21-7331-47ae-a82e-d27cf29adbdd tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.062376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85ae1f21-7331-47ae-a82e-d27cf29adbdd tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.066681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:11.075823 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d4c08e28-572b-4291-bdc3-48be7333125d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.226341 Apr 30 21:11:11.077180 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 156/328] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:10 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:11.082103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-085a31fb-8df9-4341-96a4-d9f8b35cd44e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.086233 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:11.086233 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:11.093797 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-085a31fb-8df9-4341-96a4-d9f8b35cd44e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 30 21:11:11.094396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-085a31fb-8df9-4341-96a4-d9f8b35cd44e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:11.095597 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-085a31fb-8df9-4341-96a4-d9f8b35cd44e tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.017303 Apr 30 21:11:11.097966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 157/329] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:11 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:11.103706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1414181909", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e4888131-7f37-4758-8e35-816d07886e96"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:11.172868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:11:11.241249 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-85ae1f21-7331-47ae-a82e-d27cf29adbdd tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1645 microversion: 2.1 time: 0.459728 Apr 30 21:11:11.246076 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 173/330] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:10 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1645 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:11.251845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1e733751-258a-4e95-b055-6785ef154fc7 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1530780057"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:11.255392 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:11.255392 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:11.263514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-1e733751-258a-4e95-b055-6785ef154fc7 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 68a0ff4b-b350-4095-9a51-5e5dd7dd1e2e for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:11.412455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1e733751-258a-4e95-b055-6785ef154fc7 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.164418 Apr 30 21:11:11.420304 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 174/331] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:11.428204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.429649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:11.442499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.443843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.444865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.445568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.552018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:11.559004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:11.559004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:11.559004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:11.559004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:11.568405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.569119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.570127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.570722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.590836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Getting quotas for project 039dadc3df264018a5bcb0ece1751446. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:11.595395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Getting quotas for user eda37dd9b3304fa9a9734f12ffaea8e7 and project 039dadc3df264018a5bcb0ece1751446. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:11.618185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:11:11.624754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:11:11.669983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:11.680965 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5395dee7-97b5-4cbe-b9f1-cb504a8721c6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.258500 Apr 30 21:11:11.683622 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 175/332] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:11 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:11.688842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1afcdf5-8260-4d31-aab1-08bcefba0cfb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.695417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c1afcdf5-8260-4d31-aab1-08bcefba0cfb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:11.701501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1afcdf5-8260-4d31-aab1-08bcefba0cfb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.702109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1afcdf5-8260-4d31-aab1-08bcefba0cfb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.702995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1afcdf5-8260-4d31-aab1-08bcefba0cfb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.703657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1afcdf5-8260-4d31-aab1-08bcefba0cfb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.813917 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1103bbea-59bd-4487-9522-b2e38537c156 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708161 Apr 30 21:11:11.816710 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 158/333] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:11:11.827668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9826bfc-d103-400c-963f-687c4c441ed6 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.828424 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:11.828424 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:11.829639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c9826bfc-d103-400c-963f-687c4c441ed6 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6cce227116e649da826de3541b2b2cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2470a634e4b3b96df66931847dae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:11.830655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9826bfc-d103-400c-963f-687c4c441ed6 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:11.833617 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9826bfc-d103-400c-963f-687c4c441ed6 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.008327 Apr 30 21:11:11.833617 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 159/334] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:11 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:11.842176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c10ebda6-234d-46bd-b83d-8330d1a8f013 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.842976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c10ebda6-234d-46bd-b83d-8330d1a8f013 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:11.904638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c10ebda6-234d-46bd-b83d-8330d1a8f013 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:11.914528 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c10ebda6-234d-46bd-b83d-8330d1a8f013 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1214 microversion: 2.1 time: 0.080386 Apr 30 21:11:11.935910 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 160/335] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:11 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:11.935910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6639f39-0c64-43a4-b91b-4814ae4e20b3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.937954 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:11.937954 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:11.939407 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1afcdf5-8260-4d31-aab1-08bcefba0cfb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1645 microversion: 2.1 time: 0.253480 Apr 30 21:11:11.942908 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 176/336] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:11 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1645 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:11.959830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cd3227c2-df21-4b3c-9320-7839538dec30 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:11.967750 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:11.967750 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:11.973477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3227c2-df21-4b3c-9320-7839538dec30 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.977573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3227c2-df21-4b3c-9320-7839538dec30 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:11.979295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3227c2-df21-4b3c-9320-7839538dec30 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:11.979672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3227c2-df21-4b3c-9320-7839538dec30 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.047791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cd3227c2-df21-4b3c-9320-7839538dec30 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091743 Apr 30 21:11:12.054630 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 177/337] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:11:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:11:12.056158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-141679e7-bf67-42d2-997a-a6b85f884ca0 req-4cd9f1ef-f64e-4e15-a25d-0c7de2147a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53e9e70-9d1f-4677-b6e5-19e0a393b42a", "name": "network-vif-plugged", "status": "completed", "tag": "064011e5-feea-444d-a97a-9f2180c4839e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:12.074992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-141679e7-bf67-42d2-997a-a6b85f884ca0 req-4cd9f1ef-f64e-4e15-a25d-0c7de2147a40 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.075985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-141679e7-bf67-42d2-997a-a6b85f884ca0 req-4cd9f1ef-f64e-4e15-a25d-0c7de2147a40 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.080460 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6639f39-0c64-43a4-b91b-4814ae4e20b3 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.148347 Apr 30 21:11:12.085157 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 161/338] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:11 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:12.087282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:12.089375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:12.100917 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-141679e7-bf67-42d2-997a-a6b85f884ca0 req-4cd9f1ef-f64e-4e15-a25d-0c7de2147a40 service nova] Creating event network-vif-plugged:064011e5-feea-444d-a97a-9f2180c4839e for instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a on nch2-master-1 Apr 30 21:11:12.104967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.105698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.106765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.107592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.116927 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-141679e7-bf67-42d2-997a-a6b85f884ca0 req-4cd9f1ef-f64e-4e15-a25d-0c7de2147a40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067413 Apr 30 21:11:12.117546 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 178/339] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:12.129581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0c0574c-e847-4e51-b184-0b4b70ac74cc tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:12.132968 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:12.132968 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:12.154462 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d0c0574c-e847-4e51-b184-0b4b70ac74cc tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 30 21:11:12.155074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0c0574c-e847-4e51-b184-0b4b70ac74cc tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:12.155925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0c0574c-e847-4e51-b184-0b4b70ac74cc tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036070 Apr 30 21:11:12.157339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 179/340] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:12 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:12.161975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:12.162707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:12.179901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.180784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.181138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.181583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.325914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lazy-loading 'flavor' on Instance uuid ae6c5822-07aa-4e1d-9424-ee70b0405349 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:11:12.384684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Going to try to live migrate instance to nch1-master-1 {{(pid=130670) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:11:12.406404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:12.430299 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-571b6794-be28-4575-9828-f9261b10c775 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1307 microversion: 2.1 time: 0.271785 Apr 30 21:11:12.432290 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 180/341] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:12 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:12.443139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cfe4e554-263b-46ca-a724-27856572a456 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:12.443997 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:12.443997 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:12.444984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cfe4e554-263b-46ca-a724-27856572a456 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6cce227116e649da826de3541b2b2cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2470a634e4b3b96df66931847dae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:12.445715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cfe4e554-263b-46ca-a724-27856572a456 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:12.455173 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cfe4e554-263b-46ca-a724-27856572a456 tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011980 Apr 30 21:11:12.455173 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 181/342] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:11:12 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:12.460882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f4587335-da66-4baf-a241-020c7bd868ed tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-740368931"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:12.462576 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:12.462576 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:12.463712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-f4587335-da66-4baf-a241-020c7bd868ed tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 5111e5e3-f127-4d71-9de6-241ff5f4a407 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:12.590674 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f4587335-da66-4baf-a241-020c7bd868ed tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.134243 Apr 30 21:11:12.591850 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 182/343] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:12.601596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b41461b-4afb-4c9f-93e6-ba2b89723aec tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:12.602858 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:12.602858 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:12.611535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b41461b-4afb-4c9f-93e6-ba2b89723aec tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.611994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b41461b-4afb-4c9f-93e6-ba2b89723aec tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.876762 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3b41461b-4afb-4c9f-93e6-ba2b89723aec tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.278588 Apr 30 21:11:12.880242 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 183/344] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:12 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:11:12.887770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:12.888441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:12.894745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.895199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:12.895974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:12.896555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:13.089229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:13.104348 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59dce669-b1f9-417c-b47b-a59eb7c363ab tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.214038 Apr 30 21:11:13.104348 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 184/345] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:12 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:13.104348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c945591-4b20-4b76-9b2a-b5db2e43682d tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:13.104801 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:13.104801 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:13.105545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1c945591-4b20-4b76-9b2a-b5db2e43682d tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6cce227116e649da826de3541b2b2cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2470a634e4b3b96df66931847dae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:13.106231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c945591-4b20-4b76-9b2a-b5db2e43682d tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:13.107640 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c945591-4b20-4b76-9b2a-b5db2e43682d tempest-AggregatesAdminNegativeTestJSON-6561113 tempest-AggregatesAdminNegativeTestJSON-6561113-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.007958 Apr 30 21:11:13.108270 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 185/346] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:13 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:13.113018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:13.113750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:13.120213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:13.120669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:13.121497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:13.122010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:13.203152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:13.215312 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b4f66705-9458-4c21-9ad2-60f72a604aca tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1218 microversion: 2.1 time: 0.106060 Apr 30 21:11:13.223690 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 186/347] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:13 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:13.230123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c79c4f53-67d9-424b-add3-b40e9e0d1e22 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:13.231596 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:13.231596 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:13.245493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c79c4f53-67d9-424b-add3-b40e9e0d1e22 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:13.246616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c79c4f53-67d9-424b-add3-b40e9e0d1e22 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:13.653809 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c79c4f53-67d9-424b-add3-b40e9e0d1e22 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.427808 Apr 30 21:11:13.654588 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 187/348] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:13 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:13.670806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:13.671616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:13.692835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:13.694235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:13.695426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:13.697306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:13.936798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:13.949285 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-702b2483-3607-49e0-bb67-c2ed5d99fa7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1487 microversion: 2.1 time: 0.287962 Apr 30 21:11:13.952002 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 188/349] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:13 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1487 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:13.968918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-79ed0a5c-cdcf-4f7e-953b-b13b1e2fa55c tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:13.970068 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:13.970068 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:14.181179 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-79ed0a5c-cdcf-4f7e-953b-b13b1e2fa55c tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.225892 Apr 30 21:11:14.182537 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 189/350] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:13 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:14.189037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75a0a9d7-bb39-4ad4-ad28-72219aadffa3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:14.189979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75a0a9d7-bb39-4ad4-ad28-72219aadffa3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:14.196807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a0a9d7-bb39-4ad4-ad28-72219aadffa3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:14.197677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a0a9d7-bb39-4ad4-ad28-72219aadffa3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:14.198743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a0a9d7-bb39-4ad4-ad28-72219aadffa3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:14.199451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a0a9d7-bb39-4ad4-ad28-72219aadffa3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:14.526850 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75a0a9d7-bb39-4ad4-ad28-72219aadffa3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a/action" status: 202 len: 0 microversion: 2.1 time: 0.342805 Apr 30 21:11:14.533139 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 190/351] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:14 2022] POST /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:11:14.545510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:14.546675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:14.559217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:14.559217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:14.562299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:14.564254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:14.836836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:14.845994 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ae8a408-07e7-46bd-9c96-eaf5c5458f2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1313 microversion: 2.1 time: 0.311052 Apr 30 21:11:14.856136 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 191/352] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:14 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:14.875692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-6b89b07e-e9f5-44f3-93b9-56dbdf717d37 req-f3cd6bd5-c3b5-4db3-92bd-6a7411107ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63136ef9-512e-4d74-9427-5db9addb1129", "name": "network-vif-plugged", "status": "completed", "tag": "5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:14.904249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6b89b07e-e9f5-44f3-93b9-56dbdf717d37 req-f3cd6bd5-c3b5-4db3-92bd-6a7411107ba0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:14.906393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6b89b07e-e9f5-44f3-93b9-56dbdf717d37 req-f3cd6bd5-c3b5-4db3-92bd-6a7411107ba0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:14.927346 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-6b89b07e-e9f5-44f3-93b9-56dbdf717d37 req-f3cd6bd5-c3b5-4db3-92bd-6a7411107ba0 service nova] Creating event network-vif-plugged:5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b for instance 63136ef9-512e-4d74-9427-5db9addb1129 on nch2-master-1 Apr 30 21:11:14.932866 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-6b89b07e-e9f5-44f3-93b9-56dbdf717d37 req-f3cd6bd5-c3b5-4db3-92bd-6a7411107ba0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076915 Apr 30 21:11:14.933933 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 192/353] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:14.945542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-87d9575d-974a-4579-9f2c-b7b5d6842b26 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1024966539"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:14.945542 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:14.945542 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:14.946166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-87d9575d-974a-4579-9f2c-b7b5d6842b26 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Generated uuid 45838aee-bcba-4f35-87af-85cdd22aeeea for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:11:15.055453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-87d9575d-974a-4579-9f2c-b7b5d6842b26 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.119387 Apr 30 21:11:15.062077 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 193/354] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:11:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:15.067405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:15.068159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:15.076018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:15.077260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:15.078495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:15.078946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:15.148919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:15.158127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d17ef323-b782-4807-8a46-dffeec61e152 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1274 microversion: 2.1 time: 0.094798 Apr 30 21:11:15.158710 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 194/355] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:15 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:15.364396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc21ad0c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:15.365197 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:15.365197 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:15.366453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:15.366910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:15.380754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:15.381204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:15.394213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:15.394723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:15.405342 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bde3843b-a890-4447-bd4d-608e5a27d247 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.243521 Apr 30 21:11:15.405342 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 195/356] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:11:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:15.409796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:15.410411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:15.417907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:15.418357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:15.419805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:15.420240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:15.605275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:15.614023 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4461537f-8299-4c27-9f67-1c416e64fe8c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 200 len: 1472 microversion: 2.1 time: 0.208355 Apr 30 21:11:15.625458 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 196/357] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:15 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:15.671213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1342366887", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "b894fca3-f633-42dd-93b5-bde3291d63a3"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:15.733796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] validate_networks() for [('b894fca3-f633-42dd-93b5-bde3291d63a3', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:11:16.620044 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f524f445-a781-4d66-a85b-64cad93b04d9 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349/action" status: 202 len: 0 microversion: 2.1 time: 4.537457 Apr 30 21:11:16.622828 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 162/358] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:12 2022] POST /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349/action => generated 0 bytes in 4541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:11:16.630385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:16.633177 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:16.633177 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:16.646015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.648046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.663074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.663844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.679615 ncdv-master-1 devstack@n-api.service[130670]: ERROR nova.api.openstack.compute.aggregates [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Apr 30 21:11:16.680734 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Apr 30 21:11:16.682075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:16.685034 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c151c125-9fdc-4885-bbf0-5d5fb64411d0 tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.059048 Apr 30 21:11:16.685034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 163/359] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:11:16 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:11:16.691208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc21028670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:16.692570 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:16.692570 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:16.694909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.695370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.709986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.710687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.722040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.722492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.728704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ebb508d7-9088-4363-a5ab-153511c62922 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.042868 Apr 30 21:11:16.729288 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 164/360] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Apr 30 21:11:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:16.734959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ff43203-53dc-428a-8215-d0a774a2c405 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1703691222"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:16.736174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ff43203-53dc-428a-8215-d0a774a2c405 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:16.742386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff43203-53dc-428a-8215-d0a774a2c405 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.743034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff43203-53dc-428a-8215-d0a774a2c405 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.744069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff43203-53dc-428a-8215-d0a774a2c405 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.744805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff43203-53dc-428a-8215-d0a774a2c405 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.777465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:16.779330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:16.779830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:16.780252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:16.780671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:16.797485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.798159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.799127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:16.799745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:16.824292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:16.831300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for user dadac4f61fe141dba3ee726ca6cbf29a and project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:16.844964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:11:16.847749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:11:16.998688 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eae9143d-6c75-4785-82ad-6f4650e9077b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.378134 Apr 30 21:11:16.999712 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 197/361] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:11:17.008078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:17.013307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:17.020065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.020746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.021688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.022448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.320181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:17.331644 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0a52a1a-d6c2-4568-af56-81fb0cd331b8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1462 microversion: 2.1 time: 0.330519 Apr 30 21:11:17.332520 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 198/362] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:16 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1462 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:17.346121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:17.346799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:17.359446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.363818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.364557 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ff43203-53dc-428a-8215-d0a774a2c405 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a/action" status: 202 len: 0 microversion: 2.1 time: 0.632689 Apr 30 21:11:17.365814 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 165/363] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:16 2022] POST /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:11:17.366306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.367958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.386990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:17.387811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:17.397356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.397839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.398617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.411585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.627274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:17.646985 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3ea710c-37ff-4542-9573-283198ed3e26 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.305225 Apr 30 21:11:17.654459 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 199/364] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:17 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:17.659404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dfb21365-dd32-49a3-a0be-d31b5788910c tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:17.660293 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:17.660293 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:17.697964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:17.707372 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-206e86a5-5a88-488b-ac8e-d7fb5fdb3594 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.331973 Apr 30 21:11:17.708021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 166/365] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:17 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:17.724186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc2129e550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:17.737783 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:17.737783 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:17.740503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.741335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.768162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.769157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.789380 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dfb21365-dd32-49a3-a0be-d31b5788910c tempest-AggregatesAdminNegativeTestJSON-429214968 tempest-AggregatesAdminNegativeTestJSON-429214968-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.133512 Apr 30 21:11:17.790169 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 200/366] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:11:17 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:11:17.811964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5fcb47a1-3471-4867-92da-c5f574efb784 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:17.812943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5fcb47a1-3471-4867-92da-c5f574efb784 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:17.831990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:17.836786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:17.870801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3c4c0b25-6d7f-447b-8a1a-9879ddfd15f6 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.156826 Apr 30 21:11:17.872501 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 167/367] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:11:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:17.965172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5fcb47a1-3471-4867-92da-c5f574efb784 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:17.978458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5fcb47a1-3471-4867-92da-c5f574efb784 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:17.982450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5fcb47a1-3471-4867-92da-c5f574efb784 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:17.984791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5fcb47a1-3471-4867-92da-c5f574efb784 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1262 microversion: 2.25 time: 0.192133 Apr 30 21:11:17.988168 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 201/368] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:17 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1262 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:18.002465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de96d27a-e1f7-4cd7-a8eb-34e7daca8477 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc211aa310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.080715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f8f9601-ebe3-49f2-b9a7-6b7a6ae0bf55 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.081444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f8f9601-ebe3-49f2-b9a7-6b7a6ae0bf55 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:18.088894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f8f9601-ebe3-49f2-b9a7-6b7a6ae0bf55 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.089523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f8f9601-ebe3-49f2-b9a7-6b7a6ae0bf55 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.090336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f8f9601-ebe3-49f2-b9a7-6b7a6ae0bf55 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.091823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f8f9601-ebe3-49f2-b9a7-6b7a6ae0bf55 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.101060 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de96d27a-e1f7-4cd7-a8eb-34e7daca8477 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.111738 Apr 30 21:11:18.107377 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 202/369] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:17 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:18.119876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31a76b0b-78d8-4e65-a31a-0c4d4ab1cb0a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc211aa790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.121016 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:18.121016 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:18.122695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31a76b0b-78d8-4e65-a31a-0c4d4ab1cb0a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.125618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31a76b0b-78d8-4e65-a31a-0c4d4ab1cb0a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.152036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31a76b0b-78d8-4e65-a31a-0c4d4ab1cb0a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.154244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31a76b0b-78d8-4e65-a31a-0c4d4ab1cb0a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.161420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31a76b0b-78d8-4e65-a31a-0c4d4ab1cb0a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.052604 Apr 30 21:11:18.171691 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 203/370] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:18.176423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-cb2287a0-0503-43d2-952a-3cc9f63242df req-0befbc25-2eb4-4ad2-8907-83d4e4a8dbca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36482df-2cb5-4d30-9ce3-95a6f06f80f0", "tag": "376e3c07-c6be-4468-aa0d-25e6e0c6136c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:18.216073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cb2287a0-0503-43d2-952a-3cc9f63242df req-0befbc25-2eb4-4ad2-8907-83d4e4a8dbca service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.216527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cb2287a0-0503-43d2-952a-3cc9f63242df req-0befbc25-2eb4-4ad2-8907-83d4e4a8dbca service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.242972 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-cb2287a0-0503-43d2-952a-3cc9f63242df req-0befbc25-2eb4-4ad2-8907-83d4e4a8dbca service nova] Creating event network-changed:376e3c07-c6be-4468-aa0d-25e6e0c6136c for instance b36482df-2cb5-4d30-9ce3-95a6f06f80f0 on nch1-master-1 Apr 30 21:11:18.254680 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-cb2287a0-0503-43d2-952a-3cc9f63242df req-0befbc25-2eb4-4ad2-8907-83d4e4a8dbca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081714 Apr 30 21:11:18.255469 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 204/371] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:18.260355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a99571e8-3cc1-4d7f-91bc-69c1113d202a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc21ad0d30>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.284124 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:18.284124 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:18.292578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a99571e8-3cc1-4d7f-91bc-69c1113d202a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.292578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a99571e8-3cc1-4d7f-91bc-69c1113d202a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.322916 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a99571e8-3cc1-4d7f-91bc-69c1113d202a tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.064889 Apr 30 21:11:18.323012 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 205/372] 10.222.0.23 () {58 vars in 1178 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:18.337013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc21ad0c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.338601 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:18.338601 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:18.340510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.341086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.365115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.365599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.381670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.381670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.392191 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-005c52c8-12db-4677-9f64-19e23d78cd21 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059208 Apr 30 21:11:18.398080 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 206/373] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:18.405692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2aa78058-5152-45ab-8245-1b2cca74454b tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc21ad0ee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.407368 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:18.407368 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:18.409876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aa78058-5152-45ab-8245-1b2cca74454b tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.410889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aa78058-5152-45ab-8245-1b2cca74454b tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.431517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aa78058-5152-45ab-8245-1b2cca74454b tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.432133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aa78058-5152-45ab-8245-1b2cca74454b tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.443045 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2aa78058-5152-45ab-8245-1b2cca74454b tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.043463 Apr 30 21:11:18.443837 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 207/374] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:18.459029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13e6cdf5-33d2-494f-961c-b4869f593359 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc211aaca0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.460316 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:18.460316 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:18.462406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e6cdf5-33d2-494f-961c-b4869f593359 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.462995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e6cdf5-33d2-494f-961c-b4869f593359 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.480999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e6cdf5-33d2-494f-961c-b4869f593359 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.481644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e6cdf5-33d2-494f-961c-b4869f593359 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.490162 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-13e6cdf5-33d2-494f-961c-b4869f593359 tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.036072 Apr 30 21:11:18.499860 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 208/375] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:18.504787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Calling method '.version_select at 0x7fdc21ae5790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.505702 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:18.505702 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:18.507219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.507762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.523181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.523770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.538997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.539607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.594884 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9cc30b0-40ec-49ab-83b8-73ed9dd226be tempest-HypervisorAdminTestJSON-1090938089 tempest-HypervisorAdminTestJSON-1090938089-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.093516 Apr 30 21:11:18.595847 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 209/376] 10.222.0.23 () {58 vars in 1172 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:18.661997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.665992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:18.674620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.675866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.676846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.678208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:18.975445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f8f9601-ebe3-49f2-b9a7-6b7a6ae0bf55 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1613 microversion: 2.1 time: 1.101798 Apr 30 21:11:18.976023 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 168/377] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:17 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1613 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:18.991767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:18.992383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:18.998788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:18.999441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:19.000374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:19.000963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:19.038952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:19.056834 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-462d1f6b-2faf-4add-8597-4fb4c29ed183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.400072 Apr 30 21:11:19.060625 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 210/378] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:19.069508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:19.070944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:19.078461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:19.079086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:19.080049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:19.080643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:19.248266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:19.257196 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ecc9c082-742c-446d-8e9b-f3450213ecad tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.277281 Apr 30 21:11:19.257588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9ecc7fabe57e4fc9accda390efb62b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98bd8e2e248d4b3599ea7038e73a0981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:19.267373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] flavor_id is None. Assuming migration. {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 30 21:11:19.267373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 21:11:19.268722 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 169/379] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:18 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:19.275304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:19.276956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:19.287222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:19.287898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:19.289108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:19.291215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:19.509380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:19.523237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:19.525097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:19.526246 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6ff2f98-33e1-4d25-99e8-2f620f7751d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1314 microversion: 2.25 time: 0.255950 Apr 30 21:11:19.530970 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 170/380] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:19 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:19.539015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ed806ef0-c878-4e0b-b2a5-46a405c1cd63 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc21028f70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:19.622275 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ed806ef0-c878-4e0b-b2a5-46a405c1cd63 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.089962 Apr 30 21:11:19.627937 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 171/381] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:19 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:20.049412 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8169693-f295-4f37-b80c-88a578f0e0d8 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129/action" status: 202 len: 0 microversion: 2.1 time: 0.983504 Apr 30 21:11:20.055897 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 211/382] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:19 2022] POST /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129/action => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:11:20.060611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:20.061881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:20.076284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.076749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.077545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.078027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.082861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:20.084013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:20.115192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.115657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.116456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.116898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.739022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:20.757888 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-630b9876-2d1e-41ba-8fc2-bf7bc19f1610 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1471 microversion: 2.1 time: 0.700854 Apr 30 21:11:20.760559 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 172/383] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:20 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1471 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:20.767262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:20.779063 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18784ce7-2adc-4852-bdb8-c340651cb9ad tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.704949 Apr 30 21:11:20.783945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:20.784445 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 212/384] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:20 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:20.790645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:20.801834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-fe82190d-3a53-4a79-bede-edcf416d7ffd req-eee5f771-bbcd-4899-8a0d-d24ba7168a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6c5822-07aa-4e1d-9424-ee70b0405349", "name": "network-vif-unplugged", "status": "completed", "tag": "ac54aba9-ad17-45b1-8ed2-985784924902"}, {"name": "network-changed", "server_uuid": "ae6c5822-07aa-4e1d-9424-ee70b0405349", "tag": "ac54aba9-ad17-45b1-8ed2-985784924902"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:20.810290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.811017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.812076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.813034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.822003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fe82190d-3a53-4a79-bede-edcf416d7ffd req-eee5f771-bbcd-4899-8a0d-d24ba7168a64 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.823367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fe82190d-3a53-4a79-bede-edcf416d7ffd req-eee5f771-bbcd-4899-8a0d-d24ba7168a64 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.852606 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fe82190d-3a53-4a79-bede-edcf416d7ffd req-eee5f771-bbcd-4899-8a0d-d24ba7168a64 service nova] Creating event network-vif-unplugged:ac54aba9-ad17-45b1-8ed2-985784924902 for instance ae6c5822-07aa-4e1d-9424-ee70b0405349 on nch2-master-1 Apr 30 21:11:20.853732 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fe82190d-3a53-4a79-bede-edcf416d7ffd req-eee5f771-bbcd-4899-8a0d-d24ba7168a64 service nova] Creating event network-changed:ac54aba9-ad17-45b1-8ed2-985784924902 for instance ae6c5822-07aa-4e1d-9424-ee70b0405349 on nch2-master-1 Apr 30 21:11:20.864721 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-fe82190d-3a53-4a79-bede-edcf416d7ffd req-eee5f771-bbcd-4899-8a0d-d24ba7168a64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.077769 Apr 30 21:11:20.867382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 213/385] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:20.880766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:20.881492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:20.896208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.899264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:20.900258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:20.900907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:21.052716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:21.076416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:21.078271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:21.081052 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-87147ccc-d075-41b0-a61c-f488d22936dc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1322 microversion: 2.25 time: 0.209887 Apr 30 21:11:21.082857 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 214/386] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:20 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:21.099498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1fb213e0-1c95-416e-a5c8-aa74881479c5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc21072670>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:21.190384 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1fb213e0-1c95-416e-a5c8-aa74881479c5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.105546 Apr 30 21:11:21.191261 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 215/387] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:21 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:21.299776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:21.307227 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-166ba56b-1fdb-4f8d-a337-fcf42d854001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.545450 Apr 30 21:11:21.312326 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 173/388] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:20 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:21.775553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:21.776170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:21.800992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:21.801906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:21.811709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:21.813344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:21.816184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:21.816873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:21.817873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:21.818886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:21.821937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:21.822633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:22.318129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:22.327019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:22.341110 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-52773906-04e7-466b-917e-33f9b07f59a9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1471 microversion: 2.1 time: 0.569192 Apr 30 21:11:22.346804 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 216/389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:21 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1471 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:22.355546 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad140a87-9a53-41e4-9a08-9da7fc3b49af tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.558318 Apr 30 21:11:22.359833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:22.362377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:22.369649 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 174/390] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:21 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:22.374863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b21741b2-0c1b-4dda-baac-cba7c847efb5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc210288b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:22.387976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:22.388738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:22.389816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:22.396411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:22.490427 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b21741b2-0c1b-4dda-baac-cba7c847efb5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.119254 Apr 30 21:11:22.495607 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 175/391] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:22 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:22.503767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:22.505813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:22.516270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:22.516952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:22.517922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:22.529041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:22.559972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:22.569402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:22.576241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:22.583684 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa52a164-effa-48ec-9621-9a9e5569dd14 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1320 microversion: 2.25 time: 0.235513 Apr 30 21:11:22.584579 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 217/392] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:22 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:22.896766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:22.912268 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6e72ebd-3398-4a75-853a-8d4b4157133c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.415102 Apr 30 21:11:22.914052 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 176/393] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:22 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:23.363572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:23.364187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:23.385859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:23.387205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:23.396892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:23.399386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:23.399904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:23.401063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:23.403428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:23.404915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:23.406062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:23.406207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:24.047742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:24.055177 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-605b2870-8c82-4022-986a-a1efd78fb10a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1471 microversion: 2.1 time: 0.695470 Apr 30 21:11:24.062911 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 218/394] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:23 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1471 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:24.082207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4fa079d9-60fe-4e7f-a66c-4aeb9025ac90 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc21095790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:24.174610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:24.185853 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4fa079d9-60fe-4e7f-a66c-4aeb9025ac90 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.121695 Apr 30 21:11:24.186941 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 219/395] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:24 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:24.193162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:24.194106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:24.196894 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bfd4d1c8-8f40-4708-aca5-3e6ee338bd9e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.817422 Apr 30 21:11:24.200518 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 177/396] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:23 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:24.200661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:24.200981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:24.201845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:24.202468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:24.212737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:24.214845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:24.234470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:24.235928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:24.239184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:24.239885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:24.296239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:24.307234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:24.309385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:24.314650 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16772673-7c95-4abf-8fc9-04f09a4e65aa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1320 microversion: 2.25 time: 0.126542 Apr 30 21:11:24.320704 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 220/397] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:24 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1320 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:24.331272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-33d07212-85f4-4795-93bb-50ec9cb468fc req-c843fdc2-3303-47a2-b02c-e26a37a0ab31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53e9e70-9d1f-4677-b6e5-19e0a393b42a", "name": "network-vif-plugged", "status": "completed", "tag": "064011e5-feea-444d-a97a-9f2180c4839e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:24.342699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-33d07212-85f4-4795-93bb-50ec9cb468fc req-c843fdc2-3303-47a2-b02c-e26a37a0ab31 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:24.343458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-33d07212-85f4-4795-93bb-50ec9cb468fc req-c843fdc2-3303-47a2-b02c-e26a37a0ab31 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:24.360215 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-33d07212-85f4-4795-93bb-50ec9cb468fc req-c843fdc2-3303-47a2-b02c-e26a37a0ab31 service nova] Creating event network-vif-plugged:064011e5-feea-444d-a97a-9f2180c4839e for instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a on nch2-master-1 Apr 30 21:11:24.366351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-33d07212-85f4-4795-93bb-50ec9cb468fc req-c843fdc2-3303-47a2-b02c-e26a37a0ab31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042983 Apr 30 21:11:24.369075 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 221/398] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:24.606829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:24.617743 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-788b7456-1f24-44db-9ad4-776619062683 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.415596 Apr 30 21:11:24.618721 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 178/399] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:24 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:25.073665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:25.075364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:25.106192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:25.107598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:25.109905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:25.115153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:25.199470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-702a405a-c1cf-4530-877e-3a7ff1531f5f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc2103f550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:25.297081 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-702a405a-c1cf-4530-877e-3a7ff1531f5f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.097923 Apr 30 21:11:25.299856 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 179/400] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:25 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:25.319079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:25.320015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:25.350056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:25.350836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:25.354745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:25.360896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:25.438261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:25.447663 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ccb2342a-3390-42de-a93e-4665c347fbc5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1471 microversion: 2.1 time: 0.378808 Apr 30 21:11:25.453178 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 222/401] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:25 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:25.455085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:25.455953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:25.463968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:25.465211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:25.466309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:25.467004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:25.979736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:25.987538 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-837954b0-da17-4495-a517-26deeda7f8bc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.685812 Apr 30 21:11:25.989056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:25.999376 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 180/402] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:25 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:26.004161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:26.015640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:26.016278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:26.026164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:26.029930 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a764cee2-a48c-4ddb-8a0e-51ea2d7ac12c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.579011 Apr 30 21:11:26.032619 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 223/403] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:25 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:26.034694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:26.035164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:26.035979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:26.036425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:26.312586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8272b5a-491c-4407-9772-681b0f5c7343 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc21095d30>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:26.384360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:26.393981 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-516dd4ae-fc89-40d6-bfa7-89c99da1252e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.393285 Apr 30 21:11:26.395787 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 181/404] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:25 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:26.414628 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8272b5a-491c-4407-9772-681b0f5c7343 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.105869 Apr 30 21:11:26.415382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 224/405] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:26 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:26.466465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:26.467521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:26.479847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:26.480582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:26.481684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:26.482358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:26.693869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:26.702348 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d55f9573-d49c-42f6-bdd1-79033dca0680 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1471 microversion: 2.1 time: 0.240686 Apr 30 21:11:26.711924 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 182/406] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:26 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:27.014088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:27.014088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:27.019337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:27.024053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:27.026521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:27.029665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:27.421207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:27.434196 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b52ae25-0cda-4d29-96a4-9d2967c27f4f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.433635 Apr 30 21:11:27.435581 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 183/407] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:26 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:27.444558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:27.445391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:27.457579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1687816378", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:27.468738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:27.472659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:27.473945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:27.476196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:27.573896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:11:27.818772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:27.821427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:27.822993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:27.829837 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ada9b242-9599-4eae-b08f-d960ac291769 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.390920 Apr 30 21:11:27.830446 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 184/408] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:27 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:27.839034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:27.843615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:27.860165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:27.860836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:27.861834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:27.862547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.089159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:28.089746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:28.090402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:28.090949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:28.091479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:28.106583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:28.108824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.109847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:28.110417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.133706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Getting quotas for project f727d5639c624deeba0d0d7a7d08810e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:28.139511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Getting quotas for user 6a8350c0cb814c66b94775110721dee4 and project f727d5639c624deeba0d0d7a7d08810e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:28.156040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:28.157473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:11:28.161077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:11:28.164738 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e80165c2-a58d-424d-9708-ba3345a20030 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.331834 Apr 30 21:11:28.175289 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 185/409] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:27 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:28.180294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44b062ee-df1f-4d62-acfb-3f6f30288a21 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20fffc10>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:28.244964 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44b062ee-df1f-4d62-acfb-3f6f30288a21 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.068302 Apr 30 21:11:28.245527 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 186/410] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:28 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:28.254261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8c238288-7b9b-439d-b834-2be7b2605d24 req-6b472cfb-f564-4e1a-a944-79791b7d4fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36482df-2cb5-4d30-9ce3-95a6f06f80f0", "name": "network-vif-plugged", "status": "completed", "tag": "376e3c07-c6be-4468-aa0d-25e6e0c6136c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:28.275831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8c238288-7b9b-439d-b834-2be7b2605d24 req-6b472cfb-f564-4e1a-a944-79791b7d4fd3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:28.276544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8c238288-7b9b-439d-b834-2be7b2605d24 req-6b472cfb-f564-4e1a-a944-79791b7d4fd3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.308594 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8c238288-7b9b-439d-b834-2be7b2605d24 req-6b472cfb-f564-4e1a-a944-79791b7d4fd3 service nova] Creating event network-vif-plugged:376e3c07-c6be-4468-aa0d-25e6e0c6136c for instance b36482df-2cb5-4d30-9ce3-95a6f06f80f0 on nch1-master-1 Apr 30 21:11:28.312835 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-864bce92-db09-4db2-b47b-2dacf144c4fa tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314996 Apr 30 21:11:28.320560 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 225/411] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:11:28.327748 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8c238288-7b9b-439d-b834-2be7b2605d24 req-6b472cfb-f564-4e1a-a944-79791b7d4fd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080966 Apr 30 21:11:28.328972 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 187/412] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:28.337269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:28.340425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:28.368090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:28.370516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.373239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:28.374651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.596084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6426b216-5a4d-4272-99f9-54be270b0c78 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:28.596839 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:28.596839 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:28.612115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-6426b216-5a4d-4272-99f9-54be270b0c78 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Apr 30 21:11:28.612115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6426b216-5a4d-4272-99f9-54be270b0c78 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:28.612115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6426b216-5a4d-4272-99f9-54be270b0c78 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117 tempest-InstanceUsageAuditLogNegativeTestJSON-806003117-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.275001 Apr 30 21:11:28.612115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 188/413] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:28.618267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-26ef3d5d-0a5d-4255-b205-4313e160fbb1 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:28.619280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-26ef3d5d-0a5d-4255-b205-4313e160fbb1 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:28.726283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-26ef3d5d-0a5d-4255-b205-4313e160fbb1 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:28.734094 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-26ef3d5d-0a5d-4255-b205-4313e160fbb1 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1220 microversion: 2.1 time: 0.126289 Apr 30 21:11:28.738967 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 189/414] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:28 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:28.753125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:28.754046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:28.763142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:28.768713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.771343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:28.774555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:28.807262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:28.818024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1885317e-2098-4619-b689-2c70e4f91876 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1471 microversion: 2.1 time: 0.500755 Apr 30 21:11:28.818614 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 226/415] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:28 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1471 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:29.135724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:29.166314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-716d3c02-bf28-4bde-b970-462d091e0bf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:29.166314 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:29.166314 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:29.166733 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fd5dc01c-7c4c-4a41-9889-517f4d80c870 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1314 microversion: 2.1 time: 0.422146 Apr 30 21:11:29.167259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-716d3c02-bf28-4bde-b970-462d091e0bf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '8c89d96727ad45f397a2b6e9f0f3f729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b878828e8e3444bb5fc5ef22593d450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:29.171240 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 190/416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:28 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:29.172258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-716d3c02-bf28-4bde-b970-462d091e0bf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:29.177360 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-716d3c02-bf28-4bde-b970-462d091e0bf7 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.355740 Apr 30 21:11:29.182784 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 227/417] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Apr 30 21:11:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 360 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:29.185965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:29.188625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:29.192638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-59a850fb-c685-4b30-a3cd-f149239a6f2c req-1037fd29-f793-4f5e-af8b-008dcf09c045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aab508f-4be3-49d3-bb5f-b19f4f328bcd", "tag": "154e4208-4965-4648-9e7c-f22621d3423a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:29.204137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:29.205492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:29.207031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:29.208695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:29.213662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-59a850fb-c685-4b30-a3cd-f149239a6f2c req-1037fd29-f793-4f5e-af8b-008dcf09c045 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:29.227136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-59a850fb-c685-4b30-a3cd-f149239a6f2c req-1037fd29-f793-4f5e-af8b-008dcf09c045 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:29.255798 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-59a850fb-c685-4b30-a3cd-f149239a6f2c req-1037fd29-f793-4f5e-af8b-008dcf09c045 service nova] Creating event network-changed:154e4208-4965-4648-9e7c-f22621d3423a for instance 0aab508f-4be3-49d3-bb5f-b19f4f328bcd on nch1-master-1 Apr 30 21:11:29.261335 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-59a850fb-c685-4b30-a3cd-f149239a6f2c req-1037fd29-f793-4f5e-af8b-008dcf09c045 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080210 Apr 30 21:11:29.262404 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 228/418] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:29.268976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:29.269905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:29.277082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:29.277534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:29.278369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:29.278802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:29.457032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:29.468183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:29.475640 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c78c1d47-a0ab-4adb-8b4f-4571a0776d40 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.211629 Apr 30 21:11:29.485732 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 229/419] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:29 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:29.485953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:29.485953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:29.485953 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c4fbe858-92a3-48e2-ada9-438fc6c944c9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.310712 Apr 30 21:11:29.530049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e5860bc5-ba66-4ac1-a2d8-00003c20e353 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:29.530049 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:29.530049 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:29.530049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e5860bc5-ba66-4ac1-a2d8-00003c20e353 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '8c89d96727ad45f397a2b6e9f0f3f729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b878828e8e3444bb5fc5ef22593d450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:29.530607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e5860bc5-ba66-4ac1-a2d8-00003c20e353 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:29.530607 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e5860bc5-ba66-4ac1-a2d8-00003c20e353 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492 tempest-InstanceUsageAuditLogNegativeTestJSON-1970687492-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-30 21:11:29" status: 403 len: 128 microversion: 2.1 time: 0.031957 Apr 30 21:11:29.530607 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 230/420] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:11:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-30%2021%3A11%3A29 => generated 128 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:29.530812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 191/421] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:29 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:29.530885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1387ffe4-6a13-4f97-8cce-af3d2b5737da tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc2112f8b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:29.597692 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1387ffe4-6a13-4f97-8cce-af3d2b5737da tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.086504 Apr 30 21:11:29.601809 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 231/422] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:29 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:29.752679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2747d51-7330-49fd-bbc9-cc19e3ede10a tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:29.753436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2747d51-7330-49fd-bbc9-cc19e3ede10a tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:29.844183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:29.844822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:29.865216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:29.871164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:29.871164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:29.871164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:30.018412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2747d51-7330-49fd-bbc9-cc19e3ede10a tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:30.026311 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2747d51-7330-49fd-bbc9-cc19e3ede10a tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1220 microversion: 2.1 time: 0.277541 Apr 30 21:11:30.032736 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 192/423] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:29 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1220 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:30.183172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:30.183856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:30.194624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:30.200086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:30.201315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:30.202047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:30.393504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:30.406085 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a50b689-b5f4-4971-bfb7-74403cf43050 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1471 microversion: 2.1 time: 0.565989 Apr 30 21:11:30.407929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 232/424] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:29 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1471 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:30.494300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:30.495783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:30.511194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:30.514877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:30.516239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:30.520210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:30.807951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:30.820426 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-63a2d3c7-4259-4b9e-acd6-d93ff9ff3bd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.328771 Apr 30 21:11:30.831867 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 233/425] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:30 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:30.843627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:30.844511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:30.853723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:30.853723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:30.854956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:30.855546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:30.959848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:30.968180 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7ddd5b9d-e720-4c04-9d25-247047450a9a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1464 microversion: 2.1 time: 0.790388 Apr 30 21:11:30.968762 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 193/426] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:30 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1464 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:30.994720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2eded694-c2ed-4b99-a934-4e9c3b21c605 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc210285e0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:31.074432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:31.087185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:31.088931 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2eded694-c2ed-4b99-a934-4e9c3b21c605 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.104718 Apr 30 21:11:31.089060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:31.090486 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 194/427] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:30 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:31.091670 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4a0db13-3c42-4abc-84c4-f9fec5f66415 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.257774 Apr 30 21:11:31.096087 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 234/428] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:30 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:31.120692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:31.131640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:31.134259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.135070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.136244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.136812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.282398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:31.297170 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f432d2f-ea0b-48cd-8e68-5aa14c992e62 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1272 microversion: 2.1 time: 0.198311 Apr 30 21:11:31.297724 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 235/429] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:31 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:31.424843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:31.427294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:31.441475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.442264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.444272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.444922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.588743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d54ce01c-7e35-425f-a5bb-904a5fd55af1 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:31.596682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d54ce01c-7e35-425f-a5bb-904a5fd55af1 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Searching by: {'deleted': False, 'project_id': 'a55a9172f01d405db6b58d3b1d54283d'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:31.611097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d54ce01c-7e35-425f-a5bb-904a5fd55af1 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.612191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d54ce01c-7e35-425f-a5bb-904a5fd55af1 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.618888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d54ce01c-7e35-425f-a5bb-904a5fd55af1 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.619651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d54ce01c-7e35-425f-a5bb-904a5fd55af1 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.767573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:31.779238 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a37acf15-e0c0-4da6-8cc8-01d38cb1508c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.357497 Apr 30 21:11:31.781015 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 236/430] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:31 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:31.837930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:31.839155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:31.860858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.866466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.870715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.873614 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d54ce01c-7e35-425f-a5bb-904a5fd55af1 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.781883 Apr 30 21:11:31.873785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.890951 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 195/431] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:11:31 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:11:31.900733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:31.911091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Searching by: {'deleted': False} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:31.930343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.931192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:31.932231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:31.932911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:32.235083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:11:32.467447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:32.468184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:32.928225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:32.937859 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-28ffc00d-8d38-4e2a-a63e-db30c3a1241d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 1.103954 Apr 30 21:11:32.944381 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 237/432] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:31 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:32.949375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84991e4a-adf2-4917-9e61-b239a569e216 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc21072550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:33.036850 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84991e4a-adf2-4917-9e61-b239a569e216 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.089631 Apr 30 21:11:33.039105 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 238/433] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:32 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:33.044031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:33.044654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:33.069054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:33.070572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:33.072631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:33.083259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:33.524301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:33.537066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:33.540404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:33.541662 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef2e23a0-bc5b-4eef-8a55-0ae172ee0e91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.501453 Apr 30 21:11:33.556801 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 239/434] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:33 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:33.574365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:33.575070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:33.581370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:33.581855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:33.582655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:33.583096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:33.704342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:33.718583 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6a748f91-f794-4626-ab7b-fa39ac7e1fb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1278 microversion: 2.1 time: 0.161041 Apr 30 21:11:33.728264 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 240/435] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:33 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:33.738488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:33.739437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:33.756158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:33.756158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:33.756419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:33.756820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.171740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:34.187938 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15ffa76d-bd36-4a21-9ef4-804e106b571f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.451833 Apr 30 21:11:34.188822 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 241/436] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:33 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:34.200773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:34.204932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:34.224148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:34.224842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.225805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:34.227195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.235496 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7c19b3ca-e1cd-4345-a25e-5cfdc49de41e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12600 microversion: 2.1 time: 2.342690 Apr 30 21:11:34.236637 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 196/437] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Apr 30 21:11:31 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12600 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:11:34.257213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f2566d9-b5c7-4a70-81fb-a9f8a259be45 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc21117dc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:34.382524 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f2566d9-b5c7-4a70-81fb-a9f8a259be45 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.144507 Apr 30 21:11:34.388952 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 197/438] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:34 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:34.411436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6c7a6f3-1f17-4cf7-83ed-c33ce410328b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:34.420511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6c7a6f3-1f17-4cf7-83ed-c33ce410328b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Searching by: {'deleted': False, 'project_id': 'a55a9172f01d405db6b58d3b1d54283d'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:34.429899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6c7a6f3-1f17-4cf7-83ed-c33ce410328b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:34.430433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6c7a6f3-1f17-4cf7-83ed-c33ce410328b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.431508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6c7a6f3-1f17-4cf7-83ed-c33ce410328b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:34.431645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6c7a6f3-1f17-4cf7-83ed-c33ce410328b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.499319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6c7a6f3-1f17-4cf7-83ed-c33ce410328b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=039dadc3df264018a5bcb0ece1751446" status: 200 len: 15 microversion: 2.1 time: 0.109229 Apr 30 21:11:34.506166 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 198/439] 10.222.0.23 () {58 vars in 1230 bytes} [Sat Apr 30 21:11:34 2022] GET /compute/v2.1/servers/detail?tenant_id=039dadc3df264018a5bcb0ece1751446 => generated 15 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:11:34.520769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:34.527407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Searching by: {'tenant_id': '039dadc3df264018a5bcb0ece1751446', 'deleted': False} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:34.549430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:34.555888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.557161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:34.559741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.635660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:11:34.809786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:34.810269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:34.998631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:35.017505 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d249431e-0b42-4e89-98e2-ce1560999896 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1504 microversion: 2.1 time: 0.827365 Apr 30 21:11:35.018363 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 242/440] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:34 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1504 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:35.030904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:35.031912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:35.043971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.044712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.046696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.050441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.225720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-782784c7-0743-4e22-8623-d060d1ca2b10 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=039dadc3df264018a5bcb0ece1751446" status: 200 len: 4828 microversion: 2.1 time: 0.707910 Apr 30 21:11:35.226443 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 199/441] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:11:34 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=039dadc3df264018a5bcb0ece1751446 => generated 4828 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:35.234239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:35.235550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:35.250519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.251122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.251919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.252386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.418371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:35.427557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:35.432153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:35.439245 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-07523330-2cfc-485c-878e-d09b45fd7033 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.419596 Apr 30 21:11:35.440182 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 243/442] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:35 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:35.456825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:35.457832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:35.468230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.468995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.470413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.475180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.545995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:35.560770 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-186444dd-760a-44f8-af00-5ffc01848663 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.332561 Apr 30 21:11:35.561561 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 200/443] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:35 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:35.574153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-85bdbf56-16a8-4796-b60e-72c04f56aeb7 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:35.595338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-85bdbf56-16a8-4796-b60e-72c04f56aeb7 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Searching by: {'tenant_id': 'a55a9172f01d405db6b58d3b1d54283d', 'deleted': False} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:35.616906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85bdbf56-16a8-4796-b60e-72c04f56aeb7 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.617458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85bdbf56-16a8-4796-b60e-72c04f56aeb7 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.618373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85bdbf56-16a8-4796-b60e-72c04f56aeb7 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:35.618828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85bdbf56-16a8-4796-b60e-72c04f56aeb7 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:35.698786 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-85bdbf56-16a8-4796-b60e-72c04f56aeb7 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a55a9172f01d405db6b58d3b1d54283d" status: 200 len: 15 microversion: 2.1 time: 0.131289 Apr 30 21:11:35.700351 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 201/444] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:11:35 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a55a9172f01d405db6b58d3b1d54283d => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:11:35.718427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f083b35-635b-4297-bfd5-752c3bee4938 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20d86700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:35.866344 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f083b35-635b-4297-bfd5-752c3bee4938 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.130538 Apr 30 21:11:35.874183 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 202/445] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:35 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:35.881719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d18e1d52-c3d1-491d-aba6-4582ec0c631b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:35.885235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:35.895235 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e1a7c83e-4278-4737-8aa5-a6074cc47c70 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.453470 Apr 30 21:11:35.898170 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 244/446] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:35 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:35.902339 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d18e1d52-c3d1-491d-aba6-4582ec0c631b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.026120 Apr 30 21:11:35.903174 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 203/447] 10.222.0.23 () {58 vars in 1188 bytes} [Sat Apr 30 21:11:35 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:11:35.989315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b5b71057-c01e-4c05-a9a9-b45c6bcb4b4b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:35.989315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b5b71057-c01e-4c05-a9a9-b45c6bcb4b4b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:36.011523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5b71057-c01e-4c05-a9a9-b45c6bcb4b4b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.012254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5b71057-c01e-4c05-a9a9-b45c6bcb4b4b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.016841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5b71057-c01e-4c05-a9a9-b45c6bcb4b4b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.017452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5b71057-c01e-4c05-a9a9-b45c6bcb4b4b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.034844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:36.038361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:36.046479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.048030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.051013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.051815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.335550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:36.344859 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7eeed67b-1af6-4701-9e69-6fe260faada1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1494 microversion: 2.1 time: 0.313956 Apr 30 21:11:36.345793 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 204/448] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:36 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1494 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:36.365519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56b87b5c-cba9-431f-bc87-977fb13f6fa2 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '.version_select at 0x7fdc2130e3a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:36.378665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56b87b5c-cba9-431f-bc87-977fb13f6fa2 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.379426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56b87b5c-cba9-431f-bc87-977fb13f6fa2 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.422779 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56b87b5c-cba9-431f-bc87-977fb13f6fa2 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.064007 Apr 30 21:11:36.430917 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 205/449] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:11:36 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:36.437058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f58324e7-9b44-4f44-98a2-8fb8ea691546 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:36.437971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f58324e7-9b44-4f44-98a2-8fb8ea691546 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:36.447229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f58324e7-9b44-4f44-98a2-8fb8ea691546 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.447994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f58324e7-9b44-4f44-98a2-8fb8ea691546 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.449328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f58324e7-9b44-4f44-98a2-8fb8ea691546 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.449328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f58324e7-9b44-4f44-98a2-8fb8ea691546 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.609588 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b5b71057-c01e-4c05-a9a9-b45c6bcb4b4b tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action" status: 202 len: 0 microversion: 2.1 time: 0.691131 Apr 30 21:11:36.610519 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 245/450] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:35 2022] POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:11:36.616426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:36.619214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:36.627130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.627528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.628785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.629712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.640555 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f58324e7-9b44-4f44-98a2-8fb8ea691546 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1645 microversion: 2.1 time: 0.207908 Apr 30 21:11:36.685991 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 206/451] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:36 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1645 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:36.685991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:36.685991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:36.685991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.686772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.686772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.686772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.851047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:36.861626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:36.864040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:36.866121 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a1d5f5cf-48da-4aff-8642-01f2387bb1e3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.253785 Apr 30 21:11:36.866888 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 246/452] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:36 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:36.881815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:36.885742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:36.886610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '039dadc3df264018a5bcb0ece1751446'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:36.890269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:36.894265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.894710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.895508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:36.895944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:36.898528 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97a656c4-143f-490a-b39e-9883957c83d4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.253929 Apr 30 21:11:36.899365 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 207/453] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:36 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:36.904799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-965459207", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "101af96d-46b7-4982-b0ed-3b0af2fa0ddf"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:37.026754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] validate_networks() for [('101af96d-46b7-4982-b0ed-3b0af2fa0ddf', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:11:37.034564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:11:37.266080 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75a4e0b2-6f89-4091-bdb7-5de4af1ebd7f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.387785 Apr 30 21:11:37.266597 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 247/454] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Apr 30 21:11:36 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:37.281601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3f2df13e-687f-4f74-8468-20c13beb33e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc2112a1f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:37.368103 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3f2df13e-687f-4f74-8468-20c13beb33e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.100253 Apr 30 21:11:37.369954 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 248/455] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:37 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:37.386028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:37.386652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:37.423759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:37.424989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:37.426886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:37.430957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:37.880914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:37.899782 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a9bb961a-6423-481e-a66e-4ba4d50be94f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.520909 Apr 30 21:11:37.900621 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 249/456] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:37 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:37.918456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-47864aaf-9c08-4c07-8e44-563435e67895 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:37.919821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-47864aaf-9c08-4c07-8e44-563435e67895 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:37.937208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47864aaf-9c08-4c07-8e44-563435e67895 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:37.943742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47864aaf-9c08-4c07-8e44-563435e67895 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:37.944912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47864aaf-9c08-4c07-8e44-563435e67895 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:37.945474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47864aaf-9c08-4c07-8e44-563435e67895 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.079849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:38.086320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:38.086320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:38.086320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:38.086320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:38.096912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:38.108694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.109913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:38.110634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.147137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:38.153871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for user 8bd54cdc115e4ae9b202bd06c7658e4a and project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:38.171350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:11:38.174439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:11:38.371303 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2cdd974a-456d-4366-b691-c12ae4478288 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470982 Apr 30 21:11:38.379392 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 208/457] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:11:38.386286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:38.387921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:38.401456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:38.403174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.405223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:38.406238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.438082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-47864aaf-9c08-4c07-8e44-563435e67895 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action" status: 202 len: 0 microversion: 2.1 time: 0.534625 Apr 30 21:11:38.439188 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 250/458] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:37 2022] POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:11:38.445545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:38.446490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:38.462297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:38.473169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.474248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:38.474775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.702648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:38.716604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:38.723083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:38.726851 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e98ce6e5-c90b-404d-bcc3-433707d48235 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.348983 Apr 30 21:11:38.740065 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 209/459] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:38 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:38.760194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ab9e5407-05dd-4c85-af2d-6c42056c7f36 req-f2b6aec6-bb79-4cc7-828a-6db64cffe803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aab508f-4be3-49d3-bb5f-b19f4f328bcd", "name": "network-vif-plugged", "status": "completed", "tag": "154e4208-4965-4648-9e7c-f22621d3423a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:38.784349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ab9e5407-05dd-4c85-af2d-6c42056c7f36 req-f2b6aec6-bb79-4cc7-828a-6db64cffe803 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:38.785054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ab9e5407-05dd-4c85-af2d-6c42056c7f36 req-f2b6aec6-bb79-4cc7-828a-6db64cffe803 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:38.813264 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ab9e5407-05dd-4c85-af2d-6c42056c7f36 req-f2b6aec6-bb79-4cc7-828a-6db64cffe803 service nova] Creating event network-vif-plugged:154e4208-4965-4648-9e7c-f22621d3423a for instance 0aab508f-4be3-49d3-bb5f-b19f4f328bcd on nch1-master-1 Apr 30 21:11:38.828644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ab9e5407-05dd-4c85-af2d-6c42056c7f36 req-f2b6aec6-bb79-4cc7-828a-6db64cffe803 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082296 Apr 30 21:11:38.829373 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 210/460] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:38.845720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-652081cd-0980-4394-bfb9-94407effcedd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20d7e940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:38.873072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:38.882484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b0d0d725-1e3f-4535-a016-961ea1fdd201 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.442080 Apr 30 21:11:38.893492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 251/461] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:38 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:38.900290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-754b3327-1b1a-4622-826e-6757caf9cb25 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:38.901118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-754b3327-1b1a-4622-826e-6757caf9cb25 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:38.972644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-652081cd-0980-4394-bfb9-94407effcedd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.135829 Apr 30 21:11:38.973467 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 211/462] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:38 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:38.991817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d09c236a-525a-40af-9b85-ed6526a6a154 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:38.992560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d09c236a-525a-40af-9b85-ed6526a6a154 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:39.015850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09c236a-525a-40af-9b85-ed6526a6a154 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:39.016566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09c236a-525a-40af-9b85-ed6526a6a154 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:39.017357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-754b3327-1b1a-4622-826e-6757caf9cb25 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:39.017727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09c236a-525a-40af-9b85-ed6526a6a154 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:39.018344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09c236a-525a-40af-9b85-ed6526a6a154 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:39.039274 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-754b3327-1b1a-4622-826e-6757caf9cb25 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1210 microversion: 2.1 time: 0.142136 Apr 30 21:11:39.039868 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 252/463] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:38 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1210 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:39.056394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-dd08921a-e67b-4f7f-ada6-621e9acd5c1d req-dacec4c4-c3c9-4bca-81dd-3fc2591e0109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9445f840-9b08-41a7-b9b5-48c93312189c", "tag": "f32f0d5d-bade-4f65-8f83-41da1c27b970"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:39.072609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dd08921a-e67b-4f7f-ada6-621e9acd5c1d req-dacec4c4-c3c9-4bca-81dd-3fc2591e0109 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:39.075444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dd08921a-e67b-4f7f-ada6-621e9acd5c1d req-dacec4c4-c3c9-4bca-81dd-3fc2591e0109 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:39.102930 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-dd08921a-e67b-4f7f-ada6-621e9acd5c1d req-dacec4c4-c3c9-4bca-81dd-3fc2591e0109 service nova] Creating event network-changed:f32f0d5d-bade-4f65-8f83-41da1c27b970 for instance 9445f840-9b08-41a7-b9b5-48c93312189c on nch2-master-1 Apr 30 21:11:39.116910 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-dd08921a-e67b-4f7f-ada6-621e9acd5c1d req-dacec4c4-c3c9-4bca-81dd-3fc2591e0109 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073900 Apr 30 21:11:39.117708 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 253/464] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:39.123618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:39.130059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:39.143973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:39.145584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:39.146936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:39.148892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:39.641411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d09c236a-525a-40af-9b85-ed6526a6a154 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1615 microversion: 2.1 time: 0.661491 Apr 30 21:11:39.645115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 212/465] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:38 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1615 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:39.739615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:39.764077 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee621afa-8741-44cc-87e8-dc645f7fbfb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.643027 Apr 30 21:11:39.764844 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 254/466] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:39 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:39.779937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3685553-2d16-4fe8-8608-aa5955165a99 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:39.784325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e3685553-2d16-4fe8-8608-aa5955165a99 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:39.793772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3685553-2d16-4fe8-8608-aa5955165a99 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:39.796616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3685553-2d16-4fe8-8608-aa5955165a99 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:39.797786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3685553-2d16-4fe8-8608-aa5955165a99 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:39.798439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3685553-2d16-4fe8-8608-aa5955165a99 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:39.851689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59ccef81-7b2b-407f-a367-b81387b9f737 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Action: 'create', calling method: .version_select at 0x7fdc20f98040>, body: {"keypair": {"name": "tempest-keypair-1936996644", "type": "ssh", "user_id": "57ae5450bfe2441885e623b19c6bd7ce"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:39.905478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-59ccef81-7b2b-407f-a367-b81387b9f737 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:39.920891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-59ccef81-7b2b-407f-a367-b81387b9f737 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for user a392e31a13bb403da7f9bb2261b9d9a4 and project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:40.034076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e3685553-2d16-4fe8-8608-aa5955165a99 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1615 microversion: 2.1 time: 0.265329 Apr 30 21:11:40.045099 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 255/467] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:39 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1615 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:40.054711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:40.055330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:40.068836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.070035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.071159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.071830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.226999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-59ccef81-7b2b-407f-a367-b81387b9f737 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:40.229278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-59ccef81-7b2b-407f-a367-b81387b9f737 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for user a392e31a13bb403da7f9bb2261b9d9a4 and project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:40.267092 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59ccef81-7b2b-407f-a367-b81387b9f737 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.617675 Apr 30 21:11:40.268457 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 213/468] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Apr 30 21:11:39 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 622 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:11:40.277116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:40.278202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:40.290183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.295860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.296888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.297496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.303441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:40.312403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:40.313948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:40.316878 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a33fa890-8211-4a01-b807-dac07720975e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1362 microversion: 2.25 time: 0.280307 Apr 30 21:11:40.327993 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 256/469] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:40 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:40.333097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-69dbafaf-2ac9-4d23-883e-acbfc4fd78aa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20ecde50>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:40.417431 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-69dbafaf-2ac9-4d23-883e-acbfc4fd78aa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.088054 Apr 30 21:11:40.418576 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 257/470] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:40 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:40.423438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:40.438097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:40.447906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.451135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.464900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.464900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.542147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:40.552271 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b5d45a64-5638-4e07-9d5b-8ba2ae1cea7c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.281539 Apr 30 21:11:40.562731 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 214/471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:40 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:40.568216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:40.571576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:40.576733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.577412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.578427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.579213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.667559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:40.678514 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a1995539-1868-46d1-862f-e08136d80b68 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1214 microversion: 2.1 time: 0.114411 Apr 30 21:11:40.679346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 215/472] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:40 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:40.684789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88355885-14f6-4de2-8b1d-cbb8256a96e3 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Action: 'create', calling method: .version_select at 0x7fdc2103f4c0>, body: {"keypair": {"name": "tempest-keypair-421395082", "type": "ssh", "user_id": "57ae5450bfe2441885e623b19c6bd7ce"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:40.710454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-88355885-14f6-4de2-8b1d-cbb8256a96e3 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:40.722383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-88355885-14f6-4de2-8b1d-cbb8256a96e3 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for user a392e31a13bb403da7f9bb2261b9d9a4 and project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:40.722621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:11:40.857933 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a33fb81d-fdf2-43ad-a774-ba6900f3dbe9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1649 microversion: 2.1 time: 0.437672 Apr 30 21:11:40.867267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 258/473] 10.222.0.23 () {58 vars in 1189 bytes} [Sat Apr 30 21:11:40 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1649 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:40.879890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:40.880793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:40.888803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.889521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:40.892024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:40.892726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.015964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-88355885-14f6-4de2-8b1d-cbb8256a96e3 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:41.056637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-88355885-14f6-4de2-8b1d-cbb8256a96e3 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for user a392e31a13bb403da7f9bb2261b9d9a4 and project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:41.085029 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88355885-14f6-4de2-8b1d-cbb8256a96e3 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.403798 Apr 30 21:11:41.086095 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 216/474] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Apr 30 21:11:40 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 406 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:11:41.115859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ee10f73f-150e-402a-92fc-99de60ee76c9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:41.122452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ee10f73f-150e-402a-92fc-99de60ee76c9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:11:41.131977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:41.144330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee10f73f-150e-402a-92fc-99de60ee76c9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.155941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1311eb85-964d-415e-b7f3-0448120e2ef2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.272282 Apr 30 21:11:41.155941 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 259/475] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:40 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:41.156208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee10f73f-150e-402a-92fc-99de60ee76c9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.156208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee10f73f-150e-402a-92fc-99de60ee76c9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.156208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee10f73f-150e-402a-92fc-99de60ee76c9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.162249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96d95c20-1f76-4094-8848-1f495b8c0aaa tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Calling method '.version_select at 0x7fdc21010a60>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:41.192843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96d95c20-1f76-4094-8848-1f495b8c0aaa tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1936996644?user_id=57ae5450bfe2441885e623b19c6bd7ce" status: 200 len: 706 microversion: 2.10 time: 0.045967 Apr 30 21:11:41.193787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 260/476] 10.222.0.23 () {60 vars in 1339 bytes} [Sat Apr 30 21:11:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1936996644?user_id=57ae5450bfe2441885e623b19c6bd7ce => generated 706 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:11:41.205354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-477d86aa-b6e5-48b3-a7ac-88622f793e47 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Action: 'create', calling method: .version_select at 0x7fdc21010700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1490639662", "type": "ssh"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:41.248349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-477d86aa-b6e5-48b3-a7ac-88622f793e47 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:41.253867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-477d86aa-b6e5-48b3-a7ac-88622f793e47 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for user a392e31a13bb403da7f9bb2261b9d9a4 and project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:41.357069 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ee10f73f-150e-402a-92fc-99de60ee76c9 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.269523 Apr 30 21:11:41.358132 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 217/477] 10.222.0.23 () {58 vars in 1195 bytes} [Sat Apr 30 21:11:41 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:11:41.365307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:41.365307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:41.376130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.376711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.378157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.378729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.575334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:41.585989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:41.587641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:41.588821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b6bdbd78-e818-4ae2-abd5-0e0006b69c5c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1559 microversion: 2.25 time: 0.229929 Apr 30 21:11:41.589509 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 218/478] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:41 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:41.615442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4f8cd9dc-b0bc-45e9-b0b4-ab748366a521 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:41.618945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4f8cd9dc-b0bc-45e9-b0b4-ab748366a521 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:41.629164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f8cd9dc-b0bc-45e9-b0b4-ab748366a521 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.629635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f8cd9dc-b0bc-45e9-b0b4-ab748366a521 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.630653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f8cd9dc-b0bc-45e9-b0b4-ab748366a521 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.631278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f8cd9dc-b0bc-45e9-b0b4-ab748366a521 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.712994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-477d86aa-b6e5-48b3-a7ac-88622f793e47 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:41.717498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-477d86aa-b6e5-48b3-a7ac-88622f793e47 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Getting quotas for user a392e31a13bb403da7f9bb2261b9d9a4 and project 663dac500bee407cba883268de6ff8cf. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:41.735120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-477d86aa-b6e5-48b3-a7ac-88622f793e47 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.10 time: 0.534195 Apr 30 21:11:41.736309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 261/479] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Apr 30 21:11:41 2022] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 536 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:11:41.741486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64081d2e-013d-411f-9a56-9d7a600524df tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20ecd700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:41.851035 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-64081d2e-013d-411f-9a56-9d7a600524df tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.113047 Apr 30 21:11:41.856915 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 262/480] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:41 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:41.871739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:41.873100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:41.880675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.881114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:41.882255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:41.882711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.065413 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4f8cd9dc-b0bc-45e9-b0b4-ab748366a521 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action" status: 202 len: 0 microversion: 2.1 time: 0.474425 Apr 30 21:11:42.066962 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 219/481] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:41 2022] POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:11:42.163728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:42.172840 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4bb8649b-5e89-43da-a885-ae16554ff634 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.314730 Apr 30 21:11:42.173444 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 263/482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:41 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:42.196084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:42.196997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:42.205430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.206213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.210388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.210388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.374137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:42.382468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:42.383750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:42.387534 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6263fba4-542f-428b-9399-761173292537 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1270 microversion: 2.1 time: 0.195637 Apr 30 21:11:42.388134 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 264/483] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:42 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:42.390839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.391267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.392065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.392664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.394263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b469c345-ec9d-4522-aa18-d37f1fff1548 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Calling method '.version_select at 0x7fdc20e0e310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:42.397087 ncdv-master-1 devstack@n-api.service[130671]: WARNING oslo_db.sqlalchemy.utils [None req-b469c345-ec9d-4522-aa18-d37f1fff1548 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Apr 30 21:11:42.409249 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b469c345-ec9d-4522-aa18-d37f1fff1548 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=57ae5450bfe2441885e623b19c6bd7ce" status: 200 len: 1113 microversion: 2.10 time: 0.019999 Apr 30 21:11:42.416312 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 265/484] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Apr 30 21:11:42 2022] GET /compute/v2.1/os-keypairs?user_id=57ae5450bfe2441885e623b19c6bd7ce => generated 1113 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:42.423453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:42.425332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:42.444871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.444871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.444871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.444871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.585188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid 0aab508f-4be3-49d3-bb5f-b19f4f328bcd {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:11:42.655721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:42.656159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:42.656643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:42.657065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:42.657486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:42.695835 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c5c5edf0-7183-444e-81e2-98eb82917776 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 2052 microversion: 2.25 time: 0.627407 Apr 30 21:11:42.696958 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 220/485] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:42 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 2052 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:42.703532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:42.704423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:42.711151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.712108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:42.713107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:42.713740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.016945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:43.026407 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f1dcbce-7c52-4c9b-9ffa-79a63e30a0bc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.328103 Apr 30 21:11:43.040890 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 221/486] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:42 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:43.048081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8b08d47c-d422-4670-b7cc-b23bb6829a9f tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Calling method '.version_select at 0x7fdc20f98040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.184206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8b08d47c-d422-4670-b7cc-b23bb6829a9f tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1490639662" status: 204 len: 0 microversion: 2.10 time: 0.142051 Apr 30 21:11:43.189430 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 222/487] 10.222.0.23 () {60 vars in 1324 bytes} [Sat Apr 30 21:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1490639662 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:11:43.198762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.201797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:43.205197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:43.218163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.218625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.219434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.219883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.229485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.230042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.232112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.232112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.323153 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff5bfbb4-859c-4e9c-abb3-909c35157fb8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action" status: 202 len: 1068 microversion: 2.1 time: 0.904579 Apr 30 21:11:43.349358 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 266/488] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:42 2022] POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action => generated 1068 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 30 21:11:43.354252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92471256-5fc5-4c81-adce-93d47b8f5905 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20eac700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.440848 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92471256-5fc5-4c81-adce-93d47b8f5905 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.090047 Apr 30 21:11:43.446820 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 267/489] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:43 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:43.458189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.459242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:43.469929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.470478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.471353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.471867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.530453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid 0aab508f-4be3-49d3-bb5f-b19f4f328bcd {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:11:43.547796 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5db3889a-9c76-4719-98cc-5521407b9813 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 2052 microversion: 2.25 time: 0.356622 Apr 30 21:11:43.548713 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 223/490] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:43 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 2052 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:43.553417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-499808bf-4a96-4c2d-b0e1-5c4edec2d655 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Calling method '.version_select at 0x7fdc20d8a160>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.680655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:43.705320 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9781940-37d6-40f6-9fc9-71d5a44706ad tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.253016 Apr 30 21:11:43.717232 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 268/491] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:43 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:43.732395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.732395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:43.736385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.736930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.737728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.738243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.898408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:43.905946 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c5820996-1281-4a1f-b1b8-fde068e90cdd tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.187492 Apr 30 21:11:43.906508 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 269/492] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:43 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:43.910957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.911703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:43.919273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.922156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.922156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.922156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.945641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-499808bf-4a96-4c2d-b0e1-5c4edec2d655 tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421395082?user_id=57ae5450bfe2441885e623b19c6bd7ce" status: 204 len: 0 microversion: 2.10 time: 0.394907 Apr 30 21:11:43.950558 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 224/493] 10.222.0.23 () {60 vars in 1339 bytes} [Sat Apr 30 21:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421395082?user_id=57ae5450bfe2441885e623b19c6bd7ce => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:11:43.955468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1a5d9a22-dd66-472e-b1de-6d216535e7a4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:43.956974 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:43.956974 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:43.959562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a5d9a22-dd66-472e-b1de-6d216535e7a4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.960448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a5d9a22-dd66-472e-b1de-6d216535e7a4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.961606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a5d9a22-dd66-472e-b1de-6d216535e7a4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:43.962089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a5d9a22-dd66-472e-b1de-6d216535e7a4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:43.999006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1a5d9a22-dd66-472e-b1de-6d216535e7a4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047049 Apr 30 21:11:44.007290 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 225/494] 10.222.0.23 () {60 vars in 1216 bytes} [Sat Apr 30 21:11:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:11:44.015367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a7e464e-e305-4774-9326-e0f0ee6609fc tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] Calling method '.version_select at 0x7fdc20d26670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:44.189218 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a7e464e-e305-4774-9326-e0f0ee6609fc tempest-KeyPairsV210TestJSON-2079168072 tempest-KeyPairsV210TestJSON-2079168072-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936996644?user_id=57ae5450bfe2441885e623b19c6bd7ce" status: 204 len: 0 microversion: 2.10 time: 0.178340 Apr 30 21:11:44.197422 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 226/495] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936996644?user_id=57ae5450bfe2441885e623b19c6bd7ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:11:44.214635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:44.218525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:44.234443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:44.235315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:44.236410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:44.237113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:44.258678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:44.262758 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43841e4a-4d8a-4268-a462-ff565c4e57aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.355202 Apr 30 21:11:44.263518 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 270/496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:43 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:44.291192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:44.295719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:44.309779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:44.310626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'flavor' on Instance uuid 0aab508f-4be3-49d3-bb5f-b19f4f328bcd {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:11:44.314788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:44.320063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:44.323449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:44.344337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Going to try to live migrate instance to nch2-master-1 {{(pid=130670) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:11:44.664135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:44.679064 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0bed48ac-954b-449f-aff3-4db131b6c26e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.412604 Apr 30 21:11:44.679811 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 271/497] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:44 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:44.713282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f42418c2-5f92-4044-a45f-07ac922a847f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20dbeee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:44.801440 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f42418c2-5f92-4044-a45f-07ac922a847f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1412 microversion: 2.1 time: 0.104820 Apr 30 21:11:44.802951 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 272/498] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:44 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:44.812451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:44.812451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:44.819559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:44.820199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:44.821153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:44.821742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:45.059259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:45.067763 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a4ad9a4-1c3c-4687-8709-16a4210dcb88 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.263585 Apr 30 21:11:45.079223 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 273/499] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:44 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:45.084310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:45.084917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:45.091897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:45.092707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:45.093808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:45.094397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:45.354109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:45.361892 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c7a6187-e5f5-4e78-a83f-cc2726a25098 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.281229 Apr 30 21:11:45.367354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 274/500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:45 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:45.373014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:45.375183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:45.391120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:45.391576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:45.394477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:45.397616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:45.596255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:45.605936 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dbfa4762-9ec7-4937-a4cd-06e03f3280f5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.236694 Apr 30 21:11:45.606804 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 275/501] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:45 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:45.919258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55b1ffd3-c562-4d5a-b6ba-c53eb019d48b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:45.930915 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55b1ffd3-c562-4d5a-b6ba-c53eb019d48b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.322870 Apr 30 21:11:45.938949 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 276/502] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:11:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:45.944809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:45.945517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:45.953415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:45.953998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:45.955031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:45.955610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:46.137301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:46.146076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5915019-79a1-46bc-88bd-5e197cce32c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.205822 Apr 30 21:11:46.147269 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 277/503] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:45 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:46.152851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13aee66a-c159-4dca-a41f-f7b530a99cda tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20d5baf0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:46.220953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-13aee66a-c159-4dca-a41f-f7b530a99cda tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1421 microversion: 2.1 time: 0.072438 Apr 30 21:11:46.221877 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 278/504] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:46 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1421 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:46.433447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-331ce074-b1b3-444f-a3a0-dc4a2fbf3fcc tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1034060174", "id": 91343643, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:46.435788 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:46.435788 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:46.518283 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-331ce074-b1b3-444f-a3a0-dc4a2fbf3fcc tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.293562 Apr 30 21:11:46.519528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 279/505] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:46 2022] POST /compute/v2.1/flavors => generated 419 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:46.526052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d879a694-960a-4180-a000-0c55e74ee992 req-b3de9e6e-6ece-483d-bf98-d5c7c8c3c007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9445f840-9b08-41a7-b9b5-48c93312189c", "name": "network-vif-plugged", "status": "completed", "tag": "f32f0d5d-bade-4f65-8f83-41da1c27b970"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:46.540169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d879a694-960a-4180-a000-0c55e74ee992 req-b3de9e6e-6ece-483d-bf98-d5c7c8c3c007 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:46.540620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d879a694-960a-4180-a000-0c55e74ee992 req-b3de9e6e-6ece-483d-bf98-d5c7c8c3c007 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:46.551474 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d879a694-960a-4180-a000-0c55e74ee992 req-b3de9e6e-6ece-483d-bf98-d5c7c8c3c007 service nova] Creating event network-vif-plugged:f32f0d5d-bade-4f65-8f83-41da1c27b970 for instance 9445f840-9b08-41a7-b9b5-48c93312189c on nch2-master-1 Apr 30 21:11:46.556703 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d879a694-960a-4180-a000-0c55e74ee992 req-b3de9e6e-6ece-483d-bf98-d5c7c8c3c007 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035745 Apr 30 21:11:46.557741 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 280/506] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:46.564424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:46.566034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:46.572134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:46.572584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:46.573557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:46.574633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:46.704810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:46.712595 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ded4ac77-52b9-4a65-bd4c-9375d7dfde36 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.153614 Apr 30 21:11:46.717871 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 281/507] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:46 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:46.719250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d501e148-f9b5-47ef-93e8-5ec82251f46b req-659f2f24-82f6-4f4f-8e49-81fe37540a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f26a54-dfce-45a0-9dc2-3bd5be9f87c8", "tag": "4306ca96-09e1-476e-90ee-9c1a1813cb5f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:46.735753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d501e148-f9b5-47ef-93e8-5ec82251f46b req-659f2f24-82f6-4f4f-8e49-81fe37540a3e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:46.736131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d501e148-f9b5-47ef-93e8-5ec82251f46b req-659f2f24-82f6-4f4f-8e49-81fe37540a3e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:46.755684 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d501e148-f9b5-47ef-93e8-5ec82251f46b req-659f2f24-82f6-4f4f-8e49-81fe37540a3e service nova] Creating event network-changed:4306ca96-09e1-476e-90ee-9c1a1813cb5f for instance 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 on nch2-master-1 Apr 30 21:11:46.763349 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d501e148-f9b5-47ef-93e8-5ec82251f46b req-659f2f24-82f6-4f4f-8e49-81fe37540a3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048820 Apr 30 21:11:46.764859 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 282/508] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:46.772687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37cb2d18-1345-495b-b4c1-25137c269840 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20eac700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:46.828058 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37cb2d18-1345-495b-b4c1-25137c269840 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 200 len: 1421 microversion: 2.1 time: 0.060786 Apr 30 21:11:46.835594 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 283/509] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:46 2022] GET /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 1421 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:46.835594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:46.835594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:46.841708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:46.842189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:46.842986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:46.843430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:46.990285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:46.997657 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5d881afb-4661-4a1b-84c6-cee555cc0c72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.167758 Apr 30 21:11:46.998275 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 284/510] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:46 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:47.002545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb6a1d78-50c7-45d0-93c3-14d683410b9d tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:47.009783 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb6a1d78-50c7-45d0-93c3-14d683410b9d tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.010528 Apr 30 21:11:47.010331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 285/511] 10.222.0.23 () {58 vars in 1181 bytes} [Sat Apr 30 21:11:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:11:47.014686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:47.015285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:47.021703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:47.022201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:47.022991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:47.023439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:47.183790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:47.193215 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3f1ba5b9-9bff-4378-8d38-51badda693fa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.181456 Apr 30 21:11:47.204013 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 286/512] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:47 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:47.209154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16f9a600-851f-4e2a-a04b-8ed4c4115359 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20eac8b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:48.434102 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98c8585f-2ed1-42a2-a8b4-969df111790c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd/action" status: 202 len: 0 microversion: 2.25 time: 4.235070 Apr 30 21:11:48.439206 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 227/513] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:11:44 2022] POST /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd/action => generated 0 bytes in 4241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:11:48.444890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-28c5fc25-972f-4f09-a97c-063251901c69 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1367097589", "id": 701361983, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:48.447431 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:48.447431 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:11:48.541516 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-28c5fc25-972f-4f09-a97c-063251901c69 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.099994 Apr 30 21:11:48.541803 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 228/514] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:48 2022] POST /compute/v2.1/flavors => generated 422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:48.547521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:48.548174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:48.557939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.558517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.559374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.561633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.672103 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16f9a600-851f-4e2a-a04b-8ed4c4115359 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 204 len: 0 microversion: 2.1 time: 1.466719 Apr 30 21:11:48.672670 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 287/515] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:47 2022] DELETE /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 0 bytes in 1468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:11:48.682356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:48.683391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:48.698553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.698553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.698553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.698553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.737043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:48.745111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d49a8712-68a9-4bf9-8995-d30b8307fbb6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1476 microversion: 2.1 time: 0.201711 Apr 30 21:11:48.745701 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 229/516] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:48 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:48.766147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:48.766778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:48.773979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.774089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.774843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.775335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.908842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:48.917555 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c192adf-f3fd-46ac-b8c9-520000f5e594 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1320 microversion: 2.1 time: 0.243441 Apr 30 21:11:48.923328 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 288/517] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:48 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:48.923328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:48.923855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:48.929849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.930384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.931249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.931762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.950873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:48.958873 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e98f35c-2174-49fd-ad4b-1a43048a0078 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.209809 Apr 30 21:11:48.959992 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 230/518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:48 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:48.964895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:48.965593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:48.972131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.976976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:48.976976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:48.976976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:49.132214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:49.142497 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0e2d7aad-0ccb-4848-a9ed-0ab7c0d55353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.223126 Apr 30 21:11:49.145621 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 289/519] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:48 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:49.153627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a06a947-261b-4a4b-9415-9ee6ae59d4e1 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:49.166506 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a06a947-261b-4a4b-9415-9ee6ae59d4e1 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019560 Apr 30 21:11:49.167123 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 290/520] 10.222.0.23 () {58 vars in 1181 bytes} [Sat Apr 30 21:11:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:11:49.171605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:49.172191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:49.178320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:49.178772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:49.179551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:49.179985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:49.180416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:49.189170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:49.190972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:49.192125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f0c980db-c84a-4fff-8694-4dcce98b0e27 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.230944 Apr 30 21:11:49.192687 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 231/521] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:48 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:49.197973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3185b223-3062-4f85-9fd1-b2195ba97f9e tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Action: 'create', calling method: .version_select at 0x7fdc20c7f9d0>, body: {"keypair": {"name": "tempest-keypair-197166924"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:49.208161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:11:49.211805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3185b223-3062-4f85-9fd1-b2195ba97f9e tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:49.215521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3185b223-3062-4f85-9fd1-b2195ba97f9e tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for user c816e51510ac44c9a2b3f5c022b5a3c3 and project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:49.578002 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4d76294-2ac3-409a-bbd6-a07f9072da1b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 204 len: 0 microversion: 2.1 time: 0.408834 Apr 30 21:11:49.581110 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 291/522] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:11:49 2022] DELETE /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:11:49.765215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:49.765215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:49.773530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:49.774136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:49.775423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:49.775969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:49.820491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3185b223-3062-4f85-9fd1-b2195ba97f9e tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:49.824979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3185b223-3062-4f85-9fd1-b2195ba97f9e tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for user c816e51510ac44c9a2b3f5c022b5a3c3 and project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:49.846043 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3185b223-3062-4f85-9fd1-b2195ba97f9e tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.652284 Apr 30 21:11:49.847902 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 232/523] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:11:49 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:49.851859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-839377038", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c1b131fa-a537-4b70-82cc-dbac26cd0254"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:49.917631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] validate_networks() for [('c1b131fa-a537-4b70-82cc-dbac26cd0254', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:11:50.100005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:50.108001 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6a9a09be-1dbd-4394-b96b-2ac695e40046 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1475 microversion: 2.1 time: 0.349235 Apr 30 21:11:50.108834 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 292/524] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:49 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1475 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:50.309682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e096a063-5067-4dd5-807d-04c4c97b5234 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20f4b670>, body: {"quota_set": {"ram": "5120"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:50.378508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e096a063-5067-4dd5-807d-04c4c97b5234 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.378960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e096a063-5067-4dd5-807d-04c4c97b5234 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.383225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e096a063-5067-4dd5-807d-04c4c97b5234 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.383225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e096a063-5067-4dd5-807d-04c4c97b5234 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.501780 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e096a063-5067-4dd5-807d-04c4c97b5234 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3" status: 200 len: 148 microversion: 2.57 time: 0.391679 Apr 30 21:11:50.502621 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 293/525] 10.222.0.23 () {62 vars in 1302 bytes} [Sat Apr 30 21:11:50 2022] PUT /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3 => generated 148 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:11:50.511981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:50.512874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:50.520754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.521360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.522366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.522947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.533396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:50.534791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:50.535390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:50.536032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:50.537674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:50.554925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.554925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.554925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.554925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.581367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:50.588017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for user 6e275a4d32754fe9a164bd79c3774b97 and project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:50.600596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:11:50.603333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:11:50.743236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:50.752205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a026ed3-64d1-4247-99b6-b51e18d73754 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1470 microversion: 2.1 time: 0.248393 Apr 30 21:11:50.752781 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 294/526] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:50 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:50.757171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:50.757811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:50.763698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.764143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.766785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.766785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.800096 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d423db69-11c8-4093-9328-06fc609b83a4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952210 Apr 30 21:11:50.800843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 233/527] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:11:50.813857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:50.818361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:50.822764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.823229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:50.824555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:50.825294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.342757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:51.353499 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-806eadb0-5a6e-4930-a958-6c8b471b58a1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.599582 Apr 30 21:11:51.354361 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 295/528] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:50 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:51.362009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:51.363126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:51.373689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.375576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.376253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.376843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.413459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:51.413459 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b38d0cd6-cd37-4a80-9b57-03e70c067f6f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.602661 Apr 30 21:11:51.413459 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 234/529] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:50 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:51.424130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-18b167c5-34bd-480c-ad39-0e4b4ea7c638 req-e2cc6c99-a508-455d-b618-b3de595eae47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63136ef9-512e-4d74-9427-5db9addb1129", "name": "network-vif-unplugged", "status": "completed", "tag": "5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:51.442774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-18b167c5-34bd-480c-ad39-0e4b4ea7c638 req-e2cc6c99-a508-455d-b618-b3de595eae47 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.443218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-18b167c5-34bd-480c-ad39-0e4b4ea7c638 req-e2cc6c99-a508-455d-b618-b3de595eae47 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.470101 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-18b167c5-34bd-480c-ad39-0e4b4ea7c638 req-e2cc6c99-a508-455d-b618-b3de595eae47 service nova] Creating event network-vif-unplugged:5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b for instance 63136ef9-512e-4d74-9427-5db9addb1129 on nch1-master-1 Apr 30 21:11:51.486064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-18b167c5-34bd-480c-ad39-0e4b4ea7c638 req-e2cc6c99-a508-455d-b618-b3de595eae47 service nova] Instance 63136ef9-512e-4d74-9427-5db9addb1129 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:11:51.498131 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-18b167c5-34bd-480c-ad39-0e4b4ea7c638 req-e2cc6c99-a508-455d-b618-b3de595eae47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086505 Apr 30 21:11:51.501843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 235/530] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:51.505707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f40cf8d0-b752-4992-ac08-d0ec258baf7a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Calling method '.version_select at 0x7fdc20cfc310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:51.662734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f40cf8d0-b752-4992-ac08-d0ec258baf7a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.663061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f40cf8d0-b752-4992-ac08-d0ec258baf7a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.663666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f40cf8d0-b752-4992-ac08-d0ec258baf7a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.666256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f40cf8d0-b752-4992-ac08-d0ec258baf7a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.711603 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f40cf8d0-b752-4992-ac08-d0ec258baf7a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3/detail" status: 200 len: 463 microversion: 2.57 time: 0.207324 Apr 30 21:11:51.711603 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 236/531] 10.222.0.23 () {60 vars in 1303 bytes} [Sat Apr 30 21:11:51 2022] GET /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3/detail => generated 463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:11:51.834465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:51.843485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:51.844177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:51.851772 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e07b473e-f4b7-4a07-8a0c-aa0c7f924d5e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.495994 Apr 30 21:11:51.852572 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 296/532] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:51 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:51.857959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:51.858571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:51.877401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.881248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.882330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.882932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.920890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:51.929536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:51.933120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.934108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.934968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:51.937749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:51.989574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:11:52.095205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:52.110181 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ed7d2b6-e6ad-4676-8d66-e8682e575395 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1211 microversion: 2.1 time: 0.256237 Apr 30 21:11:52.116052 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 297/533] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:51 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1211 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:52.123797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:52.124800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:52.142511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.144479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.145669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.146389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.375545 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7db8ac33-f186-4cab-b687-23ee519e2d0c tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 204 len: 0 microversion: 2.1 time: 0.662783 Apr 30 21:11:52.376390 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 237/534] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:11:51 2022] DELETE /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:11:52.385192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0d032644-63de-4c28-9827-aae6dc5c444b req-77959d4c-048f-4901-8d60-4c60a5097290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53e9e70-9d1f-4677-b6e5-19e0a393b42a", "name": "network-vif-unplugged", "status": "completed", "tag": "064011e5-feea-444d-a97a-9f2180c4839e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:52.418720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0d032644-63de-4c28-9827-aae6dc5c444b req-77959d4c-048f-4901-8d60-4c60a5097290 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.422014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0d032644-63de-4c28-9827-aae6dc5c444b req-77959d4c-048f-4901-8d60-4c60a5097290 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.441052 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0d032644-63de-4c28-9827-aae6dc5c444b req-77959d4c-048f-4901-8d60-4c60a5097290 service nova] Creating event network-vif-unplugged:064011e5-feea-444d-a97a-9f2180c4839e for instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a on nch2-master-1 Apr 30 21:11:52.464077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0d032644-63de-4c28-9827-aae6dc5c444b req-77959d4c-048f-4901-8d60-4c60a5097290 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082001 Apr 30 21:11:52.465570 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 238/535] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:52.483431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20c7f040>, body: {"quota_set": {"ram": "2048"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:52.560436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:52.568878 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-65f3bba7-0e5c-427e-b190-5c1c23e0c24a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1475 microversion: 2.1 time: 0.451014 Apr 30 21:11:52.570519 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 298/536] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:52 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1475 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:52.576444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:52.577281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:52.583751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.584638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.585035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.585814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.586591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.586934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.587277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.587808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.671433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.672175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.674818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.675372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.806634 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5526b028-55dc-4099-9be7-a4a5a546eb57 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3?user_id=7ef839c4037b4c73bacf6559b86da0d9" status: 200 len: 148 microversion: 2.57 time: 0.335019 Apr 30 21:11:52.807346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 239/537] 10.222.0.23 () {62 vars in 1383 bytes} [Sat Apr 30 21:11:52 2022] PUT /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3?user_id=7ef839c4037b4c73bacf6559b86da0d9 => generated 148 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:11:52.812899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:52.815672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:52.820628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.820849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.821806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.822150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.833593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:52.843977 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fff9e4ed-2ea0-42ea-b09b-83bc5ebd2a40 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.272114 Apr 30 21:11:52.854567 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 299/538] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:52 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:52.854567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:52.854567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:52.860540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.861139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:52.878019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:52.879094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.019296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:53.033535 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-37d41544-d550-459e-a0ba-e69dc048606c tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1476 microversion: 2.1 time: 0.224923 Apr 30 21:11:53.034588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 240/539] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:52 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:53.039706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5671fe6e-7f90-45e8-8510-2596cfdb6c99 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Calling method '.version_select at 0x7fdc20c3a430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:53.070236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:53.077613 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d66b457-d7b9-4af8-b568-3f95d88f2184 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.231576 Apr 30 21:11:53.078221 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 300/540] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:52 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:53.089689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:53.090529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:53.097269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.097737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.098549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.098998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.117962 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5671fe6e-7f90-45e8-8510-2596cfdb6c99 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3?user_id=7ef839c4037b4c73bacf6559b86da0d9" status: 200 len: 190 microversion: 2.57 time: 0.082212 Apr 30 21:11:53.118556 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 241/541] 10.222.0.23 () {60 vars in 1363 bytes} [Sat Apr 30 21:11:53 2022] GET /compute/v2.1/os-quota-sets/49d9f141c66b43f694edf7f94e1dafe3?user_id=7ef839c4037b4c73bacf6559b86da0d9 => generated 190 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:11:53.134767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:53.135399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:53.143267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.143723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.144515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.144957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.224228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:53.232247 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bf6aa3f8-a3a0-416c-9d72-3637051b2104 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1259 microversion: 2.1 time: 0.104881 Apr 30 21:11:53.233201 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 242/542] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:53 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1259 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:53.268624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:53.278472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:53.280154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:53.287848 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-478c724b-76a6-4f83-9fdb-635479430a45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.198581 Apr 30 21:11:53.287848 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 301/543] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:53 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:53.524271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d52265a6-cdb5-48f2-a64c-acc3d323a929 req-d876c0ec-2623-4501-9cb8-b874a09e2ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63136ef9-512e-4d74-9427-5db9addb1129", "tag": "5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b"}, {"server_uuid": "e53e9e70-9d1f-4677-b6e5-19e0a393b42a", "name": "network-vif-deleted", "tag": "064011e5-feea-444d-a97a-9f2180c4839e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:53.535768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d52265a6-cdb5-48f2-a64c-acc3d323a929 req-d876c0ec-2623-4501-9cb8-b874a09e2ab0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.536496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d52265a6-cdb5-48f2-a64c-acc3d323a929 req-d876c0ec-2623-4501-9cb8-b874a09e2ab0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.552190 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d52265a6-cdb5-48f2-a64c-acc3d323a929 req-d876c0ec-2623-4501-9cb8-b874a09e2ab0 service nova] Creating event network-changed:5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b for instance 63136ef9-512e-4d74-9427-5db9addb1129 on nch1-master-1 Apr 30 21:11:53.553019 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d52265a6-cdb5-48f2-a64c-acc3d323a929 req-d876c0ec-2623-4501-9cb8-b874a09e2ab0 service nova] Creating event network-vif-deleted:064011e5-feea-444d-a97a-9f2180c4839e for instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a on nch2-master-1 Apr 30 21:11:53.558642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-d52265a6-cdb5-48f2-a64c-acc3d323a929 req-d876c0ec-2623-4501-9cb8-b874a09e2ab0 service nova] Instance 63136ef9-512e-4d74-9427-5db9addb1129 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:11:53.571338 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d52265a6-cdb5-48f2-a64c-acc3d323a929 req-d876c0ec-2623-4501-9cb8-b874a09e2ab0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050867 Apr 30 21:11:53.571937 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 243/544] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:53.586778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:53.587498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:53.595482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.595994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.596785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.600221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.747127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-29796836", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "701361983", "adminPass": "***", "networks": [{"uuid": "51417b35-dffb-4e2a-abd0-357ad597c615"}], "security_groups": [{"name": "tempest-securitygroup--240132572"}], "key_name": "tempest-keypair-197166924", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:53.747294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:53.754880 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-72b4eb1d-6c31-4a3c-b362-429ffa234055 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1473 microversion: 2.1 time: 0.171939 Apr 30 21:11:53.756058 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 302/545] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:53 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:53.861654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:53.862329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:53.870664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.871135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.871926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:53.872368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:53.880556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] validate_networks() for [('51417b35-dffb-4e2a-abd0-357ad597c615', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:11:54.430244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:54.443278 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8113f0b-3f13-4f9b-b8be-0a560d22bd16 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.584986 Apr 30 21:11:54.444884 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 303/546] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:53 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:11:54.452098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:54.452890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:54.461376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:54.462133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:54.472471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:54.473212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:54.959821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:54.968689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6aa75f4f-e677-49cc-8b86-fab9814efe3d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1476 microversion: 2.1 time: 0.521931 Apr 30 21:11:54.969274 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 304/547] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:54 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:54.987651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:54.991914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:55.010139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.010598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.011455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.011905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.348033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:55.348982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:55.349705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:55.350315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:55.350914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:55.363723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.371720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.374194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.374820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.397828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:55.402554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for user c816e51510ac44c9a2b3f5c022b5a3c3 and project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:55.414453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:11:55.417184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:11:55.463503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:55.481162 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa4c0e99-780d-4de5-9423-020b6193f9d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.501728 Apr 30 21:11:55.482082 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 305/548] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:54 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:55.487140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:55.487778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:55.495245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.496491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.497430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.498516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.567399 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2c9408de-6f30-4499-94df-56525076b4c0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.825925 Apr 30 21:11:55.572052 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 244/549] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:11:55.586600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:55.587421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:55.603422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.604121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.604749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:55.605815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.606450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.622810 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4356ecd5-fbb6-42c4-8cf3-20a9c8aaba11 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1265 microversion: 2.1 time: 0.139448 Apr 30 21:11:55.632567 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 306/550] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:55 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:55.637574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-408f0dea-3776-45eb-91e1-7d116022828c req-e2c7178f-4403-46cb-836c-ed0672fff662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f26a54-dfce-45a0-9dc2-3bd5be9f87c8", "name": "network-vif-plugged", "status": "completed", "tag": "4306ca96-09e1-476e-90ee-9c1a1813cb5f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:55.646122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-408f0dea-3776-45eb-91e1-7d116022828c req-e2c7178f-4403-46cb-836c-ed0672fff662 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.646800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-408f0dea-3776-45eb-91e1-7d116022828c req-e2c7178f-4403-46cb-836c-ed0672fff662 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.660322 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-408f0dea-3776-45eb-91e1-7d116022828c req-e2c7178f-4403-46cb-836c-ed0672fff662 service nova] Creating event network-vif-plugged:4306ca96-09e1-476e-90ee-9c1a1813cb5f for instance 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 on nch2-master-1 Apr 30 21:11:55.666088 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-408f0dea-3776-45eb-91e1-7d116022828c req-e2c7178f-4403-46cb-836c-ed0672fff662 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032129 Apr 30 21:11:55.670156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 307/551] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:55.676620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:55.679901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:55.689109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.689580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:55.690794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:55.691254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.122278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.156739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.163271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.165953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1231c926-9996-41b5-8628-115f45c4967b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1470 microversion: 2.1 time: 0.494506 Apr 30 21:11:56.170940 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 308/552] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:55 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:56.171946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.176277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e3b42c93-8bf4-4d77-ab12-3d79a9d0b346 req-e07d1e6e-83f4-497e-ad91-b8d76fcf9de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aab508f-4be3-49d3-bb5f-b19f4f328bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "154e4208-4965-4648-9e7c-f22621d3423a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:56.187158 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ac3a2923-6a11-4be1-8263-84367d8a2ca2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.610707 Apr 30 21:11:56.194054 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 245/553] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:55 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:56.208925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e3b42c93-8bf4-4d77-ab12-3d79a9d0b346 req-e07d1e6e-83f4-497e-ad91-b8d76fcf9de9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.211232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e3b42c93-8bf4-4d77-ab12-3d79a9d0b346 req-e07d1e6e-83f4-497e-ad91-b8d76fcf9de9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.216735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:56.218317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:56.225294 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e3b42c93-8bf4-4d77-ab12-3d79a9d0b346 req-e07d1e6e-83f4-497e-ad91-b8d76fcf9de9 service nova] Creating event network-vif-unplugged:154e4208-4965-4648-9e7c-f22621d3423a for instance 0aab508f-4be3-49d3-bb5f-b19f4f328bcd on nch1-master-1 Apr 30 21:11:56.229520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.230409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.231105 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e3b42c93-8bf4-4d77-ab12-3d79a9d0b346 req-e07d1e6e-83f4-497e-ad91-b8d76fcf9de9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058479 Apr 30 21:11:56.231814 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 309/554] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:56.232158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.232621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.239372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e73c17de-3c0d-4c27-8f17-a7e5b1c18270 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:56.240369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e73c17de-3c0d-4c27-8f17-a7e5b1c18270 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:56.315520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e73c17de-3c0d-4c27-8f17-a7e5b1c18270 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.327005 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e73c17de-3c0d-4c27-8f17-a7e5b1c18270 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1260 microversion: 2.1 time: 0.093231 Apr 30 21:11:56.327697 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 310/555] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:56 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1260 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:56.334677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:56.335578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:56.342750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.343492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.344368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.344905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.646436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.664806 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-52eef4d2-b338-4fb6-af37-ab4d5c0376f8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 200 len: 1305 microversion: 2.1 time: 0.335699 Apr 30 21:11:56.665970 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 311/556] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:56 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 1305 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:56.679005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-49f48db5-d4fb-46ed-a473-850fbe0d2459 req-a2cc7c64-4abb-4931-8cd8-478c6e5cae2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9445f840-9b08-41a7-b9b5-48c93312189c", "name": "network-vif-deleted", "tag": "f32f0d5d-bade-4f65-8f83-41da1c27b970"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:56.694794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-49f48db5-d4fb-46ed-a473-850fbe0d2459 req-a2cc7c64-4abb-4931-8cd8-478c6e5cae2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.697560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-49f48db5-d4fb-46ed-a473-850fbe0d2459 req-a2cc7c64-4abb-4931-8cd8-478c6e5cae2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.706663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.710975 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-49f48db5-d4fb-46ed-a473-850fbe0d2459 req-a2cc7c64-4abb-4931-8cd8-478c6e5cae2f service nova] Creating event network-vif-deleted:f32f0d5d-bade-4f65-8f83-41da1c27b970 for instance 9445f840-9b08-41a7-b9b5-48c93312189c on nch2-master-1 Apr 30 21:11:56.714090 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49f1c225-e94f-4d81-84c2-bd0ba8667e53 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.525178 Apr 30 21:11:56.715062 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 246/557] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:56 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:56.717168 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-49f48db5-d4fb-46ed-a473-850fbe0d2459 req-a2cc7c64-4abb-4931-8cd8-478c6e5cae2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048691 Apr 30 21:11:56.717808 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 312/558] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:56.723932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b4af9b5f-c8c6-47b3-81e7-4eb3dcd16877 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:56.724478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b4af9b5f-c8c6-47b3-81e7-4eb3dcd16877 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:56.730097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:56.731118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:56.731252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4af9b5f-c8c6-47b3-81e7-4eb3dcd16877 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.731683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4af9b5f-c8c6-47b3-81e7-4eb3dcd16877 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.732482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4af9b5f-c8c6-47b3-81e7-4eb3dcd16877 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.732933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4af9b5f-c8c6-47b3-81e7-4eb3dcd16877 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.738606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.739324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.740361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.741176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.892845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:56.900327 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41d99984-423d-46a7-9a33-7437bf009e51 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1310 microversion: 2.1 time: 0.181413 Apr 30 21:11:56.900887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 313/559] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:56 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1310 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:56.905241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:56.905859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:56.911470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.911861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.912623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.913063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:56.981267 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b4af9b5f-c8c6-47b3-81e7-4eb3dcd16877 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129/action" status: 204 len: 0 microversion: 2.1 time: 0.260184 Apr 30 21:11:56.986415 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 247/560] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:11:56 2022] POST /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129/action => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:11:56.992252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:56.992961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:56.999397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:56.999849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.000621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.001064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.107691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:57.118631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c9ea338-7b1b-4fb9-be33-decae3b525b1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.216452 Apr 30 21:11:57.119244 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 314/561] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:56 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:57.211684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:57.217212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:57.219032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:57.220985 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cc446251-8852-4837-8129-f72d9b7a7596 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1470 microversion: 2.1 time: 0.232973 Apr 30 21:11:57.221816 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 248/562] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:56 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:57.232683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.234341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.236075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.236737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.344755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:57.345643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:57.354265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.359225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.360367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.360990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.530777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:57.543061 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9226c2c7-0a20-4332-8ab1-d1ddd9aa26e3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1264 microversion: 2.1 time: 0.201446 Apr 30 21:11:57.544029 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 249/563] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:57 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:57.599009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:57.608558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:57.610395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:57.611584 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aba5ddc3-f2a9-468a-a15f-83edfe27163a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.399386 Apr 30 21:11:57.612620 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 315/564] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:57 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:11:57.682071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:57.682600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:57.694728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.695200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.696007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.696460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.719344 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] HTTP exception thrown: Instance 9445f840-9b08-41a7-b9b5-48c93312189c could not be found. Apr 30 21:11:57.720582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Returning 404 to user: Instance 9445f840-9b08-41a7-b9b5-48c93312189c could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:11:57.721444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2a329321-13db-4d05-a62e-6147cf712361 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 404 len: 111 microversion: 2.1 time: 0.043419 Apr 30 21:11:57.722047 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 250/565] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:57 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:57.733984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:57.735007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:57.750769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.751257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.753809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.755584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.852315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-949364817", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:57.932987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:11:57.938311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:57.951257 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e2378f8d-547d-4411-8ea0-1816c6a17dec tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.223724 Apr 30 21:11:57.961673 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 316/566] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:57 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:57.969449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:57.969449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:57.974621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.977111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:57.977111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:57.977111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.364577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:58.373205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f88f010-23f9-49ce-a69a-8accfcb0b384 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1494 microversion: 2.1 time: 0.410334 Apr 30 21:11:58.373799 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 317/567] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:57 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1494 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:58.389368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:58.390379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:58.392681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:11:58.393091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:11:58.393570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:11:58.394180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:11:58.394598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:11:58.397433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.398304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.399370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.400020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.405732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.406212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.407673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.409193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.434598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Getting quotas for project f727d5639c624deeba0d0d7a7d08810e. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:11:58.440655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Getting quotas for user 6a8350c0cb814c66b94775110721dee4 and project f727d5639c624deeba0d0d7a7d08810e. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:11:58.453272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:11:58.455642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:11:58.570814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:58.578896 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ec72791-e9a9-425c-aef6-6330711951f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.203386 Apr 30 21:11:58.579766 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 318/568] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:58 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:58.585250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:58.585885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:58.592691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.593144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.593955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.594386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.608118 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70c1ebb6-0d00-4cb8-96a4-e9ac31a5a882 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761252 Apr 30 21:11:58.615586 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 251/569] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:11:58.620808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9aea1d22-1fdf-45ad-94a8-3697bb4d1e06 req-ab870e18-7570-46c1-8c04-c1c6cd63b013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aab508f-4be3-49d3-bb5f-b19f4f328bcd", "tag": "154e4208-4965-4648-9e7c-f22621d3423a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:58.635647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9aea1d22-1fdf-45ad-94a8-3697bb4d1e06 req-ab870e18-7570-46c1-8c04-c1c6cd63b013 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.637066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9aea1d22-1fdf-45ad-94a8-3697bb4d1e06 req-ab870e18-7570-46c1-8c04-c1c6cd63b013 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.653115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9aea1d22-1fdf-45ad-94a8-3697bb4d1e06 req-ab870e18-7570-46c1-8c04-c1c6cd63b013 service nova] Creating event network-changed:154e4208-4965-4648-9e7c-f22621d3423a for instance 0aab508f-4be3-49d3-bb5f-b19f4f328bcd on nch1-master-1 Apr 30 21:11:58.666555 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9aea1d22-1fdf-45ad-94a8-3697bb4d1e06 req-ab870e18-7570-46c1-8c04-c1c6cd63b013 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049281 Apr 30 21:11:58.667495 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 252/570] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:58.672794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-29a53ae4-e582-4bb8-87cf-28e6ed17d773 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:58.673680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-29a53ae4-e582-4bb8-87cf-28e6ed17d773 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:58.680905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a53ae4-e582-4bb8-87cf-28e6ed17d773 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.681709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a53ae4-e582-4bb8-87cf-28e6ed17d773 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:58.682678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a53ae4-e582-4bb8-87cf-28e6ed17d773 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:58.683911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a53ae4-e582-4bb8-87cf-28e6ed17d773 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.003013 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-29a53ae4-e582-4bb8-87cf-28e6ed17d773 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1645 microversion: 2.1 time: 0.334292 Apr 30 21:11:59.007836 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 253/571] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:58 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1645 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:59.013036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:59.013548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:59.018522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.026654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.028167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.029547 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-009267c8-b6c8-450b-aa35-63c2ffe5e3d0 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1470 microversion: 2.1 time: 0.448469 Apr 30 21:11:59.029806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.030442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.031070 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 319/572] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:58 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1470 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:59.052376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bec68816-088e-48c3-ac3b-458dd7a975fc tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:59.056630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bec68816-088e-48c3-ac3b-458dd7a975fc tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:59.112320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.120457 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc7e28b7-c4c1-4261-a0d9-d14dea15cea0 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1330 microversion: 2.1 time: 0.111820 Apr 30 21:11:59.129887 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 254/573] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:59 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:59.129887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:59.131427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:59.140403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bec68816-088e-48c3-ac3b-458dd7a975fc tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.144616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.145071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.145908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.146347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.150605 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bec68816-088e-48c3-ac3b-458dd7a975fc tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1219 microversion: 2.1 time: 0.117916 Apr 30 21:11:59.151180 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 320/574] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:59 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:59.158165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-7df12ac5-a752-4544-8c0b-c7113a4251f2 req-90315d0f-2798-4d47-8f1a-fe569fb54c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85fdff58-4182-4941-b3a0-879915a49a4a", "tag": "e3d4a5c6-46ec-4840-adba-bbaa926432a0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:59.196881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7df12ac5-a752-4544-8c0b-c7113a4251f2 req-90315d0f-2798-4d47-8f1a-fe569fb54c24 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.198518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7df12ac5-a752-4544-8c0b-c7113a4251f2 req-90315d0f-2798-4d47-8f1a-fe569fb54c24 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.228360 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-7df12ac5-a752-4544-8c0b-c7113a4251f2 req-90315d0f-2798-4d47-8f1a-fe569fb54c24 service nova] Creating event network-changed:e3d4a5c6-46ec-4840-adba-bbaa926432a0 for instance 85fdff58-4182-4941-b3a0-879915a49a4a on nch2-master-1 Apr 30 21:11:59.239608 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-7df12ac5-a752-4544-8c0b-c7113a4251f2 req-90315d0f-2798-4d47-8f1a-fe569fb54c24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085613 Apr 30 21:11:59.240670 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 321/575] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:11:59.247064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:59.247770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:59.256550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.256550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.256550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.257239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.541682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.551237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.558766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.562713 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ca82a97-3efc-4993-8602-5167725432eb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.439995 Apr 30 21:11:59.565979 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 255/576] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:11:59 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:11:59.580917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e2f6682-8359-4fcb-a83f-8ed004a91fb6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:59.581470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e2f6682-8359-4fcb-a83f-8ed004a91fb6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:59.588121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.597441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e2f6682-8359-4fcb-a83f-8ed004a91fb6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.598378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e2f6682-8359-4fcb-a83f-8ed004a91fb6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.599661 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7967a0c-7358-4bce-807f-c606b5877bdc tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.355336 Apr 30 21:11:59.600150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e2f6682-8359-4fcb-a83f-8ed004a91fb6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.600260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 322/577] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:59 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:59.600894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e2f6682-8359-4fcb-a83f-8ed004a91fb6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.611054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:59.614846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:11:59.618776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.619664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.620711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.621347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.967786 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e2f6682-8359-4fcb-a83f-8ed004a91fb6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1645 microversion: 2.1 time: 0.400333 Apr 30 21:11:59.969951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:11:59.974923 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 256/578] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:59 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1645 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:59.979706 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71a74d4e-d248-4db7-be87-a7fd131b5c6c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.378372 Apr 30 21:11:59.980534 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 323/579] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:11:59 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:11:59.984636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c21f58f-dff7-4b61-919a-293ca9e338a4 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:11:59.985941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-05592436-60ec-4a49-9537-a0111865a131 req-837b1b69-88fb-4402-a450-3187ddfb919f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63136ef9-512e-4d74-9427-5db9addb1129", "name": "network-vif-plugged", "status": "completed", "tag": "5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:11:59.986086 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:11:59.986086 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:11:59.987193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c21f58f-dff7-4b61-919a-293ca9e338a4 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.987640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c21f58f-dff7-4b61-919a-293ca9e338a4 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:11:59.988458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c21f58f-dff7-4b61-919a-293ca9e338a4 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:11:59.988873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c21f58f-dff7-4b61-919a-293ca9e338a4 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.003550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-05592436-60ec-4a49-9537-a0111865a131 req-837b1b69-88fb-4402-a450-3187ddfb919f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.003550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-05592436-60ec-4a49-9537-a0111865a131 req-837b1b69-88fb-4402-a450-3187ddfb919f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.023227 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-05592436-60ec-4a49-9537-a0111865a131 req-837b1b69-88fb-4402-a450-3187ddfb919f service nova] Creating event network-vif-plugged:5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b for instance 63136ef9-512e-4d74-9427-5db9addb1129 on nch1-master-1 Apr 30 21:12:00.034621 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-05592436-60ec-4a49-9537-a0111865a131 req-837b1b69-88fb-4402-a450-3187ddfb919f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055583 Apr 30 21:12:00.035513 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 257/580] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:00.048833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:00.049825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:00.053109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c21f58f-dff7-4b61-919a-293ca9e338a4 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071702 Apr 30 21:12:00.054001 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 324/581] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:11:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:00.066698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4bbf66c-5cf6-48b2-beba-c7ad812b4b5e tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:00.067381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4bbf66c-5cf6-48b2-beba-c7ad812b4b5e tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:00.067698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.068438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.071547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.072210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.082827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4bbf66c-5cf6-48b2-beba-c7ad812b4b5e tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.083360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4bbf66c-5cf6-48b2-beba-c7ad812b4b5e tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.086549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4bbf66c-5cf6-48b2-beba-c7ad812b4b5e tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.086549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4bbf66c-5cf6-48b2-beba-c7ad812b4b5e tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.344781 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4bbf66c-5cf6-48b2-beba-c7ad812b4b5e tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8/action" status: 202 len: 0 microversion: 2.1 time: 0.282632 Apr 30 21:12:00.345898 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 325/582] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:00 2022] POST /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:12:00.353820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:00.354906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:00.374045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.374717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.375713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.376158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.539315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:00.549184 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-579b3444-385e-4227-82de-5e223449b843 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1462 microversion: 2.1 time: 0.506305 Apr 30 21:12:00.560999 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 258/583] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:00 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1462 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:00.570174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:00.571086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:00.587815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.588736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.589853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.590481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.685114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:00.692993 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8ffebe26-d1a2-4bf5-986e-f99810478097 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1223 microversion: 2.1 time: 0.129685 Apr 30 21:12:00.694515 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 259/584] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:00 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:00.699524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc4e7c00-684d-4b96-9638-292ebb5fdf86 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:00.700146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc4e7c00-684d-4b96-9638-292ebb5fdf86 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:00.718518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4e7c00-684d-4b96-9638-292ebb5fdf86 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.718976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4e7c00-684d-4b96-9638-292ebb5fdf86 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.719774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4e7c00-684d-4b96-9638-292ebb5fdf86 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.720216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4e7c00-684d-4b96-9638-292ebb5fdf86 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.758223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:00.773809 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3a81c18b-1e61-4beb-8dec-ed02c6f95a5a tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.419315 Apr 30 21:12:00.774931 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 326/585] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:00 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:00.779906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b928f045-afcb-42c1-b6a7-ca5d0be22d81 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:00.780604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b928f045-afcb-42c1-b6a7-ca5d0be22d81 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:00.786998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b928f045-afcb-42c1-b6a7-ca5d0be22d81 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.787718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b928f045-afcb-42c1-b6a7-ca5d0be22d81 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.788446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b928f045-afcb-42c1-b6a7-ca5d0be22d81 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.789317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b928f045-afcb-42c1-b6a7-ca5d0be22d81 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.883141 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc4e7c00-684d-4b96-9638-292ebb5fdf86 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1650 microversion: 2.1 time: 0.187426 Apr 30 21:12:00.886333 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 260/586] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:00 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1650 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:00.888343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:00.888961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:00.894933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.896251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.896251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:00.896613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:00.933845 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b928f045-afcb-42c1-b6a7-ca5d0be22d81 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1613 microversion: 2.1 time: 0.157018 Apr 30 21:12:00.934437 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 327/587] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:00 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1613 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:01.034230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:01.043509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:01.044817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:01.046014 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae473124-6001-4f73-bc9a-81e9fef8703a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.161294 Apr 30 21:12:01.046880 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 261/588] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:00 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:01.051285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:01.052097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:01.061066 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02052cb6-3ba1-4866-beb7-aa402ec12303 tempest-TenantUsagesNegativeTestJSON-1694280052 tempest-TenantUsagesNegativeTestJSON-1694280052-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-29T21%3A12%3A00.601078&end=2022-05-01T21%3A12%3A00.601078" status: 404 len: 112 microversion: - time: 0.125605 Apr 30 21:12:01.067227 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 328/589] 10.222.0.23 () {58 vars in 1315 bytes} [Sat Apr 30 21:12:00 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-29T21%3A12%3A00.601078&end=2022-05-01T21%3A12%3A00.601078 => generated 112 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 21:12:01.067360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:01.067360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:01.067360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:01.067616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b5d9070f-6a11-4c6a-b150-3a34d6efee73 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '.version_select at 0x7fdc20d3c430>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:01.067704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:01.068469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5d9070f-6a11-4c6a-b150-3a34d6efee73 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:01.068923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5d9070f-6a11-4c6a-b150-3a34d6efee73 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:01.093312 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b5d9070f-6a11-4c6a-b150-3a34d6efee73 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.028160 Apr 30 21:12:01.096585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 329/590] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:12:01 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:01.100296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:01.101010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:01.126407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:01.128524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:01.129724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:01.130334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:01.641730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:01.654879 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-04ec2662-c17a-4aee-877c-23b97fe535b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1472 microversion: 2.1 time: 0.606807 Apr 30 21:12:01.655444 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 262/591] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:01 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1472 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:01.676034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-80d03cef-6309-4d8f-9c02-ee3241626716 tempest-TenantUsagesNegativeTestJSON-1694280052 tempest-TenantUsagesNegativeTestJSON-1694280052-project-admin] Calling method '.version_select at 0x7fdc20c3a670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:01.681559 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-80d03cef-6309-4d8f-9c02-ee3241626716 tempest-TenantUsagesNegativeTestJSON-1694280052 tempest-TenantUsagesNegativeTestJSON-1694280052-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Apr 30 21:12:01.683918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-80d03cef-6309-4d8f-9c02-ee3241626716 tempest-TenantUsagesNegativeTestJSON-1694280052 tempest-TenantUsagesNegativeTestJSON-1694280052-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:01.684960 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-80d03cef-6309-4d8f-9c02-ee3241626716 tempest-TenantUsagesNegativeTestJSON-1694280052 tempest-TenantUsagesNegativeTestJSON-1694280052-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/fdb41e2c2c9d41a9836e14924a739d3d?start=2022-05-01T21%3A12%3A00.601078&end=2022-04-29T21%3A12%3A00.601078" status: 400 len: 111 microversion: 2.1 time: 0.018088 Apr 30 21:12:01.698002 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 263/592] 10.222.0.23 () {58 vars in 1411 bytes} [Sat Apr 30 21:12:01 2022] GET /compute/v2.1/os-simple-tenant-usage/fdb41e2c2c9d41a9836e14924a739d3d?start=2022-05-01T21%3A12%3A00.601078&end=2022-04-29T21%3A12%3A00.601078 => generated 111 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:12:01.708908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:01.717623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1263943289", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:01.724051 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77c95d31-68f1-4e55-9acd-35f882f0d6e5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.627651 Apr 30 21:12:01.724636 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 330/593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:01 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:01.802951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:12:01.860503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b4dadd9-bc33-48ef-8d16-c4c427b0bd59 tempest-TenantUsagesNegativeTestJSON-1832750890 tempest-TenantUsagesNegativeTestJSON-1832750890-project] Calling method '.version_select at 0x7fdc20d5b0d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:01.862715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8b4dadd9-bc33-48ef-8d16-c4c427b0bd59 tempest-TenantUsagesNegativeTestJSON-1832750890 tempest-TenantUsagesNegativeTestJSON-1832750890-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'dfb76ad566b645c4a19f647585449972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb41e2c2c9d41a9836e14924a739d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:01.863543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b4dadd9-bc33-48ef-8d16-c4c427b0bd59 tempest-TenantUsagesNegativeTestJSON-1832750890 tempest-TenantUsagesNegativeTestJSON-1832750890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:01.864351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8b4dadd9-bc33-48ef-8d16-c4c427b0bd59 tempest-TenantUsagesNegativeTestJSON-1832750890 tempest-TenantUsagesNegativeTestJSON-1832750890-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-29T21%3A12%3A00.601078&end=2022-05-01T21%3A12%3A00.601078&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.138801 Apr 30 21:12:01.869174 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 331/594] 10.222.0.23 () {58 vars in 1334 bytes} [Sat Apr 30 21:12:01 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-29T21%3A12%3A00.601078&end=2022-05-01T21%3A12%3A00.601078&detailed=1 => generated 123 bytes in 140 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:01.888923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:01.889575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:01.903888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:01.905046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:01.907044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:01.908494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.053945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:02.063465 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9027c539-26aa-4fc9-8554-4b31e6470736 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1271 microversion: 2.1 time: 0.197561 Apr 30 21:12:02.064087 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 332/595] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:01 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:02.069770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:02.070377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:02.077247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.077780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.078582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.079024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.271360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:12:02.272340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:12:02.273003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:12:02.273630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:12:02.274255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:12:02.294667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.297968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.299209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.300851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.328723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:02.350372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:12:02.354720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for user cce42480cd844664991774f07ca47e79 and project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:12:02.358859 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6863af9c-868a-4590-b7dd-5d42cf3c49f8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.291538 Apr 30 21:12:02.365144 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 333/596] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:02 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:02.370081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c13fbc0-d7df-4413-9c0c-743e017513b7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:02.371353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c13fbc0-d7df-4413-9c0c-743e017513b7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:02.381041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c13fbc0-d7df-4413-9c0c-743e017513b7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.381203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:12:02.381503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c13fbc0-d7df-4413-9c0c-743e017513b7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.382317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c13fbc0-d7df-4413-9c0c-743e017513b7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.382759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c13fbc0-d7df-4413-9c0c-743e017513b7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.386879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:12:02.540306 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c13fbc0-d7df-4413-9c0c-743e017513b7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1630 microversion: 2.1 time: 0.174101 Apr 30 21:12:02.541079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 334/597] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:02 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1630 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:02.544499 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9fb0b995-7cd5-4d5a-a4ad-fd76ef6e3043 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845000 Apr 30 21:12:02.545135 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 264/598] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:12:02.555104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dcc7311b-de36-496c-a2e5-fa1661073f08 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:02.555728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dcc7311b-de36-496c-a2e5-fa1661073f08 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:02.556220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:02.556842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:02.577927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.578385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.579181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.579630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.672955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dcc7311b-de36-496c-a2e5-fa1661073f08 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:02.679762 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dcc7311b-de36-496c-a2e5-fa1661073f08 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1213 microversion: 2.1 time: 0.128564 Apr 30 21:12:02.680926 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 265/599] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:02 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:02.700162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:02.704793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:02.715659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.718932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.720224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.720751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.754068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:02.766058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lazy-loading 'flavor' on Instance uuid 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:02.768551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:02.770179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:02.772138 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c9301dcc-11ca-48e5-8826-e32cdf663454 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.228473 Apr 30 21:12:02.773301 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 335/600] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:02 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:02.779512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:02.780287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:02.781188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Going to try to live migrate instance to nch1-master-1 {{(pid=130670) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:12:02.788431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.789052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.789741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.790289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.960846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:02.969127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-264fbd85-7d96-457e-9bf0-5dc5c6b49183 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1478 microversion: 2.1 time: 0.194646 Apr 30 21:12:02.969703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 336/601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:02 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:02.974245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:02.974851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:02.987443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.987443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:02.987935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:02.988387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.183506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:03.191267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f01ae9d9-0798-4c3a-a81d-2df2749f95d3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.220544 Apr 30 21:12:03.191990 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 337/602] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:02 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:03.196621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-fd80907d-f763-4aa8-8996-98e637d8601f req-7bb92bdc-b9e5-4c51-928b-7bd5fa914564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b3ef0d-1829-471c-9d1f-461b84634a6e", "tag": "c43b09e1-c606-48c3-ab4c-b62ee389ba94"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:03.205349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fd80907d-f763-4aa8-8996-98e637d8601f req-7bb92bdc-b9e5-4c51-928b-7bd5fa914564 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.205842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fd80907d-f763-4aa8-8996-98e637d8601f req-7bb92bdc-b9e5-4c51-928b-7bd5fa914564 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.218182 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fd80907d-f763-4aa8-8996-98e637d8601f req-7bb92bdc-b9e5-4c51-928b-7bd5fa914564 service nova] Creating event network-changed:c43b09e1-c606-48c3-ab4c-b62ee389ba94 for instance c8b3ef0d-1829-471c-9d1f-461b84634a6e on nch2-master-1 Apr 30 21:12:03.223220 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-fd80907d-f763-4aa8-8996-98e637d8601f req-7bb92bdc-b9e5-4c51-928b-7bd5fa914564 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030142 Apr 30 21:12:03.224537 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 338/603] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:03.230211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:03.231022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:03.238494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.239067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.239878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.240321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.339136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:03.349552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-87c05e59-56ed-4da0-8c24-0864920ab9d6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1271 microversion: 2.1 time: 0.123020 Apr 30 21:12:03.359059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 339/604] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:03 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:03.375830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:03.378749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:03.385703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.387124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.388128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.388756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.846972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:03.863748 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5905b881-94a8-4717-87a6-e7cd9111f61d tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.491612 Apr 30 21:12:03.864362 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 340/605] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:03 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:03.869200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:03.870071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:03.876913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.877945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.879082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.879693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.954791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:03.962571 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8bf6e0f9-976b-436d-8e46-1d5158cef2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1217 microversion: 2.1 time: 0.097172 Apr 30 21:12:03.965888 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 341/606] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:03 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:03.971959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:03.972859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:03.978762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.979217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:03.980623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:03.981070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:04.165183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:04.174233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:04.175747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:04.176971 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-72a8e9cf-8dc2-4f1a-b5e6-3b3f2231e5d6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.209612 Apr 30 21:12:04.179445 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 342/607] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:03 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:04.182946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:04.183565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:04.190968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:04.191422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:04.192209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:04.193229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:04.337375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:04.345805 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-649c2077-659b-4668-bf47-2023eb303034 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1478 microversion: 2.1 time: 0.166799 Apr 30 21:12:04.346395 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 343/608] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:04 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:04.351329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:04.351952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:04.358013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:04.358471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:04.359310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:04.359693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:04.528731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:04.556732 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7894109d-13ab-4de5-ae90-1a3e1f6f9324 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.209232 Apr 30 21:12:04.559807 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 344/609] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:04 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:04.582335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:04.584638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:04.606073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:04.610513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:04.610513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:04.610513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:04.941057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:04.975641 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9f5bc133-5cd0-4197-a5a9-652cfb130e6b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1319 microversion: 2.1 time: 0.399849 Apr 30 21:12:04.977254 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 345/610] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:04 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:04.991501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:04.992967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:05.008997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.009604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:05.011979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.013923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:05.259776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:05.264473 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-98de4893-8ee5-4ad3-b3be-1478d4028ee9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.285615 Apr 30 21:12:05.265246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 346/611] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:04 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:05.289311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:05.291982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:05.302841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.303525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:05.304582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.305225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:05.464578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:05.477137 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ac1a709-f103-4bb4-a34d-ba50c9d83c6f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1265 microversion: 2.1 time: 0.202286 Apr 30 21:12:05.478354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 347/612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:05 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:05.497533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:05.499042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:05.509186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.509872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:05.510830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.512024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:05.746793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:05.760105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:05.760105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:05.760105 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cccbc033-9240-4d66-b3cf-f9dc846cf488 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1569 microversion: 2.25 time: 0.280530 Apr 30 21:12:05.762143 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 348/613] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:05 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1569 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:05.778413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:05.779400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:05.786522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.795392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:05.795392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:05.795392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:06.073090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:06.083565 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ad78f18-9184-49d5-a56f-9ef8d9b7256f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1478 microversion: 2.1 time: 0.309314 Apr 30 21:12:06.085079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 349/614] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:05 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1478 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:06.089985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-fb549bc8-8742-4966-b0f8-0e056a3f5ee5 req-b57fa121-5471-43ef-bd18-b39f41e81acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4888131-7f37-4758-8e35-816d07886e96", "name": "network-vif-unplugged", "status": "completed", "tag": "9c97a0a6-0f63-4385-8a0e-e905cd2c4f48"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:06.115627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fb549bc8-8742-4966-b0f8-0e056a3f5ee5 req-b57fa121-5471-43ef-bd18-b39f41e81acf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:06.119650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fb549bc8-8742-4966-b0f8-0e056a3f5ee5 req-b57fa121-5471-43ef-bd18-b39f41e81acf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:06.140857 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fb549bc8-8742-4966-b0f8-0e056a3f5ee5 req-b57fa121-5471-43ef-bd18-b39f41e81acf service nova] Creating event network-vif-unplugged:9c97a0a6-0f63-4385-8a0e-e905cd2c4f48 for instance e4888131-7f37-4758-8e35-816d07886e96 on nch1-master-1 Apr 30 21:12:06.148076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-fb549bc8-8742-4966-b0f8-0e056a3f5ee5 req-b57fa121-5471-43ef-bd18-b39f41e81acf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061675 Apr 30 21:12:06.149225 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 350/615] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:06.170180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:06.171158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:06.178212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:06.179058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:06.180835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:06.181309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:06.690786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:06.699924 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-46ebe020-5dfd-4b14-bedd-27cc542f20f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.549307 Apr 30 21:12:06.700594 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 351/616] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:06 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:06.706090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:06.706772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:06.712771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:06.713588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:06.715233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:06.715777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:06.946215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:06.954586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ebef3ca-eac6-4c84-95b7-1f47094bb850 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1319 microversion: 2.1 time: 0.252729 Apr 30 21:12:06.955162 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 352/617] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:06 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:06.967273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:06.968471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:06.975095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:06.975561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:06.976829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:06.977279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.200450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:07.208093 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a7dc696a-cbcc-4b2a-8a46-813b102f9795 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.245621 Apr 30 21:12:07.208681 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 353/618] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:06 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:07.213252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1ed74f5f-0c20-4207-a0a3-91baba088fe1 req-38adf985-15e1-4aab-af2e-1b6c297c483e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90628276-3647-4b96-9a5e-48538fbed14b", "tag": "6d4dd76d-9d01-473d-a7e3-bb9f5df1f76d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:07.221427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1ed74f5f-0c20-4207-a0a3-91baba088fe1 req-38adf985-15e1-4aab-af2e-1b6c297c483e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.221918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1ed74f5f-0c20-4207-a0a3-91baba088fe1 req-38adf985-15e1-4aab-af2e-1b6c297c483e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.234107 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1ed74f5f-0c20-4207-a0a3-91baba088fe1 req-38adf985-15e1-4aab-af2e-1b6c297c483e service nova] Creating event network-changed:6d4dd76d-9d01-473d-a7e3-bb9f5df1f76d for instance 90628276-3647-4b96-9a5e-48538fbed14b on nch1-master-1 Apr 30 21:12:07.238919 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1ed74f5f-0c20-4207-a0a3-91baba088fe1 req-38adf985-15e1-4aab-af2e-1b6c297c483e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029122 Apr 30 21:12:07.239697 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 354/619] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:07.250297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.250297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:07.251860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.252325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.253116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.253561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.278238 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6877e81a-c779-425d-9ead-aa22bfba2856 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8/action" status: 202 len: 0 microversion: 2.1 time: 4.595898 Apr 30 21:12:07.279132 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 266/620] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:02 2022] POST /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8/action => generated 0 bytes in 4597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:12:07.285550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.286152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:07.294013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.294411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.295323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.295771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.382876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:07.391408 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cf6c7ce0-2198-4ff2-a3bf-fd65a6f3a8fe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1271 microversion: 2.1 time: 0.150690 Apr 30 21:12:07.392316 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 355/621] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:07.488561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:07.507349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:07.510982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:07.513963 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81f55c94-c704-4b74-8dd0-64de1782b23b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1559 microversion: 2.25 time: 0.233904 Apr 30 21:12:07.516038 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 267/622] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:07.530503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.531220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:07.538010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.538482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.540499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.541062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.585549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-491546ba-47e7-40d9-8bb0-7e395da1b910 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.594961 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-491546ba-47e7-40d9-8bb0-7e395da1b910 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.201365 Apr 30 21:12:07.596063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 356/623] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:07.603585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.604275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:07.610889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.611352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.612179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.612635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.849084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:07.860358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-548744db-089e-426b-b11c-69c5b667156d tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1478 microversion: 2.1 time: 0.342826 Apr 30 21:12:07.861266 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 268/624] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1478 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:07.868225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ce57d24c-a70d-4f2f-9787-3f9bb411d00b tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '.version_select at 0x7fdc20c7f040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.871889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce57d24c-a70d-4f2f-9787-3f9bb411d00b tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.872694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce57d24c-a70d-4f2f-9787-3f9bb411d00b tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.883982 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ce57d24c-a70d-4f2f-9787-3f9bb411d00b tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1946 microversion: 2.25 time: 0.021260 Apr 30 21:12:07.885658 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 269/625] 10.222.0.23 () {60 vars in 1183 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/os-migrations => generated 1946 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:07.890664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7c5347eb-6895-4eae-bc54-38eef415477c tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.915978 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7c5347eb-6895-4eae-bc54-38eef415477c tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3073 microversion: 2.1 time: 0.028908 Apr 30 21:12:07.916892 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 270/626] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/flavors => generated 3073 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:07.929781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:07.938231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.938872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:07.939504 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3472303-2591-43f3-9d45-a6a120b2c1ec tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.342015 Apr 30 21:12:07.940886 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 357/627] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:07.945872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.946264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:07.946375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.947129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.947433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:07.947561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.954035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.954756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:07.955737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:07.956616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.244789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid 0aab508f-4be3-49d3-bb5f-b19f4f328bcd {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:08.260287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:08.272504 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ce0dbb22-1d7a-4f34-92dd-33c9c5c42873 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1307 microversion: 2.1 time: 0.352552 Apr 30 21:12:08.284775 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 271/628] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:08.290492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d192b376-b819-4ffc-bb3c-c90ff77cfd4a tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:08.299455 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d192b376-b819-4ffc-bb3c-c90ff77cfd4a tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012849 Apr 30 21:12:08.300641 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 272/629] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:08.308125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:08.308749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:08.314238 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-085f7111-d4c9-4676-b824-b8a3c40d05ff tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 2052 microversion: 2.25 time: 0.372018 Apr 30 21:12:08.315066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:08.315682 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 358/630] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:07 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 2052 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:08.315871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.317101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:08.317549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.333742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b88c4b10-b04a-4fd8-ab2b-ba1f1b1f7161 req-f237fa5c-0d2f-43ce-8b6f-a388a3c81be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85fdff58-4182-4941-b3a0-879915a49a4a", "name": "network-vif-plugged", "status": "completed", "tag": "e3d4a5c6-46ec-4840-adba-bbaa926432a0"}, {"server_uuid": "e4888131-7f37-4758-8e35-816d07886e96", "name": "network-vif-plugged", "status": "completed", "tag": "9c97a0a6-0f63-4385-8a0e-e905cd2c4f48"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:08.346346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b88c4b10-b04a-4fd8-ab2b-ba1f1b1f7161 req-f237fa5c-0d2f-43ce-8b6f-a388a3c81be3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:08.349938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b88c4b10-b04a-4fd8-ab2b-ba1f1b1f7161 req-f237fa5c-0d2f-43ce-8b6f-a388a3c81be3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.364919 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b88c4b10-b04a-4fd8-ab2b-ba1f1b1f7161 req-f237fa5c-0d2f-43ce-8b6f-a388a3c81be3 service nova] Creating event network-vif-plugged:e3d4a5c6-46ec-4840-adba-bbaa926432a0 for instance 85fdff58-4182-4941-b3a0-879915a49a4a on nch2-master-1 Apr 30 21:12:08.365557 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b88c4b10-b04a-4fd8-ab2b-ba1f1b1f7161 req-f237fa5c-0d2f-43ce-8b6f-a388a3c81be3 service nova] Creating event network-vif-plugged:9c97a0a6-0f63-4385-8a0e-e905cd2c4f48 for instance e4888131-7f37-4758-8e35-816d07886e96 on nch1-master-1 Apr 30 21:12:08.380101 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b88c4b10-b04a-4fd8-ab2b-ba1f1b1f7161 req-f237fa5c-0d2f-43ce-8b6f-a388a3c81be3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057657 Apr 30 21:12:08.380101 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 359/631] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:08.394816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:08.396568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:08.410981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:08.410981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.412414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:08.412620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.638436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:08.646064 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4319b97d-dbdf-4294-86b6-d3c462e0a2d0 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1319 microversion: 2.1 time: 0.344159 Apr 30 21:12:08.654614 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 273/632] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:08 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:08.654614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9fddd5f1-92e1-4b7c-961a-b7758fdf7b95 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:08.661444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9fddd5f1-92e1-4b7c-961a-b7758fdf7b95 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012526 Apr 30 21:12:08.665282 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 274/633] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:08.666186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:08.674014 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b1e246b-5879-408d-bf01-ae89940e5141 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.296073 Apr 30 21:12:08.674598 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 360/634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:08 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:08.680411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:08.681290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:08.687285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1401345624", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "b894fca3-f633-42dd-93b5-bde3291d63a3"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:08.720461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:08.721490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.722525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:08.723328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:08.772198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] validate_networks() for [('b894fca3-f633-42dd-93b5-bde3291d63a3', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:12:09.297900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:09.307622 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23946171-8721-4779-a6ac-e6d114f8855f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.644524 Apr 30 21:12:09.308384 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 275/635] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:08 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:09.313857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97d77132-9815-43f9-aed6-c8e8bdce79c7 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:09.353062 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97d77132-9815-43f9-aed6-c8e8bdce79c7 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.043133 Apr 30 21:12:09.365206 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 276/636] 10.222.0.23 () {58 vars in 1164 bytes} [Sat Apr 30 21:12:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:09.365206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:09.365206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:09.367884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:09.368346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:09.369235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:09.369685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:09.642507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:09.656577 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e4a081b7-6c24-4d65-aa75-b093506eb67a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1478 microversion: 2.1 time: 0.300791 Apr 30 21:12:09.666762 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 277/637] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:09 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1478 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:09.671961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:09.672592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:09.678858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:09.679310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:09.680281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:09.680779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:09.863866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:12:09.864432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:12:09.865031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:12:09.865553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:12:09.866190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:12:09.876737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:09.877316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:09.880127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:09.880127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:09.896478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:12:09.900666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for user dadac4f61fe141dba3ee726ca6cbf29a and project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:12:09.912944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:12:09.915342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:12:09.965916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:09.991326 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f6ff91d2-c7d8-4cd2-a7a3-97ba46c24f2f tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.323004 Apr 30 21:12:09.992107 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 278/638] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:09 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:09.997440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:09.998389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:10.006985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.006985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.006985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.006985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.114124 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6e40d06e-77a6-44d0-8f79-a03d60a0cf98 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.435660 Apr 30 21:12:10.119779 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 361/639] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:12:10.125616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b74d0059-fc12-4de0-aedf-d5c8672d06b8 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:10.141120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b74d0059-fc12-4de0-aedf-d5c8672d06b8 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017061 Apr 30 21:12:10.141120 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 362/640] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:10.151204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:10.151204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:10.157979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.158443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.159277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.159725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.397083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:10.404596 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5e9d5355-e526-48cc-a8dc-a9bef8bb9716 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1487 microversion: 2.1 time: 0.411371 Apr 30 21:12:10.417959 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 279/641] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:09 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1487 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:10.423004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:10.423112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:10.429109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.429556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.430517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.431034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.578164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:10.586098 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-76521693-d2de-45cc-9035-d8e5abe9ccd7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1319 microversion: 2.1 time: 0.439293 Apr 30 21:12:10.586697 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 363/642] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:10 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:10.593013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ecc9d6e0-1c01-4777-9118-20db028d722e req-cddbd82d-5284-4a64-b49c-10dcc453d1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3604c457-9d04-40ae-8d64-1e3a9c5997b9", "tag": "847cb3b0-ee43-4565-9188-e7bd64f115af"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:10.603980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ecc9d6e0-1c01-4777-9118-20db028d722e req-cddbd82d-5284-4a64-b49c-10dcc453d1de service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.605587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ecc9d6e0-1c01-4777-9118-20db028d722e req-cddbd82d-5284-4a64-b49c-10dcc453d1de service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.615841 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ecc9d6e0-1c01-4777-9118-20db028d722e req-cddbd82d-5284-4a64-b49c-10dcc453d1de service nova] Creating event network-changed:847cb3b0-ee43-4565-9188-e7bd64f115af for instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 on nch2-master-1 Apr 30 21:12:10.620683 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ecc9d6e0-1c01-4777-9118-20db028d722e req-cddbd82d-5284-4a64-b49c-10dcc453d1de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032487 Apr 30 21:12:10.621277 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 364/643] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:10.626337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ba9eb1e8-564c-4d12-adb1-93ac545cab91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:10.627042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ba9eb1e8-564c-4d12-adb1-93ac545cab91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:10.758898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ba9eb1e8-564c-4d12-adb1-93ac545cab91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:10.774045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ba9eb1e8-564c-4d12-adb1-93ac545cab91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:10.774045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ba9eb1e8-564c-4d12-adb1-93ac545cab91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:10.774045 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ba9eb1e8-564c-4d12-adb1-93ac545cab91 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1262 microversion: 2.25 time: 0.148074 Apr 30 21:12:10.774341 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 365/644] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:10 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1262 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:10.796092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:10.804247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a022b35a-ced9-4200-bd81-cac8f0499938 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:10.806043 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc2d032c-7b03-4a3b-a3da-2d4317dfd071 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.399455 Apr 30 21:12:10.807084 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 280/645] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:10 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:10.813433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:10.814520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:10.822760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.824323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.826373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.827199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.838465 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a022b35a-ced9-4200-bd81-cac8f0499938 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.066029 Apr 30 21:12:10.839109 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 366/646] 10.222.0.23 () {58 vars in 1168 bytes} [Sat Apr 30 21:12:10 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:10.845110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-824b02fd-e409-4952-bdba-3d05b551d2e1 req-35f735aa-1309-4e2b-b78c-5c1d5120c986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b3ef0d-1829-471c-9d1f-461b84634a6e", "name": "network-vif-plugged", "status": "completed", "tag": "c43b09e1-c606-48c3-ab4c-b62ee389ba94"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:10.854575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-824b02fd-e409-4952-bdba-3d05b551d2e1 req-35f735aa-1309-4e2b-b78c-5c1d5120c986 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.855144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-824b02fd-e409-4952-bdba-3d05b551d2e1 req-35f735aa-1309-4e2b-b78c-5c1d5120c986 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.867010 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-824b02fd-e409-4952-bdba-3d05b551d2e1 req-35f735aa-1309-4e2b-b78c-5c1d5120c986 service nova] Creating event network-vif-plugged:c43b09e1-c606-48c3-ab4c-b62ee389ba94 for instance c8b3ef0d-1829-471c-9d1f-461b84634a6e on nch2-master-1 Apr 30 21:12:10.872564 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-824b02fd-e409-4952-bdba-3d05b551d2e1 req-35f735aa-1309-4e2b-b78c-5c1d5120c986 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Apr 30 21:12:10.873202 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 367/647] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:10.879547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-990b24af-9dbb-45eb-8c23-6a4ea514b340 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:10.886534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-990b24af-9dbb-45eb-8c23-6a4ea514b340 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:10.886996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-990b24af-9dbb-45eb-8c23-6a4ea514b340 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:10.950187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-990b24af-9dbb-45eb-8c23-6a4ea514b340 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Going to try to stop instance {{(pid=130671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:12:11.093019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:11.100408 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6336d1b6-76d3-40c1-95e1-c3228c2e50b3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.291470 Apr 30 21:12:11.101059 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 281/648] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:10 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:11.114558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.115174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:11.122770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.122770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.122770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.123033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.269614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-990b24af-9dbb-45eb-8c23-6a4ea514b340 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.394629 Apr 30 21:12:11.273803 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 368/649] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:10 2022] POST /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:12:11.276414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8221d1b9-5a84-43b7-9fc3-8883ebf6bf50 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.288867 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8221d1b9-5a84-43b7-9fc3-8883ebf6bf50 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.016639 Apr 30 21:12:11.289569 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 369/650] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:11.295090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.295979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:11.305122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.305677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.306913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.307076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.543929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:11.552279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a83b7bde-60d0-4b49-b81e-71b66c2ab050 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1464 microversion: 2.1 time: 0.441230 Apr 30 21:12:11.553009 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 282/651] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1464 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:11.567357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.568075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:11.574129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.576703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.577964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.578684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.610899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:11.619270 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be69cc51-b0bb-424b-9690-9364545544e3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.328530 Apr 30 21:12:11.620813 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 370/652] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:11.625883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-775425cc-909d-4377-9db2-a7564146c75e tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.637939 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-775425cc-909d-4377-9db2-a7564146c75e tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015053 Apr 30 21:12:11.639015 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 371/653] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:11.646610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.647268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:11.658166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.658947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.659910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.660512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.810588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:11.820871 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f98be798-7b61-4b2d-bab0-40f8eec28a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.257642 Apr 30 21:12:11.821456 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 283/654] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:11.826998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.827614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:11.831568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:11.833681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.834267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.837028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.837028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.839863 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1cc3f78-d9d6-43b6-87fc-bed89c38cf9c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1464 microversion: 2.1 time: 0.199126 Apr 30 21:12:11.840593 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 372/655] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:11.845229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ae4a071-a589-46ea-b37a-578b1fdf659c tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.889945 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ae4a071-a589-46ea-b37a-578b1fdf659c tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 3321 microversion: 2.1 time: 0.047980 Apr 30 21:12:11.890863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 373/656] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 3321 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:11.895633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:11.896251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:11.904962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.905430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:11.906791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:11.907428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.036553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.052913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.054493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.055634 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4c39d3e-f1f2-444c-bbe2-c5332714e7b1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1258 microversion: 2.25 time: 0.163654 Apr 30 21:12:12.067606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 374/657] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:12.067606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.067606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:12.067606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.068458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.068973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.069378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.102060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.110392 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-54701177-bd3c-4a2a-a5e2-e074d02fe686 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1319 microversion: 2.1 time: 0.287524 Apr 30 21:12:12.111442 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 284/658] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:11 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:12.116147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:12.118290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:12.126007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.126706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.127758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.128325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.214661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:12:12.215381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:12:12.215869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:12:12.216286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:12:12.216873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:12:12.275040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.282763 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-25e405fe-b039-41c8-a017-ffb394134cc1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.225518 Apr 30 21:12:12.283662 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 375/659] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:12.287898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-50456a9b-738d-4e5d-9226-72bc38795bae tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.296013 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-50456a9b-738d-4e5d-9226-72bc38795bae tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011658 Apr 30 21:12:12.300354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 376/660] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:12.302109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.303461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:12.310719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.311175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.311961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.312906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.409144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:12.415557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.416267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.417318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.417984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.449947 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dac5e295-86c1-4e61-923c-f969b971b4a8 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action" status: 202 len: 1068 microversion: 2.1 time: 0.337632 Apr 30 21:12:12.453854 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 285/661] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:12 2022] POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action => generated 1068 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 30 21:12:12.456241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0390067a-6b7f-4dce-b788-41422ffe7748 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.472320 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0390067a-6b7f-4dce-b788-41422ffe7748 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.020036 Apr 30 21:12:12.472933 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 286/662] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:12.480384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.480626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:12.486734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.487886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.488700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.489150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.595979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.609379 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d46d5517-5bc6-470e-a080-41663716dcef tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.311745 Apr 30 21:12:12.619406 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 377/663] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:12.625713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b3cb5983-5e20-485a-ae7b-78b43f99d2ee tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.633204 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b3cb5983-5e20-485a-ae7b-78b43f99d2ee tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011979 Apr 30 21:12:12.633810 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 378/664] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:12.644011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.644623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:12.650659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.651035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.651927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.652429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.785308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.794062 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8aa28b2f-d03b-4ac0-a005-31c7501608e7 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.319468 Apr 30 21:12:12.804056 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 287/665] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:12.809379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6ea7f0aa-88eb-4f30-a886-27a18b8879be req-d5f5a044-7880-4250-88df-32afb2eb9d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f26a54-dfce-45a0-9dc2-3bd5be9f87c8", "name": "network-vif-unplugged", "status": "completed", "tag": "4306ca96-09e1-476e-90ee-9c1a1813cb5f"}, {"name": "network-changed", "server_uuid": "89f26a54-dfce-45a0-9dc2-3bd5be9f87c8", "tag": "4306ca96-09e1-476e-90ee-9c1a1813cb5f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:12.817903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ea7f0aa-88eb-4f30-a886-27a18b8879be req-d5f5a044-7880-4250-88df-32afb2eb9d61 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.818349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ea7f0aa-88eb-4f30-a886-27a18b8879be req-d5f5a044-7880-4250-88df-32afb2eb9d61 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.829744 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6ea7f0aa-88eb-4f30-a886-27a18b8879be req-d5f5a044-7880-4250-88df-32afb2eb9d61 service nova] Creating event network-vif-unplugged:4306ca96-09e1-476e-90ee-9c1a1813cb5f for instance 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 on nch2-master-1 Apr 30 21:12:12.830285 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6ea7f0aa-88eb-4f30-a886-27a18b8879be req-d5f5a044-7880-4250-88df-32afb2eb9d61 service nova] Creating event network-changed:4306ca96-09e1-476e-90ee-9c1a1813cb5f for instance 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 on nch2-master-1 Apr 30 21:12:12.836850 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6ea7f0aa-88eb-4f30-a886-27a18b8879be req-d5f5a044-7880-4250-88df-32afb2eb9d61 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.031002 Apr 30 21:12:12.837684 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 288/666] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:12.843898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f75422c-a537-46b9-95c2-750687fb1667 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.872987 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f75422c-a537-46b9-95c2-750687fb1667 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.034067 Apr 30 21:12:12.880363 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 289/667] 10.222.0.23 () {58 vars in 1147 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:12.884701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.885487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:12.892022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.892486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.893294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:12.897356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:12.935758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:12.945617 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dddd6ed2-6969-4ec3-8032-fde4a09e9a70 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.305676 Apr 30 21:12:12.946512 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 379/668] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:12.956713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6e33ca24-1d01-40e8-b573-6e3ab00fcd63 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.968134 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6e33ca24-1d01-40e8-b573-6e3ab00fcd63 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020274 Apr 30 21:12:12.970065 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 380/669] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:12.981502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce70f985-f53f-46c1-8288-66187e9a6f47 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:12.989646 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce70f985-f53f-46c1-8288-66187e9a6f47 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012614 Apr 30 21:12:12.995756 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 381/670] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:13.000791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3c38601-c16f-49a9-83bb-3ba2b7483d99 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.031792 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3c38601-c16f-49a9-83bb-3ba2b7483d99 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1779 microversion: 2.1 time: 0.030929 Apr 30 21:12:13.032839 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 382/671] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/flavors?marker=452 => generated 1779 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:13.049596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dddd328d-8515-48fa-8f0a-c3d888a46fb2 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.074032 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dddd328d-8515-48fa-8f0a-c3d888a46fb2 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.032065 Apr 30 21:12:13.074628 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 383/672] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:12:13 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:13.080801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.085426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:13.087679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.088129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.089444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.089913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.201655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:13.205925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:13.209933 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b1b7fb07-e8ce-40a3-b854-5c559ffa076a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.334775 Apr 30 21:12:13.210569 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 290/673] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:12 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:13.215227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:13.216270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c77900c-7185-4dbf-a9ad-8e83bac7dc01 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.216749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:13.217889 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d32a64ec-bb95-483d-8ad6-4324943f4f13 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1332 microversion: 2.25 time: 0.142035 Apr 30 21:12:13.218607 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 384/674] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:13 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:13.222792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.223436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:13.230474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.230925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.231720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c77900c-7185-4dbf-a9ad-8e83bac7dc01 tempest-FlavorsV2TestJSON-1469237617 tempest-FlavorsV2TestJSON-1469237617-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020030 Apr 30 21:12:13.231837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.232140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.233797 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 291/675] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:13.299729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.299729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:13.305572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.306072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.306847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.307468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.458971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:13.467118 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7996ee52-ba3c-44d9-a563-d731309707d7 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1319 microversion: 2.1 time: 0.247682 Apr 30 21:12:13.467943 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 385/676] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:13 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:13.545011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:13.553858 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c7f10471-acbe-459f-9b5e-3808b36191c9 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1385 microversion: 2.1 time: 0.258427 Apr 30 21:12:13.555116 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 292/677] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:13 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1385 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:13.626962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.627699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:13.646213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.652083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.653083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.653633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.812144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:13.813453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:13.825975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.828877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:13.829945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:13.830712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.199468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.206992 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc24c853-c0a4-4edf-97e3-8fbb37b2421c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.583983 Apr 30 21:12:14.207679 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 386/678] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:13 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:14.212170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5b1abd01-6d00-4668-8585-b6be92bd77e0 req-730d98b8-8664-460f-a340-94da95cb6214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90628276-3647-4b96-9a5e-48538fbed14b", "name": "network-vif-plugged", "status": "completed", "tag": "6d4dd76d-9d01-473d-a7e3-bb9f5df1f76d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:14.221305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5b1abd01-6d00-4668-8585-b6be92bd77e0 req-730d98b8-8664-460f-a340-94da95cb6214 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.221750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5b1abd01-6d00-4668-8585-b6be92bd77e0 req-730d98b8-8664-460f-a340-94da95cb6214 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.236757 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5b1abd01-6d00-4668-8585-b6be92bd77e0 req-730d98b8-8664-460f-a340-94da95cb6214 service nova] Creating event network-vif-plugged:6d4dd76d-9d01-473d-a7e3-bb9f5df1f76d for instance 90628276-3647-4b96-9a5e-48538fbed14b on nch1-master-1 Apr 30 21:12:14.242264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5b1abd01-6d00-4668-8585-b6be92bd77e0 req-730d98b8-8664-460f-a340-94da95cb6214 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Apr 30 21:12:14.243185 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 387/679] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:14.249616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:14.250906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:14.258387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.261456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.261456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.261456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.314070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.322574 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d39cd05b-b2ba-4ab2-b39d-d8997ae4ecfb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.514983 Apr 30 21:12:14.325423 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 293/680] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:13 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:14.333356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:14.334605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:14.342108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.342792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.343899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.344560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.678098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.687795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4fa46578-c832-4636-8e47-e7f7865267c6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.443140 Apr 30 21:12:14.688492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 388/681] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:14 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:14.690815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.697523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:14.701642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:14.701791 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5cc0f60-4ae9-4b7a-88c0-095bd2b33569 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.370466 Apr 30 21:12:14.701791 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 294/682] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:14 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:14.704669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.705123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.705929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.706521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.711460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:14.712221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:14.718327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.718877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.719781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:14.720294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:14.978773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.986995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.988073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.988562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:14.989788 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c0e188b-5388-4e28-97d2-976e0d033729 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.299920 Apr 30 21:12:14.996040 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 389/683] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:14 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:14.996040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:14.996232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:15.002153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.002613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.003404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.004029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.006367 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f7aa348-2685-4191-bbd8-5970686cedb6 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1319 microversion: 2.1 time: 0.304409 Apr 30 21:12:15.007181 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 295/684] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:14 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:15.224111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:15.224987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:15.233908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:15.241806 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-34602dd0-b302-47cf-bde9-3581d0b4b284 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1584 microversion: 2.1 time: 0.250079 Apr 30 21:12:15.243733 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 390/685] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:14 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1584 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:15.255027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.255499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.256331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.256764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.266093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-79c17205-c049-4e42-b946-6b0d97660f26 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:15.266807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-79c17205-c049-4e42-b946-6b0d97660f26 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:15.274386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79c17205-c049-4e42-b946-6b0d97660f26 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.275106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79c17205-c049-4e42-b946-6b0d97660f26 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.276126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79c17205-c049-4e42-b946-6b0d97660f26 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.276743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79c17205-c049-4e42-b946-6b0d97660f26 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.423785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-79c17205-c049-4e42-b946-6b0d97660f26 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161764 Apr 30 21:12:15.424392 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 391/686] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:12:15 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:12:15.435476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:15.436286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:15.442835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.443305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.444107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.444550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.466110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:15.477503 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c60e2da9-2256-496a-95cc-ed63d3e76f7d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.257034 Apr 30 21:12:15.479618 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 296/687] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:15 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:15.686642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:15.694726 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc42c934-751f-4d86-9a6b-a49a8d71173f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.263700 Apr 30 21:12:15.699553 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 392/688] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:15 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:15.712366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:15.713378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:15.725368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.729271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.730829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:15.731644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:15.803230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1932099204", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:15.862683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:12:16.000538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:16.012325 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d3fabd11-e709-4e74-8a07-b04b1afb6dc2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.311464 Apr 30 21:12:16.023099 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 393/689] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:15 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:16.030252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:16.030883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:16.043641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.044583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.045404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.045857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.229195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:12:16.229810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:12:16.231088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:12:16.231612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:12:16.232210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:12:16.242249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.242713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.243557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.244117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.263828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Getting quotas for project 9284e1c76f5a41ea9da1eb011943eb8a. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:12:16.269885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Getting quotas for user 74c331c48d20422492001f71f0672885 and project 9284e1c76f5a41ea9da1eb011943eb8a. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:12:16.290655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:16.294711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:12:16.300615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:12:16.306483 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0fa54762-c4ad-4089-ac60-551540ea3b33 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.281659 Apr 30 21:12:16.307459 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 394/690] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:16 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:16.325470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:16.327055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:16.334206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.334927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.335894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.336581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.442785 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-01750182-eb74-4c2b-90bb-6d47759bb883 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798221 Apr 30 21:12:16.451470 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 297/691] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:12:16.467190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:16.479434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:16.496130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.496878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.498123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.498833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.630023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:16.645036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:16.646855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:16.649493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5647da56-8399-43e3-9566-2e3fbb43cf8b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.330717 Apr 30 21:12:16.654055 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 395/692] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:16 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:16.664314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8927705b-88f0-41db-b9f9-45ed908db19e req-239a688e-2444-4fca-821c-dbc09049fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1645e8a-0c59-4c61-b10a-636c7fe28621", "tag": "b109dd6d-2c6c-45b3-b525-5062d226cde4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:16.672588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8927705b-88f0-41db-b9f9-45ed908db19e req-239a688e-2444-4fca-821c-dbc09049fe0e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.681826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8927705b-88f0-41db-b9f9-45ed908db19e req-239a688e-2444-4fca-821c-dbc09049fe0e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.691961 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8927705b-88f0-41db-b9f9-45ed908db19e req-239a688e-2444-4fca-821c-dbc09049fe0e service nova] Creating event network-changed:b109dd6d-2c6c-45b3-b525-5062d226cde4 for instance a1645e8a-0c59-4c61-b10a-636c7fe28621 on nch1-master-1 Apr 30 21:12:16.699982 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8927705b-88f0-41db-b9f9-45ed908db19e req-239a688e-2444-4fca-821c-dbc09049fe0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048576 Apr 30 21:12:16.704671 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 396/693] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:16.710395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fb631462-eba4-4e25-a454-938fa442157b tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:16.711353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fb631462-eba4-4e25-a454-938fa442157b tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:16.786221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb631462-eba4-4e25-a454-938fa442157b tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:16.793015 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fb631462-eba4-4e25-a454-938fa442157b tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1217 microversion: 2.1 time: 0.086949 Apr 30 21:12:16.793716 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 397/694] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:16 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:16.798621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:16.799330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:16.808468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.809409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.811102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.812213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.820195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:16.830840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aaba9e95-8e03-4ff9-bfbe-b1dc70488cb4 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1468 microversion: 2.1 time: 0.377580 Apr 30 21:12:16.842214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 298/695] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:16 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:16.847433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:16.848339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:16.854858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.855432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:16.856463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:16.857009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.181221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:17.190173 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-04c20679-6e47-41f6-9733-5d840404f65d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.394634 Apr 30 21:12:17.190778 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 398/696] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:16 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:17.195686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8ea970f-7bc7-41eb-a567-fff38042b90f tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:17.196991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8ea970f-7bc7-41eb-a567-fff38042b90f tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:17.204066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8ea970f-7bc7-41eb-a567-fff38042b90f tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.204653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8ea970f-7bc7-41eb-a567-fff38042b90f tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.205553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8ea970f-7bc7-41eb-a567-fff38042b90f tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.206160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8ea970f-7bc7-41eb-a567-fff38042b90f tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.220302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:17.233999 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-50a57c32-3f92-4acd-ab46-6b9376712b65 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.389463 Apr 30 21:12:17.242926 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 299/697] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:16 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:17.249084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:17.249856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:17.256853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.257341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.258190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.258594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.614986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:17.620258 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8ea970f-7bc7-41eb-a567-fff38042b90f tempest-DeleteServersAdminTestJSON-1495963533 tempest-DeleteServersAdminTestJSON-1495963533-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b/action" status: 202 len: 0 microversion: 2.1 time: 0.427978 Apr 30 21:12:17.624137 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 399/698] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:17 2022] POST /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:12:17.627694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:17.627694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:17.627865 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88807d60-2fc5-432e-9ffe-45811296c4fb tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.383322 Apr 30 21:12:17.637013 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 300/699] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:17 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:17.638626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-48dc5576-a202-47b0-93b3-83a05280e03a req-ee9ac96f-c640-4477-b681-e7a507921ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b3ef0d-1829-471c-9d1f-461b84634a6e", "tag": "c43b09e1-c606-48c3-ab4c-b62ee389ba94"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:17.646732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-48dc5576-a202-47b0-93b3-83a05280e03a req-ee9ac96f-c640-4477-b681-e7a507921ffc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.647198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-48dc5576-a202-47b0-93b3-83a05280e03a req-ee9ac96f-c640-4477-b681-e7a507921ffc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.657852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.658598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.659566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.660105 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-48dc5576-a202-47b0-93b3-83a05280e03a req-ee9ac96f-c640-4477-b681-e7a507921ffc service nova] Creating event network-changed:c43b09e1-c606-48c3-ab4c-b62ee389ba94 for instance c8b3ef0d-1829-471c-9d1f-461b84634a6e on nch2-master-1 Apr 30 21:12:17.660347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.665898 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-48dc5576-a202-47b0-93b3-83a05280e03a req-ee9ac96f-c640-4477-b681-e7a507921ffc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030744 Apr 30 21:12:17.666568 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 301/700] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:17.672448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:17.673368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:17.681238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.682004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:17.683403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:17.684014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.000054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.001092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.010322 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0150a02e-34e2-405c-92dd-531fba607e70 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 200 len: 1584 microversion: 2.1 time: 0.387821 Apr 30 21:12:18.011678 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81e1d968-82dc-46c3-9c92-10c3a0996ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.342342 Apr 30 21:12:18.012832 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 400/701] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:17 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 1584 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:18.017473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:18.018315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:18.023810 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 302/702] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:17 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:18.027757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.028208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.028988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.029432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.040504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:18.041529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:18.051035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.051035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.051855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.052986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.075538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.076223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.077186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lazy-loading 'fault' on Instance uuid 90628276-3647-4b96-9a5e-48538fbed14b {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:18.337314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.346080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.350192 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67108b83-352e-4551-ba5e-b420b14b8f86 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1451 microversion: 2.1 time: 0.335886 Apr 30 21:12:18.351515 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 401/703] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:18 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1451 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:18.360405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:18.362644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:18.367218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.381622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.381622 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-64ee36be-948e-4190-9bd2-71086fd7bd51 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.345030 Apr 30 21:12:18.381902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.382017 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 303/704] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:18 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:18.382108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.382108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.382108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.382372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b35e0a06-e9b7-4f76-b852-b5e4d9db6a12 req-5955d325-d5b8-4d57-a5cb-21f775afb203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3604c457-9d04-40ae-8d64-1e3a9c5997b9", "name": "network-vif-plugged", "status": "completed", "tag": "847cb3b0-ee43-4565-9188-e7bd64f115af"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:18.383828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b35e0a06-e9b7-4f76-b852-b5e4d9db6a12 req-5955d325-d5b8-4d57-a5cb-21f775afb203 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.384276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b35e0a06-e9b7-4f76-b852-b5e4d9db6a12 req-5955d325-d5b8-4d57-a5cb-21f775afb203 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.396600 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b35e0a06-e9b7-4f76-b852-b5e4d9db6a12 req-5955d325-d5b8-4d57-a5cb-21f775afb203 service nova] Creating event network-vif-plugged:847cb3b0-ee43-4565-9188-e7bd64f115af for instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 on nch2-master-1 Apr 30 21:12:18.401833 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b35e0a06-e9b7-4f76-b852-b5e4d9db6a12 req-5955d325-d5b8-4d57-a5cb-21f775afb203 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029378 Apr 30 21:12:18.402189 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 304/705] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:18.407382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:18.408072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:18.414839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.415386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.416291 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.416764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.465617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.473920 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e57db732-9ec3-439b-ae36-13a45164d26a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1221 microversion: 2.1 time: 0.120622 Apr 30 21:12:18.474727 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 402/706] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:18 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:18.479636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:18.480248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:18.486164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.486613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.487564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.488039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.754906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.762620 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dc73ee9f-1099-4528-8f81-9e0a5644d168 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.359262 Apr 30 21:12:18.763323 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 305/707] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:18 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:18.769555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:18.770073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:18.777862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:18.786710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-530cdad9-18a5-4fc2-b8b4-8beaec363c1c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.310697 Apr 30 21:12:18.790010 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 403/708] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:18 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:18.790132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.790132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.790132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.790132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.793082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:18.793977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:18.802643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.803972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.804943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:18.805540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:18.826308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:12:19.002364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.010251 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6cc1599-b945-42cf-8c0b-0abcf8ced814 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.221925 Apr 30 21:12:19.011243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 404/709] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:18 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:19.031746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:19.032636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:19.040751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.041634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.043288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.043959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.160102 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc3988ae-9407-467d-a699-80a2a6370c30 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 204 len: 0 microversion: 2.1 time: 0.394223 Apr 30 21:12:19.163726 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 306/710] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:12:18 2022] DELETE /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:12:19.171190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:19.171908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:19.181240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.181695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.182560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.183077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.218115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.218881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.218997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lazy-loading 'fault' on Instance uuid 90628276-3647-4b96-9a5e-48538fbed14b {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:19.285357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.293867 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43bab45d-e11b-4ae8-98c5-3c67e242c98f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.266170 Apr 30 21:12:19.294449 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 405/711] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:19 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:19.363412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.371431 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b3532554-8f3f-4e7b-be77-dbc6e18ec77b tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1457 microversion: 2.1 time: 0.206290 Apr 30 21:12:19.372007 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 307/712] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:19 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1457 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:19.388742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:19.389354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:19.395347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.395802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.396573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.397025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.490696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:19.491445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:19.497390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.497883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.498667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.499112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.518744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.527165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.528781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.530000 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55cb1060-a247-473b-8944-663589c05fc2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.145547 Apr 30 21:12:19.530570 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 406/713] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:19 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:19.561415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.569039 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-19c5f76b-0304-4fad-a838-e3a739a948f8 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1213 microversion: 2.1 time: 0.082248 Apr 30 21:12:19.569608 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 308/714] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:19 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:19.779033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:19.779746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:19.786425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.786879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.787658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.788098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.805432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:19.806076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:19.812956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.813386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.814192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:19.819698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:19.980326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.987789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:19.989190 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-887bf550-1633-4397-b371-47c4d8823eea tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1313 microversion: 2.1 time: 0.214167 Apr 30 21:12:19.989798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 407/715] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:19 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:19.998919 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98058569-cb87-48f7-afa4-8ca5263f92a6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.197237 Apr 30 21:12:19.999502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 309/716] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:19 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:20.030072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:20.030072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:20.036261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.037012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.037826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.038269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.172026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:20.179462 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d654eb60-a527-490c-9a1c-7b6a539804f0 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1504 microversion: 2.1 time: 0.155821 Apr 30 21:12:20.180030 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 408/717] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:20 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:20.312535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:20.313509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:20.320103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.320712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.321604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.322154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.388887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:20.389936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:20.397388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.397649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.398499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.399016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.442002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.442496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.443158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lazy-loading 'fault' on Instance uuid 90628276-3647-4b96-9a5e-48538fbed14b {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:20.514914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:20.524839 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aa3a5254-2f33-4060-9b11-8fd7bcfb511c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.217177 Apr 30 21:12:20.525705 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 310/718] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:20 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:20.554385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:20.554385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:20.557940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.558671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.559201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.559698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.584892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:20.593383 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-afa5053c-8c2e-44c1-9419-193fc7b859fb tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1457 microversion: 2.1 time: 0.208708 Apr 30 21:12:20.604302 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 409/719] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:20 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1457 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:20.609336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:20.614973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:20.616456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.616911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.617705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:20.618169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:20.696738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:20.705628 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-533edc2d-d635-45fb-b712-8422fded0601 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1269 microversion: 2.1 time: 0.100018 Apr 30 21:12:20.715175 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 410/720] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:20 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:20.758412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:20.767343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:20.768994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:20.770125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ea0d93fa-a677-400f-8b64-c95ab2c15df7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.225323 Apr 30 21:12:20.770743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 311/721] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:20 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:21.007075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:21.008820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:21.014668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.015136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.015929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.016353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:21.016472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.017052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:21.023544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.024085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.024935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.025466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.464794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:21.472716 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab200cb0-c1d4-4111-be4a-7dcd20121a39 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1463 microversion: 2.1 time: 0.471077 Apr 30 21:12:21.475998 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 411/722] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:21 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1463 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:21.477052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:21.481441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:21.482547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:21.495050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.495833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.496909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.497362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.505388 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf884233-c5a7-4e3f-84f8-c56500417882 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.492766 Apr 30 21:12:21.506773 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 312/723] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:21 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:21.523158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:21.525921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:21.534313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.535085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.536188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.536847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.657741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:21.666535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Old instance type m1.heat2, new instance type m1.heat {{(pid=130670) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 21:12:21.667410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:21.679912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:12:21.680479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:12:21.681468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:12:21.681601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:12:21.682011 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73723c07-d689-4241-9682-a47c16d946ea tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1479 microversion: 2.1 time: 0.204751 Apr 30 21:12:21.682192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:12:21.700714 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 412/724] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:21 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1479 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:21.700714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:21.700714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:21.722357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.723280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.725078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:21.725078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:21.980432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:21.988418 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89746dda-6b4b-4783-9de3-1bad5d9288ae tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.296875 Apr 30 21:12:21.989116 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 413/725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:21 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:21.995636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:21.996738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:22.004063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.004913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.006688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.006688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.038291 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4be6ee6a-85f8-4f73-bed5-f6b304a088bf tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9/action" status: 202 len: 0 microversion: 2.1 time: 0.529766 Apr 30 21:12:22.039481 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 313/726] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:21 2022] POST /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:12:22.045398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1fe816ae-3cb3-4467-b195-d6a327ce80a7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '.version_select at 0x7fdc212c43a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:22.048631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1fe816ae-3cb3-4467-b195-d6a327ce80a7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.049350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1fe816ae-3cb3-4467-b195-d6a327ce80a7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.051355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.051805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.052588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lazy-loading 'fault' on Instance uuid 90628276-3647-4b96-9a5e-48538fbed14b {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:22.063011 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1fe816ae-3cb3-4467-b195-d6a327ce80a7 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1559 microversion: 2.1 time: 0.021446 Apr 30 21:12:22.070848 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 314/727] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:12:22 2022] GET /compute/v2.1/os-migrations => generated 1559 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:22.078723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:22.091950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:22.100958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.101661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.102735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.103185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.133877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8350c0cb814c66b94775110721dee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f727d5639c624deeba0d0d7a7d08810e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:22.165228 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-018efe3d-394a-4a9e-b780-deec87965019 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 200 len: 1415 microversion: 2.1 time: 0.172821 Apr 30 21:12:22.166349 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 414/728] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:21 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 1415 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:22.175061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:22.179656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:22.207841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:22.207841 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9788428-dcb5-43fd-a91a-ea902d43d99e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1275 microversion: 2.1 time: 0.124340 Apr 30 21:12:22.207841 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 315/729] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:22 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:22.208096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.208096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.208096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.208096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.208989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f9cb51e3-b073-4da5-9d97-dc77ea3f0828 req-d71fdc07-7060-4dd8-a4e4-a84e09d81178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90628276-3647-4b96-9a5e-48538fbed14b", "name": "network-vif-deleted", "tag": "6d4dd76d-9d01-473d-a7e3-bb9f5df1f76d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:22.227533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f9cb51e3-b073-4da5-9d97-dc77ea3f0828 req-d71fdc07-7060-4dd8-a4e4-a84e09d81178 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.228117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f9cb51e3-b073-4da5-9d97-dc77ea3f0828 req-d71fdc07-7060-4dd8-a4e4-a84e09d81178 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.250091 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f9cb51e3-b073-4da5-9d97-dc77ea3f0828 req-d71fdc07-7060-4dd8-a4e4-a84e09d81178 service nova] Creating event network-vif-deleted:6d4dd76d-9d01-473d-a7e3-bb9f5df1f76d for instance 90628276-3647-4b96-9a5e-48538fbed14b on nch1-master-1 Apr 30 21:12:22.255513 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f9cb51e3-b073-4da5-9d97-dc77ea3f0828 req-d71fdc07-7060-4dd8-a4e4-a84e09d81178 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056986 Apr 30 21:12:22.256348 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 316/730] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:22.261901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:22.262829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:22.269297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.270147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.271770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.272715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.450242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:22.459791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:22.466487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:22.468736 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c037129b-a9da-4642-9f56-f2705729cf49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.299727 Apr 30 21:12:22.471180 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 415/731] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:22 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:22.475836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8412829b-a467-4a8c-975d-887370890f3c tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:22.476594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8412829b-a467-4a8c-975d-887370890f3c tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:22.488532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8412829b-a467-4a8c-975d-887370890f3c tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.489140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8412829b-a467-4a8c-975d-887370890f3c tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.490088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8412829b-a467-4a8c-975d-887370890f3c tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.490591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8412829b-a467-4a8c-975d-887370890f3c tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.524717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:22.531770 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4edb466a-78aa-49c2-9506-1b3aa1087c18 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1472 microversion: 2.1 time: 0.273946 Apr 30 21:12:22.532393 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 317/732] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:22 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:22.537534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:22.538341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:22.547185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.547642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.549129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:22.549806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:22.709530 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8412829b-a467-4a8c-975d-887370890f3c tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1630 microversion: 2.1 time: 0.237083 Apr 30 21:12:22.721825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 416/733] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:22 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1630 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:22.803085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:22.812326 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-537cd08d-4c12-4de2-b021-26d698598e86 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.278731 Apr 30 21:12:22.812894 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 318/734] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:22 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:22.869829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1287442136", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "101af96d-46b7-4982-b0ed-3b0af2fa0ddf"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:22.922497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] validate_networks() for [('101af96d-46b7-4982-b0ed-3b0af2fa0ddf', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:12:23.006331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.007811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.017667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.020518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.023031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.023547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.237514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:23.243639 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc242efd-c9fa-44b3-b867-8f8c5a5a24a5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.241463 Apr 30 21:12:23.244221 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 319/735] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:23 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:23.248633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.249284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.255197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.255661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.256448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.256900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.272758 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] HTTP exception thrown: Instance 90628276-3647-4b96-9a5e-48538fbed14b could not be found. Apr 30 21:12:23.273432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Returning 404 to user: Instance 90628276-3647-4b96-9a5e-48538fbed14b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:23.274375 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc9fd183-3949-42ec-ae8d-cd69676f1bb8 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 404 len: 111 microversion: 2.1 time: 0.029199 Apr 30 21:12:23.276958 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 320/736] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:23 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:23.284361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.284361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.287665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.288129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.288922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.289386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.597217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:23.606793 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-785dd3b4-4822-4651-a2ef-588423d2d283 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.330477 Apr 30 21:12:23.608809 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 321/737] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:23 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:23.618102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.618102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.620753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.621051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.621940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.622447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.633585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:12:23.633585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:12:23.634400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:12:23.634496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:12:23.634848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:12:23.637901 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] HTTP exception thrown: Instance 90628276-3647-4b96-9a5e-48538fbed14b could not be found. Apr 30 21:12:23.638696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Returning 404 to user: Instance 90628276-3647-4b96-9a5e-48538fbed14b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:23.639539 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ebd4639b-1383-43c5-9f93-358c304188ce tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 404 len: 111 microversion: 2.1 time: 0.029736 Apr 30 21:12:23.640490 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 322/738] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:12:23 2022] DELETE /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:23.647816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.648595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.650576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.651675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.652484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.652819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.654946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.655519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.656398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.656977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.679020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:12:23.684084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for user 8bd54cdc115e4ae9b202bd06c7658e4a and project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:12:23.697111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:12:23.699623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:12:23.804608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:23.812168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:23.813675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:23.815109 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ed09cb6d-73be-48e0-9e9f-a114f73dbbd1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.173580 Apr 30 21:12:23.816145 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 323/739] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:23 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:23.820935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.821713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.833382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.833382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.833382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.833382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.918581 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e4a27b49-18e7-4bfc-aa5c-55226c60e4c8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052615 Apr 30 21:12:23.919245 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 417/740] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:12:23.933507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.950391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 90628276-3647-4b96-9a5e-48538fbed14b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.950391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.950391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.950391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.950806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.966560 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] HTTP exception thrown: Instance 90628276-3647-4b96-9a5e-48538fbed14b could not be found. Apr 30 21:12:23.967579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Returning 404 to user: Instance 90628276-3647-4b96-9a5e-48538fbed14b could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:23.972585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-64b60874-d42a-4278-890f-77b6c49d0282 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b" status: 404 len: 111 microversion: 2.1 time: 0.042400 Apr 30 21:12:23.972585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 418/741] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:23 2022] GET /compute/v2.1/servers/90628276-3647-4b96-9a5e-48538fbed14b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:23.976424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:23.977427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:23.987266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.987865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:23.989451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:23.990025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.024796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.036382 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1da3dd52-decf-4b32-857c-87fd492864c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1472 microversion: 2.1 time: 0.218750 Apr 30 21:12:24.038656 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 324/742] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:23 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:24.063082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-54c43d5b-891b-47c2-857b-d5e42a17f07c req-19f9e928-3fd8-4052-94fa-b9121820ef50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353f3622-93d0-45c9-8971-89e3308037b6", "tag": "544026f7-e9ff-4a0e-9515-f5e31e5016da"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:24.087512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-54c43d5b-891b-47c2-857b-d5e42a17f07c req-19f9e928-3fd8-4052-94fa-b9121820ef50 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.087975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-54c43d5b-891b-47c2-857b-d5e42a17f07c req-19f9e928-3fd8-4052-94fa-b9121820ef50 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.104934 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-54c43d5b-891b-47c2-857b-d5e42a17f07c req-19f9e928-3fd8-4052-94fa-b9121820ef50 service nova] Creating event network-changed:544026f7-e9ff-4a0e-9515-f5e31e5016da for instance 353f3622-93d0-45c9-8971-89e3308037b6 on nch1-master-1 Apr 30 21:12:24.117283 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-54c43d5b-891b-47c2-857b-d5e42a17f07c req-19f9e928-3fd8-4052-94fa-b9121820ef50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077112 Apr 30 21:12:24.117923 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 325/743] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:24.130850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-24d4e2cc-1d41-4ce9-b8d4-3edc497961ad req-44604d2b-200e-4756-9064-2597366ae4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1645e8a-0c59-4c61-b10a-636c7fe28621", "name": "network-vif-plugged", "status": "completed", "tag": "b109dd6d-2c6c-45b3-b525-5062d226cde4"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:24.149376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-24d4e2cc-1d41-4ce9-b8d4-3edc497961ad req-44604d2b-200e-4756-9064-2597366ae4fa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.149861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-24d4e2cc-1d41-4ce9-b8d4-3edc497961ad req-44604d2b-200e-4756-9064-2597366ae4fa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.186604 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-24d4e2cc-1d41-4ce9-b8d4-3edc497961ad req-44604d2b-200e-4756-9064-2597366ae4fa service nova] Creating event network-vif-plugged:b109dd6d-2c6c-45b3-b525-5062d226cde4 for instance a1645e8a-0c59-4c61-b10a-636c7fe28621 on nch1-master-1 Apr 30 21:12:24.193576 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-24d4e2cc-1d41-4ce9-b8d4-3edc497961ad req-44604d2b-200e-4756-9064-2597366ae4fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067961 Apr 30 21:12:24.194193 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 326/744] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:24.200207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0ad0ca1-9947-4311-b99b-4b12b8556978 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:24.202073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0ad0ca1-9947-4311-b99b-4b12b8556978 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:24.284743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0ad0ca1-9947-4311-b99b-4b12b8556978 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.294291 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0ad0ca1-9947-4311-b99b-4b12b8556978 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1211 microversion: 2.1 time: 0.098637 Apr 30 21:12:24.294882 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 327/745] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:24 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:24.297175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.305135 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da173143-4355-4fbe-aa9d-49ba6743edef tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.334670 Apr 30 21:12:24.315663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:24.315663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:24.316606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 419/746] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:23 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:24.318228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.319257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.320232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.320684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.322313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:24.323726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:24.337042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.337042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.337042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.337042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.338680 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] HTTP exception thrown: Instance 9445f840-9b08-41a7-b9b5-48c93312189c could not be found. Apr 30 21:12:24.339379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Returning 404 to user: Instance 9445f840-9b08-41a7-b9b5-48c93312189c could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:24.340800 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bec7cd46-e186-4ca2-9b32-ecc0f1833f51 tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 404 len: 111 microversion: 2.1 time: 0.037196 Apr 30 21:12:24.342661 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 328/747] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:12:24 2022] DELETE /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:24.354650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:24.371233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] [instance: 9445f840-9b08-41a7-b9b5-48c93312189c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:24.377803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.378272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.379082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.379536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.399485 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] HTTP exception thrown: Instance 9445f840-9b08-41a7-b9b5-48c93312189c could not be found. Apr 30 21:12:24.399690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] Returning 404 to user: Instance 9445f840-9b08-41a7-b9b5-48c93312189c could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:24.400457 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b7949aa-5d16-40c8-a8fd-54bd0fcd294d tempest-DeleteServersAdminTestJSON-1789370697 tempest-DeleteServersAdminTestJSON-1789370697-project] 10.222.0.23 "GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c" status: 404 len: 111 microversion: 2.1 time: 0.054802 Apr 30 21:12:24.401586 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 329/748] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:24 2022] GET /compute/v2.1/servers/9445f840-9b08-41a7-b9b5-48c93312189c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:24.548205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.555764 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd338d22-1e96-4c00-8fcd-8e2d74a48dd3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.237903 Apr 30 21:12:24.556350 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 420/749] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:24 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:24.625347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:24.625942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:24.632358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.632816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.633597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.634070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.772574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.782663 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b787f47d-36a4-431a-94ba-7f7cccdd003e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.161224 Apr 30 21:12:24.784227 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 330/750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:24 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:24.833525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:24.834168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:24.840703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.841537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.842421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:24.842866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:24.979843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.988463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.992882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:24.992882 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-230eefea-9fb4-478c-9fa2-0b60d5c96887 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.161920 Apr 30 21:12:24.992882 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 421/751] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:24 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:25.069499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:25.070245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:25.076912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.077373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.078228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.078676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.208643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:25.216641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b65949a3-0ed5-40f1-afc3-edd0599699ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1472 microversion: 2.1 time: 0.165191 Apr 30 21:12:25.217207 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 331/752] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:25 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:25.311941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:25.312559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:25.320801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.321322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.322407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.322878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.325365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:25.326624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:25.339722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.340184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.341493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.341493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.413894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:25.422027 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aeb992a2-a94d-4394-97c9-ccf8aa788a56 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1215 microversion: 2.1 time: 0.114569 Apr 30 21:12:25.422623 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 422/753] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:25 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:25.534452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:25.543710 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a825102d-66af-4ac4-98a1-2ce9061676ce tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.224966 Apr 30 21:12:25.544514 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 332/754] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:25 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:25.573540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:25.574202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:25.580931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.581628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.582660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.583106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.787958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:25.799920 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a00ef247-372e-49da-a1cc-a59535ab9924 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.230097 Apr 30 21:12:25.800166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:25.800948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:25.801437 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 423/755] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:25 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:25.807769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.808426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:25.809208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:25.809720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.001913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:26.009653 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51b4fa6b-7188-4497-92e5-77f33fb86bdb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.213774 Apr 30 21:12:26.010554 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 333/756] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:25 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:26.019381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:26.020118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:26.026815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.027349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.028205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.028732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.183367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:26.187556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:26.194728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:26.196141 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58c35242-a1b0-4f85-8410-6b1eab46786e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1362 microversion: 2.25 time: 0.189543 Apr 30 21:12:26.196706 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 424/757] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:26 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:26.234413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:26.235099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:26.240924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.241378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.242175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.242619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.440357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:26.440922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:26.449937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.450867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.451845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.451969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:26.452556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.459631 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fd00bbab-09c4-433a-bbe2-4492395a7b92 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1472 microversion: 2.1 time: 0.229021 Apr 30 21:12:26.460408 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 334/758] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:26 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:26.548051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:26.559806 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c663b6b-f105-43fb-b676-318528b23ad5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1271 microversion: 2.1 time: 0.123704 Apr 30 21:12:26.561217 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 425/759] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:26 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:26.562534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:26.563554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:26.572750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.573575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.574681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.575521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.819815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:26.820438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:26.829501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.830361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.836890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:26.836890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:26.961944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:26.969875 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14f4ca1c-4ea5-45b6-8b68-1bd2f7475e4c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.413005 Apr 30 21:12:26.982431 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 335/760] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:26 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:27.026791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:27.030394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:27.031086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:27.042075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bad207ed-9e41-4a6b-bff0-b0cd87708a79 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.225394 Apr 30 21:12:27.044578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.046063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 426/761] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:26 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:27.046257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.047446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.048125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.214668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:27.215213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:27.221367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.221947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.222955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.223659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.284647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:27.293079 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b43192a0-0be3-4c96-9cd8-d0637e714d5d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.270163 Apr 30 21:12:27.293884 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 336/762] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:27 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:27.452213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:27.463145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:27.464809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:27.466046 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0d99d782-324e-4300-bc73-25f53183f872 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1558 microversion: 2.25 time: 0.255810 Apr 30 21:12:27.466924 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 427/763] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:27 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:27.480244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:27.485938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:27.486058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:27.486058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:27.487204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.487669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.488450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.488890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.491436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.491899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.492812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.493261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.701586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:27.709968 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2416d955-abda-4407-8dcd-7c07781ca2e3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.233617 Apr 30 21:12:27.710567 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 337/764] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:27 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:27.723881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:27.724569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:27.735451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.738367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.738367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.739298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.760907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid a1645e8a-0c59-4c61-b10a-636c7fe28621 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:27.778962 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bc10d655-9212-40ae-93ce-17ea957d5464 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 2051 microversion: 2.25 time: 0.299213 Apr 30 21:12:27.780019 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 428/765] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:27 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 2051 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:27.796897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:27.797504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:27.804098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.804464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.805312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.805784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.965749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:27.974391 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-634586a6-7707-4cab-9d36-27044368e407 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.262718 Apr 30 21:12:27.974895 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 338/766] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:27 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:27.990647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:27.991071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:27.997657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.998137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:27.998953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:27.999250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid a1645e8a-0c59-4c61-b10a-636c7fe28621 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:27.999385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.019819 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f03c36b8-c829-467d-a076-5fefeb20b922 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 2051 microversion: 2.25 time: 0.227157 Apr 30 21:12:28.033294 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 429/767] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:27 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 2051 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:28.039164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eaf745d7-620e-4707-93f0-19d06dd918c2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:28.040583 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:28.040583 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:12:28.042594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf745d7-620e-4707-93f0-19d06dd918c2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.043045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf745d7-620e-4707-93f0-19d06dd918c2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.044010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf745d7-620e-4707-93f0-19d06dd918c2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.045087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf745d7-620e-4707-93f0-19d06dd918c2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.072498 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eaf745d7-620e-4707-93f0-19d06dd918c2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.038024 Apr 30 21:12:28.073332 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 430/768] 10.222.0.23 () {60 vars in 1216 bytes} [Sat Apr 30 21:12:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:12:28.083842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:28.084116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:28.090944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.091397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.092180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.092697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.303790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:28.311510 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6eeaaae4-8d9a-4994-971d-2ea2f693f2e9 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.324940 Apr 30 21:12:28.312345 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 339/769] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:27 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:28.318164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-047159cf-23e6-4e72-876c-f06476d4bc56 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:28.319399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-047159cf-23e6-4e72-876c-f06476d4bc56 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:28.325236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-047159cf-23e6-4e72-876c-f06476d4bc56 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.325703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-047159cf-23e6-4e72-876c-f06476d4bc56 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.326822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-047159cf-23e6-4e72-876c-f06476d4bc56 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.328028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-047159cf-23e6-4e72-876c-f06476d4bc56 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.384064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:28.392596 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b01bae53-ca9a-459b-8e0a-768645775381 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.312910 Apr 30 21:12:28.393491 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 431/770] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:28 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:28.398019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:28.399392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:28.405783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.406260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.407126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.407567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.536888 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-047159cf-23e6-4e72-876c-f06476d4bc56 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621/action" status: 202 len: 0 microversion: 2.25 time: 0.223039 Apr 30 21:12:28.537776 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 340/771] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:12:28 2022] POST /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:12:28.546262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:28.547165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:28.555030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.555718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.556672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.557306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.597976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:28.606834 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5085f149-05ef-432d-b276-7c11234962b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.212224 Apr 30 21:12:28.608067 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 432/772] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:28 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:28.742127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid a1645e8a-0c59-4c61-b10a-636c7fe28621 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:28.745386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-455b2f55-fb6a-46eb-b350-a677f6c25e0e tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1820100145", "ram": 512, "vcpus": 1, "disk": 10, "id": 209665512, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:28.748974 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:28.748974 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:12:28.758048 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e3533f8f-ff67-4ed0-8cf0-017a068c1eb0 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 2056 microversion: 2.25 time: 0.215679 Apr 30 21:12:28.758638 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 341/773] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:28 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 2056 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:28.778954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:28.779586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:28.785718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.786214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.787009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:28.787457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:28.849317 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-455b2f55-fb6a-46eb-b350-a677f6c25e0e tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.231503 Apr 30 21:12:28.849973 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 433/774] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:12:28 2022] POST /compute/v2.1/flavors => generated 413 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:28.860876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3bcea4ef-0cd3-4a64-a460-0125ac2d0426 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:28.863064 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:28.863064 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:12:28.962947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:28.970322 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-09a5c7cc-08c7-44eb-8787-b0fac27cd48d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.210754 Apr 30 21:12:28.970921 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 342/775] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:28 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:28.984054 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3bcea4ef-0cd3-4a64-a460-0125ac2d0426 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/209665512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.126802 Apr 30 21:12:28.984672 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 434/776] 10.222.0.23 () {60 vars in 1220 bytes} [Sat Apr 30 21:12:28 2022] POST /compute/v2.1/flavors/209665512/os-extra_specs => generated 66 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:12:28.997802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:28.998390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:29.005528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.006017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.006913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.007337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.099215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98cd6220-d1db-42e4-a7a7-2bf446cb5c34 tempest-FlavorsExtraSpecsTestJSON-1047878935 tempest-FlavorsExtraSpecsTestJSON-1047878935-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.108815 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98cd6220-d1db-42e4-a7a7-2bf446cb5c34 tempest-FlavorsExtraSpecsTestJSON-1047878935 tempest-FlavorsExtraSpecsTestJSON-1047878935-project] 10.222.0.23 "GET /compute/v2.1/flavors/209665512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115545 Apr 30 21:12:29.109388 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 343/777] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:12:28 2022] GET /compute/v2.1/flavors/209665512/os-extra_specs => generated 66 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:12:29.120700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16f48318-1966-47f6-84da-d281d2725d6d tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:29.122140 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:29.122140 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:12:29.144144 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16f48318-1966-47f6-84da-d281d2725d6d tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/209665512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027551 Apr 30 21:12:29.144824 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 344/778] 10.222.0.23 () {60 vars in 1220 bytes} [Sat Apr 30 21:12:29 2022] POST /compute/v2.1/flavors/209665512/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:12:29.149627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-37eab9a5-9e59-46c2-813e-ce2f2f12b811 req-5c15eb91-d3c3-41ae-b557-e08cd93c8a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c246e5-490c-4639-8c9a-4b088609cc2e", "tag": "2ecc5d88-fb01-4e83-9ea8-85d7acd6114b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:29.158381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-37eab9a5-9e59-46c2-813e-ce2f2f12b811 req-5c15eb91-d3c3-41ae-b557-e08cd93c8a6e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.158930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-37eab9a5-9e59-46c2-813e-ce2f2f12b811 req-5c15eb91-d3c3-41ae-b557-e08cd93c8a6e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.170164 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-37eab9a5-9e59-46c2-813e-ce2f2f12b811 req-5c15eb91-d3c3-41ae-b557-e08cd93c8a6e service nova] Creating event network-changed:2ecc5d88-fb01-4e83-9ea8-85d7acd6114b for instance 27c246e5-490c-4639-8c9a-4b088609cc2e on nch2-master-1 Apr 30 21:12:29.174957 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-37eab9a5-9e59-46c2-813e-ce2f2f12b811 req-5c15eb91-d3c3-41ae-b557-e08cd93c8a6e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028976 Apr 30 21:12:29.175502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 345/779] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:29.184400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d429175d-7eb3-480d-9437-261ac8fc7549 tempest-FlavorsExtraSpecsTestJSON-1047878935 tempest-FlavorsExtraSpecsTestJSON-1047878935-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.191688 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d429175d-7eb3-480d-9437-261ac8fc7549 tempest-FlavorsExtraSpecsTestJSON-1047878935 tempest-FlavorsExtraSpecsTestJSON-1047878935-project] 10.222.0.23 "GET /compute/v2.1/flavors/209665512/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014772 Apr 30 21:12:29.193470 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 346/780] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:12:29 2022] GET /compute/v2.1/flavors/209665512/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:12:29.204735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3799e537-5988-4d29-bf59-38d0abdb7e44 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:29.206214 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:29.206214 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:12:29.222908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:29.226188 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3799e537-5988-4d29-bf59-38d0abdb7e44 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/209665512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024900 Apr 30 21:12:29.227055 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 347/781] 10.222.0.23 () {60 vars in 1220 bytes} [Sat Apr 30 21:12:29 2022] POST /compute/v2.1/flavors/209665512/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:12:29.231408 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4a866fe-0a27-4358-9893-d0e234abedd9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.238044 Apr 30 21:12:29.232157 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 435/782] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:28 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:29.240643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-13c50d5e-7de4-4515-a3d7-cc26af13ab57 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.249827 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-13c50d5e-7de4-4515-a3d7-cc26af13ab57 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/209665512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017313 Apr 30 21:12:29.250386 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 348/783] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:12:29 2022] GET /compute/v2.1/flavors/209665512/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:12:29.259223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fce5e63c-f5b0-4e70-8dea-915702b40200 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:29.260537 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:29.260537 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:12:29.334831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.335572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:29.338455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fce5e63c-f5b0-4e70-8dea-915702b40200 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/209665512/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.082859 Apr 30 21:12:29.342808 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 436/784] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:12:29 2022] PUT /compute/v2.1/flavors/209665512/os-extra_specs/hw:numa_nodes => generated 22 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:12:29.342946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.342946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.348528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.348528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.351037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f9735c45-5f5e-4721-b71c-bd44ce92eaf5 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.360857 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f9735c45-5f5e-4721-b71c-bd44ce92eaf5 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/209665512/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016667 Apr 30 21:12:29.361601 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 437/785] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:12:29 2022] GET /compute/v2.1/flavors/209665512/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:12:29.370592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-695291ae-0189-4f82-813e-f20a99d2109b tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.371345 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:29.371345 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:12:29.454218 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-695291ae-0189-4f82-813e-f20a99d2109b tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/209665512/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.087569 Apr 30 21:12:29.454956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 438/786] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:12:29 2022] DELETE /compute/v2.1/flavors/209665512/os-extra_specs/hw:numa_nodes => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 30 21:12:29.460460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.461079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:29.467988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.468450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.469253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.469734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.803993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:29.812223 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3960aab5-cc78-4c6d-a318-a9c802ffc4b1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.481200 Apr 30 21:12:29.812995 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 349/787] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:29 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:29.818304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-faaddc4f-b17c-4823-a503-106345e83583 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.819606 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:29.819606 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:12:29.904424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:29.912110 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa4db930-dff0-40a4-ada3-2e915c54eb89 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.455924 Apr 30 21:12:29.912688 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 439/788] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:29 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:29.917784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.918405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:29.924785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.925240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.926218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.926814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.928595 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-faaddc4f-b17c-4823-a503-106345e83583 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/209665512/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.114012 Apr 30 21:12:29.929250 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 350/789] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:12:29 2022] DELETE /compute/v2.1/flavors/209665512/os-extra_specs/hw:cpu_policy => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:12:29.935058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:29.935832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:29.942410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.942872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:29.947060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:29.947060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.215013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:30.222736 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb72e78e-812e-4362-b437-c80640bbc8d4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.308970 Apr 30 21:12:30.223309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 440/790] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:29 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:30.228562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-79d9dc93-226f-49ca-8845-f4903150afcf tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:30.237007 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-79d9dc93-226f-49ca-8845-f4903150afcf tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/209665512/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011974 Apr 30 21:12:30.244506 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 441/791] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:12:30 2022] GET /compute/v2.1/flavors/209665512/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:12:30.249341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid a1645e8a-0c59-4c61-b10a-636c7fe28621 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:30.249920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:30.250716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:30.257608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.258309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.259276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.259870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.263716 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a111a9a8-c7e3-4160-a72c-d280998f500d tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 2036 microversion: 2.25 time: 0.333327 Apr 30 21:12:30.264372 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 351/792] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:29 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 2036 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:30.269325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:30.270223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:30.289270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.289877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.290791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.291383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.559084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:30.565171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:30.566778 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c45c05e5-8f47-47e5-a31a-123de4278f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.301133 Apr 30 21:12:30.576657 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 352/793] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:30 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:30.576657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd815feb-5a1b-4f55-9f35-079f09398a55 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:30.576657 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:30.576657 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:12:30.577228 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-864bf3f9-576a-4d9b-acc2-65a89ce4eb2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.329275 Apr 30 21:12:30.577228 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 442/794] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:30 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:30.581165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:30.582474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:30.591672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.592122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.592902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.593342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.658541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'flavor' on Instance uuid a1645e8a-0c59-4c61-b10a-636c7fe28621 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:30.677713 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd815feb-5a1b-4f55-9f35-079f09398a55 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/209665512" status: 202 len: 0 microversion: 2.1 time: 0.109298 Apr 30 21:12:30.683846 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 353/795] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:12:30 2022] DELETE /compute/v2.1/flavors/209665512 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:12:30.686189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5eb4841-6967-4b31-bad8-374c569d26b7 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:30.705249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Going to try to live migrate instance to nch2-master-1 {{(pid=130671) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:12:30.706345 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5eb4841-6967-4b31-bad8-374c569d26b7 tempest-FlavorsExtraSpecsTestJSON-1765522635 tempest-FlavorsExtraSpecsTestJSON-1765522635-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.023909 Apr 30 21:12:30.706921 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 354/796] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:12:30 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:30.830372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:30.830995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:30.836955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.837417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.838856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.839706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.967675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:30.976283 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ffeed3ac-0bdd-4aa8-ad41-39814fde318c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.149591 Apr 30 21:12:30.976863 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 355/797] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:30 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:30.981345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:30.982337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:30.988716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.989471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:30.989998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:30.990443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.118243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:31.126189 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8f4157b9-0a37-4ae1-be08-179e8ea3132c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.148353 Apr 30 21:12:31.126756 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 356/798] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:30 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:31.240141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:31.240907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:31.247320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:31.247773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.248546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:31.248986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.405262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:31.413548 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e85f538-8864-4d0a-84d6-7e0f0295b0e7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.177264 Apr 30 21:12:31.414155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 357/799] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:31 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:31.583820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:31.584447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:31.591175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:31.591635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.592425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:31.592868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.742567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:31.750207 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2aeefbc-5c77-458f-aa79-3f0343b59562 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.170206 Apr 30 21:12:31.750785 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 358/800] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:31 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:31.759449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:31.765045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:31.769124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:31.769610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.770470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:31.771103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.914510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:31.925125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9d07dd4-6360-459f-a618-146de9dd03c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.173171 Apr 30 21:12:31.925707 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 359/801] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:31 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:31.934046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c5385789-1db3-4461-9368-f0ebddbf7a38 req-9e5d065d-6bfa-4838-90c2-702a761a4c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f3622-93d0-45c9-8971-89e3308037b6", "name": "network-vif-plugged", "status": "completed", "tag": "544026f7-e9ff-4a0e-9515-f5e31e5016da"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:31.938237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c5385789-1db3-4461-9368-f0ebddbf7a38 req-9e5d065d-6bfa-4838-90c2-702a761a4c6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:31.938673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c5385789-1db3-4461-9368-f0ebddbf7a38 req-9e5d065d-6bfa-4838-90c2-702a761a4c6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:31.950041 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c5385789-1db3-4461-9368-f0ebddbf7a38 req-9e5d065d-6bfa-4838-90c2-702a761a4c6a service nova] Creating event network-vif-plugged:544026f7-e9ff-4a0e-9515-f5e31e5016da for instance 353f3622-93d0-45c9-8971-89e3308037b6 on nch1-master-1 Apr 30 21:12:31.955107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c5385789-1db3-4461-9368-f0ebddbf7a38 req-9e5d065d-6bfa-4838-90c2-702a761a4c6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028272 Apr 30 21:12:31.955975 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 360/802] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:31.994935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:31.995732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:32.001982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.002438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.004825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.004825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.164861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:32.173027 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8887e8e1-9e03-4747-b655-0023a5c8a4bb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.183061 Apr 30 21:12:32.173617 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 361/803] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:31 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:32.184112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:32.184112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:32.186041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.186513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.187297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.187842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.318797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:32.326516 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-20e0c5aa-b9ee-4d93-a2a3-8091838aa4cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.151959 Apr 30 21:12:32.327086 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 362/804] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:32 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:32.431021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:32.431626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:32.438725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.439188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.440235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.440678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.625596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:32.632913 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b27816fb-43de-4151-b24b-4659de66ac19 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1317 microversion: 2.1 time: 0.205725 Apr 30 21:12:32.633532 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 363/805] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:32 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:32.773913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:32.774900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:32.782340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.782340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.783280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.783861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.914656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:32.921933 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49ea139c-07b6-4119-a7a7-decea70c4d01 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.158208 Apr 30 21:12:32.922500 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 364/806] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:32 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:32.941899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:32.942517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:32.948869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.949327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:32.950148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:32.950588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.139308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:33.146912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70797539-fae9-4cb4-8670-79f9c7402654 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.209146 Apr 30 21:12:33.147487 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 365/807] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:32 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:33.191078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:33.191841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:33.197842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.198310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.199098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.199547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.394325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:33.402420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0f71e32-4641-423b-a00f-63fc7111156e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.215519 Apr 30 21:12:33.403318 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 366/808] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:33 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:33.412570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:33.413198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:33.420631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.421323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.422548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.423189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.560418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:33.568052 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-00a5f160-08f0-484f-8f3c-3ec2d121ed83 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.160246 Apr 30 21:12:33.568621 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 367/809] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:33 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:33.649654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:33.651276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:33.659615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.659934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.660723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.661334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.798649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:33.811386 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0910ec79-b25a-4f36-8cab-4d306c06b07a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1467 microversion: 2.1 time: 0.160458 Apr 30 21:12:33.811386 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 368/810] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:33 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1467 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:33.824490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1595863364", "metadata": {"image_type": "test"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:33.825646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:33.831594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.834264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.834264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.834264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.847267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d317f3de-d89a-46fc-89c5-831c05a06ed4 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621/action" status: 202 len: 0 microversion: 2.25 time: 3.270365 Apr 30 21:12:33.851113 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 443/811] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:12:30 2022] POST /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621/action => generated 0 bytes in 3272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:12:33.866613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:33.867271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:33.871398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Getting quotas for project 9284e1c76f5a41ea9da1eb011943eb8a. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:12:33.876216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Getting quotas for user 74c331c48d20422492001f71f0672885 and project 9284e1c76f5a41ea9da1eb011943eb8a. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:12:33.880008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.889773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:33.890724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:33.891920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.070785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:34.079632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:34.081147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:34.082340 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d25e8228-7f92-4cfc-ba41-b82766458270 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.224454 Apr 30 21:12:34.082902 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 444/812] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:33 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:34.087453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:34.088108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:34.094732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.095188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.095970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.096412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.316127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:34.325316 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c5719a29-8b00-472f-9a8d-5582d32b7230 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.241380 Apr 30 21:12:34.326070 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 445/813] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:34 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:34.340009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:34.340629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:34.347414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.347869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.348653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.349097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.362821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-21ccf364-bd58-45a9-9274-74168ce53e7c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "POST /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6/action" status: 202 len: 0 microversion: 2.1 time: 0.542544 Apr 30 21:12:34.364060 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 369/814] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:33 2022] POST /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 30 21:12:34.386820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10ba99ec-bf56-4e07-84c4-b39b6bf509a5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a748b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:34.443140 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10ba99ec-bf56-4e07-84c4-b39b6bf509a5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.072466 Apr 30 21:12:34.444271 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 370/815] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:34 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:34.449902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:34.450850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:34.458527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.459110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.460027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.460561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.706990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:34.715139 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41c18959-0130-4d73-8b67-fa087080004f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.378852 Apr 30 21:12:34.715819 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 446/816] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:34 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:34.720579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:34.721360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:34.727262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.727715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.728492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:34.729660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:34.745386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:34.753083 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cff65a20-fcfc-4e74-9785-f785e6622e59 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.307444 Apr 30 21:12:34.753980 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 371/817] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:34 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:34.944954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:34.952674 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c38d089-a7a4-4e7f-ac85-caae58ed0a5c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.235575 Apr 30 21:12:34.953361 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 447/818] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:34 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:35.100529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:35.101557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:35.107588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f767b42-0497-411b-b249-7bf1da533392 tempest-NetworksTest-1146541079 tempest-NetworksTest-1146541079-project-admin] Calling method '.version_select at 0x7fdc20c3a8b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:35.111208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.113562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:35.113562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.113562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:35.628812 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f767b42-0497-411b-b249-7bf1da533392 tempest-NetworksTest-1146541079 tempest-NetworksTest-1146541079-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 6744 microversion: 2.1 time: 0.635606 Apr 30 21:12:35.633716 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 372/819] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:34 2022] GET /compute/v2.1/os-networks => generated 6744 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:35.639977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:35.640901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:35.647400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.647935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:35.649087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.649217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:35.657520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:35.669581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:35.671707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:35.673496 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-83886a8e-8a05-412e-806b-d6046fbc7ef0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.576845 Apr 30 21:12:35.674884 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 448/820] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:35 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:35.680434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-179aebd1-9ca3-4845-b7d3-5a8457eab381 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc21204dc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:35.730882 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-179aebd1-9ca3-4845-b7d3-5a8457eab381 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.054376 Apr 30 21:12:35.731671 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 449/821] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:35 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:35.736172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8dfe42bd-cc1e-489c-aa29-2532db003c5b tempest-NetworksTest-1146541079 tempest-NetworksTest-1146541079-project-admin] Calling method '.version_select at 0x7fdc20ba6c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:35.902257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:35.910086 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-36405ebe-7383-405e-9762-91e3bc33e57d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.274669 Apr 30 21:12:35.910751 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 373/822] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:35 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:35.915602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:35.916784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:35.922713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.923222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:35.924007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.924616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:35.962055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8dfe42bd-cc1e-489c-aa29-2532db003c5b tempest-NetworksTest-1146541079 tempest-NetworksTest-1146541079-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/24d2363b-44f9-4b0c-a866-84cec16dff58" status: 200 len: 652 microversion: 2.1 time: 0.229061 Apr 30 21:12:35.964795 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 450/823] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:12:35 2022] GET /compute/v2.1/os-networks/24d2363b-44f9-4b0c-a866-84cec16dff58 => generated 652 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:35.972882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:35.973839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:35.982357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.982814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:35.983596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:35.984033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.183813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:36.191643 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9bb6f737-7581-49e3-8df2-343d3be32566 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.279826 Apr 30 21:12:36.192216 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 374/824] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:35 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:36.196684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6bd995fe-1100-4c29-a2f4-8d390f59547e req-16b68eca-9bf7-4b30-a7fd-38492e2cc4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c246e5-490c-4639-8c9a-4b088609cc2e", "name": "network-vif-plugged", "status": "completed", "tag": "2ecc5d88-fb01-4e83-9ea8-85d7acd6114b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:36.204221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:36.204664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6bd995fe-1100-4c29-a2f4-8d390f59547e req-16b68eca-9bf7-4b30-a7fd-38492e2cc4fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.205114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6bd995fe-1100-4c29-a2f4-8d390f59547e req-16b68eca-9bf7-4b30-a7fd-38492e2cc4fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.211557 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c6d4cf8-57bd-460d-b845-e02489a52f5e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.245573 Apr 30 21:12:36.212116 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 451/825] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:35 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:36.216983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:36.217245 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6bd995fe-1100-4c29-a2f4-8d390f59547e req-16b68eca-9bf7-4b30-a7fd-38492e2cc4fc service nova] Creating event network-vif-plugged:2ecc5d88-fb01-4e83-9ea8-85d7acd6114b for instance 27c246e5-490c-4639-8c9a-4b088609cc2e on nch2-master-1 Apr 30 21:12:36.217600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:36.222608 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6bd995fe-1100-4c29-a2f4-8d390f59547e req-16b68eca-9bf7-4b30-a7fd-38492e2cc4fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029064 Apr 30 21:12:36.223200 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 375/826] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:36.223637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.224088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.224930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.225356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.227972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bcf2fbfd-0a82-496b-83fd-49d2fc5f68a8 tempest-NetworksTest-1146541079 tempest-NetworksTest-1146541079-project-admin] Calling method '.version_select at 0x7fdc20bb5430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:36.518984 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bcf2fbfd-0a82-496b-83fd-49d2fc5f68a8 tempest-NetworksTest-1146541079 tempest-NetworksTest-1146541079-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 6744 microversion: 2.1 time: 0.294558 Apr 30 21:12:36.519684 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 376/827] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:36 2022] GET /compute/v2.1/os-networks => generated 6744 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:36.524630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-53aa64c8-d29e-41e9-84a0-0222b3354aba req-30563ad0-731e-449b-86d7-692f9fabd940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1645e8a-0c59-4c61-b10a-636c7fe28621", "name": "network-vif-unplugged", "status": "completed", "tag": "b109dd6d-2c6c-45b3-b525-5062d226cde4"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:36.533839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-53aa64c8-d29e-41e9-84a0-0222b3354aba req-30563ad0-731e-449b-86d7-692f9fabd940 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.534315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-53aa64c8-d29e-41e9-84a0-0222b3354aba req-30563ad0-731e-449b-86d7-692f9fabd940 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.545073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:36.546122 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-53aa64c8-d29e-41e9-84a0-0222b3354aba req-30563ad0-731e-449b-86d7-692f9fabd940 service nova] Creating event network-vif-unplugged:b109dd6d-2c6c-45b3-b525-5062d226cde4 for instance a1645e8a-0c59-4c61-b10a-636c7fe28621 on nch1-master-1 Apr 30 21:12:36.555872 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be4856f9-520f-4106-b620-1e48582f0c07 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.342680 Apr 30 21:12:36.556814 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 452/828] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:36 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:36.566307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-53aa64c8-d29e-41e9-84a0-0222b3354aba req-30563ad0-731e-449b-86d7-692f9fabd940 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045223 Apr 30 21:12:36.566972 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 377/829] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:36.692641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:36.698470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:36.700132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.700674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.701460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.701940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.745293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5d32e49-eb31-40c6-b847-f13df169eca2 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20bb5dc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:36.790606 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5d32e49-eb31-40c6-b847-f13df169eca2 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.050011 Apr 30 21:12:36.791300 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 378/830] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:36 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:36.869084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:36.876928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:36.878519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:36.879672 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02aab404-66d0-4a74-951a-fa69e6622e9a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.191269 Apr 30 21:12:36.880226 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 453/831] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:36 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:36.927621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:36.928357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:36.939651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.940407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:36.941515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:36.942000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.089216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:37.097461 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-86346674-55c5-4e0e-b9b0-ad140f2b259d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1311 microversion: 2.1 time: 0.173816 Apr 30 21:12:37.098076 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 379/832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:36 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:37.208634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:37.210048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:37.216975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.217431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.218242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.218686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.228497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:37.229793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:37.235737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.236197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.240838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.240838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.414480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:37.421975 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e86b1e70-a207-4f23-b814-fce3f196c341 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.217235 Apr 30 21:12:37.422559 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 454/833] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:37 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:37.423737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:37.431794 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e450c9a7-4e98-4106-9f52-b7f148d30e6f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.207224 Apr 30 21:12:37.432487 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 380/834] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:37 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:37.572837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:37.573463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:37.579849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.580314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.581099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.581545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.736188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:37.743662 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f0f78bb9-7784-4cfd-95b5-e3d5260a8787 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.175224 Apr 30 21:12:37.744737 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 455/835] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:37 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:37.803029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-38594a75-6e67-41e9-9602-25f36927bfd5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20b70d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:37.847193 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-38594a75-6e67-41e9-9602-25f36927bfd5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.047914 Apr 30 21:12:37.847951 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 381/836] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:37 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:37.898223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:37.898929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:37.905256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.905720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:37.906544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:37.906995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.050364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:38.058808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:38.066708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:38.066708 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58f22cc0-469a-47a9-a543-8b7620aea61e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.167746 Apr 30 21:12:38.066708 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 456/837] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:37 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:38.115241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:38.115991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:38.122324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.122778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.123590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.124024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.269252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:38.281369 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-83f5bab6-a8a2-42e2-9f00-a1c966888546 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1494 microversion: 2.1 time: 0.170197 Apr 30 21:12:38.290304 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 382/838] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:38 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1494 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:38.302058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f8b59c7-c5bb-4032-af68-afdf1f31e690 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:38.302058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f8b59c7-c5bb-4032-af68-afdf1f31e690 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:38.310604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f8b59c7-c5bb-4032-af68-afdf1f31e690 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.311058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f8b59c7-c5bb-4032-af68-afdf1f31e690 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.311841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f8b59c7-c5bb-4032-af68-afdf1f31e690 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.312450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f8b59c7-c5bb-4032-af68-afdf1f31e690 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.439379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:38.440072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:38.446388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.446848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.447677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.448125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.458975 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f8b59c7-c5bb-4032-af68-afdf1f31e690 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1645 microversion: 2.1 time: 0.162783 Apr 30 21:12:38.459709 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 457/839] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:38 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1645 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:38.465575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:38.466498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:38.472936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.474044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.474727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.475276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.720905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:38.732019 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3da03883-c473-427d-b77d-cf3e3329be93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.294173 Apr 30 21:12:38.732019 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 383/840] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:38 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:38.745637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e38e0f6c-4a2f-4858-bc04-aad654ee02cf tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:38.748712 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:12:38.748712 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:12:38.751483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:38.752881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e38e0f6c-4a2f-4858-bc04-aad654ee02cf tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.752881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e38e0f6c-4a2f-4858-bc04-aad654ee02cf tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.755688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e38e0f6c-4a2f-4858-bc04-aad654ee02cf tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.755688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e38e0f6c-4a2f-4858-bc04-aad654ee02cf tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.769163 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8720d9f4-bd55-4475-ab55-a86f7644d206 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.308309 Apr 30 21:12:38.771190 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 458/841] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:38 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:38.778248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-95996849-f2e8-4281-83cd-e6e14b3bc016 req-d067e2b5-4ffe-40e8-894d-c8980926cf84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1645e8a-0c59-4c61-b10a-636c7fe28621", "tag": "b109dd6d-2c6c-45b3-b525-5062d226cde4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:38.783029 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e38e0f6c-4a2f-4858-bc04-aad654ee02cf tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051704 Apr 30 21:12:38.783767 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 384/842] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:12:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:38.788357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:38.789171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:38.796686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.797234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.798067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-95996849-f2e8-4281-83cd-e6e14b3bc016 req-d067e2b5-4ffe-40e8-894d-c8980926cf84 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.798212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:38.798764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.799271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-95996849-f2e8-4281-83cd-e6e14b3bc016 req-d067e2b5-4ffe-40e8-894d-c8980926cf84 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:38.813379 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-95996849-f2e8-4281-83cd-e6e14b3bc016 req-d067e2b5-4ffe-40e8-894d-c8980926cf84 service nova] Creating event network-changed:b109dd6d-2c6c-45b3-b525-5062d226cde4 for instance a1645e8a-0c59-4c61-b10a-636c7fe28621 on nch1-master-1 Apr 30 21:12:38.818993 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-95996849-f2e8-4281-83cd-e6e14b3bc016 req-d067e2b5-4ffe-40e8-894d-c8980926cf84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046141 Apr 30 21:12:38.819673 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 459/843] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:38.870078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ebd1101-34ec-428b-bfcf-d419ddf5d303 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20b67820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:38.942207 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ebd1101-34ec-428b-bfcf-d419ddf5d303 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.076334 Apr 30 21:12:38.944771 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 460/844] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:38 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:38.982137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:39.008656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b56e6e11-ef39-4c59-a483-cde9e058c7f8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.220970 Apr 30 21:12:39.011434 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 385/845] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:38 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:39.082800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:39.083942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:39.093046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:39.093908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:39.094780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:39.096024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:39.266668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:39.294613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:39.298282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:39.300237 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-236973a7-c5bb-4a02-9342-3e6d47303266 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.224000 Apr 30 21:12:39.301428 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 461/846] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:39 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:39.750555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:39.752332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:39.779942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:39.779942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:39.780977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:39.781448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:39.790003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:39.792201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:39.804038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:39.805927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:39.805927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:39.805927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:40.242608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:40.253885 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e261def-9a37-41ad-b791-9e29974c6e0e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.509066 Apr 30 21:12:40.254506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:40.255121 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 386/847] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:39 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:40.268193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10afe76c-b362-412b-99d2-c962ed279059 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20abdb80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:40.299150 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80eff40f-423b-46ce-b272-167dea0c03fb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.513279 Apr 30 21:12:40.299726 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 462/848] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:39 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:40.317100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e368cff2-01b0-4614-aa3a-4040b071af4e req-2796eb98-42fc-408b-8524-30cabb8aa5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f3622-93d0-45c9-8971-89e3308037b6", "name": "network-vif-plugged", "status": "completed", "tag": "544026f7-e9ff-4a0e-9515-f5e31e5016da"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:40.335618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e368cff2-01b0-4614-aa3a-4040b071af4e req-2796eb98-42fc-408b-8524-30cabb8aa5c8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:40.336065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e368cff2-01b0-4614-aa3a-4040b071af4e req-2796eb98-42fc-408b-8524-30cabb8aa5c8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:40.352925 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10afe76c-b362-412b-99d2-c962ed279059 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.096538 Apr 30 21:12:40.354819 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 387/849] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:40 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:40.358516 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e368cff2-01b0-4614-aa3a-4040b071af4e req-2796eb98-42fc-408b-8524-30cabb8aa5c8 service nova] Creating event network-vif-plugged:544026f7-e9ff-4a0e-9515-f5e31e5016da for instance 353f3622-93d0-45c9-8971-89e3308037b6 on nch1-master-1 Apr 30 21:12:40.360067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:40.360972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:40.373193 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e368cff2-01b0-4614-aa3a-4040b071af4e req-2796eb98-42fc-408b-8524-30cabb8aa5c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066773 Apr 30 21:12:40.374437 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 463/850] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:40.379505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:40.379965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:40.380808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:40.381257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:40.381859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:40.382748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:40.393060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:40.393902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:40.394851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:40.395515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:40.867896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:40.867896 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d97f0415-a8a0-4d35-b093-d48800d4e1c8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.502552 Apr 30 21:12:40.867896 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 388/851] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:40 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:40.876317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:40.894477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:40.897238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:40.899245 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-666451bf-ca38-482f-a41a-c55d6ea82646 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.523353 Apr 30 21:12:40.900724 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 464/852] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:40 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:41.028984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b92c9c68-484a-4379-a245-ef4c70e11021 tempest-FlavorsV2NegativeTest-1483902465 tempest-FlavorsV2NegativeTest-1483902465-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:41.040812 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b92c9c68-484a-4379-a245-ef4c70e11021 tempest-FlavorsV2NegativeTest-1483902465 tempest-FlavorsV2NegativeTest-1483902465-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.180389 Apr 30 21:12:41.042004 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 389/853] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:41.272696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:41.274910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:41.289527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:41.290022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:41.291667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:41.291667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:41.320400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:41.321301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:41.343208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:41.346605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:41.348682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:41.349506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:41.553066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:41.566351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f0c9261-5ef6-4a41-b903-2d144283428c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.294991 Apr 30 21:12:41.567577 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 465/854] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:41 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:41.582794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c13c1c8-9864-41d1-97ed-7ac110de24a0 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20e13670>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:41.608545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:41.621849 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b4682316-f44f-4350-a431-2e71360c0692 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.308955 Apr 30 21:12:41.622847 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 390/855] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:41 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:41.890237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:41.890237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:41.895685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:41.896413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:41.897245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:41.897886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:42.050762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:42.062486 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a3496f4a-8381-4a77-af14-5b4d5ab55bd8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1497 microversion: 2.1 time: 0.175911 Apr 30 21:12:42.063548 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 391/856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:41 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:42.069554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:42.070430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:42.078224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:42.079419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:42.080027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:42.080634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:42.257101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:42.271977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:42.273505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:42.274711 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-33f93210-b5a0-4586-a8a1-9ce849fc07b0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.209658 Apr 30 21:12:42.282195 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 392/857] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:42 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:42.415237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f2b59df-b2bd-45e2-9a1e-63a908e64d94 tempest-FlavorsV2NegativeTest-1483902465 tempest-FlavorsV2NegativeTest-1483902465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-540069516", "imageRef": "48ce8aae-7a08-45e5-8729-64af6d9a085f", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:42.425381 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c13c1c8-9864-41d1-97ed-7ac110de24a0 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.856576 Apr 30 21:12:42.434001 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 466/858] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:41 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:42.490043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-1f2b59df-b2bd-45e2-9a1e-63a908e64d94 tempest-FlavorsV2NegativeTest-1483902465 tempest-FlavorsV2NegativeTest-1483902465-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:12:42.524289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef4c65de-21bd-474b-a059-a0d2d6022b0c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b53e786-98d2-47b8-a116-d63bdd9029d1", "device": "/dev/xvdb"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:42.531114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef4c65de-21bd-474b-a059-a0d2d6022b0c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:42.536069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4c65de-21bd-474b-a059-a0d2d6022b0c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:42.536821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4c65de-21bd-474b-a059-a0d2d6022b0c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:42.538000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4c65de-21bd-474b-a059-a0d2d6022b0c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:42.538595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4c65de-21bd-474b-a059-a0d2d6022b0c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:42.936630 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1f2b59df-b2bd-45e2-9a1e-63a908e64d94 tempest-FlavorsV2NegativeTest-1483902465 tempest-FlavorsV2NegativeTest-1483902465-project] HTTP exception thrown: Flavor's memory is too small for requested image. Apr 30 21:12:42.937251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f2b59df-b2bd-45e2-9a1e-63a908e64d94 tempest-FlavorsV2NegativeTest-1483902465 tempest-FlavorsV2NegativeTest-1483902465-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:12:42.938118 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f2b59df-b2bd-45e2-9a1e-63a908e64d94 tempest-FlavorsV2NegativeTest-1483902465 tempest-FlavorsV2NegativeTest-1483902465-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.529455 Apr 30 21:12:42.938743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 393/859] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:12:42 2022] POST /compute/v2.1/servers => generated 93 bytes in 531 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:42.944319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:42.944934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:42.951913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:42.952323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:42.953118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:42.953566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:43.101595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:43.109260 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e8363ac3-1ce8-4d08-b5d2-4fbab288e24f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.169245 Apr 30 21:12:43.109780 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 394/860] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:42 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:43.114143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:43.114800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:43.120782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:43.121257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:43.122065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:43.122508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:43.429647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:43.445676 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-987b0ec8-ecf5-4229-a99a-47c276a210ff tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.333828 Apr 30 21:12:43.448204 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 395/861] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:43 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:43.455733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:43.456698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:43.463180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:43.464525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:43.465674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:43.466301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:43.717337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:43.727948 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b237368a-6c12-4242-a556-74588ecbe551 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 200 len: 1474 microversion: 2.1 time: 0.278275 Apr 30 21:12:43.730208 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 396/862] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:43 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:43.744583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:43.745398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:43.753965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:43.755212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:43.756240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:43.756873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:43.913336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:43.923185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:43.924886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:43.926295 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5e55f93-e723-4e49-8feb-2dfcc646de9b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1568 microversion: 2.25 time: 0.196730 Apr 30 21:12:43.927345 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 397/863] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:43 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:43.932781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d4af65d-82e0-474d-8893-6d35057c2276 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20ac4ca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:43.989012 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef4c65de-21bd-474b-a059-a0d2d6022b0c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "POST /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.469026 Apr 30 21:12:43.990460 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 467/864] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:12:42 2022] POST /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments => generated 194 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:12:44.000571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92ba71b0-56ad-4302-88da-7ee303377dfa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-454274491"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:44.002302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-92ba71b0-56ad-4302-88da-7ee303377dfa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:44.020676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ba71b0-56ad-4302-88da-7ee303377dfa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.021170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ba71b0-56ad-4302-88da-7ee303377dfa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:44.023726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ba71b0-56ad-4302-88da-7ee303377dfa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.028121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ba71b0-56ad-4302-88da-7ee303377dfa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:44.032745 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5d4af65d-82e0-474d-8893-6d35057c2276 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.099899 Apr 30 21:12:44.032745 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 398/865] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:43 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:44.126338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:44.126793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:44.136642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.137408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:44.138387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.139012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:44.612748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:44.629488 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ef286654-dbfc-43d5-a244-a78a16f7ab95 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.506341 Apr 30 21:12:44.632174 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 399/866] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:44 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:44.648497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:44.649206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:44.656508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.657060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:44.663760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.663760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:44.663975 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92ba71b0-56ad-4302-88da-7ee303377dfa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.671135 Apr 30 21:12:44.665673 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 468/867] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:43 2022] POST /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:12:44.675957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c7e4a9af-4cd8-46ff-8ad0-c27ea7011c0a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc263608b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:44.732285 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c7e4a9af-4cd8-46ff-8ad0-c27ea7011c0a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.060506 Apr 30 21:12:44.738703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 469/868] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:44 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:44.927992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:44.937002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d968805d-7fed-45ac-81c2-591f22452fa1 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1473 microversion: 2.1 time: 0.292594 Apr 30 21:12:44.949916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:44.951053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:44.957033 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 400/869] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:44 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1473 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:44.969141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.973603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:44.973603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:44.973603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:45.045267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3dd5fc8e-7514-452c-9e14-374e282d978b tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a1fee0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:45.128641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3dd5fc8e-7514-452c-9e14-374e282d978b tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.090110 Apr 30 21:12:45.129241 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 401/870] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:45 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:45.263426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:45.277557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:45.279510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:45.280909 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90f19343-4dd6-4777-b733-9a7dc8e810fe tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1543 microversion: 2.25 time: 0.339859 Apr 30 21:12:45.282541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 470/871] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:44 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1543 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:45.299433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e84ac92b-548d-4ee4-bca2-dbe39e970a3c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '.version_select at 0x7fdc20a74f70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:45.301943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e84ac92b-548d-4ee4-bca2-dbe39e970a3c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:45.302392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e84ac92b-548d-4ee4-bca2-dbe39e970a3c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:45.338143 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e84ac92b-548d-4ee4-bca2-dbe39e970a3c tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.042490 Apr 30 21:12:45.350016 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 402/872] 10.222.0.23 () {60 vars in 1183 bytes} [Sat Apr 30 21:12:45 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:45.356043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:45.356676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:45.368279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:45.368739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:45.370208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:45.370839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:45.597447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid a1645e8a-0c59-4c61-b10a-636c7fe28621 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:45.613913 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31df860b-da2c-4688-b4ec-23725ddf8d94 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 2036 microversion: 2.25 time: 0.262337 Apr 30 21:12:45.615163 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 471/873] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:45 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 2036 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:45.651341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:45.652140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:45.678367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:45.679176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:45.680207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:45.681087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:45.746265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a1fdd6c8-eeac-4e88-a9a9-3c21ec65c7f5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc22f07820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:45.810481 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a1fdd6c8-eeac-4e88-a9a9-3c21ec65c7f5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.068630 Apr 30 21:12:45.816914 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 472/874] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:45 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:45.822428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1931326321", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "b894fca3-f633-42dd-93b5-bde3291d63a3"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:45.894541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:45.894776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] validate_networks() for [('b894fca3-f633-42dd-93b5-bde3291d63a3', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:12:45.915522 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c1ec6a12-90a7-4206-a4bb-13511c549cf1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.270716 Apr 30 21:12:45.927069 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 403/875] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:45 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:45.972975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:45.974061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:45.985645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:45.989866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:45.991761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:45.992388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:46.266765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:46.279626 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc377948-a8a7-489a-a83e-53e1cb48b179 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1479 microversion: 2.1 time: 0.310604 Apr 30 21:12:46.284718 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 404/876] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:45 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1479 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:46.309648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-063e3b38-03d7-4525-a497-f69b51ef90b1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a7b940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:46.369991 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-063e3b38-03d7-4525-a497-f69b51ef90b1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.083889 Apr 30 21:12:46.371641 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 405/877] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:46 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:46.578157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:12:46.578157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:12:46.578702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:12:46.579052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:12:46.579418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:12:46.592533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:46.593085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:46.594036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:46.594551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:46.617342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:12:46.617996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for user dadac4f61fe141dba3ee726ca6cbf29a and project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:12:46.630705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:12:46.633130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:12:46.737914 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58a5f0c5-d97c-48ec-acc5-30bb38cbe751 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.919415 Apr 30 21:12:46.743581 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 473/878] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:12:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:12:46.749242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-04350d12-5971-401c-925b-0ba13ccd74f6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:46.750081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-04350d12-5971-401c-925b-0ba13ccd74f6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:46.826117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04350d12-5971-401c-925b-0ba13ccd74f6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:46.849050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d34378ff-d6f4-439b-80ce-34b18e569768 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20bc6af0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:46.849245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04350d12-5971-401c-925b-0ba13ccd74f6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:46.849434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04350d12-5971-401c-925b-0ba13ccd74f6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:46.850670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-04350d12-5971-401c-925b-0ba13ccd74f6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1262 microversion: 2.25 time: 0.105560 Apr 30 21:12:46.862745 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 406/879] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:46 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1262 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:12:46.922056 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d34378ff-d6f4-439b-80ce-34b18e569768 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.101126 Apr 30 21:12:46.926158 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 474/880] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:46 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:46.935568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:46.936455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:46.952319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:46.952793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:46.953669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:46.954273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:47.217673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:47.231466 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f8b0e684-0b80-4263-a272-680bb3c23811 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.300532 Apr 30 21:12:47.232056 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 407/881] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:46 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:47.304573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:47.305255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:47.314776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:47.315537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:47.316429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:47.316985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:47.383730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e2a407f-feea-4ea7-9e0d-cb44650f4e1d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a74d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:47.430146 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e2a407f-feea-4ea7-9e0d-cb44650f4e1d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.050447 Apr 30 21:12:47.430722 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 408/882] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:47 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:47.457967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:47.466844 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3a1bdbfa-44cc-49bb-95c4-0ce5040944ee tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1479 microversion: 2.1 time: 0.167560 Apr 30 21:12:47.468185 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 475/883] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:47 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1479 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:47.870472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4c1a8550-c526-4aa4-9ac2-7206eaaaa8de tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:47.871381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4c1a8550-c526-4aa4-9ac2-7206eaaaa8de tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:47.943073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58c99718-67b4-4eb1-9566-c3c158aafdf5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc26360d30>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:47.964015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4c1a8550-c526-4aa4-9ac2-7206eaaaa8de tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:47.987136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4c1a8550-c526-4aa4-9ac2-7206eaaaa8de tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:47.989012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4c1a8550-c526-4aa4-9ac2-7206eaaaa8de tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:47.990402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4c1a8550-c526-4aa4-9ac2-7206eaaaa8de tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1262 microversion: 2.25 time: 0.125271 Apr 30 21:12:47.991468 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 409/884] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:47 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1262 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:48.021126 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58c99718-67b4-4eb1-9566-c3c158aafdf5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.082571 Apr 30 21:12:48.021716 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 476/885] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:47 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:48.252283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:48.253498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:48.262085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:48.263554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:48.265230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:48.266280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:48.446163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c85a4f7-da11-4919-be10-63fd13c3d8ae tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc262bf040>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:48.521100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:48.532295 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a2316c24-9532-4486-8f66-44e9cec66649 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.285002 Apr 30 21:12:48.533485 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 410/886] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:48 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:48.541737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:48.544814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:48.550130 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c85a4f7-da11-4919-be10-63fd13c3d8ae tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.108954 Apr 30 21:12:48.555212 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 477/887] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:48 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:48.570440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:48.572133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:48.572133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:48.572133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:48.765116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:48.785243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81bdeb21-556a-4cc8-960f-c0ffc38680f5 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1479 microversion: 2.1 time: 0.250368 Apr 30 21:12:48.787497 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 411/888] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:48 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1479 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:49.010539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:49.011753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:49.023447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:49.024282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:49.025684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:49.026303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:49.035940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6f71ce7c-2df6-4163-81f9-d019d83d468b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20fffe50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:49.126713 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6f71ce7c-2df6-4163-81f9-d019d83d468b tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.095300 Apr 30 21:12:49.132862 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 412/889] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:49 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:49.152395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:49.161052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:49.162793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:49.164614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6bfeddb1-a24b-4198-b4dc-784db4408c33 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1258 microversion: 2.25 time: 0.158909 Apr 30 21:12:49.175971 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 478/890] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:49 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:49.559680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:49.560949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:49.568512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-baad855a-fdc7-4bc3-b712-e4f115027be5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc262bd550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:49.576208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:49.577515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:49.579727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:49.582220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:49.622051 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-baad855a-fdc7-4bc3-b712-e4f115027be5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.057819 Apr 30 21:12:49.622928 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 479/891] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:49 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:49.763255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:49.773005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-307db073-528a-49a1-9941-91c47ecfaa12 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.217558 Apr 30 21:12:49.779752 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 413/892] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:49 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:49.803515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:49.804405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:49.815995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:49.817190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:49.818697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:49.819456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:49.975565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8191cbe8-aa85-42a0-bed7-ef0add8a0172 req-071a7872-3904-404a-97d4-936dc3adedaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4888131-7f37-4758-8e35-816d07886e96", "name": "network-vif-unplugged", "status": "completed", "tag": "9c97a0a6-0f63-4385-8a0e-e905cd2c4f48"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:49.992049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8191cbe8-aa85-42a0-bed7-ef0add8a0172 req-071a7872-3904-404a-97d4-936dc3adedaa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:49.992746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8191cbe8-aa85-42a0-bed7-ef0add8a0172 req-071a7872-3904-404a-97d4-936dc3adedaa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.020446 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8191cbe8-aa85-42a0-bed7-ef0add8a0172 req-071a7872-3904-404a-97d4-936dc3adedaa service nova] Creating event network-vif-unplugged:9c97a0a6-0f63-4385-8a0e-e905cd2c4f48 for instance e4888131-7f37-4758-8e35-816d07886e96 on nch1-master-1 Apr 30 21:12:50.036265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:50.046440 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc4c931a-6fc3-4835-bc0d-dd6266c1ba6a tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1464 microversion: 2.1 time: 0.247659 Apr 30 21:12:50.046832 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8191cbe8-aa85-42a0-bed7-ef0add8a0172 req-071a7872-3904-404a-97d4-936dc3adedaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058632 Apr 30 21:12:50.048970 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 414/893] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:50.050419 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 480/894] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:49 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1464 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:50.093312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8742290e-b613-4fd9-b91a-b36c040735a6 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:50.094729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8742290e-b613-4fd9-b91a-b36c040735a6 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:50.105077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8742290e-b613-4fd9-b91a-b36c040735a6 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.105813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8742290e-b613-4fd9-b91a-b36c040735a6 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.109999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8742290e-b613-4fd9-b91a-b36c040735a6 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.109999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8742290e-b613-4fd9-b91a-b36c040735a6 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.140296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1442f474-4d6c-4407-ad32-bc6e42fb73a6 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc262f64c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:50.191559 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1442f474-4d6c-4407-ad32-bc6e42fb73a6 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.055167 Apr 30 21:12:50.193078 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 481/895] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:50 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:50.209807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:50.211391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:50.221477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.224944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.226187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.226869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.374546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:50.392759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:50.398567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:50.403173 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9cb06fba-4edb-4b91-b6fd-6481c6538af5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1332 microversion: 2.25 time: 0.207300 Apr 30 21:12:50.404128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 482/896] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:50 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1332 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:50.517219 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8742290e-b613-4fd9-b91a-b36c040735a6 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action" status: 202 len: 0 microversion: 2.1 time: 0.428785 Apr 30 21:12:50.518114 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 415/897] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:50 2022] POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:12:50.528286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:50.529234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:50.540052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.540851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.542711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.544140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.637106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb412307-365f-43bb-ba18-9227021f28ce tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a1fee0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:50.662634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.666547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.667245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lazy-loading 'fault' on Instance uuid e4888131-7f37-4758-8e35-816d07886e96 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:50.912410 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb412307-365f-43bb-ba18-9227021f28ce tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1424 microversion: 2.1 time: 0.278073 Apr 30 21:12:50.918241 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 416/898] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:50 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1424 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:50.942572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:50.943199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:50.965731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.967655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:50.968715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:50.969338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:51.013877 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-314ff9f1-2261-4d99-aff3-07bc212e8b6e tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1598 microversion: 2.1 time: 0.488812 Apr 30 21:12:51.015528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 483/899] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:50 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1598 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:12:51.035666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73f5cf56-1921-4df5-a930-673cd83ec97f tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:51.036636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-73f5cf56-1921-4df5-a930-673cd83ec97f tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:51.047862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73f5cf56-1921-4df5-a930-673cd83ec97f tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:51.050025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73f5cf56-1921-4df5-a930-673cd83ec97f tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:51.052998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73f5cf56-1921-4df5-a930-673cd83ec97f tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:51.053650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73f5cf56-1921-4df5-a930-673cd83ec97f tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:51.355637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:51.363635 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6265f9f0-9e0d-4c9d-a225-68a98bcd258d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.444096 Apr 30 21:12:51.364552 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 417/900] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:50 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:51.379469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0fb63d2-2288-4c31-a1a6-cb6c4d013ba5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20a81670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:51.789400 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73f5cf56-1921-4df5-a930-673cd83ec97f tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action" status: 202 len: 0 microversion: 2.1 time: 0.630370 Apr 30 21:12:51.789400 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 484/901] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:51 2022] POST /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:12:51.789400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:51.789400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:51.789400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:51.791225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:51.791225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:51.791225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:51.791851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:51.791851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:51.792190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:51.792190 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ff760a5-51f2-443f-bd1a-d1b89a7d6602 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1320 microversion: 2.25 time: 0.108890 Apr 30 21:12:51.792190 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 485/902] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:51 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1320 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:51.823847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15b6a29a-7540-4704-81fd-7e11a85b1977 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:51.825086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15b6a29a-7540-4704-81fd-7e11a85b1977 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:51.835119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15b6a29a-7540-4704-81fd-7e11a85b1977 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:51.835732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15b6a29a-7540-4704-81fd-7e11a85b1977 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:51.836602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15b6a29a-7540-4704-81fd-7e11a85b1977 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:51.837116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15b6a29a-7540-4704-81fd-7e11a85b1977 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:52.011913 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15b6a29a-7540-4704-81fd-7e11a85b1977 tempest-ServersAdminTestJSON-617884205 tempest-ServersAdminTestJSON-617884205-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1615 microversion: 2.1 time: 0.193907 Apr 30 21:12:52.012833 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 486/903] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:51 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1615 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:52.017580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab56ff17-6726-4171-b72b-372a098ae643 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc26360ca0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:53.795071 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0fb63d2-2288-4c31-a1a6-cb6c4d013ba5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 2.419523 Apr 30 21:12:53.796375 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 418/904] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:51 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:53.810108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-725200e1-954a-42bd-9099-8b7f506be3ad tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:53.811616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-725200e1-954a-42bd-9099-8b7f506be3ad tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:53.829722 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab56ff17-6726-4171-b72b-372a098ae643 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1433 microversion: 2.1 time: 1.811067 Apr 30 21:12:53.829722 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 487/905] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:52 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1433 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:53.842027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:53.842447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:53.869679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-725200e1-954a-42bd-9099-8b7f506be3ad tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:53.870494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-725200e1-954a-42bd-9099-8b7f506be3ad tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:53.871837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-725200e1-954a-42bd-9099-8b7f506be3ad tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:53.874811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-725200e1-954a-42bd-9099-8b7f506be3ad tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:53.890047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:53.890561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:53.898016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:53.900948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:54.004812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:12:54.438100 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15a347c7-1b94-4859-be44-d83f47b40061 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 204 len: 0 microversion: 2.1 time: 0.609669 Apr 30 21:12:54.439968 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 488/906] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:12:53 2022] DELETE /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:12:54.447922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-11a8c51c-c9a1-4cb7-be2e-84cd7da197fb req-022b1ebd-2470-4579-b73b-82b82d2fee3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85fdff58-4182-4941-b3a0-879915a49a4a", "name": "network-vif-plugged", "status": "completed", "tag": "e3d4a5c6-46ec-4840-adba-bbaa926432a0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:54.458462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-11a8c51c-c9a1-4cb7-be2e-84cd7da197fb req-022b1ebd-2470-4579-b73b-82b82d2fee3d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:54.459551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-11a8c51c-c9a1-4cb7-be2e-84cd7da197fb req-022b1ebd-2470-4579-b73b-82b82d2fee3d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:54.485803 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-11a8c51c-c9a1-4cb7-be2e-84cd7da197fb req-022b1ebd-2470-4579-b73b-82b82d2fee3d service nova] Creating event network-vif-plugged:e3d4a5c6-46ec-4840-adba-bbaa926432a0 for instance 85fdff58-4182-4941-b3a0-879915a49a4a on nch2-master-1 Apr 30 21:12:54.493521 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-11a8c51c-c9a1-4cb7-be2e-84cd7da197fb req-022b1ebd-2470-4579-b73b-82b82d2fee3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051717 Apr 30 21:12:54.494314 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 489/907] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:54.500828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:54.501742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:54.508609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:54.509373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:54.510416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:54.511076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:54.782698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:54.791470 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3aaf6e51-fd89-4df5-8c09-2d0b20e51283 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.294508 Apr 30 21:12:54.792264 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 490/908] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:54 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:54.797516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:54.798401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:54.811406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:54.814527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:54.814949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:54.817772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:54.858511 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-725200e1-954a-42bd-9099-8b7f506be3ad tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1691 microversion: 2.1 time: 1.048106 Apr 30 21:12:54.858511 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 419/909] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:53 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1691 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:54.863089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7ebb025a-f8f1-4176-b4de-c0768e25ebf7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20bebaf0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:54.929713 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7ebb025a-f8f1-4176-b4de-c0768e25ebf7 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 200 len: 1433 microversion: 2.1 time: 0.081913 Apr 30 21:12:54.930323 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 420/910] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:54 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 1433 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:54.944874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:54.946960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:54.955620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:54.956371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:54.957385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:54.963138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:55.319753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:55.319753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:55.326401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:55.328482 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-12660571-c7ba-4dbb-a460-55a3441eee6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.534385 Apr 30 21:12:55.329467 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 491/911] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:54 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:55.334262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e866508e-3c05-44cf-bebd-620690e991aa req-5c19f7e9-b56d-4320-a5a4-c1101b543789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77da7802-0fa5-4899-89bc-0300c2599af7", "tag": "2514de9a-e593-441c-b26f-47d347c23ccb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:55.354178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e866508e-3c05-44cf-bebd-620690e991aa req-5c19f7e9-b56d-4320-a5a4-c1101b543789 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:55.359709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e866508e-3c05-44cf-bebd-620690e991aa req-5c19f7e9-b56d-4320-a5a4-c1101b543789 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:55.375841 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e866508e-3c05-44cf-bebd-620690e991aa req-5c19f7e9-b56d-4320-a5a4-c1101b543789 service nova] Creating event network-changed:2514de9a-e593-441c-b26f-47d347c23ccb for instance 77da7802-0fa5-4899-89bc-0300c2599af7 on nch1-master-1 Apr 30 21:12:55.381455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e866508e-3c05-44cf-bebd-620690e991aa req-5c19f7e9-b56d-4320-a5a4-c1101b543789 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050550 Apr 30 21:12:55.382362 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 492/912] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:55.395934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bcf97073-8308-4c04-83e0-9e9e5fd656cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc262bd5e0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:55.466147 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bcf97073-8308-4c04-83e0-9e9e5fd656cb tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.082359 Apr 30 21:12:55.471655 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 493/913] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:55 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:55.477748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:55.479886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:55.488021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:55.488615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:55.489504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:55.490102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:55.524639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lazy-loading 'flavor' on Instance uuid 27c246e5-490c-4639-8c9a-4b088609cc2e {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:12:55.545179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Going to try to live migrate instance to nch1-master-1 {{(pid=130671) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:12:55.685703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:55.713430 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-42e9863f-cdf3-4297-9a11-7135429dc00e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1470 microversion: 2.1 time: 0.771036 Apr 30 21:12:55.713430 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 421/914] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:54 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1470 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:55.721651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:55.723034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:55.741227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:55.741703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:55.742539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:55.743134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:56.413280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:56.425401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e6c74f7-66d9-4bdd-a976-266f4fe3f5f1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1467 microversion: 2.1 time: 0.716799 Apr 30 21:12:56.426026 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 422/915] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:55 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1467 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:56.441084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:56.453935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:56.475142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:56.475915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:56.486631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:56.488063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:57.200737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:57.209294 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78e32bbe-da17-42e4-850f-d8599eb45f97 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1477 microversion: 2.1 time: 0.779250 Apr 30 21:12:57.213524 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 423/916] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:56 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1477 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:57.228429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:57.229274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:57.241600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:57.242202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:57.250738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:57.251177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:57.609384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:57.620120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:57.622365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:57.624015 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ddfc6b3-fa8b-4e1b-bf0b-2d1f2cbd2f68 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.409181 Apr 30 21:12:57.624712 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 424/917] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:12:57 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:12:57.631198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b4a860d-8819-4f12-9e18-b60e2775d801 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a814c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:57.703298 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b4a860d-8819-4f12-9e18-b60e2775d801 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d" status: 200 len: 784 microversion: 2.1 time: 0.076606 Apr 30 21:12:57.704168 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 425/918] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:57 2022] GET /compute/v2.1/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:57.717470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b71bb41-66e1-44e7-a4c1-c3a3c667553d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20ac4af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:57.791095 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b71bb41-66e1-44e7-a4c1-c3a3c667553d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.080415 Apr 30 21:12:57.797845 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 426/919] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:57 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:57.797845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9b818692-f4bd-4937-8084-6ad01602474f req-b960a974-50f2-49e5-be0d-aef0a0cd4360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4888131-7f37-4758-8e35-816d07886e96", "name": "network-vif-plugged", "status": "completed", "tag": "9c97a0a6-0f63-4385-8a0e-e905cd2c4f48"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:12:57.808995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9b818692-f4bd-4937-8084-6ad01602474f req-b960a974-50f2-49e5-be0d-aef0a0cd4360 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:57.809620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9b818692-f4bd-4937-8084-6ad01602474f req-b960a974-50f2-49e5-be0d-aef0a0cd4360 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:57.820803 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9b818692-f4bd-4937-8084-6ad01602474f req-b960a974-50f2-49e5-be0d-aef0a0cd4360 service nova] Creating event network-vif-plugged:9c97a0a6-0f63-4385-8a0e-e905cd2c4f48 for instance e4888131-7f37-4758-8e35-816d07886e96 on nch1-master-1 Apr 30 21:12:57.830060 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9b818692-f4bd-4937-8084-6ad01602474f req-b960a974-50f2-49e5-be0d-aef0a0cd4360 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031937 Apr 30 21:12:57.830744 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 427/920] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:57.836443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:57.837219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:12:57.844026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:57.844538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:57.845437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:12:57.845957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:12:57.992546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:12:58.000927 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0921ab3c-5a6e-4afb-a55d-37c0f97be1b6 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1470 microversion: 2.1 time: 0.168920 Apr 30 21:12:58.001512 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 428/921] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:57 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:12:58.006015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e3979d6e-6da9-43c6-aa92-514f1ffd562a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:12:58.016473 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e3979d6e-6da9-43c6-aa92-514f1ffd562a tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013931 Apr 30 21:12:58.017078 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 429/922] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:12:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:12:58.027493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68b3de37-2cfe-4544-b8f3-bbf3d15983c3 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a811f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:00.234226 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68b3de37-2cfe-4544-b8f3-bbf3d15983c3 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "DELETE /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 204 len: 0 microversion: 2.1 time: 2.210533 Apr 30 21:13:00.234812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 430/923] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:12:58 2022] DELETE /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 0 bytes in 2212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:13:00.239590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:00.242898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:00.258178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:00.259819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:00.261966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:00.262427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:00.679744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:00.707228 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c871a0f4-3c4e-4ae2-860a-bb76fbbc0bfe tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1476 microversion: 2.1 time: 0.471308 Apr 30 21:13:00.708863 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 431/924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:00 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:00.717088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-44abf9a3-0ecc-491f-8347-fba90aca5e60 req-6b831ae6-dc12-41a3-8756-b24235db16c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36482df-2cb5-4d30-9ce3-95a6f06f80f0", "name": "network-vif-deleted", "tag": "376e3c07-c6be-4468-aa0d-25e6e0c6136c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:00.748933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-44abf9a3-0ecc-491f-8347-fba90aca5e60 req-6b831ae6-dc12-41a3-8756-b24235db16c5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:00.752317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-44abf9a3-0ecc-491f-8347-fba90aca5e60 req-6b831ae6-dc12-41a3-8756-b24235db16c5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:00.797056 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-44abf9a3-0ecc-491f-8347-fba90aca5e60 req-6b831ae6-dc12-41a3-8756-b24235db16c5 service nova] Creating event network-vif-deleted:376e3c07-c6be-4468-aa0d-25e6e0c6136c for instance b36482df-2cb5-4d30-9ce3-95a6f06f80f0 on nch1-master-1 Apr 30 21:13:00.802999 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-44abf9a3-0ecc-491f-8347-fba90aca5e60 req-6b831ae6-dc12-41a3-8756-b24235db16c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091871 Apr 30 21:13:00.803827 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 432/925] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:00.815185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:00.816151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:00.827043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:00.827763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:00.828712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:00.829322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:00.961223 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-721b08db-c024-4713-8be3-fe1c1e94e63f tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/action" status: 202 len: 0 microversion: 2.1 time: 5.487458 Apr 30 21:13:00.966934 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 494/926] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:12:55 2022] POST /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/action => generated 0 bytes in 5494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:13:00.973437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ed984fac-3e9d-4163-bb14-82eea7719535 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc26356280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:01.106647 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ed984fac-3e9d-4163-bb14-82eea7719535 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.137577 Apr 30 21:13:01.109880 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 495/927] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:00 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:01.126862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:01.135612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:01.192547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:01.192764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:01.195423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:01.198351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:01.327146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:01.327602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:01.328062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lazy-loading 'fault' on Instance uuid b36482df-2cb5-4d30-9ce3-95a6f06f80f0 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:13:01.453793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:01.464746 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6d44b96b-afa4-4540-b76e-fcb9f05bb94f tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 200 len: 1304 microversion: 2.1 time: 0.353536 Apr 30 21:13:01.465616 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 496/928] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:01 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 1304 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:01.480944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:01.481528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-53bffd18-f9c0-4265-9f79-acb4bddb23f2 req-937bbedb-d08a-4765-929e-9f2923351ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f3622-93d0-45c9-8971-89e3308037b6", "name": "network-vif-unplugged", "status": "completed", "tag": "544026f7-e9ff-4a0e-9515-f5e31e5016da"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:01.496301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:01.499514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-53bffd18-f9c0-4265-9f79-acb4bddb23f2 req-937bbedb-d08a-4765-929e-9f2923351ba6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:01.499967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-53bffd18-f9c0-4265-9f79-acb4bddb23f2 req-937bbedb-d08a-4765-929e-9f2923351ba6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:01.500546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:01.501992 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7ac8c7e4-cc51-4ae4-90cd-c6c9b3d7ecc0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.692494 Apr 30 21:13:01.505001 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 433/929] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:00 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:01.558464 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-53bffd18-f9c0-4265-9f79-acb4bddb23f2 req-937bbedb-d08a-4765-929e-9f2923351ba6 service nova] Creating event network-vif-unplugged:544026f7-e9ff-4a0e-9515-f5e31e5016da for instance 353f3622-93d0-45c9-8971-89e3308037b6 on nch1-master-1 Apr 30 21:13:01.586106 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-53bffd18-f9c0-4265-9f79-acb4bddb23f2 req-937bbedb-d08a-4765-929e-9f2923351ba6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118692 Apr 30 21:13:01.586725 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 497/930] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:01.597172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45bdba85-ae7e-4cc4-9f8e-ca7481a99ca2 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc262bd310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:01.657460 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-45bdba85-ae7e-4cc4-9f8e-ca7481a99ca2 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] HTTP exception thrown: Image not found. Apr 30 21:13:01.662939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45bdba85-ae7e-4cc4-9f8e-ca7481a99ca2 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:01.667347 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45bdba85-ae7e-4cc4-9f8e-ca7481a99ca2 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 404 len: 62 microversion: 2.1 time: 0.079406 Apr 30 21:13:01.672990 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 498/931] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:01 2022] GET /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:13:01.692325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:01.693108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:01.717273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:01.717735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:01.718568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:01.719014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:01.877793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5f3851e-b043-4465-b510-dcd3b83f90b0 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Action: 'create', calling method: .version_select at 0x7fdc20a81a60>, body: {"pool": null} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:02.648461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:02.680565 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0184dfec-f8c9-495a-8d19-8596fb6ee0e5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 1.005014 Apr 30 21:13:02.695493 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 499/932] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:01 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:02.705711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:02.712908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:02.726468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:02.726468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:02.727192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:02.727965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:02.766818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:13:03.135690 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f133ce6e-e432-4fa9-9ae7-6b5c12e3f3f4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 204 len: 0 microversion: 2.1 time: 0.437918 Apr 30 21:13:03.136776 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 500/933] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:13:02 2022] DELETE /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:03.144262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ffa47e4b-cf97-4da1-9ddb-8f744237b60c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1966271297"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:03.164571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ffa47e4b-cf97-4da1-9ddb-8f744237b60c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:03.185153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa47e4b-cf97-4da1-9ddb-8f744237b60c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:03.191287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa47e4b-cf97-4da1-9ddb-8f744237b60c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:03.192882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa47e4b-cf97-4da1-9ddb-8f744237b60c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:03.198739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa47e4b-cf97-4da1-9ddb-8f744237b60c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:04.234610 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ffa47e4b-cf97-4da1-9ddb-8f744237b60c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "POST /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6/action" status: 202 len: 0 microversion: 2.1 time: 1.095803 Apr 30 21:13:04.236158 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 501/934] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:13:03 2022] POST /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:13:04.244150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:04.244890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:04.255932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:04.256726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:04.258672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:04.260338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:04.514551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:04.524129 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d47fd745-034b-4450-a448-819885610712 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1474 microversion: 2.1 time: 0.286554 Apr 30 21:13:04.525003 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 502/935] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:04 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1474 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:04.535825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb6ea36b-8703-4f66-b31e-372f21b90706 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20bc6280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:04.608445 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb6ea36b-8703-4f66-b31e-372f21b90706 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.080022 Apr 30 21:13:04.609601 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 503/936] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:04 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:04.617245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:04.623562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: b36482df-2cb5-4d30-9ce3-95a6f06f80f0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:04.636342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:04.636957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:04.637912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:04.639832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:04.670507 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] HTTP exception thrown: Instance b36482df-2cb5-4d30-9ce3-95a6f06f80f0 could not be found. Apr 30 21:13:04.671223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Returning 404 to user: Instance b36482df-2cb5-4d30-9ce3-95a6f06f80f0 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:04.672178 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e4822289-cd8d-4579-9301-b3a883dc18eb tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0" status: 404 len: 111 microversion: 2.1 time: 0.061604 Apr 30 21:13:04.673153 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 504/937] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:04 2022] GET /compute/v2.1/servers/b36482df-2cb5-4d30-9ce3-95a6f06f80f0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:04.684959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:04.685817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:04.693269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:04.694161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:04.697834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:04.697834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:04.992336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:05.004402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:05.007142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:05.009312 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0600adec-9213-4b75-9c9e-192bd2e5b87b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.335137 Apr 30 21:13:05.010101 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 505/938] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:04 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:05.034122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1671589607", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "91343643", "adminPass": "***", "networks": [{"uuid": "51417b35-dffb-4e2a-abd0-357ad597c615"}], "security_groups": [{"name": "tempest-securitygroup--240132572"}], "key_name": "tempest-keypair-197166924", "user_data": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:05.314490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] validate_networks() for [('51417b35-dffb-4e2a-abd0-357ad597c615', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:13:06.081240 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5f3851e-b043-4465-b510-dcd3b83f90b0 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.570604 Apr 30 21:13:06.083251 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 434/939] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:13:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:06.095624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:06.096311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:06.110175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:06.110632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:06.111633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:06.112081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:06.515202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:13:06.516306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:13:06.516789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:13:06.517203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:13:06.517962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:13:06.536180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:06.537007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:06.538288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:06.539071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:06.567476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:13:06.572051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Getting quotas for user c816e51510ac44c9a2b3f5c022b5a3c3 and project 7710d2f3153e440ab46c2d89ce24c4cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:13:06.585016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:13:06.588033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:13:06.843773 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3c074bd-2e08-4a4e-af09-c951eb573146 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.832353 Apr 30 21:13:06.861088 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 506/940] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:13:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:13:06.870241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b3c1310c-9a7c-4504-8e23-4809dbc14872 req-31048daa-164d-4a0b-8356-54f5bc7731a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3604c457-9d04-40ae-8d64-1e3a9c5997b9", "name": "network-vif-unplugged", "status": "completed", "tag": "847cb3b0-ee43-4565-9188-e7bd64f115af"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:06.879680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:06.896342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b923c939-a3ab-4540-a98b-5ac9620e1265 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.811127 Apr 30 21:13:06.904307 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 435/941] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:06 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:06.929956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-470c0314-caae-4b22-8b5a-54e15141c04e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a3d790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:06.939592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b3c1310c-9a7c-4504-8e23-4809dbc14872 req-31048daa-164d-4a0b-8356-54f5bc7731a9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:06.946329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b3c1310c-9a7c-4504-8e23-4809dbc14872 req-31048daa-164d-4a0b-8356-54f5bc7731a9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:06.991097 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b3c1310c-9a7c-4504-8e23-4809dbc14872 req-31048daa-164d-4a0b-8356-54f5bc7731a9 service nova] Creating event network-vif-unplugged:847cb3b0-ee43-4565-9188-e7bd64f115af for instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 on nch2-master-1 Apr 30 21:13:07.025417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-b3c1310c-9a7c-4504-8e23-4809dbc14872 req-31048daa-164d-4a0b-8356-54f5bc7731a9 service nova] Instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:13:07.037871 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-470c0314-caae-4b22-8b5a-54e15141c04e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.132062 Apr 30 21:13:07.039034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 436/942] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:06 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:07.046893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:07.054848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:07.065113 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b3c1310c-9a7c-4504-8e23-4809dbc14872 req-31048daa-164d-4a0b-8356-54f5bc7731a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.202426 Apr 30 21:13:07.069636 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 507/943] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:07.075646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:07.080658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:07.083799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:07.083799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:07.083799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:07.093321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:07.119781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:07.122323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:07.123305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:07.123914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:07.147928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:13:07.511123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:07.522884 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-abd53986-3071-4ad4-bd3d-cec6f07eadb2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1471 microversion: 2.1 time: 0.451795 Apr 30 21:13:07.525550 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 508/944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:07 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:07.532697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d51a9432-b0a5-4866-8d74-d90f40611628 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc262bd5e0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:07.557634 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bb69dea1-aa16-4c0a-bb34-8dd4ddca02db tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 204 len: 0 microversion: 2.1 time: 0.513221 Apr 30 21:13:07.559802 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 437/945] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:13:07 2022] DELETE /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:07.575605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:07.576917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:07.590858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:07.593448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:07.595084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:07.612161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:07.639938 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d51a9432-b0a5-4866-8d74-d90f40611628 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.112546 Apr 30 21:13:07.640881 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 509/946] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:07 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:07.658475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c166851-2395-41ad-8b66-04e11606db36 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Calling method '.version_select at 0x7fdc2629e940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:08.042357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:08.052843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:08.059600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:08.062558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ecef479-02cd-401a-9ec8-e0e63961e7ad tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.499261 Apr 30 21:13:08.064361 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 438/947] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:07 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:08.074845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ca0755f-1568-4220-b650-ad3296192452 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:08.076918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2ca0755f-1568-4220-b650-ad3296192452 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:08.135687 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c166851-2395-41ad-8b66-04e11606db36 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/f938712d-9bfd-4667-b0b3-439293245d6a" status: 200 len: 141 microversion: 2.1 time: 0.493472 Apr 30 21:13:08.136826 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 510/948] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:13:07 2022] GET /compute/v2.1/os-floating-ips/f938712d-9bfd-4667-b0b3-439293245d6a => generated 141 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:08.150197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b2fa177-2a66-4bc4-9941-736b2687c85f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:08.150197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b2fa177-2a66-4bc4-9941-736b2687c85f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:08.157165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b2fa177-2a66-4bc4-9941-736b2687c85f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.157790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b2fa177-2a66-4bc4-9941-736b2687c85f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.158912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b2fa177-2a66-4bc4-9941-736b2687c85f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.159469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b2fa177-2a66-4bc4-9941-736b2687c85f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.186729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ca0755f-1568-4220-b650-ad3296192452 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:08.195044 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ca0755f-1568-4220-b650-ad3296192452 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1260 microversion: 2.1 time: 0.129531 Apr 30 21:13:08.197477 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 439/949] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:08 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1260 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:08.211433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:08.213724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:08.227705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.229045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.232875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.232875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.398525 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b2fa177-2a66-4bc4-9941-736b2687c85f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9/action" status: 204 len: 0 microversion: 2.1 time: 0.254633 Apr 30 21:13:08.400004 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 511/950] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:13:08 2022] POST /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9/action => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:08.410998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:08.427837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:08.451408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.452586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.454024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.454611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.495787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:08.509163 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-abf20bb1-751d-4827-86b6-331bc4188c63 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1470 microversion: 2.1 time: 0.303943 Apr 30 21:13:08.510435 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 440/951] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:08 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:08.520614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-29bc9adf-324d-4f39-a5e1-039b434bfafb req-2f5cac89-56e5-4de7-a492-b2db553f0c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b3ef0d-1829-471c-9d1f-461b84634a6e", "name": "network-vif-deleted", "tag": "c43b09e1-c606-48c3-ab4c-b62ee389ba94"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:08.537889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-29bc9adf-324d-4f39-a5e1-039b434bfafb req-2f5cac89-56e5-4de7-a492-b2db553f0c65 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.538355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-29bc9adf-324d-4f39-a5e1-039b434bfafb req-2f5cac89-56e5-4de7-a492-b2db553f0c65 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.557801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-29bc9adf-324d-4f39-a5e1-039b434bfafb req-2f5cac89-56e5-4de7-a492-b2db553f0c65 service nova] Creating event network-vif-deleted:c43b09e1-c606-48c3-ab4c-b62ee389ba94 for instance c8b3ef0d-1829-471c-9d1f-461b84634a6e on nch2-master-1 Apr 30 21:13:08.563247 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-29bc9adf-324d-4f39-a5e1-039b434bfafb req-2f5cac89-56e5-4de7-a492-b2db553f0c65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050904 Apr 30 21:13:08.568141 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 441/952] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:08.570091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c5aaf18e-2e9f-4c7e-9029-194248542278 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a81310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:08.622513 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c5aaf18e-2e9f-4c7e-9029-194248542278 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.056528 Apr 30 21:13:08.623594 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 442/953] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:08 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:08.634781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ac82d347-bfa9-448e-8509-4a2b0dff55b9 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Calling method '.version_select at 0x7fdc20bc15e0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:08.733968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:08.744646 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-550e6569-3c6c-48de-87e0-2272ae40e075 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.338154 Apr 30 21:13:08.749572 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 512/954] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:08 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:08.762277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:08.763275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:08.794706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.794706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:08.794706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:08.794706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.275854 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ac82d347-bfa9-448e-8509-4a2b0dff55b9 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.634006 Apr 30 21:13:09.275854 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 443/955] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:13:08 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:09.282193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-157b10fe-b3fe-4308-be57-71a25019829e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20a4ec10>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:09.344158 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-157b10fe-b3fe-4308-be57-71a25019829e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.070992 Apr 30 21:13:09.344882 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 444/956] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:09 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:09.355818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:09.364421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:09.372633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:09.373132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.374143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:09.374760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.378037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:09.400942 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45515dcf-a7b7-4cd3-9ef3-f36f426633db tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1471 microversion: 2.1 time: 0.642248 Apr 30 21:13:09.412820 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 513/957] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:08 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1471 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:09.418099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ee42ea37-aeae-4449-9750-2e499331a5a2 req-93529cb7-931c-4ae2-b5fb-44c5b075ef9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77da7802-0fa5-4899-89bc-0300c2599af7", "name": "network-vif-plugged", "status": "completed", "tag": "2514de9a-e593-441c-b26f-47d347c23ccb"}, {"server_uuid": "3604c457-9d04-40ae-8d64-1e3a9c5997b9", "name": "network-vif-plugged", "status": "completed", "tag": "847cb3b0-ee43-4565-9188-e7bd64f115af"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:09.427878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ee42ea37-aeae-4449-9750-2e499331a5a2 req-93529cb7-931c-4ae2-b5fb-44c5b075ef9b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:09.428152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ee42ea37-aeae-4449-9750-2e499331a5a2 req-93529cb7-931c-4ae2-b5fb-44c5b075ef9b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.443691 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ee42ea37-aeae-4449-9750-2e499331a5a2 req-93529cb7-931c-4ae2-b5fb-44c5b075ef9b service nova] Creating event network-vif-plugged:2514de9a-e593-441c-b26f-47d347c23ccb for instance 77da7802-0fa5-4899-89bc-0300c2599af7 on nch1-master-1 Apr 30 21:13:09.444543 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ee42ea37-aeae-4449-9750-2e499331a5a2 req-93529cb7-931c-4ae2-b5fb-44c5b075ef9b service nova] Creating event network-vif-plugged:847cb3b0-ee43-4565-9188-e7bd64f115af for instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 on nch2-master-1 Apr 30 21:13:09.450253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-ee42ea37-aeae-4449-9750-2e499331a5a2 req-93529cb7-931c-4ae2-b5fb-44c5b075ef9b service nova] Instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:13:09.460437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ee42ea37-aeae-4449-9750-2e499331a5a2 req-93529cb7-931c-4ae2-b5fb-44c5b075ef9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047634 Apr 30 21:13:09.461219 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 514/958] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:09.467006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:09.467711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:09.476914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:09.477377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.478860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:09.479312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.568657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:09.578227 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a5cd0d3-7741-456d-8dd1-44427c7406a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1256 microversion: 2.1 time: 0.115075 Apr 30 21:13:09.578844 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 515/959] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:09 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1256 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:09.583668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-572613da-786b-48ce-b759-c60b6048f077 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Calling method '.version_select at 0x7fdc262f6940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:09.680174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:09.688496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:09.691659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:09.691659 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51d615c0-8d09-4b2f-92fd-3c53383cc8c2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.345356 Apr 30 21:13:09.692064 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 445/960] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:09 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:09.705240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:09.705700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:09.729091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:09.729547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.730360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:09.732121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:09.932605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:09.945622 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a578918e-1f55-434d-8b4c-188b6b7c4d72 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1470 microversion: 2.1 time: 0.242180 Apr 30 21:13:09.951923 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 446/961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:09 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:09.959846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-548058fc-3aa7-4684-bb1e-4f09211ea3c1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20d864c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:10.028895 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-548058fc-3aa7-4684-bb1e-4f09211ea3c1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.075284 Apr 30 21:13:10.030060 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 447/962] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:09 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:10.036671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:10.039418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:10.051589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:10.052240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:10.053423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:10.055030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:10.649610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:10.657815 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9b80351b-b341-4eca-b7cc-1db9325b976c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.626451 Apr 30 21:13:10.658377 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 448/963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:10 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:10.662925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-84e6eeb8-cd06-4eff-96e2-2ee44e7144e2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20a4e940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:10.732791 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-84e6eeb8-cd06-4eff-96e2-2ee44e7144e2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1411 microversion: 2.1 time: 0.073375 Apr 30 21:13:10.734295 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 449/964] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:10 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:10.739459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:10.740077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:10.746664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:10.747096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:10.747878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:10.748315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:10.968550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:10.976607 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9da2b3d6-0e11-4258-bf92-632c20b1d220 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1471 microversion: 2.1 time: 0.241186 Apr 30 21:13:10.989632 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 450/965] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:10 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:10.995260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:10.995873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:11.001916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.002372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.003145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.003585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.072575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:11.080625 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d265c514-1406-4eb3-9a41-9aab7ff902d2 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1330 microversion: 2.1 time: 0.089408 Apr 30 21:13:11.081423 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 451/966] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:10 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1330 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:11.087630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:11.091244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:11.094277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.094916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.095885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.096492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.222722 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-572613da-786b-48ce-b759-c60b6048f077 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/f938712d-9bfd-4667-b0b3-439293245d6a" status: 202 len: 0 microversion: 2.1 time: 1.642768 Apr 30 21:13:11.228041 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 516/967] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:13:09 2022] DELETE /compute/v2.1/os-floating-ips/f938712d-9bfd-4667-b0b3-439293245d6a => generated 0 bytes in 1644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:13:11.228662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:11.229379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:11.236030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.236756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.237658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.238258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.302673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:11.311170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:11.312690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:11.314129 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-698241db-96da-4a88-9d35-56c8d7683d0e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.231133 Apr 30 21:13:11.324707 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 452/968] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:11 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:11.324707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ddc489ec-58fc-463e-9c2a-318e8c8968b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a4ea60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:11.389502 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ddc489ec-58fc-463e-9c2a-318e8c8968b4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.073733 Apr 30 21:13:11.392547 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 453/969] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:11 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:11.398412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03044c5d-e834-4087-b7c0-23f3a2274e37 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Action: 'create', calling method: .version_select at 0x7fdc20bc1f70>, body: {"pool": null} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:11.514763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:11.526552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4291052c-8f10-4319-96ab-131486463352 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 200 len: 1470 microversion: 2.1 time: 0.301977 Apr 30 21:13:11.533790 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 517/970] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:11 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:11.546200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-123fa0fd-ca81-4624-94b6-bc09f32aefad req-f58915f5-385a-4fd7-b83b-dcf4bbdf7727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f3622-93d0-45c9-8971-89e3308037b6", "name": "network-vif-plugged", "status": "completed", "tag": "544026f7-e9ff-4a0e-9515-f5e31e5016da"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:11.563859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-123fa0fd-ca81-4624-94b6-bc09f32aefad req-f58915f5-385a-4fd7-b83b-dcf4bbdf7727 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.565607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-123fa0fd-ca81-4624-94b6-bc09f32aefad req-f58915f5-385a-4fd7-b83b-dcf4bbdf7727 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.582046 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-123fa0fd-ca81-4624-94b6-bc09f32aefad req-f58915f5-385a-4fd7-b83b-dcf4bbdf7727 service nova] Creating event network-vif-plugged:544026f7-e9ff-4a0e-9515-f5e31e5016da for instance 353f3622-93d0-45c9-8971-89e3308037b6 on nch1-master-1 Apr 30 21:13:11.587834 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-123fa0fd-ca81-4624-94b6-bc09f32aefad req-f58915f5-385a-4fd7-b83b-dcf4bbdf7727 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046702 Apr 30 21:13:11.588483 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 518/971] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:11.677560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:11.689014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:11.698563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.699045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.699830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:11.700287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:11.968575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:11.982926 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-614ed015-4722-4210-9738-2c75ff3eeb2a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.309550 Apr 30 21:13:11.984928 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 519/972] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:11 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:12.000878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c006c212-41a9-4477-8413-f0d68c9492b6 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20bc6940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:12.066091 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c006c212-41a9-4477-8413-f0d68c9492b6 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1420 microversion: 2.1 time: 0.079549 Apr 30 21:13:12.067513 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 520/973] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:11 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:12.072931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:12.074012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:12.081403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:12.082473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:12.083655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:12.084330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:12.291486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:12.300126 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8cd361ba-7571-47ae-9fbd-2471a173acfd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1463 microversion: 2.1 time: 0.231345 Apr 30 21:13:12.301084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 521/974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:12 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1463 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:12.305621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d877034b-f74b-4f15-bbd2-fa03b5476682 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc262f6700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:12.355746 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d877034b-f74b-4f15-bbd2-fa03b5476682 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 200 len: 1420 microversion: 2.1 time: 0.053607 Apr 30 21:13:12.357584 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 522/975] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:12 2022] GET /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:12.368169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:12.368169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:12.372029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:12.372669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:12.373656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:12.374287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:12.611846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:12.623081 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9ebe6059-dc35-46b6-84bb-4be1483d7399 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1385 microversion: 2.1 time: 0.261306 Apr 30 21:13:12.623081 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 523/976] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:12 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1385 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:12.633585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:12.634652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:12.641174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:12.641933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:12.642802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:12.643322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:12.981927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:12.990437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da0b00ad-202d-46d4-855f-95f39e2b256c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1463 microversion: 2.1 time: 0.363679 Apr 30 21:13:12.994394 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 524/977] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:12 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1463 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:13.018206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:13.019976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:13.037937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:13.038325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:13.039149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:13.039597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:13.431495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:13.449845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:13.451756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:13.453548 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7fd9f4f4-27d2-4a5a-a921-2bc1427ee3f0 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1362 microversion: 2.25 time: 0.457922 Apr 30 21:13:13.457537 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 525/978] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:12 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:13.466629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ea51aab-a8f7-4ee9-b791-3580f1825e2f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20bc68b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:13.905258 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-03044c5d-e834-4087-b7c0-23f3a2274e37 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.511133 Apr 30 21:13:13.907965 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 454/979] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:13:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:13.919671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cfea7830-b088-44a3-985e-16de4194143c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a81f70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.114189 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ea51aab-a8f7-4ee9-b791-3580f1825e2f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 204 len: 0 microversion: 2.1 time: 1.655223 Apr 30 21:13:15.116588 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 526/980] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:13 2022] DELETE /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 0 bytes in 1658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:15.136104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.141657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: 10b1f705-0c2a-4bd9-af97-caf3ba66ca37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:15.150411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.151100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.152154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.152764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.170207 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] HTTP exception thrown: Instance 10b1f705-0c2a-4bd9-af97-caf3ba66ca37 could not be found. Apr 30 21:13:15.171033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Returning 404 to user: Instance 10b1f705-0c2a-4bd9-af97-caf3ba66ca37 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:15.172041 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e92cf2d9-3897-4daa-a1ba-5dad1f300810 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37" status: 404 len: 111 microversion: 2.1 time: 0.052521 Apr 30 21:13:15.173062 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 527/981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:15 2022] GET /compute/v2.1/servers/10b1f705-0c2a-4bd9-af97-caf3ba66ca37 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:15.178271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-7f9667d0-e3de-41fe-84f1-66323fed145e req-60fcf897-9426-4234-9850-0b428946daea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c246e5-490c-4639-8c9a-4b088609cc2e", "name": "network-vif-unplugged", "status": "completed", "tag": "2ecc5d88-fb01-4e83-9ea8-85d7acd6114b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:15.178514 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cfea7830-b088-44a3-985e-16de4194143c tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 1.270127 Apr 30 21:13:15.184649 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 455/982] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:13 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:15.184649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.185426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:15.192186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.192734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.193594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.194128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.197003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7f9667d0-e3de-41fe-84f1-66323fed145e req-60fcf897-9426-4234-9850-0b428946daea service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.197629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7f9667d0-e3de-41fe-84f1-66323fed145e req-60fcf897-9426-4234-9850-0b428946daea service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.210751 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-7f9667d0-e3de-41fe-84f1-66323fed145e req-60fcf897-9426-4234-9850-0b428946daea service nova] Creating event network-vif-unplugged:2ecc5d88-fb01-4e83-9ea8-85d7acd6114b for instance 27c246e5-490c-4639-8c9a-4b088609cc2e on nch2-master-1 Apr 30 21:13:15.218029 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-7f9667d0-e3de-41fe-84f1-66323fed145e req-60fcf897-9426-4234-9850-0b428946daea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043356 Apr 30 21:13:15.218899 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 528/983] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:15.224960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93bb0917-e5d0-40a9-ad64-371a3110dc46 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '.version_select at 0x7fdc20d52820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.228655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93bb0917-e5d0-40a9-ad64-371a3110dc46 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.229709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93bb0917-e5d0-40a9-ad64-371a3110dc46 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.240992 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-93bb0917-e5d0-40a9-ad64-371a3110dc46 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2720 microversion: 2.1 time: 0.020710 Apr 30 21:13:15.241600 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 529/984] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:13:15 2022] GET /compute/v2.1/os-migrations => generated 2720 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:15.254952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.255704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:15.263142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.263602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.264606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.265054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.427675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:15.439655 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ce544765-77f2-4c8d-bd3e-8b1f74832855 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.258204 Apr 30 21:13:15.440925 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 456/985] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:15 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:15.448229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b06ea414-d8f3-48fa-bc1f-6465d00a523b tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Calling method '.version_select at 0x7fdc20a4e940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.461454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:15.469849 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d2c690a-03f0-447f-9e6c-0cdbac2f0c59 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1385 microversion: 2.1 time: 0.226997 Apr 30 21:13:15.481901 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 530/986] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:15 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1385 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:15.486934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.487553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:15.494887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.497851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.497851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.497851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.726947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:15.740377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:15.742170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:15.744393 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-97f6ae43-206b-415e-baea-0f26ed81fd03 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1558 microversion: 2.25 time: 0.261403 Apr 30 21:13:15.757998 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 531/987] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:15 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1558 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:15.764987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:15.765833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:15.775799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.776843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.778275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:15.778851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:15.810813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:13:16.190711 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6284da6-14e2-498e-a308-65fb6d01b80d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 204 len: 0 microversion: 2.1 time: 0.430972 Apr 30 21:13:16.197395 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 532/988] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:13:15 2022] DELETE /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:16.205518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:16.207605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:16.220185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:16.220649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:16.221930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:16.222393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:16.274606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:13:16.764625 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b06ea414-d8f3-48fa-bc1f-6465d00a523b tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/141fe870-5abd-46d7-9da1-3a782cd473be" status: 202 len: 0 microversion: 2.1 time: 1.321625 Apr 30 21:13:16.768415 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 457/989] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:13:15 2022] DELETE /compute/v2.1/os-floating-ips/141fe870-5abd-46d7-9da1-3a782cd473be => generated 0 bytes in 1326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:13:16.773801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e144d31-2a45-43c3-8d83-715144b16253 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:16.783127 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e144d31-2a45-43c3-8d83-715144b16253 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013368 Apr 30 21:13:16.783943 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 458/990] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:13:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:16.788431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:16.789630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:16.798016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:16.798797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:16.799901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:16.800542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:16.825651 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b3111ee-473f-47e1-bc46-cb0492cf3918 tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 204 len: 0 microversion: 2.1 time: 0.626353 Apr 30 21:13:16.826657 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 533/991] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:13:16 2022] DELETE /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:16.834907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1ae609fa-7dcd-42f2-96c5-ae99af0566b0 req-642c062c-00b7-4cdb-b222-1aa53dfc126b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85fdff58-4182-4941-b3a0-879915a49a4a", "name": "network-vif-unplugged", "status": "completed", "tag": "e3d4a5c6-46ec-4840-adba-bbaa926432a0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:16.855242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1ae609fa-7dcd-42f2-96c5-ae99af0566b0 req-642c062c-00b7-4cdb-b222-1aa53dfc126b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:16.855697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1ae609fa-7dcd-42f2-96c5-ae99af0566b0 req-642c062c-00b7-4cdb-b222-1aa53dfc126b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:16.871535 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1ae609fa-7dcd-42f2-96c5-ae99af0566b0 req-642c062c-00b7-4cdb-b222-1aa53dfc126b service nova] Creating event network-vif-unplugged:e3d4a5c6-46ec-4840-adba-bbaa926432a0 for instance 85fdff58-4182-4941-b3a0-879915a49a4a on nch2-master-1 Apr 30 21:13:16.877153 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1ae609fa-7dcd-42f2-96c5-ae99af0566b0 req-642c062c-00b7-4cdb-b222-1aa53dfc126b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046037 Apr 30 21:13:16.882970 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 534/992] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:16.891871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4d3c8ea5-6500-446e-8cb6-d9bfdc3cb83d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc262534c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:16.948711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid 77da7802-0fa5-4899-89bc-0300c2599af7 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:13:16.965876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ba4a3e6-c936-4850-9310-45b8bb455989 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 2051 microversion: 2.25 time: 0.180618 Apr 30 21:13:16.966258 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4d3c8ea5-6500-446e-8cb6-d9bfdc3cb83d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.080820 Apr 30 21:13:16.967208 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 459/993] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:16 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 2051 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:16.975178 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 535/994] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:16 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:16.977903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-271799289", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c1b131fa-a537-4b70-82cc-dbac26cd0254"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:16.981094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:16.982598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:16.991184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:16.991777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:16.992731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:16.993345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.043923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] validate_networks() for [('c1b131fa-a537-4b70-82cc-dbac26cd0254', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:13:17.249117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:17.258052 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3b8e454-fa73-460c-8d6c-433b3afe9f35 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.286272 Apr 30 21:13:17.284942 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 536/995] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:16 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:17.290149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:17.291312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:17.297387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.297875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.298675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.299120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.526009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:17.534117 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a96a6b8f-5e6a-4111-bfee-abd097aa3604 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1385 microversion: 2.1 time: 0.247842 Apr 30 21:13:17.535212 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 537/996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:17 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:17.549330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee685226-dcec-451e-acef-326af99ed7f4 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Calling method '.version_select at 0x7fdc20df6790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:17.617360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-ee685226-dcec-451e-acef-326af99ed7f4 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 141fe870-5abd-46d7-9da1-3a782cd473be could not be found", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:13:17.618970 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ee685226-dcec-451e-acef-326af99ed7f4 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] HTTP exception thrown: Floating IP not found for ID 141fe870-5abd-46d7-9da1-3a782cd473be Apr 30 21:13:17.619441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee685226-dcec-451e-acef-326af99ed7f4 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Returning 404 to user: Floating IP not found for ID 141fe870-5abd-46d7-9da1-3a782cd473be {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:17.620290 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee685226-dcec-451e-acef-326af99ed7f4 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/141fe870-5abd-46d7-9da1-3a782cd473be" status: 404 len: 111 microversion: 2.1 time: 0.075049 Apr 30 21:13:17.621106 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 538/997] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:13:17 2022] GET /compute/v2.1/os-floating-ips/141fe870-5abd-46d7-9da1-3a782cd473be => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:17.628151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5997ff39-1040-40ba-84c5-73fe5cf36d9a tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1765094410", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:17.628151 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:17.628151 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:13:17.670381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:13:17.670810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:13:17.671294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:13:17.671994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:13:17.672608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:13:17.684994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.685496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.686526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.686970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.701450 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5997ff39-1040-40ba-84c5-73fe5cf36d9a tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.079381 Apr 30 21:13:17.702558 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 539/998] 10.222.0.23 () {60 vars in 1145 bytes} [Sat Apr 30 21:13:17 2022] POST /compute/v2.1/flavors => generated 499 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:17.712014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:17.712657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:17.717131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:13:17.721140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.727815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.727815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.728084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for user 6e275a4d32754fe9a164bd79c3774b97 and project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:13:17.728279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.736374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:13:17.740709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:13:17.880375 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3338d8b2-33a5-4cf7-a198-547bf97e913a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911869 Apr 30 21:13:17.881801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:17.887784 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 460/999] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:13:17.890168 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9aac94db-733c-449e-bc82-d32c16a53e3e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1470 microversion: 2.1 time: 0.186521 Apr 30 21:13:17.893601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32eea1c2-b400-4488-98da-61908287323f tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:17.895306 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:17.895306 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:17.896824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32eea1c2-b400-4488-98da-61908287323f tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.897527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32eea1c2-b400-4488-98da-61908287323f tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.898842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32eea1c2-b400-4488-98da-61908287323f tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.899651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32eea1c2-b400-4488-98da-61908287323f tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.900557 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 540/1000] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:17 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:17.906471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ca5c74ef-4d00-4cb0-92b8-4c5a8da00c2b req-b623f478-b970-421e-8bfa-1783b40674cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b1f705-0c2a-4bd9-af97-caf3ba66ca37", "name": "network-vif-deleted", "tag": "ac2b59b7-f6ea-45a4-b2fc-ad1e92f9f8e6"}, {"name": "network-changed", "server_uuid": "ceb8816e-710b-48c2-b59d-862a9a875311", "tag": "ec76b029-1b07-4d93-8cd9-507a98ae0296"}, {"name": "network-changed", "server_uuid": "27c246e5-490c-4639-8c9a-4b088609cc2e", "tag": "2ecc5d88-fb01-4e83-9ea8-85d7acd6114b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:17.917422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ca5c74ef-4d00-4cb0-92b8-4c5a8da00c2b req-b623f478-b970-421e-8bfa-1783b40674cb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:17.918741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ca5c74ef-4d00-4cb0-92b8-4c5a8da00c2b req-b623f478-b970-421e-8bfa-1783b40674cb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:17.935902 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ca5c74ef-4d00-4cb0-92b8-4c5a8da00c2b req-b623f478-b970-421e-8bfa-1783b40674cb service nova] Creating event network-vif-deleted:ac2b59b7-f6ea-45a4-b2fc-ad1e92f9f8e6 for instance 10b1f705-0c2a-4bd9-af97-caf3ba66ca37 on nch1-master-1 Apr 30 21:13:17.936625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ca5c74ef-4d00-4cb0-92b8-4c5a8da00c2b req-b623f478-b970-421e-8bfa-1783b40674cb service nova] Creating event network-changed:ec76b029-1b07-4d93-8cd9-507a98ae0296 for instance ceb8816e-710b-48c2-b59d-862a9a875311 on nch2-master-1 Apr 30 21:13:17.937297 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ca5c74ef-4d00-4cb0-92b8-4c5a8da00c2b req-b623f478-b970-421e-8bfa-1783b40674cb service nova] Creating event network-changed:2ecc5d88-fb01-4e83-9ea8-85d7acd6114b for instance 27c246e5-490c-4639-8c9a-4b088609cc2e on nch2-master-1 Apr 30 21:13:17.950844 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ca5c74ef-4d00-4cb0-92b8-4c5a8da00c2b req-b623f478-b970-421e-8bfa-1783b40674cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.048684 Apr 30 21:13:17.956266 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 541/1001] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:17.962089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77e884e1-7055-4ad8-b32b-13584b7dc095 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Calling method '.version_select at 0x7fdc262f68b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:17.982570 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32eea1c2-b400-4488-98da-61908287323f tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093325 Apr 30 21:13:17.993840 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 461/1002] 10.222.0.23 () {60 vars in 1216 bytes} [Sat Apr 30 21:13:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:13:18.003152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64b66572-d5ec-47f7-a7cf-772a08031982 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:18.015059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-77e884e1-7055-4ad8-b32b-13584b7dc095 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 141fe870-5abd-46d7-9da1-3a782cd473be could not be found", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:13:18.015944 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-77e884e1-7055-4ad8-b32b-13584b7dc095 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] HTTP exception thrown: Floating IP not found for ID 141fe870-5abd-46d7-9da1-3a782cd473be Apr 30 21:13:18.016715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77e884e1-7055-4ad8-b32b-13584b7dc095 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] Returning 404 to user: Floating IP not found for ID 141fe870-5abd-46d7-9da1-3a782cd473be {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:18.017718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77e884e1-7055-4ad8-b32b-13584b7dc095 tempest-FloatingIPsTestJSON-49946637 tempest-FloatingIPsTestJSON-49946637-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/141fe870-5abd-46d7-9da1-3a782cd473be" status: 404 len: 111 microversion: 2.1 time: 0.060128 Apr 30 21:13:18.018875 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 542/1003] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:13:17 2022] DELETE /compute/v2.1/os-floating-ips/141fe870-5abd-46d7-9da1-3a782cd473be => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:18.022493 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-64b66572-d5ec-47f7-a7cf-772a08031982 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027487 Apr 30 21:13:18.028933 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 462/1004] 10.222.0.23 () {58 vars in 1181 bytes} [Sat Apr 30 21:13:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:13:18.033351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-07cb4715-0671-4ac9-8e91-b9cef68aae9c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:18.034131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-07cb4715-0671-4ac9-8e91-b9cef68aae9c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:18.044313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b636472-a4ae-4afe-b8f2-99172f1c8d07 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20a81ca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:18.119113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b636472-a4ae-4afe-b8f2-99172f1c8d07 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.088754 Apr 30 21:13:18.120235 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 463/1005] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:18 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:18.182935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-07cb4715-0671-4ac9-8e91-b9cef68aae9c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:18.193054 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-07cb4715-0671-4ac9-8e91-b9cef68aae9c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1207 microversion: 2.1 time: 0.170338 Apr 30 21:13:18.193583 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 543/1006] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:18 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1207 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:18.255299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-305715739", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "24f26b92-a3ce-4952-a05c-bfbb4378fc13"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:18.280616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:18.281267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:18.302832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:18.304380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:18.314237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:18.314990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:18.369287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:13:19.316620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:19.333100 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e0db535d-1096-436b-bf1d-5c3b67b2fce6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 1.061146 Apr 30 21:13:19.334391 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 544/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:18 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:19.343799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:19.345224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:19.358775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.359342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.363285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.363862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.486957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:13:19.487967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:13:19.488623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:13:19.489195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:13:19.489807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:13:19.510330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.511184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.512024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.512469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.552242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:13:19.562280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for user cce42480cd844664991774f07ca47e79 and project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:13:19.592603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:13:19.608926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:13:19.686257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:19.699077 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15637f7f-adfa-4215-b6d8-9fe70168bfed tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1385 microversion: 2.1 time: 0.363418 Apr 30 21:13:19.703147 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 545/1008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:19 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1385 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:19.719680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:19.722714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:19.734792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.735262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.736272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.736887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.798548 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e375a35-ff9f-47b5-958b-9cfd28efdb79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548224 Apr 30 21:13:19.812458 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 464/1009] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:13:19.818676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0c3b3748-c45c-4d57-9507-11cb830d358e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20c3aaf0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:19.874034 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0c3b3748-c45c-4d57-9507-11cb830d358e tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.059686 Apr 30 21:13:19.875596 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 465/1010] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:19 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:19.876549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:19.882894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:19.890319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:19.901598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.902455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.903517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:19.908954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:19.941601 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7e563a7f-07c0-421a-b5bc-3e830cb1eacf tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1428 microversion: 2.1 time: 0.235713 Apr 30 21:13:19.947749 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 546/1011] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:19 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1428 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:19.964732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3b40a53-2f97-49e7-8b70-dcbc2d8866c1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:19.970680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3b40a53-2f97-49e7-8b70-dcbc2d8866c1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:20.091672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:20.105940 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e7f30c0c-8efd-4884-b7f5-e07c3449f86a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1203 microversion: 2.1 time: 0.229004 Apr 30 21:13:20.110685 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 466/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:19 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1203 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:20.119603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c3b40a53-2f97-49e7-8b70-dcbc2d8866c1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:20.132479 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3b40a53-2f97-49e7-8b70-dcbc2d8866c1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1278 microversion: 2.1 time: 0.181574 Apr 30 21:13:20.133248 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 547/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:19 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:20.340996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-166f7b02-e97e-4857-afd1-6e9968f7a024 req-65788c18-2500-4bc2-a591-8dd3e4804866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85fdff58-4182-4941-b3a0-879915a49a4a", "name": "network-vif-deleted", "tag": "e3d4a5c6-46ec-4840-adba-bbaa926432a0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:20.356408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:20.357144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:20.371328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:20.373727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:20.376096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:20.377630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:20.382200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-166f7b02-e97e-4857-afd1-6e9968f7a024 req-65788c18-2500-4bc2-a591-8dd3e4804866 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:20.389855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-166f7b02-e97e-4857-afd1-6e9968f7a024 req-65788c18-2500-4bc2-a591-8dd3e4804866 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:20.440575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-166f7b02-e97e-4857-afd1-6e9968f7a024 req-65788c18-2500-4bc2-a591-8dd3e4804866 service nova] Creating event network-vif-deleted:e3d4a5c6-46ec-4840-adba-bbaa926432a0 for instance 85fdff58-4182-4941-b3a0-879915a49a4a on nch2-master-1 Apr 30 21:13:20.455498 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-166f7b02-e97e-4857-afd1-6e9968f7a024 req-65788c18-2500-4bc2-a591-8dd3e4804866 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114767 Apr 30 21:13:20.459487 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 467/1014] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:20.514195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cf8bc41e-1c21-4d2a-b731-a68d378eea09 req-8343f643-1d71-4de0-b791-b719af8ae869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb8816e-710b-48c2-b59d-862a9a875311", "name": "network-vif-plugged", "status": "completed", "tag": "ec76b029-1b07-4d93-8cd9-507a98ae0296"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:20.536595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cf8bc41e-1c21-4d2a-b731-a68d378eea09 req-8343f643-1d71-4de0-b791-b719af8ae869 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:20.538299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cf8bc41e-1c21-4d2a-b731-a68d378eea09 req-8343f643-1d71-4de0-b791-b719af8ae869 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:20.569326 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cf8bc41e-1c21-4d2a-b731-a68d378eea09 req-8343f643-1d71-4de0-b791-b719af8ae869 service nova] Creating event network-vif-plugged:ec76b029-1b07-4d93-8cd9-507a98ae0296 for instance ceb8816e-710b-48c2-b59d-862a9a875311 on nch2-master-1 Apr 30 21:13:20.579245 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cf8bc41e-1c21-4d2a-b731-a68d378eea09 req-8343f643-1d71-4de0-b791-b719af8ae869 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070137 Apr 30 21:13:20.584366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 468/1015] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:13:20.718779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e047c238-156e-48ab-ba4f-ead5fd10ef77 req-efaa26c1-ab89-4cc5-aa7e-5ff48fb77562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4888131-7f37-4758-8e35-816d07886e96", "name": "network-vif-deleted", "tag": "9c97a0a6-0f63-4385-8a0e-e905cd2c4f48"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:20.751543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e047c238-156e-48ab-ba4f-ead5fd10ef77 req-efaa26c1-ab89-4cc5-aa7e-5ff48fb77562 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:20.751933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e047c238-156e-48ab-ba4f-ead5fd10ef77 req-efaa26c1-ab89-4cc5-aa7e-5ff48fb77562 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:20.788008 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e047c238-156e-48ab-ba4f-ead5fd10ef77 req-efaa26c1-ab89-4cc5-aa7e-5ff48fb77562 service nova] Creating event network-vif-deleted:9c97a0a6-0f63-4385-8a0e-e905cd2c4f48 for instance e4888131-7f37-4758-8e35-816d07886e96 on nch1-master-1 Apr 30 21:13:20.802243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e047c238-156e-48ab-ba4f-ead5fd10ef77 req-efaa26c1-ab89-4cc5-aa7e-5ff48fb77562 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090387 Apr 30 21:13:20.804561 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 469/1016] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:13:20.843082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:20.845289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:20.866561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:20.866561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:20.866561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:20.866837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:21.071829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:21.083900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1932100c-847b-4405-b33e-5f789836fb7c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.736389 Apr 30 21:13:21.084532 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 548/1017] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:20 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:21.090221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-389ba405-ad75-49f1-8a51-a259ac502ded tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc261fbf70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:21.152256 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-389ba405-ad75-49f1-8a51-a259ac502ded tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.066268 Apr 30 21:13:21.153156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 549/1018] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:21 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:21.159154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:21.160089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:21.167644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:21.168586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:21.169651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:21.170370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:21.174771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:21.185211 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b4b5db04-6da9-4d0b-9b9f-494675e50244 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1385 microversion: 2.1 time: 0.379095 Apr 30 21:13:21.185826 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 470/1019] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:20 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1385 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:21.202227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:21.202901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:21.214125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:21.214684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:21.215573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:21.216545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:21.258933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda37dd9b3304fa9a9734f12ffaea8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039dadc3df264018a5bcb0ece1751446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:21.264908 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-358f2cc8-d382-407c-aad2-34db5ac3ac8c tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 200 len: 1299 microversion: 2.1 time: 0.110385 Apr 30 21:13:21.265784 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 550/1020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:21 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:21.271980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a495ffe-a394-40b7-9e4a-74109fdccadc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:21.272805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a495ffe-a394-40b7-9e4a-74109fdccadc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:21.294144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:21.301797 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4e6cba5-fdbc-4419-b8b8-a3c5a23afa6a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1259 microversion: 2.1 time: 0.103410 Apr 30 21:13:21.302372 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 471/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:21 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1259 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:21.307038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-61d144b2-805f-4d92-8704-5d7143db12c5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faff6da0-9c40-4fee-bd74-c45260d3e9a2", "device": "/dev/xvdb"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:21.308631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-61d144b2-805f-4d92-8704-5d7143db12c5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:21.315547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61d144b2-805f-4d92-8704-5d7143db12c5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:21.316302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61d144b2-805f-4d92-8704-5d7143db12c5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:21.316795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61d144b2-805f-4d92-8704-5d7143db12c5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:21.317245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61d144b2-805f-4d92-8704-5d7143db12c5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:21.331190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6a495ffe-a394-40b7-9e4a-74109fdccadc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:21.339030 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6a495ffe-a394-40b7-9e4a-74109fdccadc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1278 microversion: 2.1 time: 0.071283 Apr 30 21:13:21.340100 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 551/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:21 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1278 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:22.101669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:22.114884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:22.115774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.119407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.120374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.120937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.319596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:22.339787 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-988f987a-e2e5-4892-8dde-f0c784228515 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.242726 Apr 30 21:13:22.340578 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 552/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:22 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:22.346874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-914b22ac-0ffc-4a39-90c7-c5f64566c93f tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc26348dc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:22.408212 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-914b22ac-0ffc-4a39-90c7-c5f64566c93f tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.065306 Apr 30 21:13:22.416742 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 553/1024] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:22 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:22.422186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:22.422818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:22.432518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.433360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.434784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.434784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.635174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:22.644310 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df016610-fbee-431a-908a-bfc4e8546971 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1385 microversion: 2.1 time: 0.226301 Apr 30 21:13:22.645703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 554/1025] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:22 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1385 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:22.650415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:22.651035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] [instance: e4888131-7f37-4758-8e35-816d07886e96] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:22.658575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.659036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.659835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.660282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.676140 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] HTTP exception thrown: Instance e4888131-7f37-4758-8e35-816d07886e96 could not be found. Apr 30 21:13:22.676800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] Returning 404 to user: Instance e4888131-7f37-4758-8e35-816d07886e96 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:22.677712 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ecf8b2d-b8ee-45f7-a337-d4ebe8b94f2e tempest-ServersAdminTestJSON-1918533868 tempest-ServersAdminTestJSON-1918533868-project] 10.222.0.23 "GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96" status: 404 len: 111 microversion: 2.1 time: 0.031402 Apr 30 21:13:22.678308 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 555/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:22 2022] GET /compute/v2.1/servers/e4888131-7f37-4758-8e35-816d07886e96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:22.697133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:22.697781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:22.704463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.704925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.705723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.706204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.826122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:22.835701 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aab2d7ea-67eb-4778-beb5-f87e0d4be842 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1265 microversion: 2.1 time: 0.155676 Apr 30 21:13:22.837636 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 556/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:22 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:22.848764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:22.849748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:22.858320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.859116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.860257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:22.862085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:22.911398 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-61d144b2-805f-4d92-8704-5d7143db12c5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "POST /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.603113 Apr 30 21:13:22.915514 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 472/1028] 10.222.0.23 () {62 vars in 1363 bytes} [Sat Apr 30 21:13:21 2022] POST /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments => generated 194 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:13:23.041732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:23.069425 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0eb879e6-f48d-4f1d-96f6-a8ae5c51eb30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1274 microversion: 2.1 time: 0.229783 Apr 30 21:13:23.072463 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 557/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:22 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:23.358533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:23.359260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:23.383801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:23.384475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:23.391316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:23.391886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:23.423125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-38176445-6350-4878-a570-c22401d38abb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc261fb160>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:23.535668 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-38176445-6350-4878-a570-c22401d38abb tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.116593 Apr 30 21:13:23.541302 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 558/1030] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:23 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:23.664029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:23.664615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:23.673744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:23.684761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:23.692213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:23.692822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:24.365014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:24.378676 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a7f27ea-c10b-44b7-9a28-fb6e4d6a7b34 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1584 microversion: 2.1 time: 0.718422 Apr 30 21:13:24.381098 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 559/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:23 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1584 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:24.381213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:24.390179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:24.391010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:24.397576 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-694cc444-0e2a-4970-ac62-f0d6ec2e1536 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 1.043971 Apr 30 21:13:24.398723 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 473/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:23 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:24.405401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:24.407893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:24.408355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:24.408759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:24.409530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:24.411676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:24.425860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:24.426624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:24.427524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:24.428069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:24.585018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:24.598689 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e25ead50-39c8-44fc-8a6b-3f4f441fa42d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1336 microversion: 2.1 time: 0.194843 Apr 30 21:13:24.599800 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 474/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:24 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1336 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:24.608938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-28c10e08-4709-4cb4-b2ed-9a7367f18ee8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:24.616032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-28c10e08-4709-4cb4-b2ed-9a7367f18ee8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:24.622952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28c10e08-4709-4cb4-b2ed-9a7367f18ee8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:24.626003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28c10e08-4709-4cb4-b2ed-9a7367f18ee8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:24.627063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28c10e08-4709-4cb4-b2ed-9a7367f18ee8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:24.629415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28c10e08-4709-4cb4-b2ed-9a7367f18ee8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:24.799247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:24.806922 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9db63d81-9182-4462-9f3f-15a6b6fc4a6e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.426006 Apr 30 21:13:24.809586 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 560/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:24 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:24.829862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a0d9afc-c5c2-4320-93a0-a1997d5e6a10 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc26267550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:24.921747 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a0d9afc-c5c2-4320-93a0-a1997d5e6a10 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.099453 Apr 30 21:13:24.922347 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 561/1035] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:24 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:24.955498 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-28c10e08-4709-4cb4-b2ed-9a7367f18ee8 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.354383 Apr 30 21:13:24.956426 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 475/1036] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:13:24 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:25.415509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:25.415846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:25.422121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:25.422591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:25.423399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:25.423845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:25.618314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:25.620880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:25.655829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:25.657008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:25.658070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:25.658859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:26.223471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:26.234507 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b30305b-997b-43cf-8652-fbc7635044d2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1336 microversion: 2.1 time: 0.621963 Apr 30 21:13:26.247517 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 476/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:25 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1336 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:26.253615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:26.255273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:26.268934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:26.269864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:26.275018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:26.275018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:26.275227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:26.292496 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb0d2a9d-c481-4131-918b-c4fedc91ef60 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.881750 Apr 30 21:13:26.293711 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 562/1038] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:25 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:26.298590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-11f8bcaa-16e3-4f9f-bfc5-524737be5603 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc26253700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:26.402250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-11f8bcaa-16e3-4f9f-bfc5-524737be5603 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.106964 Apr 30 21:13:26.403708 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 563/1039] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:26 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:26.694235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1e65bd32-3a44-4f13-aae4-412566804e5d req-4d7783c5-1dc3-423e-a58a-dcafed17a8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d428068-040a-4030-9d03-bc335def8d5d", "tag": "7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:26.699571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1e65bd32-3a44-4f13-aae4-412566804e5d req-4d7783c5-1dc3-423e-a58a-dcafed17a8a1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:26.700340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1e65bd32-3a44-4f13-aae4-412566804e5d req-4d7783c5-1dc3-423e-a58a-dcafed17a8a1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:26.718894 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1e65bd32-3a44-4f13-aae4-412566804e5d req-4d7783c5-1dc3-423e-a58a-dcafed17a8a1 service nova] Creating event network-changed:7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750 for instance 3d428068-040a-4030-9d03-bc335def8d5d on nch1-master-1 Apr 30 21:13:26.730291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1e65bd32-3a44-4f13-aae4-412566804e5d req-4d7783c5-1dc3-423e-a58a-dcafed17a8a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053921 Apr 30 21:13:26.731746 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 564/1040] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:13:26.874062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:26.884646 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e816fc58-eed6-4725-9bb8-bacd4fcbc07d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.635547 Apr 30 21:13:26.885479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 477/1041] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:26 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:27.256973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:27.257182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:27.301319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:27.307456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:27.308435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:27.308890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:27.310468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:27.311091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:27.328019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:27.335688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:27.335688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:27.335688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:27.909228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:27.921448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:27.930989 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1552ac70-99c6-4e4a-85ba-7f1fd46a523d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.623511 Apr 30 21:13:27.933395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-06d6f1d7-3def-484c-83ca-609017608b63 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.683848 Apr 30 21:13:27.934187 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 565/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:27 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:27.966080 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 478/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:27 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:27.980695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c197ac36-c9a5-4d33-82e2-5e0931f7b2cd tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc26226550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:27.994758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:27.994758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:28.019647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:28.020105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:28.020991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:28.021434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:28.116197 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c197ac36-c9a5-4d33-82e2-5e0931f7b2cd tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1429 microversion: 2.1 time: 0.180649 Apr 30 21:13:28.117721 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 566/1044] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:27 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1429 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:28.468851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:28.478323 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d433c033-6f30-44e2-bfc2-830d23026ab9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.508738 Apr 30 21:13:28.478813 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 479/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:27 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:28.764606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:28.765236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:28.788400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:28.788870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:28.789707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:28.792075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:28.850269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:28.851176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:28.858472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:28.859455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:28.860845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:28.861594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.413142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid 77da7802-0fa5-4899-89bc-0300c2599af7 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:13:29.419956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:29.427847 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-454e564d-29bd-45a4-abd2-3db2bf87c076 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1584 microversion: 2.1 time: 0.581907 Apr 30 21:13:29.442000 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 480/1046] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:28 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1584 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:29.443495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-aebd8087-c19b-4b13-b656-169f2eba5ba5 req-cd596f3d-032d-4b28-bdfe-b9e26e5263e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceb8816e-710b-48c2-b59d-862a9a875311", "tag": "ec76b029-1b07-4d93-8cd9-507a98ae0296"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:29.457704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aebd8087-c19b-4b13-b656-169f2eba5ba5 req-cd596f3d-032d-4b28-bdfe-b9e26e5263e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:29.458248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aebd8087-c19b-4b13-b656-169f2eba5ba5 req-cd596f3d-032d-4b28-bdfe-b9e26e5263e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.470601 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c666462-ea12-4ab1-848c-fc1c087d159e tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 2129 microversion: 2.25 time: 0.710512 Apr 30 21:13:29.475074 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 567/1047] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:28 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 2129 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:29.483775 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-aebd8087-c19b-4b13-b656-169f2eba5ba5 req-cd596f3d-032d-4b28-bdfe-b9e26e5263e5 service nova] Creating event network-changed:ec76b029-1b07-4d93-8cd9-507a98ae0296 for instance ceb8816e-710b-48c2-b59d-862a9a875311 on nch2-master-1 Apr 30 21:13:29.487292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:29.488350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:29.492615 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-aebd8087-c19b-4b13-b656-169f2eba5ba5 req-cd596f3d-032d-4b28-bdfe-b9e26e5263e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052493 Apr 30 21:13:29.502866 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 481/1048] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:29.508734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:29.510093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:29.523502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:29.526043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.527901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:29.528592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.529171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:29.529624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.530950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:29.531577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.903951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:29.907928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:29.915910 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f6a0763-e1cb-42af-a9c1-f1142ebb2f9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1550 microversion: 2.1 time: 0.411667 Apr 30 21:13:29.916504 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 482/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:29 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1550 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:29.919804 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-250ec8bd-fa65-417a-91c3-ef072befea48 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.440176 Apr 30 21:13:29.921239 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 568/1050] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:29 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:29.927559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc716232-feda-4c5b-8a51-ec6e710c1824 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc261af8b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:29.931560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:29.950259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:29.957067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:29.957748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.958973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:29.959580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:29.998636 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc716232-feda-4c5b-8a51-ec6e710c1824 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1438 microversion: 2.1 time: 0.075722 Apr 30 21:13:30.010585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 569/1051] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:29 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:30.013220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'flavor' on Instance uuid 77da7802-0fa5-4899-89bc-0300c2599af7 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:13:30.019223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:30.020198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:30.043182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:30.046266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:30.046266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:30.046651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Going to try to live migrate instance to nch2-master-1 {{(pid=130670) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:13:30.046744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:30.250809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:30.263972 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cce645a4-ec48-42c8-a00b-19eec22647fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.251603 Apr 30 21:13:30.264933 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 570/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:30 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:30.272146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3e0d33f5-2f00-453a-9df8-7b92a80a7be4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc26210940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:30.323519 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3e0d33f5-2f00-453a-9df8-7b92a80a7be4 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 200 len: 1438 microversion: 2.1 time: 0.056341 Apr 30 21:13:30.324618 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 571/1053] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:30 2022] GET /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 1438 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:30.336369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:30.337350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:30.344048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:30.344514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:30.345323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:30.346056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:30.608207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:30.627350 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a03e3ca0-ffe3-4451-bc95-cf4062a50873 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1467 microversion: 2.1 time: 0.294875 Apr 30 21:13:30.632787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 572/1054] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:30 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:30.653488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a684741-3457-4ead-bd03-f868f0a2fba5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc20ba6820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:32.187752 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a684741-3457-4ead-bd03-f868f0a2fba5 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "DELETE /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270" status: 204 len: 0 microversion: 2.1 time: 1.538594 Apr 30 21:13:32.189009 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 573/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:30 2022] DELETE /compute/v2.1/images/82b47a32-7e3b-4fd4-9a85-1db76a598270 => generated 0 bytes in 1540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:13:32.531739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-514fcf54-643f-494d-8caf-0decaf650710 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:32.533077 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:32.533077 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:13:32.534327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-514fcf54-643f-494d-8caf-0decaf650710 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.534988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-514fcf54-643f-494d-8caf-0decaf650710 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.535807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-514fcf54-643f-494d-8caf-0decaf650710 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.536306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-514fcf54-643f-494d-8caf-0decaf650710 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.564311 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-514fcf54-643f-494d-8caf-0decaf650710 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.374319 Apr 30 21:13:32.565121 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 574/1056] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:13:32 2022] GET /compute/v2.1/os-services => generated 947 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:32.575633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:32.576349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:32.582565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.583076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.583853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.584291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.726581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:32.734581 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bf7ad9c5-c63e-41e7-8db5-38bd0e0927e8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1540 microversion: 2.1 time: 0.168318 Apr 30 21:13:32.735146 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 575/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:32 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1540 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:32.739576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:32.740178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:32.746611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.747302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.748184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.748521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.910256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:32.911113 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef78b36f-9eda-408e-bd35-20652855c641 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.174926 Apr 30 21:13:32.911791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 576/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:32 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:32.917690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:32.919674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:32.927473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.928025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.928912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.929453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:32.971800 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/action" status: 202 len: 0 microversion: 2.25 time: 3.043934 Apr 30 21:13:32.973023 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 483/1059] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:13:29 2022] POST /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/action => generated 0 bytes in 3046 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:32.978941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3254cfa9-f17b-40fc-b838-30b4a4003144 req-1c56c53c-f391-48f9-9516-33ae7e7294c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:32.987531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3254cfa9-f17b-40fc-b838-30b4a4003144 req-1c56c53c-f391-48f9-9516-33ae7e7294c3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:32.987984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3254cfa9-f17b-40fc-b838-30b4a4003144 req-1c56c53c-f391-48f9-9516-33ae7e7294c3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.000226 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3254cfa9-f17b-40fc-b838-30b4a4003144 req-1c56c53c-f391-48f9-9516-33ae7e7294c3 service nova] Creating event network-changed:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch1-master-1 Apr 30 21:13:33.005101 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3254cfa9-f17b-40fc-b838-30b4a4003144 req-1c56c53c-f391-48f9-9516-33ae7e7294c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Apr 30 21:13:33.005705 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 484/1060] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:33.012195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-293fa85d-c616-4d4a-a06a-5661e2499aaf tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '.version_select at 0x7fdc209d51f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.074674 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-293fa85d-c616-4d4a-a06a-5661e2499aaf tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] HTTP exception thrown: Image not found. Apr 30 21:13:33.075584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-293fa85d-c616-4d4a-a06a-5661e2499aaf tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:33.076476 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-293fa85d-c616-4d4a-a06a-5661e2499aaf tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "DELETE /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c" status: 404 len: 62 microversion: 2.1 time: 0.069305 Apr 30 21:13:33.077310 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 485/1061] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:33 2022] DELETE /compute/v2.1/images/2e525002-f625-41c4-8739-4caf3319987c => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:13:33.081991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c521d5ee-4587-4f4b-84fd-e78a09bd15f7 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.084071 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:33.084071 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:33.085592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c521d5ee-4587-4f4b-84fd-e78a09bd15f7 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.086184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c521d5ee-4587-4f4b-84fd-e78a09bd15f7 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.087075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c521d5ee-4587-4f4b-84fd-e78a09bd15f7 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.087569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c521d5ee-4587-4f4b-84fd-e78a09bd15f7 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.102393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:33.110111 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6914e05d-ef38-4b90-8208-de3fb467c080 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.196802 Apr 30 21:13:33.110690 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 577/1062] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:32 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:33.112488 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c521d5ee-4587-4f4b-84fd-e78a09bd15f7 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.033862 Apr 30 21:13:33.113734 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 486/1063] 10.222.0.23 () {58 vars in 1173 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:33.119295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.120237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:33.124978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-144a7d30-fcd0-4258-9e62-3e4a568284eb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '.version_select at 0x7fdc262f6940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.127806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.128242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-144a7d30-fcd0-4258-9e62-3e4a568284eb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.128357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.128706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-144a7d30-fcd0-4258-9e62-3e4a568284eb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.135478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.135478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.142003 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-144a7d30-fcd0-4258-9e62-3e4a568284eb tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3105 microversion: 2.1 time: 0.020552 Apr 30 21:13:33.142613 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 578/1064] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/os-migrations => generated 3105 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:33.148789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.149711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:33.157348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.158048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.158848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.159421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.187475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:13:33.303421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:33.313422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:33.315476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:33.316837 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-628305f2-e2d9-45e4-94f8-362d1985c1ab tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.201811 Apr 30 21:13:33.317388 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 487/1065] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:33.332732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9c67aa8-6088-4e8e-9f02-8d91b26fcf18 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.334054 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:33.334054 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:33.335248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c67aa8-6088-4e8e-9f02-8d91b26fcf18 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.335894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c67aa8-6088-4e8e-9f02-8d91b26fcf18 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.337253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c67aa8-6088-4e8e-9f02-8d91b26fcf18 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.337845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c67aa8-6088-4e8e-9f02-8d91b26fcf18 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.361619 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9c67aa8-6088-4e8e-9f02-8d91b26fcf18 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.032540 Apr 30 21:13:33.362337 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 488/1066] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:33.366643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4f43802b-1b12-45a5-81fe-a827bf3a1117 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.367502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4f43802b-1b12-45a5-81fe-a827bf3a1117 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:33.374141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f43802b-1b12-45a5-81fe-a827bf3a1117 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.374608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f43802b-1b12-45a5-81fe-a827bf3a1117 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.375436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f43802b-1b12-45a5-81fe-a827bf3a1117 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.375882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f43802b-1b12-45a5-81fe-a827bf3a1117 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.488750 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-78014935-3df6-4b44-a7d4-f8a19e35cf59 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 204 len: 0 microversion: 2.1 time: 0.344544 Apr 30 21:13:33.489313 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 579/1067] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:13:33 2022] DELETE /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:13:33.494409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6dc78bf-1457-49ea-910b-592cf5319e59 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.495859 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:33.495859 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:13:33.497107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6dc78bf-1457-49ea-910b-592cf5319e59 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.497549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6dc78bf-1457-49ea-910b-592cf5319e59 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.498591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6dc78bf-1457-49ea-910b-592cf5319e59 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.498803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6dc78bf-1457-49ea-910b-592cf5319e59 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.523252 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6dc78bf-1457-49ea-910b-592cf5319e59 tempest-ServicesAdminTestJSON-1958203745 tempest-ServicesAdminTestJSON-1958203745-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.032669 Apr 30 21:13:33.529560 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 580/1068] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/os-services => generated 947 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:33.536604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.537834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:33.547020 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4f43802b-1b12-45a5-81fe-a827bf3a1117 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1691 microversion: 2.1 time: 0.183600 Apr 30 21:13:33.562300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.562300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.562300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.562300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.562874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 489/1069] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:33.566092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e8e952c-1c5f-435e-ab22-abed7e394bc8 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.566948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e8e952c-1c5f-435e-ab22-abed7e394bc8 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:33.575267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8e952c-1c5f-435e-ab22-abed7e394bc8 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.575986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8e952c-1c5f-435e-ab22-abed7e394bc8 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.576955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8e952c-1c5f-435e-ab22-abed7e394bc8 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.577559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8e952c-1c5f-435e-ab22-abed7e394bc8 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.848815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:33.858642 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f47bb65-3da9-41bb-9f63-adee06fd36a1 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1473 microversion: 2.1 time: 0.333245 Apr 30 21:13:33.859397 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 581/1070] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1473 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:33.869773 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e8e952c-1c5f-435e-ab22-abed7e394bc8 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1691 microversion: 2.1 time: 0.309275 Apr 30 21:13:33.870733 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 490/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:33.928155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.928818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:33.935378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.935882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.936673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.937118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.940155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:33.940671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:33.947741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.948207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:33.949002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:33.949453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.113810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lazy-loading 'services' on Instance uuid 27c246e5-490c-4639-8c9a-4b088609cc2e {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:13:34.157914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:34.183009 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41b63f6e-278c-4acf-b031-7e6f1b8c338a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.258666 Apr 30 21:13:34.183595 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 582/1072] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:33 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:34.194357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:34.194980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:34.202832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.203284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.204204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.204952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.343998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:34.352287 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e8c2ce13-9212-40a4-bdbf-64a1f63733b7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.167109 Apr 30 21:13:34.353215 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 583/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:34 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:34.358377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:34.359072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:34.365595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.366078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.366867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.367961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.441235 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "DELETE /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments/8b53e786-98d2-47b8-a116-d63bdd9029d1" status: 202 len: 0 microversion: 2.1 time: 0.504897 Apr 30 21:13:34.442491 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 491/1074] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:13:33 2022] DELETE /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments/8b53e786-98d2-47b8-a116-d63bdd9029d1 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:13:34.453433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f116f602-48e6-4e31-b27b-6a91f3d310ca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:34.453433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f116f602-48e6-4e31-b27b-6a91f3d310ca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:34.460695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f116f602-48e6-4e31-b27b-6a91f3d310ca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.461878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f116f602-48e6-4e31-b27b-6a91f3d310ca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.462784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f116f602-48e6-4e31-b27b-6a91f3d310ca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.463355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f116f602-48e6-4e31-b27b-6a91f3d310ca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.499685 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f116f602-48e6-4e31-b27b-6a91f3d310ca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049227 Apr 30 21:13:34.499685 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 492/1075] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:13:34 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:34.515896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:34.526566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:34.528194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:34.529633 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-13240556-899c-4c1d-b977-ef48d5031f4a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.175189 Apr 30 21:13:34.530414 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 584/1076] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:34 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:34.875800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:34.876508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:34.882574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.890600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:34.890600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:34.890600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.020447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:35.028559 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-58ce30b7-a7d1-42ea-9787-8ea6d6d6021d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1473 microversion: 2.1 time: 0.156753 Apr 30 21:13:35.029141 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 493/1077] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:34 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1473 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:35.200183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:35.201176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:35.208502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.209196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.210341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.211120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.372740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:35.376814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:35.380213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:35.383507 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0af781d2-672f-4e65-9d29-7a13441d1eb9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.187020 Apr 30 21:13:35.385190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.393948 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 585/1078] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:35 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:35.395129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.396001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.396445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.427945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9d43e3d3-e2dd-4b0f-87a8-59b56b7e5663 req-d7c9d6a6-8b88-484f-8e50-e8f8d2c3887f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d428068-040a-4030-9d03-bc335def8d5d", "name": "network-vif-plugged", "status": "completed", "tag": "7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:35.437088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9d43e3d3-e2dd-4b0f-87a8-59b56b7e5663 req-d7c9d6a6-8b88-484f-8e50-e8f8d2c3887f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.440767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9d43e3d3-e2dd-4b0f-87a8-59b56b7e5663 req-d7c9d6a6-8b88-484f-8e50-e8f8d2c3887f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.449642 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9d43e3d3-e2dd-4b0f-87a8-59b56b7e5663 req-d7c9d6a6-8b88-484f-8e50-e8f8d2c3887f service nova] Creating event network-vif-plugged:7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750 for instance 3d428068-040a-4030-9d03-bc335def8d5d on nch1-master-1 Apr 30 21:13:35.454754 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9d43e3d3-e2dd-4b0f-87a8-59b56b7e5663 req-d7c9d6a6-8b88-484f-8e50-e8f8d2c3887f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030458 Apr 30 21:13:35.455515 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 586/1079] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:13:35.525287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-502cfeef-910e-44c4-a69b-948717123d6d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:35.530230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-502cfeef-910e-44c4-a69b-948717123d6d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:35.551569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502cfeef-910e-44c4-a69b-948717123d6d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.552400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502cfeef-910e-44c4-a69b-948717123d6d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.554580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502cfeef-910e-44c4-a69b-948717123d6d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.555172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502cfeef-910e-44c4-a69b-948717123d6d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.589645 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-502cfeef-910e-44c4-a69b-948717123d6d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070684 Apr 30 21:13:35.590630 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 587/1080] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:13:35 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:35.599372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:35.603135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:35.607028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.607625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.608527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:35.609083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:35.675392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:35.689284 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2988c65d-303f-4b45-88b9-94c965714198 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.323076 Apr 30 21:13:35.689904 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 494/1081] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:35 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:36.019425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:36.030516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:36.033243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:36.035370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20343f3f-4f9e-44a3-8ef0-3dc5b956684d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.443383 Apr 30 21:13:36.036718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 588/1082] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:35 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:36.050950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:36.051967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:36.061458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.062473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.064795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.065504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.402523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:36.403592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:36.411459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.412136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.413244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.413881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.451861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:36.464691 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-878b7c58-97fc-4a44-81a2-e1b6174935ee tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1473 microversion: 2.1 time: 0.422746 Apr 30 21:13:36.478418 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 495/1083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:36 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1473 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:36.602337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5c2585b2-bb43-4845-9c6e-a7f5e09dd3c4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:36.607056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5c2585b2-bb43-4845-9c6e-a7f5e09dd3c4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:36.625438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c2585b2-bb43-4845-9c6e-a7f5e09dd3c4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.628698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c2585b2-bb43-4845-9c6e-a7f5e09dd3c4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.629693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c2585b2-bb43-4845-9c6e-a7f5e09dd3c4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.633343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c2585b2-bb43-4845-9c6e-a7f5e09dd3c4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.669721 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5c2585b2-bb43-4845-9c6e-a7f5e09dd3c4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072841 Apr 30 21:13:36.671082 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 496/1084] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:13:36 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:36.709391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:36.713326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:36.724110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.724685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.725687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:36.726378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:36.728499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:36.765158 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b7a0a07d-e688-4709-aa5d-c250cbfae855 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.366988 Apr 30 21:13:36.766390 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 589/1085] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:36 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:36.933278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:36.942950 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a37d708-94fa-4852-b478-e7c30b329ae4 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1307 microversion: 2.1 time: 0.239326 Apr 30 21:13:36.944106 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 497/1086] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:36 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1307 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:37.056408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:37.056894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4af9b5eb-c99d-4fea-9f77-041ce929db8a req-a6aed6df-5c1a-4b02-9d89-bd8954635750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f3622-93d0-45c9-8971-89e3308037b6", "name": "network-vif-deleted", "tag": "544026f7-e9ff-4a0e-9515-f5e31e5016da"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:37.057502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:37.070082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4af9b5eb-c99d-4fea-9f77-041ce929db8a req-a6aed6df-5c1a-4b02-9d89-bd8954635750 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.070342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4af9b5eb-c99d-4fea-9f77-041ce929db8a req-a6aed6df-5c1a-4b02-9d89-bd8954635750 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.074634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.075095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.075915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.076361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.087831 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4af9b5eb-c99d-4fea-9f77-041ce929db8a req-a6aed6df-5c1a-4b02-9d89-bd8954635750 service nova] Creating event network-vif-deleted:544026f7-e9ff-4a0e-9515-f5e31e5016da for instance 353f3622-93d0-45c9-8971-89e3308037b6 on nch1-master-1 Apr 30 21:13:37.093907 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4af9b5eb-c99d-4fea-9f77-041ce929db8a req-a6aed6df-5c1a-4b02-9d89-bd8954635750 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040889 Apr 30 21:13:37.096179 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 498/1087] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:37.437603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:37.448009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:37.449975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:37.451623 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-753a0c02-f4f0-4352-b528-db6d89d05eb9 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.401360 Apr 30 21:13:37.453025 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 590/1088] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:37 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:37.480690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9c4d8a4b-256a-4818-b69f-a7de79440280 req-931e99fc-2152-48b4-8d19-a388fd1ac2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f3622-93d0-45c9-8971-89e3308037b6", "name": "network-vif-unplugged", "status": "completed", "tag": "544026f7-e9ff-4a0e-9515-f5e31e5016da"}, {"server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "name": "network-vif-plugged", "status": "completed", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:37.492858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:37.493654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:37.493836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9c4d8a4b-256a-4818-b69f-a7de79440280 req-931e99fc-2152-48b4-8d19-a388fd1ac2a8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.494131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9c4d8a4b-256a-4818-b69f-a7de79440280 req-931e99fc-2152-48b4-8d19-a388fd1ac2a8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.503018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.503018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.503018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.503018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.508972 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9c4d8a4b-256a-4818-b69f-a7de79440280 req-931e99fc-2152-48b4-8d19-a388fd1ac2a8 service nova] Creating event network-vif-unplugged:544026f7-e9ff-4a0e-9515-f5e31e5016da for instance 353f3622-93d0-45c9-8971-89e3308037b6 on nch1-master-1 Apr 30 21:13:37.509902 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9c4d8a4b-256a-4818-b69f-a7de79440280 req-931e99fc-2152-48b4-8d19-a388fd1ac2a8 service nova] Creating event network-vif-plugged:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch1-master-1 Apr 30 21:13:37.516358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9c4d8a4b-256a-4818-b69f-a7de79440280 req-931e99fc-2152-48b4-8d19-a388fd1ac2a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.040439 Apr 30 21:13:37.517182 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 499/1089] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:37.547079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.547835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.547993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lazy-loading 'fault' on Instance uuid 353f3622-93d0-45c9-8971-89e3308037b6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:13:37.691355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a298dc93-d619-4d0e-bb78-654a54b71353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:37.692580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a298dc93-d619-4d0e-bb78-654a54b71353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:37.725144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a298dc93-d619-4d0e-bb78-654a54b71353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.733088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a298dc93-d619-4d0e-bb78-654a54b71353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.733088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a298dc93-d619-4d0e-bb78-654a54b71353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.733088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a298dc93-d619-4d0e-bb78-654a54b71353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.814163 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a298dc93-d619-4d0e-bb78-654a54b71353 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135679 Apr 30 21:13:37.823015 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 500/1090] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:13:37 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:13:37.863424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:37.864645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:37.893159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.894416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:37.896763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:37.898834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:38.114784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c331c48d20422492001f71f0672885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284e1c76f5a41ea9da1eb011943eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:38.133635 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b93ea91a-1786-47c7-94f8-7ead7fb6474d tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 200 len: 1307 microversion: 2.1 time: 0.649624 Apr 30 21:13:38.144608 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 591/1091] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:37 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 1307 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:38.152043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:38.152938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:38.161247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:38.161953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:38.165252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:38.165975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:38.498397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:38.534575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-54c22f9a-aef9-467f-a603-ea26fa531a56 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.684407 Apr 30 21:13:38.536342 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 501/1092] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:37 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:38.556890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:38.556890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:38.572720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:38.579002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:38.593654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:38.594437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:38.611686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:38.620235 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75e9fd38-2a40-422c-bb09-1208c7dfc20a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1487 microversion: 2.1 time: 0.474162 Apr 30 21:13:38.628384 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 592/1093] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:38 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1487 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:38.637160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:38.637707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:38.660150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:38.664303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:38.665144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:38.665592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:38.709064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lazy-loading 'flavor' on Instance uuid 3d428068-040a-4030-9d03-bc335def8d5d {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:13:38.968603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:38.986957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:38.989468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:38.990850 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4418fe3e-c8db-4d8c-8686-fc6dfdc48e45 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.452267 Apr 30 21:13:38.991571 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 502/1094] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:38 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:39.153314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:39.153314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] [instance: 353f3622-93d0-45c9-8971-89e3308037b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:39.158807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:39.159313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:39.161369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:39.162884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:39.191987 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] HTTP exception thrown: Instance 353f3622-93d0-45c9-8971-89e3308037b6 could not be found. Apr 30 21:13:39.191987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] Returning 404 to user: Instance 353f3622-93d0-45c9-8971-89e3308037b6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:39.192345 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2e9f80f-5542-4ccd-8449-46f0fc53f761 tempest-ImagesOneServerTestJSON-1978191862 tempest-ImagesOneServerTestJSON-1978191862-project] 10.222.0.23 "GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6" status: 404 len: 111 microversion: 2.1 time: 0.045488 Apr 30 21:13:39.198196 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 503/1095] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:39 2022] GET /compute/v2.1/servers/353f3622-93d0-45c9-8971-89e3308037b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:13:39.202828 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b45ce126-2f08-4345-b2f6-c5bc9a4c83f9 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d/action" status: 202 len: 0 microversion: 2.1 time: 0.568480 Apr 30 21:13:39.205859 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 593/1096] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:13:38 2022] POST /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:13:39.220239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:39.221721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:39.239823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:39.240911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:39.242595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:39.248628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:39.484381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:39.493445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f48c4e3-c254-41ac-8d43-d863cd044568 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1495 microversion: 2.1 time: 0.281508 Apr 30 21:13:39.494138 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 504/1097] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:39 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1495 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:39.562011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:39.569042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:39.571191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:39.571647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:39.572445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:39.572891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:39.871265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:39.881531 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea0de84a-3c62-4acd-8225-762adf168835 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1378 microversion: 2.1 time: 0.328167 Apr 30 21:13:39.882166 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 594/1098] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:39 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1378 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:40.012523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:40.013232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:40.024763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.026612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.027466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.033413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.310517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:40.322403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:40.324029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:40.325836 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fe6b91c6-6624-4c2d-af49-764893d4aa7c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.319519 Apr 30 21:13:40.327461 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 505/1099] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:40 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:40.516318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:40.518050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:40.528577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.529643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.530870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.531579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.594967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Action: 'update', calling method: .version_select at 0x7fdc26182790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:40.596630 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:40.596630 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:13:40.598252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.599607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.616063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.616665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.626109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] HTTP exception thrown: Service 1e115d1e-1286-44b3-af46-a84fc62e6cba could not be found. Apr 30 21:13:40.627027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Returning 404 to user: Service 1e115d1e-1286-44b3-af46-a84fc62e6cba could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:40.628122 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d32ddc7-b787-418a-893f-34fbb2f4c431 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/1e115d1e-1286-44b3-af46-a84fc62e6cba" status: 404 len: 110 microversion: 2.53 time: 0.225751 Apr 30 21:13:40.628922 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 595/1100] 10.222.0.23 () {62 vars in 1308 bytes} [Sat Apr 30 21:13:40 2022] PUT /compute/v2.1/os-services/1e115d1e-1286-44b3-af46-a84fc62e6cba => generated 110 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:13:40.639919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Action: 'update', calling method: .version_select at 0x7fdc261820d0>, body: {"status": "disabled"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:40.646171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.647109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.654821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.656408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.664550 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] HTTP exception thrown: Service 1e115d1e-1286-44b3-af46-a84fc62e6cba could not be found. Apr 30 21:13:40.667836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Returning 404 to user: Service 1e115d1e-1286-44b3-af46-a84fc62e6cba could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:40.669512 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-567b0090-bc0f-4b7c-a9bb-8340e87fcb4a tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/1e115d1e-1286-44b3-af46-a84fc62e6cba" status: 404 len: 110 microversion: 2.53 time: 0.032698 Apr 30 21:13:40.670702 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 596/1101] 10.222.0.23 () {62 vars in 1308 bytes} [Sat Apr 30 21:13:40 2022] PUT /compute/v2.1/os-services/1e115d1e-1286-44b3-af46-a84fc62e6cba => generated 110 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:13:40.698607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Action: 'update', calling method: .version_select at 0x7fdc262aa280>, body: {"status": "enabled"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:40.702702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.703164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.732956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.733428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.741287 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] HTTP exception thrown: Service 1e115d1e-1286-44b3-af46-a84fc62e6cba could not be found. Apr 30 21:13:40.741960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Returning 404 to user: Service 1e115d1e-1286-44b3-af46-a84fc62e6cba could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:40.742817 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a9f502b1-ec34-453a-985f-35e6c3972ecd tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/1e115d1e-1286-44b3-af46-a84fc62e6cba" status: 404 len: 110 microversion: 2.53 time: 0.063923 Apr 30 21:13:40.748382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 597/1102] 10.222.0.23 () {62 vars in 1308 bytes} [Sat Apr 30 21:13:40 2022] PUT /compute/v2.1/os-services/1e115d1e-1286-44b3-af46-a84fc62e6cba => generated 110 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:13:40.754035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-858b99f2-b08d-4ef8-b50a-41247f6c5f82 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:40.761445 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:40.761445 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:13:40.763163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-858b99f2-b08d-4ef8-b50a-41247f6c5f82 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.763697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-858b99f2-b08d-4ef8-b50a-41247f6c5f82 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.764766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-858b99f2-b08d-4ef8-b50a-41247f6c5f82 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.766858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-858b99f2-b08d-4ef8-b50a-41247f6c5f82 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.819781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:40.827798 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0c385f7f-5d2b-499b-8d6e-33b16f337b6d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 200 len: 1478 microversion: 2.1 time: 0.318940 Apr 30 21:13:40.829247 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 506/1103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:40 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 1478 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:40.831969 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-858b99f2-b08d-4ef8-b50a-41247f6c5f82 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.082205 Apr 30 21:13:40.833028 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 598/1104] 10.222.0.23 () {60 vars in 1177 bytes} [Sat Apr 30 21:13:40 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:40.848491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e7041e1-5bce-4f55-ad83-f73b70f633d3 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:40.851141 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:40.851141 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:40.854195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e7041e1-5bce-4f55-ad83-f73b70f633d3 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.854519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1135351e-aad8-4b84-b6d6-82b0d54a0c7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-498614042"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:40.855762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1135351e-aad8-4b84-b6d6-82b0d54a0c7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:40.856391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e7041e1-5bce-4f55-ad83-f73b70f633d3 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.858324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e7041e1-5bce-4f55-ad83-f73b70f633d3 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.859088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e7041e1-5bce-4f55-ad83-f73b70f633d3 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.870613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1135351e-aad8-4b84-b6d6-82b0d54a0c7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.873437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1135351e-aad8-4b84-b6d6-82b0d54a0c7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.882137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1135351e-aad8-4b84-b6d6-82b0d54a0c7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.882799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1135351e-aad8-4b84-b6d6-82b0d54a0c7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.901575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e7041e1-5bce-4f55-ad83-f73b70f633d3 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.060597 Apr 30 21:13:40.902749 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 507/1105] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Apr 30 21:13:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:40.907754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:40.908621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:40.915794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.916526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:40.917482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:40.918111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.093914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:41.110013 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2786e0f1-e10f-4e7c-b61f-e15b2bc97bd8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1527 microversion: 2.1 time: 0.199220 Apr 30 21:13:41.110013 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 508/1106] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:40 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:41.110013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-99168ae0-2b2b-4870-99c3-55669f94d7eb tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.110914 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:41.110914 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:41.111526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99168ae0-2b2b-4870-99c3-55669f94d7eb tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.112313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99168ae0-2b2b-4870-99c3-55669f94d7eb tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.113314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99168ae0-2b2b-4870-99c3-55669f94d7eb tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.113977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99168ae0-2b2b-4870-99c3-55669f94d7eb tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.143405 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-99168ae0-2b2b-4870-99c3-55669f94d7eb tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.038364 Apr 30 21:13:41.144450 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 509/1107] 10.222.0.23 () {60 vars in 1177 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:41.150017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.151080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:41.158674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.159526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.160511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.161414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.435565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:41.446785 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c695955f-d4ef-4de2-b859-2417a1be51e6 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1527 microversion: 2.1 time: 0.299211 Apr 30 21:13:41.459591 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 510/1108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1527 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:41.465368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2899e263-ba49-42f7-9072-58e7f8a79ee9 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.467075 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:41.467075 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:41.469681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2899e263-ba49-42f7-9072-58e7f8a79ee9 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.470355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2899e263-ba49-42f7-9072-58e7f8a79ee9 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.471343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2899e263-ba49-42f7-9072-58e7f8a79ee9 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.472024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2899e263-ba49-42f7-9072-58e7f8a79ee9 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.502479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2899e263-ba49-42f7-9072-58e7f8a79ee9 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.041402 Apr 30 21:13:41.510432 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 511/1109] 10.222.0.23 () {60 vars in 1236 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:41.515690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.524533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:41.524533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.524533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.525490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.526249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.610910 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1135351e-aad8-4b84-b6d6-82b0d54a0c7d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d/action" status: 202 len: 0 microversion: 2.1 time: 0.766516 Apr 30 21:13:41.614476 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 599/1110] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:13:40 2022] POST /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:13:41.624623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02c8bb4a-eb44-4859-a3ed-d95956d0a501 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.625466 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:41.625466 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:13:41.767797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:41.779536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:41.781079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:41.782331 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9426e1ce-074b-4de5-ba8e-e64d8e2fd216 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.270659 Apr 30 21:13:41.782996 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 512/1111] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:41.788069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-334ccf57-5e2b-4021-8389-91c70a17bb53 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.790593 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:41.790593 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:41.792269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-334ccf57-5e2b-4021-8389-91c70a17bb53 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.792900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-334ccf57-5e2b-4021-8389-91c70a17bb53 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.798527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-334ccf57-5e2b-4021-8389-91c70a17bb53 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.799718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-334ccf57-5e2b-4021-8389-91c70a17bb53 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.828137 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-334ccf57-5e2b-4021-8389-91c70a17bb53 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.043612 Apr 30 21:13:41.829139 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 513/1112] 10.222.0.23 () {60 vars in 1177 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:41.834626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02c8bb4a-eb44-4859-a3ed-d95956d0a501 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/24f26b92-a3ce-4952-a05c-bfbb4378fc13" status: 202 len: 0 microversion: 2.1 time: 0.216895 Apr 30 21:13:41.836971 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 600/1113] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:13:41 2022] DELETE /compute/v2.1/flavors/24f26b92-a3ce-4952-a05c-bfbb4378fc13 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:13:41.844038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c567783a-fb54-47da-9d35-6812f76a7303 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20961310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.846772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d5c689ef-f92f-4938-aca8-e0050aa58c35 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.850059 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:41.850059 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:13:41.853111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5c689ef-f92f-4938-aca8-e0050aa58c35 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.854037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5c689ef-f92f-4938-aca8-e0050aa58c35 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.855600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5c689ef-f92f-4938-aca8-e0050aa58c35 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:41.856187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5c689ef-f92f-4938-aca8-e0050aa58c35 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:41.916201 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d5c689ef-f92f-4938-aca8-e0050aa58c35 tempest-ServicesAdminNegativeV253TestJSON-720191429 tempest-ServicesAdminNegativeV253TestJSON-720191429-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.077568 Apr 30 21:13:41.917233 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 601/1114] 10.222.0.23 () {60 vars in 1238 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:41.923380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c0afbd7-3881-4296-bb41-653dadb01d08 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:41.925166 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c567783a-fb54-47da-9d35-6812f76a7303 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 200 len: 1437 microversion: 2.1 time: 0.081324 Apr 30 21:13:41.926949 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 514/1115] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:41.987504 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c0afbd7-3881-4296-bb41-653dadb01d08 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.068692 Apr 30 21:13:41.989933 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 602/1116] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:42.006246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:42.015396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:42.035247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:42.035724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:42.036562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:42.040065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:42.215488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:42.226054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Old instance type tempest-test_resize_flavor_-1765094410, new instance type m1.heat {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 21:13:42.240892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:13:42.241548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:13:42.243571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:13:42.244138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:13:42.244812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:13:42.338356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-223ae12a-a762-4188-ba16-4ce3f5146ee3 tempest-ServicesAdminNegativeV253TestJSON-2107488264 tempest-ServicesAdminNegativeV253TestJSON-2107488264-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:42.338356 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:13:42.338356 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:13:42.338356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-223ae12a-a762-4188-ba16-4ce3f5146ee3 tempest-ServicesAdminNegativeV253TestJSON-2107488264 tempest-ServicesAdminNegativeV253TestJSON-2107488264-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b4da9575aafc490b908379ddcbcde906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b494a426f9d74c94b7c7e5e630bc5da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:42.339792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-223ae12a-a762-4188-ba16-4ce3f5146ee3 tempest-ServicesAdminNegativeV253TestJSON-2107488264 tempest-ServicesAdminNegativeV253TestJSON-2107488264-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:42.339792 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-223ae12a-a762-4188-ba16-4ce3f5146ee3 tempest-ServicesAdminNegativeV253TestJSON-2107488264 tempest-ServicesAdminNegativeV253TestJSON-2107488264-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.404382 Apr 30 21:13:42.339792 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 515/1117] 10.222.0.23 () {60 vars in 1177 bytes} [Sat Apr 30 21:13:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 405 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:13:42.654411 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d975c01c-7dee-485e-9c02-b985a89f1927 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638/action" status: 202 len: 0 microversion: 2.1 time: 0.653681 Apr 30 21:13:42.656145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 603/1118] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:13:41 2022] POST /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:13:42.665715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:42.667461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:42.681898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:42.682971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:42.684062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:42.699791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:42.801039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:42.801777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:42.821085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:42.821718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:42.827533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:42.828141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:42.986273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:43.002183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb0b1bdd-fc58-48b5-b013-99cb34d46ce2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1536 microversion: 2.1 time: 0.341947 Apr 30 21:13:43.003030 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 516/1119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:42 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1536 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:43.009154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88143830-724f-49d6-afc3-1690fd3e0a00 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc209c28b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:43.067890 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88143830-724f-49d6-afc3-1690fd3e0a00 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 200 len: 1437 microversion: 2.1 time: 0.063622 Apr 30 21:13:43.068601 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 517/1120] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:43 2022] GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 1437 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:43.107280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d5fac8c0-7d5f-4669-bc83-c85c2e6db8c5 req-4292de7b-4949-4f20-807c-a31a03026310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77da7802-0fa5-4899-89bc-0300c2599af7", "name": "network-vif-unplugged", "status": "completed", "tag": "2514de9a-e593-441c-b26f-47d347c23ccb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:43.125878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d5fac8c0-7d5f-4669-bc83-c85c2e6db8c5 req-4292de7b-4949-4f20-807c-a31a03026310 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:43.126567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d5fac8c0-7d5f-4669-bc83-c85c2e6db8c5 req-4292de7b-4949-4f20-807c-a31a03026310 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:43.143907 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d5fac8c0-7d5f-4669-bc83-c85c2e6db8c5 req-4292de7b-4949-4f20-807c-a31a03026310 service nova] Creating event network-vif-unplugged:2514de9a-e593-441c-b26f-47d347c23ccb for instance 77da7802-0fa5-4899-89bc-0300c2599af7 on nch1-master-1 Apr 30 21:13:43.153903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d5fac8c0-7d5f-4669-bc83-c85c2e6db8c5 req-4292de7b-4949-4f20-807c-a31a03026310 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052471 Apr 30 21:13:43.155048 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 518/1121] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:13:43.219001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:43.231816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:43.233618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:43.235142 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-62c07960-49cd-46db-9a32-dd15bf7df58c tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.438267 Apr 30 21:13:43.236394 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 604/1122] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:42 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:44.023069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:44.025148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:44.048710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:44.054201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:44.056992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:44.057494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:44.084126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e5aedb43-d331-4fa9-b6d3-6a8c946d3304 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc26182040>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:44.582679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:44.595556 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f6cfb44a-120e-458c-946d-f581eb7cd434 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1536 microversion: 2.1 time: 0.579523 Apr 30 21:13:44.596148 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 519/1123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:44 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1536 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:44.606973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:44.616322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:44.631733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:44.632518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:44.633537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:44.635982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:44.889465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:44.933645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:44.943480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:44.951184 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d3d62b93-4061-4aae-9c00-5df7245393ae tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.347914 Apr 30 21:13:44.956851 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 520/1124] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:44 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:45.444886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6e8dff6-1784-45a3-8d65-4af85f77b6d6 tempest-FloatingIPDetailsNegativeTestJSON-1392089895 tempest-FloatingIPDetailsNegativeTestJSON-1392089895-project] Calling method '.version_select at 0x7fdc2094c670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:45.523683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-d6e8dff6-1784-45a3-8d65-4af85f77b6d6 tempest-FloatingIPDetailsNegativeTestJSON-1392089895 tempest-FloatingIPDetailsNegativeTestJSON-1392089895-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f25c4ccd-3521-4265-82ce-b43d40fa59cb could not be found", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:13:45.524467 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d6e8dff6-1784-45a3-8d65-4af85f77b6d6 tempest-FloatingIPDetailsNegativeTestJSON-1392089895 tempest-FloatingIPDetailsNegativeTestJSON-1392089895-project] HTTP exception thrown: Floating IP not found for ID f25c4ccd-3521-4265-82ce-b43d40fa59cb Apr 30 21:13:45.525932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6e8dff6-1784-45a3-8d65-4af85f77b6d6 tempest-FloatingIPDetailsNegativeTestJSON-1392089895 tempest-FloatingIPDetailsNegativeTestJSON-1392089895-project] Returning 404 to user: Floating IP not found for ID f25c4ccd-3521-4265-82ce-b43d40fa59cb {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:13:45.527154 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6e8dff6-1784-45a3-8d65-4af85f77b6d6 tempest-FloatingIPDetailsNegativeTestJSON-1392089895 tempest-FloatingIPDetailsNegativeTestJSON-1392089895-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/f25c4ccd-3521-4265-82ce-b43d40fa59cb" status: 404 len: 111 microversion: 2.1 time: 0.569056 Apr 30 21:13:45.527909 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 521/1125] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:13:44 2022] GET /compute/v2.1/os-floating-ips/f25c4ccd-3521-4265-82ce-b43d40fa59cb => generated 111 bytes in 571 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:45.534870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e1926720-316b-41db-943d-ba596a187be7 req-0b7fe3f2-d1d0-4480-80a1-4c844b3e2f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77da7802-0fa5-4899-89bc-0300c2599af7", "tag": "2514de9a-e593-441c-b26f-47d347c23ccb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:45.548411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e1926720-316b-41db-943d-ba596a187be7 req-0b7fe3f2-d1d0-4480-80a1-4c844b3e2f49 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:45.549235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e1926720-316b-41db-943d-ba596a187be7 req-0b7fe3f2-d1d0-4480-80a1-4c844b3e2f49 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:45.564373 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e1926720-316b-41db-943d-ba596a187be7 req-0b7fe3f2-d1d0-4480-80a1-4c844b3e2f49 service nova] Creating event network-changed:2514de9a-e593-441c-b26f-47d347c23ccb for instance 77da7802-0fa5-4899-89bc-0300c2599af7 on nch1-master-1 Apr 30 21:13:45.575633 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e1926720-316b-41db-943d-ba596a187be7 req-0b7fe3f2-d1d0-4480-80a1-4c844b3e2f49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040471 Apr 30 21:13:45.575633 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 522/1126] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:45.613915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:45.614879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:45.634024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:45.637495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:45.637495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:45.637495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:45.816943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e5aedb43-d331-4fa9-b6d3-6a8c946d3304 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 200 len: 1437 microversion: 2.1 time: 1.738634 Apr 30 21:13:45.818580 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 605/1127] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:44 2022] GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 1437 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:45.825239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e87be8f0-8797-4a8c-9a26-a439a7419921 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26190e50>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:45.926420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e87be8f0-8797-4a8c-9a26-a439a7419921 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/15e0057f-71f5-44b3-8ca2-02d2a40fec86" status: 200 len: 661 microversion: 2.1 time: 0.106340 Apr 30 21:13:45.936250 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 606/1128] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:45 2022] GET /compute/v2.1/images/15e0057f-71f5-44b3-8ca2-02d2a40fec86 => generated 661 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:45.943806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be6eb174-9c0b-4be5-bef6-51f48809c0ab tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26182550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:46.014871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:46.026515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4fafb25-4621-4aad-b306-dd6a98cbf4ec tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1536 microversion: 2.1 time: 0.417569 Apr 30 21:13:46.029129 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 523/1129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:45 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1536 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:46.050965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:46.058689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:46.073792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:46.074569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:46.075610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:46.076254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:46.269924 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be6eb174-9c0b-4be5-bef6-51f48809c0ab tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/15e0057f-71f5-44b3-8ca2-02d2a40fec86" status: 200 len: 661 microversion: 2.1 time: 0.331085 Apr 30 21:13:46.271399 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 607/1130] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:45 2022] GET /compute/v2.1/images/15e0057f-71f5-44b3-8ca2-02d2a40fec86 => generated 661 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:46.418251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:46.435597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:46.438349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:46.446338 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8f202d92-b147-4746-adc8-a2f1c2e9a7a3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.413474 Apr 30 21:13:46.447040 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 524/1131] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:46 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:46.836084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c46dbce-64c4-427d-a5ff-a41f73775a4e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc26190af0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:47.045771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:47.046613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:47.060719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:47.061191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:47.066362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:47.067552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:47.504916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:47.515457 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2b2afd0-7f27-432f-b987-2d064f3ca2fd tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1536 microversion: 2.1 time: 0.474342 Apr 30 21:13:47.520045 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 525/1132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:47 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1536 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:47.528322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f87533e1-5687-48be-8913-46229b22f4f4 req-722d4268-c00b-4879-9c36-55b154a58b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d428068-040a-4030-9d03-bc335def8d5d", "name": "network-vif-plugged", "status": "completed", "tag": "7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:47.553732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f87533e1-5687-48be-8913-46229b22f4f4 req-722d4268-c00b-4879-9c36-55b154a58b45 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:47.555256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f87533e1-5687-48be-8913-46229b22f4f4 req-722d4268-c00b-4879-9c36-55b154a58b45 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:47.582863 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f87533e1-5687-48be-8913-46229b22f4f4 req-722d4268-c00b-4879-9c36-55b154a58b45 service nova] Creating event network-vif-plugged:7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750 for instance 3d428068-040a-4030-9d03-bc335def8d5d on nch1-master-1 Apr 30 21:13:47.634958 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f87533e1-5687-48be-8913-46229b22f4f4 req-722d4268-c00b-4879-9c36-55b154a58b45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106530 Apr 30 21:13:47.634958 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 526/1133] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:13:47.661946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:47.670568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:47.681003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:47.681900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:47.682841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:47.683509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:48.349026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:48.361473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:48.367863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:48.369103 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae64976d-f309-4c42-b07c-6af5b822e5fa tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.723624 Apr 30 21:13:48.369676 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 527/1134] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:47 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:13:48.534431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:48.535126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:48.545311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:48.545804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:48.546605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:48.547052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:48.989587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:49.047174 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2cfced56-61ab-4212-89c2-ccb94fa8cf30 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1541 microversion: 2.1 time: 0.516324 Apr 30 21:13:49.058686 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 528/1135] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:48 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1541 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:49.394206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:49.395162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:49.405644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:49.407388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:49.409114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:49.410696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:49.744685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:49.759373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:49.760993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:49.762255 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc2e0e2d-a0a2-42fa-acec-66f2025d8745 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.378298 Apr 30 21:13:49.774473 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 529/1136] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:49 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:13:50.115778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:50.118063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:50.154030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:50.158842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:50.164817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:50.165355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:50.486502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:50.508758 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ff61ec0-5831-4468-9361-08a591b93332 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1541 microversion: 2.1 time: 0.395245 Apr 30 21:13:50.508758 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 530/1137] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:50 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1541 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:13:50.788389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:50.790699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:50.803760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:50.806257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:50.807951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:50.809611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:51.097133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:51.111812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:51.115515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:13:51.122024 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-06bff44a-0bf0-4571-83c6-48551fa824c6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1646 microversion: 2.25 time: 0.339925 Apr 30 21:13:51.122773 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 531/1138] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:13:50 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1646 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:13:51.415064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1324037206", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:13:59.787345 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c46dbce-64c4-427d-a5ff-a41f73775a4e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 200 len: 1437 microversion: 2.1 time: 12.958036 Apr 30 21:13:59.795708 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 608/1139] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:46 2022] GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 1437 bytes in 12968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:13:59.803226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:13:59.804732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:13:59.810716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:13:59.831493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:59.834811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:13:59.834811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:13:59.834811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.070721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:00.086076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30e1fb49-6a05-49a5-af87-31b336534c71 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1541 microversion: 2.1 time: 0.288857 Apr 30 21:14:00.087162 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 609/1140] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:13:59 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1541 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:00.109563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:00.110460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:00.123011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:00.123713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.125077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:00.125901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.205099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:00.205925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:00.207794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:00.208597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:00.209290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:00.219923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:00.220524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.221615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:00.222396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.253623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Getting quotas for project 4be651a660d6452e9c0bfeece7227370. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:00.256703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Getting quotas for user 3914f1552b63492b820beb7096278c39 and project 4be651a660d6452e9c0bfeece7227370. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:00.271134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:00.274925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:00.303520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:00.313303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:00.315154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:00.316368 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-153552ee-2f93-45bb-b0cb-9564c42a4f3d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1636 microversion: 2.25 time: 0.228078 Apr 30 21:14:00.317133 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 610/1141] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:14:00 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1636 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:14:00.432243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9b79f28f-878b-468f-b9eb-c5423328dc11 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.308160 Apr 30 21:14:00.433503 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 532/1142] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 9310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:00.438593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-da141d89-adbc-4849-aa87-ff455a13bcde tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '.version_select at 0x7fdc208224c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:00.441582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da141d89-adbc-4849-aa87-ff455a13bcde tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:00.442092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da141d89-adbc-4849-aa87-ff455a13bcde tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.461586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-da141d89-adbc-4849-aa87-ff455a13bcde tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3802 microversion: 2.25 time: 0.026614 Apr 30 21:14:00.462495 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 533/1143] 10.222.0.23 () {60 vars in 1183 bytes} [Sat Apr 30 21:14:00 2022] GET /compute/v2.1/os-migrations => generated 3802 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:14:00.467686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1a6a9dfd-6fd3-4258-be2c-75e93fa89cd0 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:00.468546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1a6a9dfd-6fd3-4258-be2c-75e93fa89cd0 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:00.475124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-120743266", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "9f3cd876-8b51-4bde-a809-728e22df1c30"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:00.558688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1a6a9dfd-6fd3-4258-be2c-75e93fa89cd0 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:00.571968 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1a6a9dfd-6fd3-4258-be2c-75e93fa89cd0 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1214 microversion: 2.1 time: 0.107074 Apr 30 21:14:00.573093 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 534/1144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:00 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:00.593139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:00.593823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:00.600348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:00.601038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.602140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:00.602751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:00.609106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] validate_networks() for [('9f3cd876-8b51-4bde-a809-728e22df1c30', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:00.918005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid 77da7802-0fa5-4899-89bc-0300c2599af7 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:14:00.953132 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a3b0ae1e-d234-45a3-89fc-10fc71f4ccf6 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 2129 microversion: 2.25 time: 0.378399 Apr 30 21:14:00.965201 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 535/1145] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:14:00 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 2129 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:14:00.965201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fcad24b5-bb43-4024-9d8d-c792861c6570 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20836a60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:01.580275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:01.580805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:01.581173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:01.581587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:01.582039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:01.591099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:01.591556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:01.592368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:01.592810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:01.609475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for project 711cc97213824857927f7626b41012cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:01.613525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for user ddcc9f1b17c94698a5df6ffc6482149f and project 711cc97213824857927f7626b41012cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:01.625677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:01.628193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:01.889478 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3d48bb2-5b69-4347-9afd-0b0371ef61ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560727 Apr 30 21:14:01.890164 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 611/1146] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:14:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:01.894500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:01.895186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:01.902671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:01.903124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:01.903934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:01.904376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.029150 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fcad24b5-bb43-4024-9d8d-c792861c6570 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 200 len: 1437 microversion: 2.1 time: 1.073838 Apr 30 21:14:02.030125 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 536/1147] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:00 2022] GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 1437 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:02.042929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:02.043692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:02.054088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid 77da7802-0fa5-4899-89bc-0300c2599af7 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:14:02.072977 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-85b083b6-335f-45f3-902b-3fdeb13cb872 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 2129 microversion: 2.25 time: 0.181247 Apr 30 21:14:02.080860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.084458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.085605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.086872 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 612/1148] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:14:01 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 2129 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:14:02.094559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:02.095195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:02.102637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.103170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.103966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.104186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.105080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.181851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:02.189675 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-06b074b0-191c-468e-b870-0c19c0c00f7f tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1218 microversion: 2.1 time: 0.100907 Apr 30 21:14:02.190607 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 613/1149] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:02 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:02.195582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90f9ef18-746a-498a-adbd-bbbec5afd6aa tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:02.196195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90f9ef18-746a-498a-adbd-bbbec5afd6aa tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:02.286068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90f9ef18-746a-498a-adbd-bbbec5afd6aa tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:02.293453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90f9ef18-746a-498a-adbd-bbbec5afd6aa tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1224 microversion: 2.1 time: 0.101775 Apr 30 21:14:02.294139 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 614/1150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:02 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:02.300014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-137d6deb-f6f8-4398-9141-756d5ac75f27 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2064c040>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:02.347130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:02.349055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-137d6deb-f6f8-4398-9141-756d5ac75f27 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/e84f5342-ab96-46b8-bf21-c62729b65811" status: 200 len: 661 microversion: 2.1 time: 0.053871 Apr 30 21:14:02.349635 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 615/1151] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:02 2022] GET /compute/v2.1/images/e84f5342-ab96-46b8-bf21-c62729b65811 => generated 661 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:02.354843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:02.357863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:02.361327 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ec488f3-81a5-43ad-8e58-e9db12618c51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1541 microversion: 2.1 time: 0.329763 Apr 30 21:14:02.361683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.362080 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 537/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:02 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1541 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:02.362334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.363210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.363718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.374385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e9fd8dc-0b5d-4d0e-b4e6-3b744630398a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc209c7040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:02.420307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e9fd8dc-0b5d-4d0e-b4e6-3b744630398a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/e84f5342-ab96-46b8-bf21-c62729b65811" status: 200 len: 661 microversion: 2.1 time: 0.056145 Apr 30 21:14:02.421425 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 538/1153] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:02 2022] GET /compute/v2.1/images/e84f5342-ab96-46b8-bf21-c62729b65811 => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:02.518226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lazy-loading 'services' on Instance uuid 77da7802-0fa5-4899-89bc-0300c2599af7 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:14:02.798291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-032a69f5-a9fb-43c1-a1ad-982c5206770a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments/faff6da0-9c40-4fee-bd74-c45260d3e9a2" status: 202 len: 0 microversion: 2.25 time: 0.447149 Apr 30 21:14:02.799144 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 616/1154] 10.222.0.23 () {60 vars in 1456 bytes} [Sat Apr 30 21:14:02 2022] DELETE /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments/faff6da0-9c40-4fee-bd74-c45260d3e9a2 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:02.808275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb4609ec-e8fd-4509-bfe8-9989e47fdf00 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:02.809506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb4609ec-e8fd-4509-bfe8-9989e47fdf00 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:02.816706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb4609ec-e8fd-4509-bfe8-9989e47fdf00 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.817164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb4609ec-e8fd-4509-bfe8-9989e47fdf00 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.817981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb4609ec-e8fd-4509-bfe8-9989e47fdf00 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:02.818430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb4609ec-e8fd-4509-bfe8-9989e47fdf00 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:02.848198 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb4609ec-e8fd-4509-bfe8-9989e47fdf00 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.044472 Apr 30 21:14:02.849003 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 539/1155] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:14:02 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:14:02.999987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.000581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:03.006856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.007315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.008641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.009080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.034548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:14:03.042792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b3062a0-c42e-4fee-a52e-97ab78d0a2a8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc208f20d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.092290 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b3062a0-c42e-4fee-a52e-97ab78d0a2a8 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 200 len: 1446 microversion: 2.1 time: 0.053335 Apr 30 21:14:03.100132 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 540/1156] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:03 2022] GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 1446 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:03.105972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3340ce8e-12a7-43eb-afa9-9d53ce782583 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc208fe430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.157650 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3340ce8e-12a7-43eb-afa9-9d53ce782583 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 200 len: 1446 microversion: 2.1 time: 0.056140 Apr 30 21:14:03.167049 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 541/1157] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:03 2022] GET /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 1446 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:03.172623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc815b96-4cb3-4176-9992-adc1c895cee5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20822040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.328660 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53cb0629-9cd1-48d3-840b-88f33edb5a68 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 204 len: 0 microversion: 2.1 time: 0.333226 Apr 30 21:14:03.329481 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 617/1158] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:02 2022] DELETE /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:03.342522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.343605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:03.350237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.350896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.351899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.352554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.421468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:03.430382 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-754188ab-d3e0-472c-a2f1-1be0ec12d1a2 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1274 microversion: 2.1 time: 0.098764 Apr 30 21:14:03.430991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 618/1159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:03 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:03.436145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.436769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:03.443879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.444336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.452825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.453416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.553534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:03.562115 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1b686a9d-2618-4111-9738-d576b36b1d4f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1228 microversion: 2.1 time: 0.129924 Apr 30 21:14:03.562956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 619/1160] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:03 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1228 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:03.567546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.568427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:03.574149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.574604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.575385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.575828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.711340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:03.719734 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b70459dd-5af5-4a69-a4f7-75bf619b57a1 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1708 microversion: 2.1 time: 0.155792 Apr 30 21:14:03.724110 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 620/1161] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:03 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:03.724707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.725346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:03.731658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.732107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.732884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.733328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.885205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:03.892628 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5a4e68ba-38bf-4c25-abb9-f8efe094c373 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1541 microversion: 2.1 time: 0.171380 Apr 30 21:14:03.893197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 621/1162] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:03 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1541 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:03.897865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-624eb2df-783e-44c9-b319-9a097df73d86 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:03.899354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-624eb2df-783e-44c9-b319-9a097df73d86 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:03.904972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-624eb2df-783e-44c9-b319-9a097df73d86 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.905427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-624eb2df-783e-44c9-b319-9a097df73d86 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.906238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-624eb2df-783e-44c9-b319-9a097df73d86 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:03.906682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-624eb2df-783e-44c9-b319-9a097df73d86 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:03.936790 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-624eb2df-783e-44c9-b319-9a097df73d86 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.042518 Apr 30 21:14:03.937342 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 622/1163] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:14:03 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:14:04.297877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c722a00-9510-4c94-8e3c-ec71053605b9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2062d3a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:04.341426 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c722a00-9510-4c94-8e3c-ec71053605b9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/6f73709b-da95-4aee-828f-c952262618a0" status: 200 len: 661 microversion: 2.1 time: 0.047430 Apr 30 21:14:04.342022 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 623/1164] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:04 2022] GET /compute/v2.1/images/6f73709b-da95-4aee-828f-c952262618a0 => generated 661 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:14:04.352947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89939028-df3f-44a0-a930-9052dca3e358 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2063caf0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:04.391913 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89939028-df3f-44a0-a930-9052dca3e358 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/6f73709b-da95-4aee-828f-c952262618a0" status: 200 len: 661 microversion: 2.1 time: 0.042520 Apr 30 21:14:04.392460 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 624/1165] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:04 2022] GET /compute/v2.1/images/6f73709b-da95-4aee-828f-c952262618a0 => generated 661 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:14:04.448534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:04.449161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:04.455255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.455722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.456536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.456982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.520384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:04.528954 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d266685-074a-4ead-a5ee-68697451d492 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1284 microversion: 2.1 time: 0.084812 Apr 30 21:14:04.529534 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 625/1166] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:04 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:04.534054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1795800584", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:04.580605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:04.594444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc815b96-4cb3-4176-9992-adc1c895cee5 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 204 len: 0 microversion: 2.1 time: 1.426010 Apr 30 21:14:04.595059 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 542/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:03 2022] DELETE /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 0 bytes in 1427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:04.600161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:04.600779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:04.607091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.607407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.608191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.608660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.701862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:04.712180 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-284c2ac4-9f99-4a54-aa0e-d6bc02aaff27 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1220 microversion: 2.1 time: 0.115959 Apr 30 21:14:04.712760 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 543/1168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:04 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:04.717707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:04.718230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:04.724350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.725001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.725805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.726254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.751658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:14:04.838167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:04.839079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:04.839812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:04.841346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:04.842158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:04.856107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.856632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.858031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:04.858680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:04.886415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Getting quotas for project a33635f00a9e48818fe1081019a2ceb5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:04.895387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Getting quotas for user eb2cc38da7684af39aed81a0e05d60a7 and project a33635f00a9e48818fe1081019a2ceb5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:04.912740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:04.917348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:05.098054 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6c8e733-997b-4d06-9863-2f3e306c84ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567406 Apr 30 21:14:05.101991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 626/1169] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:05.108125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:05.108929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:05.126388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:05.126687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:05.127481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:05.127921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:05.146453 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2f6156e-0c15-4441-ae75-6d9c1b84ab95 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 204 len: 0 microversion: 2.1 time: 0.432043 Apr 30 21:14:05.147505 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 544/1170] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:04 2022] DELETE /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:05.162641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:05.167364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:05.180528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:05.181243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:05.183296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:05.186257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:05.476688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:05.481813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:05.487830 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b8878742-55c1-4554-9587-6d68642b13ca tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1708 microversion: 2.1 time: 0.384746 Apr 30 21:14:05.490391 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 627/1171] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:05 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1708 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:05.492704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cdc6483f-57d9-4fef-8ff1-edfc635218a5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1541 microversion: 2.1 time: 0.342682 Apr 30 21:14:05.493319 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 545/1172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:05 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1541 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:05.496422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f49ffa0f-9cca-474d-a1fd-151043c956e8 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:05.497570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f49ffa0f-9cca-474d-a1fd-151043c956e8 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:05.498487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-246132955", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:05.504560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f49ffa0f-9cca-474d-a1fd-151043c956e8 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:05.505233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f49ffa0f-9cca-474d-a1fd-151043c956e8 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:05.506035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f49ffa0f-9cca-474d-a1fd-151043c956e8 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:05.506763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f49ffa0f-9cca-474d-a1fd-151043c956e8 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:05.543972 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f49ffa0f-9cca-474d-a1fd-151043c956e8 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.052250 Apr 30 21:14:05.549672 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 628/1173] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:14:05 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:05.556722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1102558607", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c1b131fa-a537-4b70-82cc-dbac26cd0254"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:05.580487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:05.637817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] validate_networks() for [('c1b131fa-a537-4b70-82cc-dbac26cd0254', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:06.265688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:06.286136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:06.289564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:06.290139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:06.293055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:06.305415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:06.305915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:06.306748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:06.307199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:06.345136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Getting quotas for project a33635f00a9e48818fe1081019a2ceb5. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:06.353676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Getting quotas for user eb2cc38da7684af39aed81a0e05d60a7 and project a33635f00a9e48818fe1081019a2ceb5. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:06.371815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:06.378316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:06.530114 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fed3caf3-90bf-4e93-9b69-d12508dee322 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032841 Apr 30 21:14:06.530833 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 546/1174] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:06.540713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:06.541353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:06.559631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:06.560576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:06.561650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:06.562691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.118833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:07.165473 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e29a50ea-e61c-4558-b208-b5a6f7f45527 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.631663 Apr 30 21:14:07.170534 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 547/1175] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:06 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:07.177208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:07.178837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:07.186517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.189111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.190408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.191152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.296576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:07.302647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:07.302647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:07.302647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:07.302647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:07.321936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.326296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.327443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.328112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.366331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:07.383910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:07.398206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Getting quotas for user 6e275a4d32754fe9a164bd79c3774b97 and project 64f0bbc311b44034838e939a3c2e98ae. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:07.406105 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81a711a2-af00-4e49-9bfe-8bf0916c00f1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1282 microversion: 2.1 time: 0.231783 Apr 30 21:14:07.408038 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 548/1176] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:07 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:07.422400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:07.422857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:07.424894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:07.425332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:07.448797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.450393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.453746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.453746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.629153 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8e1cf33-aa34-4094-aca6-c3c0d1290213 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.077836 Apr 30 21:14:07.630167 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 629/1177] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:07.636553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:07.651646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:07.667647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.667647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.667647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.667647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.959864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:07.973406 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35fbd695-a300-400a-aed7-0ecff037d969 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1708 microversion: 2.1 time: 0.560035 Apr 30 21:14:07.973406 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 549/1178] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:07 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1708 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:07.985482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:07.986098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:07.997212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.997591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:07.998415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:07.998858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:08.201022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:08.208914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab8d0892-5206-456f-919c-838861fa7586 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1221 microversion: 2.1 time: 0.235810 Apr 30 21:14:08.219053 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 550/1179] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:07 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1221 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:08.232702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c803bb11-3650-4fa9-b683-09714f06bae5 req-7bcfce72-efac-451c-a6a6-d4208b4edd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "name": "network-vif-unplugged", "status": "completed", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:08.247953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c803bb11-3650-4fa9-b683-09714f06bae5 req-7bcfce72-efac-451c-a6a6-d4208b4edd8f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:08.253831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c803bb11-3650-4fa9-b683-09714f06bae5 req-7bcfce72-efac-451c-a6a6-d4208b4edd8f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:08.262509 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c803bb11-3650-4fa9-b683-09714f06bae5 req-7bcfce72-efac-451c-a6a6-d4208b4edd8f service nova] Creating event network-vif-unplugged:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch2-master-1 Apr 30 21:14:08.272449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-c803bb11-3650-4fa9-b683-09714f06bae5 req-7bcfce72-efac-451c-a6a6-d4208b4edd8f service nova] Instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:14:08.301362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:08.310401 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ce847c5-76e0-48d4-a17d-ef6465a79506 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1540 microversion: 2.1 time: 0.678958 Apr 30 21:14:08.316557 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 630/1180] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:07 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1540 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:08.324853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c2e8c93d-c2ef-4fe1-8bed-aca570a7172c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:08.325587 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c803bb11-3650-4fa9-b683-09714f06bae5 req-7bcfce72-efac-451c-a6a6-d4208b4edd8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090866 Apr 30 21:14:08.326463 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 551/1181] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:08.332957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c2e8c93d-c2ef-4fe1-8bed-aca570a7172c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:08.344518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:08.347006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:08.367294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:08.367925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:08.369680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:08.372370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.030891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c2e8c93d-c2ef-4fe1-8bed-aca570a7172c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:09.084550 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c2e8c93d-c2ef-4fe1-8bed-aca570a7172c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1208 microversion: 2.1 time: 0.766518 Apr 30 21:14:09.085222 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 631/1182] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:08 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1208 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:09.109300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:09.109968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:09.130755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.131206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.132069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.132755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.189502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:09.201530 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc48b40b-273b-4e44-9037-6564279558ad tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.873572 Apr 30 21:14:09.203535 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 552/1183] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:08 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:09.217673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6521c5d7-bb81-4201-b9e1-aff015c9694d req-ebb05c43-b38b-41fe-b201-585224c5d734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa7daf2-fa4f-4c1d-8383-a64c33a81636", "tag": "d509f1b5-3706-43e8-bf15-4384090568d2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:09.227359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6521c5d7-bb81-4201-b9e1-aff015c9694d req-ebb05c43-b38b-41fe-b201-585224c5d734 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.228111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6521c5d7-bb81-4201-b9e1-aff015c9694d req-ebb05c43-b38b-41fe-b201-585224c5d734 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.243797 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6521c5d7-bb81-4201-b9e1-aff015c9694d req-ebb05c43-b38b-41fe-b201-585224c5d734 service nova] Creating event network-changed:d509f1b5-3706-43e8-bf15-4384090568d2 for instance 1fa7daf2-fa4f-4c1d-8383-a64c33a81636 on nch2-master-1 Apr 30 21:14:09.250710 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6521c5d7-bb81-4201-b9e1-aff015c9694d req-ebb05c43-b38b-41fe-b201-585224c5d734 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046726 Apr 30 21:14:09.252105 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 553/1184] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:09.260489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:09.262123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:09.276707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.277457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.292539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.293105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.457404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:09.469186 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cfeeaf94-3d8c-493f-8b3b-c45950d7c2f3 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1641 microversion: 2.1 time: 0.213908 Apr 30 21:14:09.470356 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 554/1185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:09 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1641 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:09.486205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:09.487790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:09.495793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.496503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.498136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.498812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.724726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:09.735935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ba9789c-d120-412e-82f3-737c4be793fe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1269 microversion: 2.1 time: 0.253919 Apr 30 21:14:09.743005 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 555/1186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:09 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1269 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:09.778842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:09.779569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:09.791561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:09.799802 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c9b93221-667b-47a5-aa50-5e2182424786 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.700916 Apr 30 21:14:09.809859 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 632/1187] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:09 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:09.822159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.824451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.826968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.831830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.834458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-85bc522c-51f7-4c17-9dd1-cbbaafea5f3c req-8af9b923-ef34-4885-a46f-72932804e495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb8816e-710b-48c2-b59d-862a9a875311", "name": "network-vif-deleted", "tag": "ec76b029-1b07-4d93-8cd9-507a98ae0296"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:09.892769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-85bc522c-51f7-4c17-9dd1-cbbaafea5f3c req-8af9b923-ef34-4885-a46f-72932804e495 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:09.893483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-85bc522c-51f7-4c17-9dd1-cbbaafea5f3c req-8af9b923-ef34-4885-a46f-72932804e495 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:09.941939 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-85bc522c-51f7-4c17-9dd1-cbbaafea5f3c req-8af9b923-ef34-4885-a46f-72932804e495 service nova] Creating event network-vif-deleted:ec76b029-1b07-4d93-8cd9-507a98ae0296 for instance ceb8816e-710b-48c2-b59d-862a9a875311 on nch2-master-1 Apr 30 21:14:09.963601 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-85bc522c-51f7-4c17-9dd1-cbbaafea5f3c req-8af9b923-ef34-4885-a46f-72932804e495 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151228 Apr 30 21:14:09.974259 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 633/1188] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:10.107367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:10.108432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:10.137317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.143028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.145010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.148831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.393245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:10.402975 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1628ba27-48cc-42f1-bde2-67770ec633f3 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1260 microversion: 2.1 time: 0.302083 Apr 30 21:14:10.408631 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 634/1189] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:10 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:10.425561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:10.426300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:10.436888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.440832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.443117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.444373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.504341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:10.517177 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fda7f505-c839-444a-8600-12d52b09e258 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1540 microversion: 2.1 time: 0.771677 Apr 30 21:14:10.519456 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 556/1190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:09 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1540 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:10.530523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-32e1a734-611b-4638-beec-b37d95a6c634 req-7c865c39-b7c9-4468-8db9-1953d4238858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d428068-040a-4030-9d03-bc335def8d5d", "name": "network-vif-unplugged", "status": "completed", "tag": "7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:10.551296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-32e1a734-611b-4638-beec-b37d95a6c634 req-7c865c39-b7c9-4468-8db9-1953d4238858 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.551744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-32e1a734-611b-4638-beec-b37d95a6c634 req-7c865c39-b7c9-4468-8db9-1953d4238858 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.584428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-32e1a734-611b-4638-beec-b37d95a6c634 req-7c865c39-b7c9-4468-8db9-1953d4238858 service nova] Creating event network-vif-unplugged:7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750 for instance 3d428068-040a-4030-9d03-bc335def8d5d on nch1-master-1 Apr 30 21:14:10.598083 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-32e1a734-611b-4638-beec-b37d95a6c634 req-7c865c39-b7c9-4468-8db9-1953d4238858 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076062 Apr 30 21:14:10.601297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 557/1191] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:10.634867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:10.635776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:10.659256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.662800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.664819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.665432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.754563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.756618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.759542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lazy-loading 'fault' on Instance uuid ceb8816e-710b-48c2-b59d-862a9a875311 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:14:10.887897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c816e51510ac44c9a2b3f5c022b5a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7710d2f3153e440ab46c2d89ce24c4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:10.896403 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-213274a2-5cef-49ee-80cc-dd2ec9693928 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 200 len: 1350 microversion: 2.1 time: 0.284864 Apr 30 21:14:10.901683 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 558/1192] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:10 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 1350 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:10.915513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:10.916448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:10.923988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:10.933810 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cd3064b3-ea2f-4031-81a9-f5afa42f7503 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.523861 Apr 30 21:14:10.941703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 635/1193] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:10 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:10.945966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.954582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.955722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.956357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.961300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:10.962364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:10.986365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.987228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:10.988261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:10.988951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:11.325376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:11.341226 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51be03db-f1dd-434c-93fa-d7813e8d83ee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1275 microversion: 2.1 time: 0.437964 Apr 30 21:14:11.342669 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 559/1194] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:10 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1275 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:11.430276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:11.430470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:11.438691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:11.440038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:11.448795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:11.450331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:11.841027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:11.851605 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-85c48190-a686-43e7-8c82-c69c5e17ee6f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1268 microversion: 2.1 time: 0.426716 Apr 30 21:14:11.858420 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 560/1195] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:11 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1268 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:11.868594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6d05c9ab-e181-4fc8-b950-aa857ed8cc72 req-02cbb6f0-9831-4a93-8f9a-b53cc8735dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d428068-040a-4030-9d03-bc335def8d5d", "name": "network-vif-deleted", "tag": "7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750"}, {"name": "network-changed", "server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:11.891985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6d05c9ab-e181-4fc8-b950-aa857ed8cc72 req-02cbb6f0-9831-4a93-8f9a-b53cc8735dc3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:11.893983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6d05c9ab-e181-4fc8-b950-aa857ed8cc72 req-02cbb6f0-9831-4a93-8f9a-b53cc8735dc3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:11.942358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:11.943319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6d05c9ab-e181-4fc8-b950-aa857ed8cc72 req-02cbb6f0-9831-4a93-8f9a-b53cc8735dc3 service nova] Creating event network-vif-deleted:7fcf8eef-c22d-4fd4-a6b0-fb1e4abb1750 for instance 3d428068-040a-4030-9d03-bc335def8d5d on nch1-master-1 Apr 30 21:14:11.943848 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6d05c9ab-e181-4fc8-b950-aa857ed8cc72 req-02cbb6f0-9831-4a93-8f9a-b53cc8735dc3 service nova] Creating event network-changed:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch2-master-1 Apr 30 21:14:11.955072 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-390008d9-4194-4783-a92c-678d6d522d42 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 1.011857 Apr 30 21:14:11.959978 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 636/1196] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:10 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:11.963324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-6d05c9ab-e181-4fc8-b950-aa857ed8cc72 req-02cbb6f0-9831-4a93-8f9a-b53cc8735dc3 service nova] Instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:14:11.984661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:11.985792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:11.994751 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6d05c9ab-e181-4fc8-b950-aa857ed8cc72 req-02cbb6f0-9831-4a93-8f9a-b53cc8735dc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.135967 Apr 30 21:14:11.995696 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 561/1197] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:12.003107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:12.009432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:12.015827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.016556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.017597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.018218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.024823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.025278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.026093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.027455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.056575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] HTTP exception thrown: Instance ceb8816e-710b-48c2-b59d-862a9a875311 could not be found. Apr 30 21:14:12.063050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Returning 404 to user: Instance ceb8816e-710b-48c2-b59d-862a9a875311 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:12.064002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e933a895-e749-4114-bb6e-823b2b0bcff5 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 404 len: 111 microversion: 2.1 time: 0.066926 Apr 30 21:14:12.064906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 562/1198] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:11 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:12.106218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:12.142709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:12.142709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.142709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.142709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.143043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.423354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:12.433296 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9adeccdb-dc13-4638-86cb-f1550bf6c4be tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1540 microversion: 2.1 time: 0.471333 Apr 30 21:14:12.434260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 637/1199] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:11 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1540 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:12.439621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:12.440492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:12.458885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.459779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.460718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.463880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.486667 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] HTTP exception thrown: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. Apr 30 21:14:12.487746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Returning 404 to user: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:12.490811 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b80cf1d1-5518-4c91-be67-93099118291c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 404 len: 111 microversion: 2.1 time: 0.055236 Apr 30 21:14:12.492316 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 638/1200] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:12 2022] DELETE /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:12.501705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:12.502735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:12.512263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.514260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.519041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.519883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.567007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:12.578398 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bddd6f48-9b80-4883-b683-a32da2f59b10 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.477343 Apr 30 21:14:12.579596 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 563/1201] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:12 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:12.585719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:12.586707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:12.599998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.601542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.602599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.603280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.629253 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] HTTP exception thrown: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. Apr 30 21:14:12.630272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Returning 404 to user: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:12.633189 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f590df47-a5d3-4e83-8754-30341bd4bf6b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 404 len: 111 microversion: 2.1 time: 0.050614 Apr 30 21:14:12.634521 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 564/1202] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:12 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:12.642551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ae5afa4-e10e-4181-bf04-2fae9fc2a2e4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '.version_select at 0x7fdc208fe3a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:12.675678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:12.683857 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce76e9f2-4804-4057-a5ad-c528203a00e6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1275 microversion: 2.1 time: 0.190222 Apr 30 21:14:12.684423 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 639/1203] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:12 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:12.875067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:12.875945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:12.883053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.883757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.884726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:12.885392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:12.969381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:12.981514 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f19b1fbe-117a-4f59-86c5-df543809ce18 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1266 microversion: 2.1 time: 0.109668 Apr 30 21:14:12.993952 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 640/1204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:12 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:13.014200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:13.014825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:13.029250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:13.030332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:13.032019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:13.032468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:13.343666 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ae5afa4-e10e-4181-bf04-2fae9fc2a2e4 tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-197166924" status: 202 len: 0 microversion: 2.1 time: 0.704836 Apr 30 21:14:13.344931 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 565/1205] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:14:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-197166924 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:14:13.450635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:13.451497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:13.460308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:13.467202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:13.467202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:13.467202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:13.770479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:13.781204 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a84d678f-0d5d-4380-9d93-5243e89840bf tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.771817 Apr 30 21:14:13.787109 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 641/1206] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:13 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:13.802238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:13.802238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:13.819035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:13.820662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:13.826829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:13.830867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:14.018849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:14.050086 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55d3a421-9ee9-4e23-a81a-fb311939de51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1540 microversion: 2.1 time: 0.603282 Apr 30 21:14:14.051085 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 566/1207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:13 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1540 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:14.056579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-aba29e52-32de-4d8b-be4d-5d4ec9d42673 req-c39f720b-b5a0-4672-a15b-9a7850019b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427c1770-3b54-49dc-b533-f3e65b86634f", "tag": "f256cd51-3b8b-4fb2-bf70-a39b65aef80e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:14.066099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aba29e52-32de-4d8b-be4d-5d4ec9d42673 req-c39f720b-b5a0-4672-a15b-9a7850019b81 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:14.066755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aba29e52-32de-4d8b-be4d-5d4ec9d42673 req-c39f720b-b5a0-4672-a15b-9a7850019b81 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:14.080193 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-aba29e52-32de-4d8b-be4d-5d4ec9d42673 req-c39f720b-b5a0-4672-a15b-9a7850019b81 service nova] Creating event network-changed:f256cd51-3b8b-4fb2-bf70-a39b65aef80e for instance 427c1770-3b54-49dc-b533-f3e65b86634f on nch2-master-1 Apr 30 21:14:14.087631 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-aba29e52-32de-4d8b-be4d-5d4ec9d42673 req-c39f720b-b5a0-4672-a15b-9a7850019b81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035446 Apr 30 21:14:14.088729 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 567/1208] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:14.100522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:14.101508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:14.113952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:14.117813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:14.117813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:14.117813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:14.255353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:14.280116 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9e31579-ad33-4400-85ff-68fc97882aa3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.491527 Apr 30 21:14:14.280709 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 642/1209] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:13 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:14.285258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:14.297090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:14.303498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:14.306085 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e3d4f8f9-79af-42c6-b81e-c48f4fb96ba6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1275 microversion: 2.1 time: 0.215932 Apr 30 21:14:14.311935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 568/1210] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:14 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1275 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:14.315845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:14.316297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:14.317081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:14.317517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:14.614307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:14.623725 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e0dca7a6-327b-432c-81b3-9aad7bf9c11e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.341815 Apr 30 21:14:14.624719 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 643/1211] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:14 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:14.692405 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:14:14.692537 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 21:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:14:14.803903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:14.807469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:14.815308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:14.815816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:14.816556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:14.816996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.067725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:15.068748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:15.075601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.076377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.077483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.078155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.203049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:15.214592 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-91f5721a-4133-4dc8-907f-3803d9f392ba tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.414366 Apr 30 21:14:15.215394 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 569/1212] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:14 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:15.307680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:15.320969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:15.338979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.339823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.340928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.342626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.597296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:15.606562 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe970d10-cd41-48e7-835b-7413fb567d79 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1472 microversion: 2.1 time: 0.542564 Apr 30 21:14:15.607236 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 644/1213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:15 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1472 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:15.617034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f637541d-dcc0-4206-acbf-06bf5e20b75e req-117aebf4-5ae5-4070-b616-0f7a1c18b5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17c37ba-07cd-47b9-9a7b-17d799280bbb", "tag": "0148cfe2-db7e-4096-b624-dd079aece8ea"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:15.628840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f637541d-dcc0-4206-acbf-06bf5e20b75e req-117aebf4-5ae5-4070-b616-0f7a1c18b5ff service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.630117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f637541d-dcc0-4206-acbf-06bf5e20b75e req-117aebf4-5ae5-4070-b616-0f7a1c18b5ff service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.643466 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f637541d-dcc0-4206-acbf-06bf5e20b75e req-117aebf4-5ae5-4070-b616-0f7a1c18b5ff service nova] Creating event network-changed:0148cfe2-db7e-4096-b624-dd079aece8ea for instance f17c37ba-07cd-47b9-9a7b-17d799280bbb on nch1-master-1 Apr 30 21:14:15.654255 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f637541d-dcc0-4206-acbf-06bf5e20b75e req-117aebf4-5ae5-4070-b616-0f7a1c18b5ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041857 Apr 30 21:14:15.655008 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 645/1214] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:15.663868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:15.664945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:15.673078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.674008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.675051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.675786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.840180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:15.851795 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e6d07398-9fe4-46e4-99a7-b41f84eb481a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.558486 Apr 30 21:14:15.854918 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 570/1215] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:15 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:15.857312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1d5b44ea-7cab-479a-be40-a7f690a9ce67 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:15.862960 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:14:15.862960 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:14:15.943445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1d5b44ea-7cab-479a-be40-a7f690a9ce67 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/701361983" status: 202 len: 0 microversion: 2.1 time: 0.089550 Apr 30 21:14:15.945505 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 571/1216] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:14:15 2022] DELETE /compute/v2.1/flavors/701361983 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:14:15.951155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:15.952195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:15.958862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.959661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:15.960576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:15.961103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.059184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:16.093061 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b85c2af3-6519-4ee9-9418-f32237e91b85 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.436432 Apr 30 21:14:16.095833 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 646/1217] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:15 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:16.103174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d9b8535-20e6-4a4a-96f9-fbe8886a1b79 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.125861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d9b8535-20e6-4a4a-96f9-fbe8886a1b79 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5400 microversion: 2.1 time: 0.028563 Apr 30 21:14:16.126616 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 647/1218] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:14:16 2022] GET /compute/v2.1/flavors/detail => generated 5400 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:16.145774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b7c51e53-f566-46c1-a2e2-8cdc7eac8b28 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.146998 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:14:16.146998 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:14:16.218103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:16.228597 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e872030-8f94-4a22-a5b9-00c53fd1f90e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.281728 Apr 30 21:14:16.229198 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 572/1219] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:15 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:16.234420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.235278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.243056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.243510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.244614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.245155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.248453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b7c51e53-f566-46c1-a2e2-8cdc7eac8b28 tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/91343643" status: 202 len: 0 microversion: 2.1 time: 0.106641 Apr 30 21:14:16.252675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 648/1220] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:14:16 2022] DELETE /compute/v2.1/flavors/91343643 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:14:16.258915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4e7f0c2e-636f-4087-b98c-706e5a8f300e tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.293586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4e7f0c2e-636f-4087-b98c-706e5a8f300e tempest-ServersWithSpecificFlavorTestJSON-1337872676 tempest-ServersWithSpecificFlavorTestJSON-1337872676-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039458 Apr 30 21:14:16.302718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 649/1221] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:14:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:16.320059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.320702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.327498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.328087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.329150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.329698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.349854 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] HTTP exception thrown: Instance ceb8816e-710b-48c2-b59d-862a9a875311 could not be found. Apr 30 21:14:16.351366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Returning 404 to user: Instance ceb8816e-710b-48c2-b59d-862a9a875311 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:16.352585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e84725de-237d-4eb4-b3cf-1f063f09c82b tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 404 len: 111 microversion: 2.1 time: 0.037015 Apr 30 21:14:16.353658 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 650/1222] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:16 2022] DELETE /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:16.367599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.368499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: ceb8816e-710b-48c2-b59d-862a9a875311] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.375608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.376407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.378097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.378783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.408124 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] HTTP exception thrown: Instance ceb8816e-710b-48c2-b59d-862a9a875311 could not be found. Apr 30 21:14:16.409110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Returning 404 to user: Instance ceb8816e-710b-48c2-b59d-862a9a875311 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:16.411968 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ada7d02-683c-4465-82d2-03dd6f5680ec tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311" status: 404 len: 111 microversion: 2.1 time: 0.049777 Apr 30 21:14:16.413712 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 651/1223] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:16 2022] GET /compute/v2.1/servers/ceb8816e-710b-48c2-b59d-862a9a875311 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:16.421506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f41c4620-ae7e-4c74-8f9b-955ecf4b7621 req-97c9acb5-1799-4db3-8ae3-a36dd4b78c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6999d013-7fa4-4cc4-81a1-7aa1f8399eb0", "tag": "6d37cf5e-e3cd-47b3-b260-73e5e72b6685"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:16.434525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f41c4620-ae7e-4c74-8f9b-955ecf4b7621 req-97c9acb5-1799-4db3-8ae3-a36dd4b78c60 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.435319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f41c4620-ae7e-4c74-8f9b-955ecf4b7621 req-97c9acb5-1799-4db3-8ae3-a36dd4b78c60 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.468766 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f41c4620-ae7e-4c74-8f9b-955ecf4b7621 req-97c9acb5-1799-4db3-8ae3-a36dd4b78c60 service nova] Creating event network-changed:6d37cf5e-e3cd-47b3-b260-73e5e72b6685 for instance 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 on nch1-master-1 Apr 30 21:14:16.488128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f41c4620-ae7e-4c74-8f9b-955ecf4b7621 req-97c9acb5-1799-4db3-8ae3-a36dd4b78c60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072549 Apr 30 21:14:16.488998 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 652/1224] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:16.501879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.502473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.511822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:16.522693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.523151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.524559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.524559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.529358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82801e5d-d70e-4096-a21f-6ab1ac43dae8 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.298666 Apr 30 21:14:16.539876 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 573/1225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:16 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:16.558423 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] HTTP exception thrown: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. Apr 30 21:14:16.559424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Returning 404 to user: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:16.560424 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a273991d-dd75-4e78-888b-354d41555f6c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 404 len: 111 microversion: 2.1 time: 0.070347 Apr 30 21:14:16.561464 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 653/1226] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:16 2022] DELETE /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:16.571458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.573226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] [instance: c8b3ef0d-1829-471c-9d1f-461b84634a6e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.580737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.581201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.582014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.582457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.597636 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] HTTP exception thrown: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. Apr 30 21:14:16.598516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] Returning 404 to user: Instance c8b3ef0d-1829-471c-9d1f-461b84634a6e could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:16.599515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bdfc1b80-59cf-4c85-9098-9d4028bbb63c tempest-ServersWithSpecificFlavorTestJSON-87434388 tempest-ServersWithSpecificFlavorTestJSON-87434388-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e" status: 404 len: 111 microversion: 2.1 time: 0.033660 Apr 30 21:14:16.600075 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 574/1227] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:16 2022] GET /compute/v2.1/servers/c8b3ef0d-1829-471c-9d1f-461b84634a6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:16.626170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.626934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.634009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.634591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.635697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.636141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.705299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ba16781a-4e03-40c9-90e6-54d213d0868b req-43a5885a-4527-4d31-a1d7-a4cc96e4db3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa7daf2-fa4f-4c1d-8383-a64c33a81636", "name": "network-vif-plugged", "status": "completed", "tag": "d509f1b5-3706-43e8-bf15-4384090568d2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:16.726916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ba16781a-4e03-40c9-90e6-54d213d0868b req-43a5885a-4527-4d31-a1d7-a4cc96e4db3b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.727688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ba16781a-4e03-40c9-90e6-54d213d0868b req-43a5885a-4527-4d31-a1d7-a4cc96e4db3b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.751463 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ba16781a-4e03-40c9-90e6-54d213d0868b req-43a5885a-4527-4d31-a1d7-a4cc96e4db3b service nova] Creating event network-vif-plugged:d509f1b5-3706-43e8-bf15-4384090568d2 for instance 1fa7daf2-fa4f-4c1d-8383-a64c33a81636 on nch2-master-1 Apr 30 21:14:16.757049 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ba16781a-4e03-40c9-90e6-54d213d0868b req-43a5885a-4527-4d31-a1d7-a4cc96e4db3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055685 Apr 30 21:14:16.762285 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 575/1228] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:14:16.818084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:16.827079 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e70952be-dc2a-4c54-96a6-3d4903d54b0d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1469 microversion: 2.1 time: 0.206143 Apr 30 21:14:16.830324 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 654/1229] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:16 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:16.848838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:16.850171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.862109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.862724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.863690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.864145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.868388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:16.869019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:16.877580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.878074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.878876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.879327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.915163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.915914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.916996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:16.917634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:16.942524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:16.948055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for user cce42480cd844664991774f07ca47e79 and project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:17.068087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:17.076218 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e1a15f0b-d709-41a6-91b0-02dfb87b4a47 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.211646 Apr 30 21:14:17.076715 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 655/1230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:16 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:17.113514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:17.114338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:17.124815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.125389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.126320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.126865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.322304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:17.330055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b3a71f7a-4827-4612-8ad5-de280f412977 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.220704 Apr 30 21:14:17.330837 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 656/1231] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:17 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:17.336208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:17.337312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:17.345616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.346400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.347602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.348200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.389178 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b4b43b1d-0715-465f-9472-560ba84e540e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638/action" status: 202 len: 0 microversion: 2.1 time: 0.548230 Apr 30 21:14:17.390308 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 576/1232] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:14:16 2022] POST /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:14:17.399981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:17.400937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:17.411847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.412307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.413144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.413612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.602953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:17.635612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fdb54a8c-67f3-426e-acc9-c8fb05f04041 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.277662 Apr 30 21:14:17.635612 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 657/1233] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:17 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:17.635612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:17.635612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:17.636644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:17.636879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.636879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.636879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.637164 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8cf9ede5-f2a5-4f3b-b180-d48f8b4aed15 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1468 microversion: 2.1 time: 0.233136 Apr 30 21:14:17.637268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.637371 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 577/1234] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:17 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:17.762320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cba8045d-e742-4734-8006-9127f40386b3 req-169e2472-ab7f-41b5-b0ea-4882183a13aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8ac748-1dff-4324-8ad2-b5c50606e509", "tag": "45386324-e00d-4309-b5b4-97378c6cd56e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:17.770843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cba8045d-e742-4734-8006-9127f40386b3 req-169e2472-ab7f-41b5-b0ea-4882183a13aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:17.771307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cba8045d-e742-4734-8006-9127f40386b3 req-169e2472-ab7f-41b5-b0ea-4882183a13aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:17.784532 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cba8045d-e742-4734-8006-9127f40386b3 req-169e2472-ab7f-41b5-b0ea-4882183a13aa service nova] Creating event network-changed:45386324-e00d-4309-b5b4-97378c6cd56e for instance 5f8ac748-1dff-4324-8ad2-b5c50606e509 on nch1-master-1 Apr 30 21:14:17.790906 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cba8045d-e742-4734-8006-9127f40386b3 req-169e2472-ab7f-41b5-b0ea-4882183a13aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032159 Apr 30 21:14:17.791734 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 578/1235] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:14:17.888981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:17.897455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cd9a91e2-1beb-46fc-bff2-36ef49a27d7d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.284573 Apr 30 21:14:17.898079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 658/1236] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:17 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:18.095127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:18.095874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:18.102537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:18.102997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:18.103783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:18.104230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:18.355831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:18.356587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:18.363849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:18.364397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:18.365285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:18.365829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:18.721505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:18.733668 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b8e71ed-e708-4d7c-92d6-933120412f4e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.643752 Apr 30 21:14:18.734387 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 579/1237] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:18 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:18.739631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:18.740239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:18.753931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:18.754533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:18.755521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:18.756127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.019322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:19.034370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ce27bea-b5cf-4ccb-8bde-ef55f33e2682 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.689570 Apr 30 21:14:19.035148 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 659/1238] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:18 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:19.041115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:19.042082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:19.060388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:19.062446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.063370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:19.063917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.084312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:19.100994 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cda22f57-28b6-4ae7-b8ee-b4746434d23f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.364823 Apr 30 21:14:19.103177 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 580/1239] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:18 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:19.108851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:19.111521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:19.118700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:19.122416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.123273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:19.123727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.265944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:19.275636 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-10936909-834f-470b-baa8-7e47af1350b9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1468 microversion: 2.1 time: 0.239016 Apr 30 21:14:19.281197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 660/1240] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:19 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:19.305246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:19.313111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-28236fe8-4a62-4143-baa3-5652c39d5ea7 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.208613 Apr 30 21:14:19.314469 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 581/1241] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:19 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:19.753846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:19.755603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:19.774919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:19.778804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.778804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:19.778804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.866171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2d432414-b20c-4853-b96c-a05b41b928fa req-95681467-909b-4ac9-b8d7-fcca20d458f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "name": "network-vif-plugged", "status": "completed", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:19.881747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d432414-b20c-4853-b96c-a05b41b928fa req-95681467-909b-4ac9-b8d7-fcca20d458f9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:19.885837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d432414-b20c-4853-b96c-a05b41b928fa req-95681467-909b-4ac9-b8d7-fcca20d458f9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:19.905631 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2d432414-b20c-4853-b96c-a05b41b928fa req-95681467-909b-4ac9-b8d7-fcca20d458f9 service nova] Creating event network-vif-plugged:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch2-master-1 Apr 30 21:14:19.911903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-2d432414-b20c-4853-b96c-a05b41b928fa req-95681467-909b-4ac9-b8d7-fcca20d458f9 service nova] Instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:14:19.924670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2d432414-b20c-4853-b96c-a05b41b928fa req-95681467-909b-4ac9-b8d7-fcca20d458f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062711 Apr 30 21:14:19.926058 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 582/1242] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:14:19.959776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:19.979191 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c5558664-3f42-4ce1-9ea5-2aafaf5610f7 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1314 microversion: 2.1 time: 0.222924 Apr 30 21:14:19.979191 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 661/1243] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:19 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:20.054123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:20.054123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:20.069818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.070287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.071083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.071524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.120272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:20.121642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:20.130052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.130600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.131692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.132853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.296557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:20.304373 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2a10d7e-0389-49e3-82be-7a8e9085985c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.256088 Apr 30 21:14:20.315726 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 583/1244] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:20 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:20.321627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:20.322502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:20.332042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.332767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.334147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.335682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.342024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:20.361132 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73e6313c-d80b-4e6f-ae50-682bdd2fcc35 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.245663 Apr 30 21:14:20.365576 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 662/1245] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:20 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:20.374351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:20.384815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:20.388168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.394398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.395530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.396144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.628190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:20.636876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4c705789-4a7d-4dff-9775-3a2b883c18b1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1468 microversion: 2.1 time: 0.319571 Apr 30 21:14:20.637456 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 584/1246] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:20 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1468 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:20.641899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:20.652289 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-177ca859-f394-49ab-92e6-ac2b91223132 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.285324 Apr 30 21:14:20.653063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 663/1247] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:20 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:20.988360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:20.989308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:20.996629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.997386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:20.998404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:20.999006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.274149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:21.293440 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-161120c5-f006-4742-bbe6-9892faa3f7c9 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1463 microversion: 2.1 time: 0.308947 Apr 30 21:14:21.302416 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 585/1248] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:20 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1463 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:21.321849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:21.326039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:21.333564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.345792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.345792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.345792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.464134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30b83e14-95a6-48a2-a1bc-8d6774a3cea3 tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Calling method '.version_select at 0x7fdc2063c5e0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:21.482596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30b83e14-95a6-48a2-a1bc-8d6774a3cea3 tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.483065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30b83e14-95a6-48a2-a1bc-8d6774a3cea3 tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.501159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30b83e14-95a6-48a2-a1bc-8d6774a3cea3 tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.505507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30b83e14-95a6-48a2-a1bc-8d6774a3cea3 tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.520612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30b83e14-95a6-48a2-a1bc-8d6774a3cea3 tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/4be651a660d6452e9c0bfeece7227370?start=2022-04-29T21%3A14%3A21.312929&end=2022-05-01T21%3A14%3A21.312929" status: 200 len: 695 microversion: 2.1 time: 0.203525 Apr 30 21:14:21.521533 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 664/1249] 10.222.0.23 () {58 vars in 1411 bytes} [Sat Apr 30 21:14:21 2022] GET /compute/v2.1/os-simple-tenant-usage/4be651a660d6452e9c0bfeece7227370?start=2022-04-29T21%3A14%3A21.312929&end=2022-05-01T21%3A14%3A21.312929 => generated 695 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:21.531726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:21.531726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:21.536026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.536495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.537389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.537746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.602895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:21.611085 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b926ced-4b9d-4168-a7c4-03d6977f6aa9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.293456 Apr 30 21:14:21.611893 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 586/1250] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:21 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:21.618858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-77327882-b670-43fb-b531-f596837c0df3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '.version_select at 0x7fdc207f14c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:21.627629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77327882-b670-43fb-b531-f596837c0df3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.628089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77327882-b670-43fb-b531-f596837c0df3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.644587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77327882-b670-43fb-b531-f596837c0df3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.644983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77327882-b670-43fb-b531-f596837c0df3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.666784 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-77327882-b670-43fb-b531-f596837c0df3 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/4be651a660d6452e9c0bfeece7227370?start=2022-04-29T21%3A14%3A21.312929&end=2022-05-01T21%3A14%3A21.312929" status: 200 len: 695 microversion: 2.1 time: 0.051479 Apr 30 21:14:21.667377 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 587/1251] 10.222.0.23 () {58 vars in 1411 bytes} [Sat Apr 30 21:14:21 2022] GET /compute/v2.1/os-simple-tenant-usage/4be651a660d6452e9c0bfeece7227370?start=2022-04-29T21%3A14%3A21.312929&end=2022-05-01T21%3A14%3A21.312929 => generated 695 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:21.671747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:21.672359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:21.678381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.678870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.679933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.680104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.879367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:21.886698 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2dba6528-4b03-4b20-b58f-f2f624cb6f91 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.364116 Apr 30 21:14:21.887270 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 665/1252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:21 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:21.891812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b7a78d96-6a65-4db6-a931-a6a5e446093a tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Calling method '.version_select at 0x7fdc2063c430>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:21.900296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a78d96-6a65-4db6-a931-a6a5e446093a tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.900690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a78d96-6a65-4db6-a931-a6a5e446093a tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.915928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a78d96-6a65-4db6-a931-a6a5e446093a tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.916396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a78d96-6a65-4db6-a931-a6a5e446093a tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.932857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:21.942101 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d976fc23-6331-4ce0-89f4-d8b491127fe4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1468 microversion: 2.1 time: 0.273714 Apr 30 21:14:21.942885 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 588/1253] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:21 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1468 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:21.948499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:21.949115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:21.958076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.958770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.960598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:21.961355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:21.970636 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b7a78d96-6a65-4db6-a931-a6a5e446093a tempest-TenantUsagesTestJSON-149047346 tempest-TenantUsagesTestJSON-149047346-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-29T21%3A14%3A21.312929&end=2022-05-01T21%3A14%3A21.312929&detailed=1" status: 200 len: 11449 microversion: 2.1 time: 0.081877 Apr 30 21:14:21.983390 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 666/1254] 10.222.0.23 () {58 vars in 1334 bytes} [Sat Apr 30 21:14:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-29T21%3A14%3A21.312929&end=2022-05-01T21%3A14%3A21.312929&detailed=1 => generated 11449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:14:22.011300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:22.017662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:22.035906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.036779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.037592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.038164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.069050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:14:22.255447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:22.264695 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de689aeb-9a3d-4d36-9d3a-5d8ef617318f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.320404 Apr 30 21:14:22.265627 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 589/1255] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:21 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:22.442892 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f91fd6a-2f5e-4696-86ca-6fb3fa7337df tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 204 len: 0 microversion: 2.1 time: 0.436243 Apr 30 21:14:22.446014 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 667/1256] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:22 2022] DELETE /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:14:22.453122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:22.453830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:22.466672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.468534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.469355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.471753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.577489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-dcd5efc2-d9d8-447b-ac9f-c553de1787d2 req-a933e32f-13f7-4021-8c1f-46c9b5408848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427c1770-3b54-49dc-b533-f3e65b86634f", "name": "network-vif-plugged", "status": "completed", "tag": "f256cd51-3b8b-4fb2-bf70-a39b65aef80e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:22.588495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dcd5efc2-d9d8-447b-ac9f-c553de1787d2 req-a933e32f-13f7-4021-8c1f-46c9b5408848 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.589302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dcd5efc2-d9d8-447b-ac9f-c553de1787d2 req-a933e32f-13f7-4021-8c1f-46c9b5408848 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.609709 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-dcd5efc2-d9d8-447b-ac9f-c553de1787d2 req-a933e32f-13f7-4021-8c1f-46c9b5408848 service nova] Creating event network-vif-plugged:f256cd51-3b8b-4fb2-bf70-a39b65aef80e for instance 427c1770-3b54-49dc-b533-f3e65b86634f on nch2-master-1 Apr 30 21:14:22.636151 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-dcd5efc2-d9d8-447b-ac9f-c553de1787d2 req-a933e32f-13f7-4021-8c1f-46c9b5408848 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073875 Apr 30 21:14:22.643051 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 668/1257] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:22.662728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:22.664334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:22.674086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.675151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.676554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.677262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.804993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:22.815208 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bf7c458e-fc4b-4e19-849e-ee1941595795 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1469 microversion: 2.1 time: 0.365345 Apr 30 21:14:22.817220 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 590/1258] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:22 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:22.905898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:22.906974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:22.917631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:22.917785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.917785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.917785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.917785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.920814 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc22d387-8a5a-4d91-ba5b-2e898d693122 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.276301 Apr 30 21:14:22.921509 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 669/1259] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:22 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:22.959468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:22.960624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:22.971591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.972149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:22.973030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:22.973553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:23.253546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:23.264377 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5dc28dc5-d980-4449-99b3-8f8a98db6263 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.363999 Apr 30 21:14:23.265251 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 591/1260] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:22 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:23.288580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:23.289477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:23.296991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:23.299134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:23.299988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:23.300481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:23.301946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:23.325121 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-07b606ce-b037-4106-b68e-423579d41da2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1534 microversion: 2.1 time: 0.369377 Apr 30 21:14:23.326495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 670/1261] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:22 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1534 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:23.578747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:23.590072 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-72631022-4e74-47a7-ae6b-4107265d716d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.305960 Apr 30 21:14:23.593109 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 592/1262] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:23 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:23.705887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c6b1a3b2-d7ac-4c56-89e9-cd177d721555 req-aa4a0a43-ad5c-4124-b575-4f0af0d01748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "name": "network-vif-unplugged", "status": "completed", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:23.721623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c6b1a3b2-d7ac-4c56-89e9-cd177d721555 req-aa4a0a43-ad5c-4124-b575-4f0af0d01748 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:23.722573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c6b1a3b2-d7ac-4c56-89e9-cd177d721555 req-aa4a0a43-ad5c-4124-b575-4f0af0d01748 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:23.738270 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c6b1a3b2-d7ac-4c56-89e9-cd177d721555 req-aa4a0a43-ad5c-4124-b575-4f0af0d01748 service nova] Creating event network-vif-unplugged:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch1-master-1 Apr 30 21:14:23.746077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-c6b1a3b2-d7ac-4c56-89e9-cd177d721555 req-aa4a0a43-ad5c-4124-b575-4f0af0d01748 service nova] Instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:14:23.758689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c6b1a3b2-d7ac-4c56-89e9-cd177d721555 req-aa4a0a43-ad5c-4124-b575-4f0af0d01748 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056504 Apr 30 21:14:23.759873 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 671/1263] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:23.836418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:23.847644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:23.857505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:23.858649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:23.860791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:23.866317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:23.939344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:23.940054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:23.952026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:23.953539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:23.957260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:23.957841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.579021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:24.588956 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-233b2179-72f5-4411-aec4-31e00334c92e tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1469 microversion: 2.1 time: 0.758854 Apr 30 21:14:24.589664 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 593/1264] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:23 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1469 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:24.595583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:24.596497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:24.603553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:24.604316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.605206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:24.605898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.631137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:24.642833 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7d14453-8a7b-442f-9063-6c7ec252d1a9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.707879 Apr 30 21:14:24.643806 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 672/1265] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:23 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:24.658611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:24.659860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:24.669400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:24.670169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.671140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:24.671778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.925960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:24.931173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d9aa047-4b69-43a7-a355-a5a2c11b120c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.340284 Apr 30 21:14:24.931753 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 594/1266] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:24 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:24.936239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:24.937302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:24.943083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:24.943543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.944974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:24.945350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.949265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:24.957695 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58de6447-c9ef-43b6-ab6a-5fef12fa3e49 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1534 microversion: 2.1 time: 0.311783 Apr 30 21:14:24.958914 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 673/1267] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:24 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1534 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:24.964162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a23f845b-0583-4334-b3bb-49654ea9bd49 req-b283797e-d1e8-44be-81f4-adc88307e5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c37ba-07cd-47b9-9a7b-17d799280bbb", "name": "network-vif-plugged", "status": "completed", "tag": "0148cfe2-db7e-4096-b624-dd079aece8ea"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:24.973670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a23f845b-0583-4334-b3bb-49654ea9bd49 req-b283797e-d1e8-44be-81f4-adc88307e5c3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:24.977656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a23f845b-0583-4334-b3bb-49654ea9bd49 req-b283797e-d1e8-44be-81f4-adc88307e5c3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:24.986454 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a23f845b-0583-4334-b3bb-49654ea9bd49 req-b283797e-d1e8-44be-81f4-adc88307e5c3 service nova] Creating event network-vif-plugged:0148cfe2-db7e-4096-b624-dd079aece8ea for instance f17c37ba-07cd-47b9-9a7b-17d799280bbb on nch1-master-1 Apr 30 21:14:24.992562 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a23f845b-0583-4334-b3bb-49654ea9bd49 req-b283797e-d1e8-44be-81f4-adc88307e5c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032251 Apr 30 21:14:24.993519 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 674/1268] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:25.383020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:25.394853 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-519af583-31f6-40ea-b8f6-9953821c0c28 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1324 microversion: 2.1 time: 0.462036 Apr 30 21:14:25.404809 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 595/1269] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:24 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:25.611186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:25.612873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:25.626604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:25.627905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:25.628985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:25.630272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:25.660419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:25.661010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:25.667797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:25.676022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:25.677321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:25.677998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:25.748579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:25.767036 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6d048fdb-aa04-4ab0-a5bc-f981cd0fce76 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1427 microversion: 2.1 time: 0.162913 Apr 30 21:14:25.785602 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 675/1270] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:25 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1427 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:25.806522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b29adeb4-34c8-4f58-8aed-af338f4aa629 req-e401826e-bb4e-472e-a8ab-4509329250c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}, {"server_uuid": "1fa7daf2-fa4f-4c1d-8383-a64c33a81636", "name": "network-vif-deleted", "tag": "d509f1b5-3706-43e8-bf15-4384090568d2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:25.854639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b29adeb4-34c8-4f58-8aed-af338f4aa629 req-e401826e-bb4e-472e-a8ab-4509329250c1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:25.857613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b29adeb4-34c8-4f58-8aed-af338f4aa629 req-e401826e-bb4e-472e-a8ab-4509329250c1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:25.887632 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b29adeb4-34c8-4f58-8aed-af338f4aa629 req-e401826e-bb4e-472e-a8ab-4509329250c1 service nova] Creating event network-changed:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch1-master-1 Apr 30 21:14:25.888428 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b29adeb4-34c8-4f58-8aed-af338f4aa629 req-e401826e-bb4e-472e-a8ab-4509329250c1 service nova] Creating event network-vif-deleted:d509f1b5-3706-43e8-bf15-4384090568d2 for instance 1fa7daf2-fa4f-4c1d-8383-a64c33a81636 on nch2-master-1 Apr 30 21:14:25.903301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-b29adeb4-34c8-4f58-8aed-af338f4aa629 req-e401826e-bb4e-472e-a8ab-4509329250c1 service nova] Instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:14:25.943611 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b29adeb4-34c8-4f58-8aed-af338f4aa629 req-e401826e-bb4e-472e-a8ab-4509329250c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.155224 Apr 30 21:14:25.945229 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 676/1271] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:25.951796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:25.953900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:25.963426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:25.964176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:25.965301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:25.965969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.024074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:26.032627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de7c615d-1af1-4d37-b858-62e52b331cdc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.375526 Apr 30 21:14:26.043061 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 596/1272] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:25 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:26.065187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:26.065187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:26.073430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.073931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.074737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.075188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.513639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:26.520140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:26.526279 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-433b4096-b4e8-4db0-8f62-867447342b4f tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.579474 Apr 30 21:14:26.536095 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d7bbc63-f202-46b6-989f-c1325acb1a51 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1534 microversion: 2.1 time: 0.491253 Apr 30 21:14:26.545744 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 597/1273] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:26 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1534 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:26.545991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 677/1274] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:25 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:26.546114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:26.546114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:26.548005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.548458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.549241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.549677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.812507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:26.814508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:26.830535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.832296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.837596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.837596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.894697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:26.904446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.905109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.905768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lazy-loading 'fault' on Instance uuid 1fa7daf2-fa4f-4c1d-8383-a64c33a81636 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:14:26.914485 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-473ce8c0-f1d7-4d5f-b23a-082386516c4e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.367255 Apr 30 21:14:26.915181 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 598/1275] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:26 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:26.937701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:26.938826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:26.949233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.954016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.954974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:26.955439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:26.957502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3914f1552b63492b820beb7096278c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be651a660d6452e9c0bfeece7227370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:26.970460 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-702c0686-2841-4e82-becf-9824de6afa3a tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 200 len: 1304 microversion: 2.1 time: 0.169733 Apr 30 21:14:26.974156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 678/1276] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:26 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:27.010287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-bfb0d92f-6f4c-4ef8-b02e-5d55a0d1f26e req-30d07a68-e9d0-4aad-a9cd-5df83be9c3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ac748-1dff-4324-8ad2-b5c50606e509", "name": "network-vif-plugged", "status": "completed", "tag": "45386324-e00d-4309-b5b4-97378c6cd56e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:27.018556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bfb0d92f-6f4c-4ef8-b02e-5d55a0d1f26e req-30d07a68-e9d0-4aad-a9cd-5df83be9c3ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.019082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bfb0d92f-6f4c-4ef8-b02e-5d55a0d1f26e req-30d07a68-e9d0-4aad-a9cd-5df83be9c3ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.033094 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-bfb0d92f-6f4c-4ef8-b02e-5d55a0d1f26e req-30d07a68-e9d0-4aad-a9cd-5df83be9c3ed service nova] Creating event network-vif-plugged:45386324-e00d-4309-b5b4-97378c6cd56e for instance 5f8ac748-1dff-4324-8ad2-b5c50606e509 on nch1-master-1 Apr 30 21:14:27.035008 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-bfb0d92f-6f4c-4ef8-b02e-5d55a0d1f26e req-30d07a68-e9d0-4aad-a9cd-5df83be9c3ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028792 Apr 30 21:14:27.035603 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 679/1277] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:27.050226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:27.051120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:27.058428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.059598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.060750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.061353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.231360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:27.245550 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1871c78f-de5a-4006-8d85-dadb22aa98c2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.316913 Apr 30 21:14:27.251132 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 599/1278] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:26 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:27.265040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-928bbc9e-a0ed-416f-ad6d-47eb493e811a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2039777037", "metadata": {"": ""}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:27.270615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-928bbc9e-a0ed-416f-ad6d-47eb493e811a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:27.271876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-928bbc9e-a0ed-416f-ad6d-47eb493e811a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action" status: 400 len: 170 microversion: 2.1 time: 0.013612 Apr 30 21:14:27.273709 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 600/1279] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Apr 30 21:14:27 2022] POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action => generated 170 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:14:27.295416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:27.296338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:27.300063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:27.307020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.310273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.310273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.310273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.316952 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c109e013-f16c-4ec5-b872-e365f0e15fbd tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.270627 Apr 30 21:14:27.318276 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 680/1280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:27 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:27.475102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:27.485785 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a8f776df-0567-4e24-a16c-4d29c39e35dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.201722 Apr 30 21:14:27.486830 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 601/1281] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:27 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:27.504723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:27.506779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:27.512297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.513040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.513923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.514532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.544674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:27.545218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:27.552459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.552914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.553834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.554281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.738532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:27.745584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:27.754511 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e76dd2ec-b729-4f75-96f0-0ecaae1bbab2 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.213719 Apr 30 21:14:27.755581 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 602/1282] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:27 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:27.762402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:27.762402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:27.770396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.771078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.772079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.772791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-476b4435-fc4e-47b9-bd54-57c6b57ed8d9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.271488 Apr 30 21:14:27.773485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.774490 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 681/1283] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:27 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:27.793420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b4350a13-c10c-4a80-9fbc-7c214685d1d3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-766864445", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:27.796995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b4350a13-c10c-4a80-9fbc-7c214685d1d3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:27.797918 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b4350a13-c10c-4a80-9fbc-7c214685d1d3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action" status: 400 len: 938 microversion: 2.1 time: 0.008527 Apr 30 21:14:27.798748 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 682/1284] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Apr 30 21:14:27 2022] POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:14:27.807351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:27.808312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:27.942243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:27.952727 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf3099c8-6c3e-4a21-9c66-e6f0e007865f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1534 microversion: 2.1 time: 0.195982 Apr 30 21:14:27.963258 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 603/1285] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:27 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1534 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:27.989492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:27.990668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] [instance: 1fa7daf2-fa4f-4c1d-8383-a64c33a81636] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:27.997681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.998166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:27.998956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:27.999394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.016170 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] HTTP exception thrown: Instance 1fa7daf2-fa4f-4c1d-8383-a64c33a81636 could not be found. Apr 30 21:14:28.016772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] Returning 404 to user: Instance 1fa7daf2-fa4f-4c1d-8383-a64c33a81636 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:28.017610 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-48db0c52-df03-4e82-8365-85b37ed2cd87 tempest-TenantUsagesTestJSON-1618276084 tempest-TenantUsagesTestJSON-1618276084-project] 10.222.0.23 "GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636" status: 404 len: 111 microversion: 2.1 time: 0.032843 Apr 30 21:14:28.018199 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 604/1286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:27 2022] GET /compute/v2.1/servers/1fa7daf2-fa4f-4c1d-8383-a64c33a81636 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:14:28.040079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.040567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.041322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.041792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.229268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:28.239749 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9468f77-e227-416b-8883-78d1d6e4e05e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.436618 Apr 30 21:14:28.242884 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 683/1287] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:27 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:28.265451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:28.266578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:28.283670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.284151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.285018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.286052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.335231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:28.336457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:28.345667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.347819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.349588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.352354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.613282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:28.622487 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10ebedb3-cda2-425c-8c0f-986daa94d475 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.364118 Apr 30 21:14:28.623443 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 605/1288] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:28 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:28.639349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-06ccde04-a18a-453a-b4b3-712f1a0a5b8d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:28.640667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-06ccde04-a18a-453a-b4b3-712f1a0a5b8d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:28.641487 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-06ccde04-a18a-453a-b4b3-712f1a0a5b8d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action" status: 400 len: 619 microversion: 2.1 time: 0.006162 Apr 30 21:14:28.642481 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 606/1289] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Apr 30 21:14:28 2022] POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:14:28.651030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:28.651745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:28.663635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.664374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.665621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.666256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.669324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:28.684137 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0d764994-a9be-48e1-9ed0-51b4f3ce919e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.353019 Apr 30 21:14:28.704295 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 684/1290] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:28 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:28.773126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:28.773735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:28.780625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.781082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.781920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.782361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:28.968036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:28.978389 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98338333-dff6-475a-83d0-ce73fb713c04 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.331457 Apr 30 21:14:28.979431 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 607/1291] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:28 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:28.989140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:28.989140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:28.998853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:28.999396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.000422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.000969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.089243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:29.098045 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ed705d73-4cdf-4b96-b372-a6edb9f2361d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.329182 Apr 30 21:14:29.098887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 685/1292] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:28 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:29.103710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:29.104327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:29.110669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.111927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.113838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.114391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.202802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:29.212423 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-05719b30-c8b0-4e0c-9a9b-b05162a8642c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1534 microversion: 2.1 time: 0.231614 Apr 30 21:14:29.222750 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 608/1293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:28 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1534 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:29.227841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b7f436c0-cd54-4f08-aa49-3f833e6de0b6 req-806f50d3-d749-4f1a-965c-412a4330d4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6999d013-7fa4-4cc4-81a1-7aa1f8399eb0", "name": "network-vif-plugged", "status": "completed", "tag": "6d37cf5e-e3cd-47b3-b260-73e5e72b6685"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:29.236072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b7f436c0-cd54-4f08-aa49-3f833e6de0b6 req-806f50d3-d749-4f1a-965c-412a4330d4a4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.236648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b7f436c0-cd54-4f08-aa49-3f833e6de0b6 req-806f50d3-d749-4f1a-965c-412a4330d4a4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.250322 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b7f436c0-cd54-4f08-aa49-3f833e6de0b6 req-806f50d3-d749-4f1a-965c-412a4330d4a4 service nova] Creating event network-vif-plugged:6d37cf5e-e3cd-47b3-b260-73e5e72b6685 for instance 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 on nch1-master-1 Apr 30 21:14:29.274756 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b7f436c0-cd54-4f08-aa49-3f833e6de0b6 req-806f50d3-d749-4f1a-965c-412a4330d4a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038335 Apr 30 21:14:29.278204 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 609/1294] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:29.290373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:29.299477 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1dfa0df7-d3d0-4b00-b6b9-f7b03f6a6c18 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.199453 Apr 30 21:14:29.300051 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 686/1295] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:29 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:29.317411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98504c03-7b0e-41a2-bc33-42ef826d535a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2008225787"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:29.318565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98504c03-7b0e-41a2-bc33-42ef826d535a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:29.325385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98504c03-7b0e-41a2-bc33-42ef826d535a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.325949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98504c03-7b0e-41a2-bc33-42ef826d535a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.326741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98504c03-7b0e-41a2-bc33-42ef826d535a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.327373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98504c03-7b0e-41a2-bc33-42ef826d535a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.701027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:29.701654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:29.710498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.712605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.713429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.713919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.925511 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98504c03-7b0e-41a2-bc33-42ef826d535a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action" status: 202 len: 0 microversion: 2.1 time: 0.613197 Apr 30 21:14:29.926265 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 610/1296] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:14:29 2022] POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 30 21:14:29.938302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2061934574"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:29.939894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:29.947656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.948210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.949015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:29.949632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:29.955782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:29.963394 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3fca206-ed53-4ea4-8ff7-8fa2a9a75fe5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1317 microversion: 2.1 time: 0.266363 Apr 30 21:14:29.963952 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 687/1297] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:29 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:29.982890 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Cannot 'createImage' instance 427c1770-3b54-49dc-b533-f3e65b86634f while it is in task_state image_snapshot_pending Apr 30 21:14:29.983521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 409 to user: Cannot 'createImage' instance 427c1770-3b54-49dc-b533-f3e65b86634f while it is in task_state image_snapshot_pending {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:29.984354 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b39750b7-0c04-43cd-b32a-531f8e1777f4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action" status: 409 len: 167 microversion: 2.1 time: 0.051271 Apr 30 21:14:29.984899 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 611/1298] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:14:29 2022] POST /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f/action => generated 167 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:14:29.993976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b83eaa9f-10cf-4921-af3f-e31e346414a1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '.version_select at 0x7fdc205174c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:30.118168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:30.119139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:30.129949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.131089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.132792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.133428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.276570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:30.285222 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f1698c85-445b-4b97-bb0a-a5d33104f2c7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1308 microversion: 2.1 time: 0.173105 Apr 30 21:14:30.288827 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 612/1299] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:30 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:30.290900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:30.291549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:30.297250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.297715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.298513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.298957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.314729 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b83eaa9f-10cf-4921-af3f-e31e346414a1 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/images/da6f619a-1015-4f9e-933f-d894c5edac4d" status: 204 len: 0 microversion: 2.1 time: 0.324416 Apr 30 21:14:30.315309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 688/1300] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:29 2022] DELETE /compute/v2.1/images/da6f619a-1015-4f9e-933f-d894c5edac4d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:30.323484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:30.324103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:30.330325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.339298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.339298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.339718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.591780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:30.597737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:30.600440 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-568f35b2-15f1-4ec1-880e-055c238860f5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1527 microversion: 2.1 time: 0.313617 Apr 30 21:14:30.601403 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 613/1301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:30 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1527 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:30.617537 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f079e81e-e893-49c7-87f2-7ae64e94eb62 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1534 microversion: 2.1 time: 0.297801 Apr 30 21:14:30.619624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:30.620493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:30.626536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.627072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.628077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.628582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.629174 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 689/1302] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:30 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1534 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:30.801645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:30.810282 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9979033a-a86c-40be-bef6-3add14d2c16c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1527 microversion: 2.1 time: 0.195925 Apr 30 21:14:30.821692 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 614/1303] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:30 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1527 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:30.826890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c76a310-63ce-4828-bab8-1a42e3500436 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:30.827878 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:14:30.827878 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:14:30.833658 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-2c76a310-63ce-4828-bab8-1a42e3500436 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] HTTP exception thrown: Flavor 24f26b92-a3ce-4952-a05c-bfbb4378fc13 could not be found. Apr 30 21:14:30.834312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c76a310-63ce-4828-bab8-1a42e3500436 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Returning 404 to user: Flavor 24f26b92-a3ce-4952-a05c-bfbb4378fc13 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:30.836309 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c76a310-63ce-4828-bab8-1a42e3500436 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/24f26b92-a3ce-4952-a05c-bfbb4378fc13" status: 404 len: 109 microversion: 2.1 time: 0.012913 Apr 30 21:14:30.837977 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 690/1304] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:30 2022] DELETE /compute/v2.1/flavors/24f26b92-a3ce-4952-a05c-bfbb4378fc13 => generated 109 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:30.964476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1866190935", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:30.980105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:30.980919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:30.990122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.991465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:30.992845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:30.993491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:31.026666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:31.597786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:31.607428 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4e8e9261-367b-42d3-b07d-bab873ddf451 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1467 microversion: 2.1 time: 0.631209 Apr 30 21:14:31.608190 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 691/1305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:30 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1467 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:31.627307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:31.627995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:31.634944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:31.635677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:31.636678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:31.637123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:31.717110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:31.717638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:31.718255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:31.718889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:31.719673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:31.747883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:31.748354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:31.749190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:31.749640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:31.776542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:31.781998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Getting quotas for user cce42480cd844664991774f07ca47e79 and project 4d8bde5d9ca44f859b5536d3398b63d4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:31.796403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:31.803894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:31.804174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:31.810307 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-60881b8c-39a4-4534-a563-9a47bf3d4382 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1488 microversion: 2.1 time: 0.189459 Apr 30 21:14:31.811334 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 692/1306] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:31 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1488 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:31.816816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:31.817646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:31.824669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:31.825124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:31.826165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:31.826842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:31.977341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:31.979585 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c124f840-dfee-47be-9421-f5788912c89e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019034 Apr 30 21:14:31.981134 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 615/1307] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:31.986452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:31.988508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:31.988623 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ea2ae58-ae09-4e9b-bfe4-605e1cb94448 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1468 microversion: 2.1 time: 0.175479 Apr 30 21:14:31.989502 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 693/1308] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:31 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1468 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:31.995129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a2eed59-3e98-424c-9349-dccfcee8211a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-987251147"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:31.996563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a2eed59-3e98-424c-9349-dccfcee8211a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:31.999165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:31.999641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:32.000518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:32.000968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:32.007499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a2eed59-3e98-424c-9349-dccfcee8211a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:32.008215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a2eed59-3e98-424c-9349-dccfcee8211a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:32.009235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a2eed59-3e98-424c-9349-dccfcee8211a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:32.010088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a2eed59-3e98-424c-9349-dccfcee8211a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:32.185010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:32.214047 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6aa6e7ae-a80a-46c8-af95-1e827d7119ca tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1540 microversion: 2.1 time: 0.231409 Apr 30 21:14:32.218121 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 616/1309] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:31 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1540 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:32.219117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8229520f-427a-4841-913b-98f66ec79049 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:32.219943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8229520f-427a-4841-913b-98f66ec79049 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:32.297202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8229520f-427a-4841-913b-98f66ec79049 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:32.306399 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8229520f-427a-4841-913b-98f66ec79049 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1213 microversion: 2.1 time: 0.090793 Apr 30 21:14:32.316404 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 617/1310] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:32 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:32.323355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74c7b677-db11-4bd1-8bb2-90604a786ac5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1776614554"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:32.324638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74c7b677-db11-4bd1-8bb2-90604a786ac5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:32.330717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c7b677-db11-4bd1-8bb2-90604a786ac5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:32.331169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c7b677-db11-4bd1-8bb2-90604a786ac5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:32.331953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c7b677-db11-4bd1-8bb2-90604a786ac5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:32.332396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c7b677-db11-4bd1-8bb2-90604a786ac5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:32.734278 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a2eed59-3e98-424c-9349-dccfcee8211a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "POST /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0/action" status: 202 len: 0 microversion: 2.1 time: 0.743330 Apr 30 21:14:32.750138 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 694/1311] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:14:31 2022] POST /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0/action => generated 0 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:14:32.762506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-131f5184-b4e7-4350-b087-3c6fe3ec98d1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc2052b280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:32.821033 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-131f5184-b4e7-4350-b087-3c6fe3ec98d1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c" status: 200 len: 1411 microversion: 2.1 time: 0.065208 Apr 30 21:14:32.821966 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 695/1312] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:32 2022] GET /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:32.839394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b24148e-132b-4f35-a695-cca7264c3e4d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc2052b4c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:32.896125 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b24148e-132b-4f35-a695-cca7264c3e4d tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c" status: 200 len: 1411 microversion: 2.1 time: 0.059834 Apr 30 21:14:32.896125 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 696/1313] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:32 2022] GET /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:32.923093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a878f6c-5717-4b25-9de4-c8074a1ae1f1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc2052bf70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:33.168539 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74c7b677-db11-4bd1-8bb2-90604a786ac5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "POST /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.850744 Apr 30 21:14:33.170694 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 618/1314] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:14:32 2022] POST /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb/action => generated 0 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:14:33.185413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6494ecd5-4e99-4a45-bdb4-24f8327bfdf0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc207e8ca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:33.234897 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6494ecd5-4e99-4a45-bdb4-24f8327bfdf0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.055964 Apr 30 21:14:33.235493 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 619/1315] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:33 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:33.241096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:33.242072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:33.252324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:33.255789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:33.256449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:33.256930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:33.260437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a878f6c-5717-4b25-9de4-c8074a1ae1f1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c" status: 204 len: 0 microversion: 2.1 time: 0.361457 Apr 30 21:14:33.261011 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 697/1316] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:32 2022] DELETE /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:33.269630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26ed2914-645a-42a8-be25-8e0daf27f286 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20540a60>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:33.303077 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-26ed2914-645a-42a8-be25-8e0daf27f286 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Image not found. Apr 30 21:14:33.303913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26ed2914-645a-42a8-be25-8e0daf27f286 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:33.305205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26ed2914-645a-42a8-be25-8e0daf27f286 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c" status: 404 len: 62 microversion: 2.1 time: 0.039979 Apr 30 21:14:33.309728 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 698/1317] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:33 2022] GET /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:14:33.318198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:33.322065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:33.337454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:33.366017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:33.378884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:33.381682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:33.487312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:33.495937 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d4c45ee-a43d-4601-a94e-5cc37f790bc0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1540 microversion: 2.1 time: 0.259398 Apr 30 21:14:33.497023 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 620/1318] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:33 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1540 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:33.504851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:33.505791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:33.523064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:33.524407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:33.525687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:33.526340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:33.656589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:33.664450 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56d2903c-a305-46e8-8d7f-66b70de925cd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1500 microversion: 2.1 time: 0.353292 Apr 30 21:14:33.665031 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 699/1319] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:33 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1500 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:33.667746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:33.670505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5a38dab7-df16-4673-b421-8a026e199bf5 req-4a8b8ff2-a0b2-451a-b938-873a192a90fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "name": "network-vif-plugged", "status": "completed", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:33.683402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-775d1ffb-d9c8-4d5d-b235-d811bff3ec1f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1217 microversion: 2.1 time: 0.177075 Apr 30 21:14:33.683402 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 621/1320] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:33 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:33.689910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5a38dab7-df16-4673-b421-8a026e199bf5 req-4a8b8ff2-a0b2-451a-b938-873a192a90fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:33.690372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5a38dab7-df16-4673-b421-8a026e199bf5 req-4a8b8ff2-a0b2-451a-b938-873a192a90fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:33.702357 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5a38dab7-df16-4673-b421-8a026e199bf5 req-4a8b8ff2-a0b2-451a-b938-873a192a90fe service nova] Creating event network-vif-plugged:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch1-master-1 Apr 30 21:14:33.707806 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5a38dab7-df16-4673-b421-8a026e199bf5 req-4a8b8ff2-a0b2-451a-b938-873a192a90fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041354 Apr 30 21:14:33.708388 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 700/1321] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:34.209407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Calling method '.version_select at 0x7fdc2077be50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.210442 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:14:34.210442 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:14:34.216173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.216173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.228358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.228827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.239830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.244997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.247388 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4f2473cf-5dbe-41de-9419-c13d31f35dda tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.157425 Apr 30 21:14:34.248129 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 622/1322] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:34.251290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2102c683-b424-465f-b51b-4c67899a22f3 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26190d30>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.258611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Calling method '.version_select at 0x7fdc20763310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.259413 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:14:34.259413 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:14:34.260547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.261011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.279009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.279472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.303793 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2102c683-b424-465f-b51b-4c67899a22f3 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.058312 Apr 30 21:14:34.304572 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 701/1323] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:34.315805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.316467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.326113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c979074f-2aba-4ba9-b4c0-ecfdee3720c0 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 591 microversion: 2.1 time: 0.071681 Apr 30 21:14:34.327528 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 623/1324] 10.222.0.23 () {58 vars in 1211 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 591 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:34.338965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Calling method '.version_select at 0x7fdc20540790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.339885 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:14:34.339885 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:14:34.341085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.341540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.357499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.357983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.368611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.369057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.374890 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dfcbc631-0377-4d24-a4ae-1205132afc40 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039696 Apr 30 21:14:34.375471 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 702/1325] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:34.385132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-da9dc5bd-c6a8-4ba6-abe4-175f45c97651 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Calling method '.version_select at 0x7fdc20875160>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.385977 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:14:34.385977 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:14:34.387104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da9dc5bd-c6a8-4ba6-abe4-175f45c97651 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.387573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da9dc5bd-c6a8-4ba6-abe4-175f45c97651 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.399994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da9dc5bd-c6a8-4ba6-abe4-175f45c97651 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.400453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da9dc5bd-c6a8-4ba6-abe4-175f45c97651 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.406465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-da9dc5bd-c6a8-4ba6-abe4-175f45c97651 tempest-HypervisorAdminUnderV252Test-1881125335 tempest-HypervisorAdminUnderV252Test-1881125335-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.025168 Apr 30 21:14:34.407068 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 624/1326] 10.222.0.23 () {58 vars in 1208 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:34.515738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.516929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:34.524718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.525279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.526825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.527553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.682732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.683287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:34.690242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:34.698642 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1ca5acc4-da60-4227-a4b1-b37468db93de tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1522 microversion: 2.1 time: 0.187954 Apr 30 21:14:34.699263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 703/1327] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:34.703138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.708347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.709907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.710511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.715866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.716867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:34.727961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.731630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.732495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.732966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.903045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:34.913168 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-28c1470c-adc7-4a5e-8327-3ffef8fcc735 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1265 microversion: 2.1 time: 0.208179 Apr 30 21:14:34.914427 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 704/1328] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:34.918780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:34.919299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:34.926656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.927132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.928155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:34.928859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:34.960490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:14:34.962800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:34.970722 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6844bb2a-2f3c-4c3f-9f18-fcb16dcf85ab tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1506 microversion: 2.1 time: 0.293271 Apr 30 21:14:34.981795 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 625/1329] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:34 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:35.318556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7aa02c2c-f78b-402e-85e9-41360a61eb3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20875ca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:35.379028 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7aa02c2c-f78b-402e-85e9-41360a61eb3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.064848 Apr 30 21:14:35.379765 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 626/1330] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:35 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:35.468925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad10a4c7-05cb-4d57-99ae-c586fd20771a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 204 len: 0 microversion: 2.1 time: 0.551825 Apr 30 21:14:35.470245 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 705/1331] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:34 2022] DELETE /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:35.478935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:35.479743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:35.507112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:35.507729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:35.510514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:35.511083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:35.743132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1e2a4d58-7e57-4fb1-ba18-daf1cfbca598 req-ff3778a4-7c43-49bb-8b2b-81cd0c428556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427c1770-3b54-49dc-b533-f3e65b86634f", "name": "network-vif-plugged", "status": "completed", "tag": "f256cd51-3b8b-4fb2-bf70-a39b65aef80e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:35.764518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1e2a4d58-7e57-4fb1-ba18-daf1cfbca598 req-ff3778a4-7c43-49bb-8b2b-81cd0c428556 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:35.765009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1e2a4d58-7e57-4fb1-ba18-daf1cfbca598 req-ff3778a4-7c43-49bb-8b2b-81cd0c428556 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:35.800119 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1e2a4d58-7e57-4fb1-ba18-daf1cfbca598 req-ff3778a4-7c43-49bb-8b2b-81cd0c428556 service nova] Creating event network-vif-plugged:f256cd51-3b8b-4fb2-bf70-a39b65aef80e for instance 427c1770-3b54-49dc-b533-f3e65b86634f on nch2-master-1 Apr 30 21:14:35.806491 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1e2a4d58-7e57-4fb1-ba18-daf1cfbca598 req-ff3778a4-7c43-49bb-8b2b-81cd0c428556 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070584 Apr 30 21:14:35.807797 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 706/1332] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:14:35.863719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:35.888233 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ae6f3dd-fb13-4b19-b39a-595e03cd367c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1528 microversion: 2.1 time: 0.413447 Apr 30 21:14:35.889641 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 627/1333] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:35 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1528 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:35.938790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:35.941881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:35.956123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:35.959096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:35.961170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:35.962180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:35.989887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:35.991538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:36.003251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:36.003833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:36.006989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:36.008223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:36.102534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:36.113316 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3f6c68ba-bc1c-4bdb-9658-0c6febc11bda tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1271 microversion: 2.1 time: 0.186135 Apr 30 21:14:36.128331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 707/1334] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:35 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:36.292077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:36.301715 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-982e33ea-a289-435a-bedc-d12bb353f89a tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1506 microversion: 2.1 time: 0.315876 Apr 30 21:14:36.310167 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 628/1335] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:35 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:36.392847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c128a8e-caad-4033-81f9-40fc3b4a433c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2052be50>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:36.466132 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c128a8e-caad-4033-81f9-40fc3b4a433c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.077369 Apr 30 21:14:36.470188 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 708/1336] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:36 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:36.910074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:36.911400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:36.925184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:36.925645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:36.932210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:36.933835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:37.143560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:37.144697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:37.157482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:37.158338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:37.159708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:37.160384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:37.481039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:37.490037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:37.492573 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9af8df61-65cf-4e38-b8d7-c8a0416fca1b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.362947 Apr 30 21:14:37.494066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 709/1337] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:37 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:37.501852 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5cb54877-c4a2-4d9d-b3e1-cae7d2fb89ff tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1528 microversion: 2.1 time: 0.597752 Apr 30 21:14:37.502857 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 629/1338] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:36 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1528 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:37.506424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:37.509063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:37.526781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b1dd936f-5504-49ba-9ad0-d29fd9b40031 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc209c7700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:37.529132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:37.529537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:37.531983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:37.534072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:37.626662 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b1dd936f-5504-49ba-9ad0-d29fd9b40031 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.120433 Apr 30 21:14:37.627401 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 630/1339] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:37 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:37.839953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:37.850859 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9956e2d-2667-456d-a4db-4db7b9260715 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1488 microversion: 2.1 time: 0.354845 Apr 30 21:14:37.862707 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 710/1340] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:37 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1488 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:37.869580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:37.870119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:37.878144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:37.878785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:37.879756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:37.880388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:37.912187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:14:38.404745 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6cd89a39-d86c-416f-8bc8-766746187e99 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 204 len: 0 microversion: 2.1 time: 0.539247 Apr 30 21:14:38.405348 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 631/1341] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:37 2022] DELETE /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:38.420585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56aec8ed-a56c-4869-a644-21ef1095c071 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc205d4ca0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:38.464723 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-56aec8ed-a56c-4869-a644-21ef1095c071 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Image not found. Apr 30 21:14:38.465338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56aec8ed-a56c-4869-a644-21ef1095c071 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:38.466511 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56aec8ed-a56c-4869-a644-21ef1095c071 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c" status: 404 len: 62 microversion: 2.1 time: 0.049652 Apr 30 21:14:38.477125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:38.479714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:38.479937 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 711/1342] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:38 2022] DELETE /compute/v2.1/images/97eefa39-9608-4d75-a058-d9991665085c => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:14:38.489491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:38.490229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:38.491724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:38.495187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:38.514194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:38.516015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:38.543023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:38.543697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:38.545468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:38.547613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:38.609410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:14:39.020732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Instance is already in deleting state, ignoring this request Apr 30 21:14:39.021590 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c16bfa61-4a54-4b7c-9724-b40eee663c74 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 204 len: 0 microversion: 2.1 time: 0.548891 Apr 30 21:14:39.033637 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 632/1343] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:38 2022] DELETE /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:14:39.059608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:39.065990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:39.090738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:39.091229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:39.110637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:39.111301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:39.402943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:39.414655 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a52047da-00d8-4600-9b96-88d5f344ceda tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1309 microversion: 2.1 time: 0.377744 Apr 30 21:14:39.417921 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 633/1344] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:39 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1309 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:39.428637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0c765afa-733b-4359-81a0-a1a632fecf4b req-6fefdc87-c690-4785-b8d7-0f3bcf572ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:39.432398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:39.450141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0c765afa-733b-4359-81a0-a1a632fecf4b req-6fefdc87-c690-4785-b8d7-0f3bcf572ef1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:39.452264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0c765afa-733b-4359-81a0-a1a632fecf4b req-6fefdc87-c690-4785-b8d7-0f3bcf572ef1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:39.456340 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59468cbe-6918-4dbc-95f9-61e8203c30ed tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.945382 Apr 30 21:14:39.457503 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 712/1345] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:38 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:39.488829 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0c765afa-733b-4359-81a0-a1a632fecf4b req-6fefdc87-c690-4785-b8d7-0f3bcf572ef1 service nova] Creating event network-changed:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch2-master-1 Apr 30 21:14:39.499851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-578e3b1b-ab5c-4011-b3e6-90d794e03780 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20b7c940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:39.502008 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0c765afa-733b-4359-81a0-a1a632fecf4b req-6fefdc87-c690-4785-b8d7-0f3bcf572ef1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077324 Apr 30 21:14:39.502947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 634/1346] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:39.518128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8092f279-1d3d-4b5f-b82c-6969fd7c6c08 req-278ac0f3-f854-4cf0-92db-5020fa8e1d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427c1770-3b54-49dc-b533-f3e65b86634f", "name": "network-vif-deleted", "tag": "f256cd51-3b8b-4fb2-bf70-a39b65aef80e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:39.539486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8092f279-1d3d-4b5f-b82c-6969fd7c6c08 req-278ac0f3-f854-4cf0-92db-5020fa8e1d14 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:39.541635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8092f279-1d3d-4b5f-b82c-6969fd7c6c08 req-278ac0f3-f854-4cf0-92db-5020fa8e1d14 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:39.587071 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8092f279-1d3d-4b5f-b82c-6969fd7c6c08 req-278ac0f3-f854-4cf0-92db-5020fa8e1d14 service nova] Creating event network-vif-deleted:f256cd51-3b8b-4fb2-bf70-a39b65aef80e for instance 427c1770-3b54-49dc-b533-f3e65b86634f on nch2-master-1 Apr 30 21:14:39.597596 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8092f279-1d3d-4b5f-b82c-6969fd7c6c08 req-278ac0f3-f854-4cf0-92db-5020fa8e1d14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089332 Apr 30 21:14:39.603261 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 635/1347] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:39.614695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:39.615308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:39.638361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:39.638827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:39.639641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:39.640089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:39.641038 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-578e3b1b-ab5c-4011-b3e6-90d794e03780 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.182228 Apr 30 21:14:39.641616 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 713/1348] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:39 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:40.095956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:40.111357 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fd5d8f54-5854-43d0-b5cf-8d36e67d7851 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1494 microversion: 2.1 time: 0.503519 Apr 30 21:14:40.112050 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 636/1349] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:39 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1494 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:40.432273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:40.433778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:40.444914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:40.452625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:40.454161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:40.454807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:40.475404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:40.476589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:40.483508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:40.484230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:40.485360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:40.486012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:40.596043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:40.596043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:40.596043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lazy-loading 'fault' on Instance uuid 427c1770-3b54-49dc-b533-f3e65b86634f {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:14:41.031509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:41.048029 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bc2e7563-d2a5-4115-a663-aa0eb98cf15e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 200 len: 1314 microversion: 2.1 time: 0.620465 Apr 30 21:14:41.054956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 714/1350] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:40 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:41.072780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22ae4866-7af9-421f-b1da-e53e620f763d tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26190dc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:41.170393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:41.199376 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-666f56ae-fd65-44ab-99ba-92e3d429f246 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.727514 Apr 30 21:14:41.201904 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 637/1351] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:40 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:41.218588 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22ae4866-7af9-421f-b1da-e53e620f763d tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.160660 Apr 30 21:14:41.227123 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 715/1352] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:41 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:41.233673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:41.234552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:41.254536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:41.255332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:41.259481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:41.260300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:41.425735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:41.439068 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6eaab209-6ef9-43e7-b50b-0aa0c555b3fa tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1452 microversion: 2.1 time: 0.229571 Apr 30 21:14:41.439711 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 638/1353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:41 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:41.689796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-117e14d5-df7f-4c1f-8fb5-66186de15d20 req-63eb4797-f3ca-418c-8949-58bfa700a2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6999d013-7fa4-4cc4-81a1-7aa1f8399eb0", "name": "network-vif-deleted", "tag": "6d37cf5e-e3cd-47b3-b260-73e5e72b6685"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:41.718570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-485a0320-3b37-4020-bba6-21f4cc7b8926 req-65552d3b-1c17-4976-9925-bd9376462298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c37ba-07cd-47b9-9a7b-17d799280bbb", "name": "network-vif-plugged", "status": "completed", "tag": "0148cfe2-db7e-4096-b624-dd079aece8ea"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:41.730830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-117e14d5-df7f-4c1f-8fb5-66186de15d20 req-63eb4797-f3ca-418c-8949-58bfa700a2b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:41.733360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-117e14d5-df7f-4c1f-8fb5-66186de15d20 req-63eb4797-f3ca-418c-8949-58bfa700a2b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:41.736762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-485a0320-3b37-4020-bba6-21f4cc7b8926 req-65552d3b-1c17-4976-9925-bd9376462298 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:41.763479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-485a0320-3b37-4020-bba6-21f4cc7b8926 req-65552d3b-1c17-4976-9925-bd9376462298 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:41.812715 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-117e14d5-df7f-4c1f-8fb5-66186de15d20 req-63eb4797-f3ca-418c-8949-58bfa700a2b7 service nova] Creating event network-vif-deleted:6d37cf5e-e3cd-47b3-b260-73e5e72b6685 for instance 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 on nch1-master-1 Apr 30 21:14:41.827617 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-485a0320-3b37-4020-bba6-21f4cc7b8926 req-65552d3b-1c17-4976-9925-bd9376462298 service nova] Creating event network-vif-plugged:0148cfe2-db7e-4096-b624-dd079aece8ea for instance f17c37ba-07cd-47b9-9a7b-17d799280bbb on nch1-master-1 Apr 30 21:14:41.842929 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-117e14d5-df7f-4c1f-8fb5-66186de15d20 req-63eb4797-f3ca-418c-8949-58bfa700a2b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156880 Apr 30 21:14:41.844053 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-485a0320-3b37-4020-bba6-21f4cc7b8926 req-65552d3b-1c17-4976-9925-bd9376462298 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128433 Apr 30 21:14:41.847397 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 716/1354] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:41.848431 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 639/1355] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:14:42.076145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:42.078195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:42.087258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:42.088151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:42.093750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:42.093750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:42.136416 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Instance 427c1770-3b54-49dc-b533-f3e65b86634f could not be found. Apr 30 21:14:42.138799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Instance 427c1770-3b54-49dc-b533-f3e65b86634f could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:42.139698 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-93a37960-47ef-4867-b1d7-8a549230df07 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 404 len: 111 microversion: 2.1 time: 0.069764 Apr 30 21:14:42.140289 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 717/1356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:42 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:42.157495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e0a312f-e254-481f-948a-26e76c858a02 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'create', calling method: .version_select at 0x7fdc20794dc0>, body: {"keypair": {"name": "tempest-keypair-994827377"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:42.180280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6e0a312f-e254-481f-948a-26e76c858a02 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for project 711cc97213824857927f7626b41012cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:42.188080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6e0a312f-e254-481f-948a-26e76c858a02 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for user ddcc9f1b17c94698a5df6ffc6482149f and project 711cc97213824857927f7626b41012cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:42.218059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:42.219646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:42.232938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:42.236272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:42.237295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:42.238118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:42.717858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6e0a312f-e254-481f-948a-26e76c858a02 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for project 711cc97213824857927f7626b41012cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:42.722723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6e0a312f-e254-481f-948a-26e76c858a02 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for user ddcc9f1b17c94698a5df6ffc6482149f and project 711cc97213824857927f7626b41012cb. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:42.760548 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e0a312f-e254-481f-948a-26e76c858a02 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.606133 Apr 30 21:14:42.767392 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 640/1357] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:14:42 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:42.780122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c16c5552-cdc5-4a44-bb63-a1c711a29bd9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20815160>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:42.822886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:42.857093 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-40096f31-0166-4eb6-85a6-f5105583912a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.639006 Apr 30 21:14:42.859209 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 718/1358] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:42 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:42.894714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:42.898380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:42.911441 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c16c5552-cdc5-4a44-bb63-a1c711a29bd9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.141083 Apr 30 21:14:42.912261 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 641/1359] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:42 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:42.923484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:42.923950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:42.924785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:42.925240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:43.036446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:43.037156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:43.037968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lazy-loading 'fault' on Instance uuid 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:14:43.148123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e275a4d32754fe9a164bd79c3774b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f0bbc311b44034838e939a3c2e98ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:43.160230 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-82b5627e-f85e-4353-a4e1-46fac84ab5bd tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 200 len: 1298 microversion: 2.1 time: 0.296620 Apr 30 21:14:43.162767 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 719/1360] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:42 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:43.481893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-608308539", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:43.595901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:43.876650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:43.881207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:43.897715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:43.898275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:43.899225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:43.899997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.455679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:44.459254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:44.459254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:44.459254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:44.459254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:44.488035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.489483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.492634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.493095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.557773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Getting quotas for project 1a2d262c5cf4435aa19253f70823433f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:44.564794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Getting quotas for user d57b97f51d2f4aa6869b41518f14d3aa and project 1a2d262c5cf4435aa19253f70823433f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:44.578036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:44.596308 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-82f50e83-0f5d-453e-86b6-4068729dce8f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.720726 Apr 30 21:14:44.599822 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 720/1361] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:43 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:44.610126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:44.623502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b03d2fcf-2e90-4e6d-b9b7-69f88bae81a6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20640af0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:44.625277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:44.706114 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b03d2fcf-2e90-4e6d-b9b7-69f88bae81a6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.104781 Apr 30 21:14:44.713726 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 721/1362] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:44 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:44.720171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:44.721199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:44.731474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.732284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.733359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.734354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.758772 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Instance 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 could not be found. Apr 30 21:14:44.759811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Instance 6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:44.760822 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6a8a6cbb-5a49-4473-8ed8-de19f86d3199 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0" status: 404 len: 111 microversion: 2.1 time: 0.045622 Apr 30 21:14:44.762177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 722/1363] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:44 2022] GET /compute/v2.1/servers/6999d013-7fa4-4cc4-81a1-7aa1f8399eb0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:44.771801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73eca0c7-7ab8-411c-a790-81db8868333c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc206401f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:44.790023 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2309499e-9184-4f09-821b-c9662be1c34d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496017 Apr 30 21:14:44.801687 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 642/1364] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:44.809495 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-73eca0c7-7ab8-411c-a790-81db8868333c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Image not found. Apr 30 21:14:44.810916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73eca0c7-7ab8-411c-a790-81db8868333c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:44.812358 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73eca0c7-7ab8-411c-a790-81db8868333c tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c" status: 404 len: 62 microversion: 2.1 time: 0.046189 Apr 30 21:14:44.813128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 723/1365] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:44 2022] DELETE /compute/v2.1/images/d37a8617-adec-4bf2-af2a-b9bb4a1ca54c => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:14:44.817939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5e476a06-a22a-43a6-9293-73be7f62bd30 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:44.819290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5e476a06-a22a-43a6-9293-73be7f62bd30 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:44.828610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:44.828610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:44.832385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.833170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.835420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.836648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.863393 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Instance 3d428068-040a-4030-9d03-bc335def8d5d could not be found. Apr 30 21:14:44.864310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Instance 3d428068-040a-4030-9d03-bc335def8d5d could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:44.866135 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a113de7-6097-42bc-9c9f-3f4a82e32b43 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 404 len: 111 microversion: 2.1 time: 0.047705 Apr 30 21:14:44.868231 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 724/1366] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:44 2022] DELETE /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:14:44.883810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:44.886827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 3d428068-040a-4030-9d03-bc335def8d5d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:44.915471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.915964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.931911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:44.932391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:44.949580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5e476a06-a22a-43a6-9293-73be7f62bd30 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:44.949580 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5e476a06-a22a-43a6-9293-73be7f62bd30 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1218 microversion: 2.1 time: 0.144060 Apr 30 21:14:44.953125 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 643/1367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:44 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:44.983683 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Instance 3d428068-040a-4030-9d03-bc335def8d5d could not be found. Apr 30 21:14:44.996729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Instance 3d428068-040a-4030-9d03-bc335def8d5d could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:44.998103 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35b05e18-2bb6-4d06-b2d0-becc12b883a0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d" status: 404 len: 111 microversion: 2.1 time: 0.124657 Apr 30 21:14:45.006792 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 725/1368] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:44 2022] GET /compute/v2.1/servers/3d428068-040a-4030-9d03-bc335def8d5d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:45.009028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-337bddba-7d3e-4b5c-95d6-b3a594496dd0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20837310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.072829 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-337bddba-7d3e-4b5c-95d6-b3a594496dd0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Image not found. Apr 30 21:14:45.089226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-337bddba-7d3e-4b5c-95d6-b3a594496dd0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:45.089226 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-337bddba-7d3e-4b5c-95d6-b3a594496dd0 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879" status: 404 len: 62 microversion: 2.1 time: 0.077206 Apr 30 21:14:45.089226 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 644/1369] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:45 2022] DELETE /compute/v2.1/images/c389b6d6-dcb3-4ede-8cd8-c0a468bcb879 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:14:45.090474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.090646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:45.103805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.104280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.105102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.105555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.148358 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Instance 85fdff58-4182-4941-b3a0-879915a49a4a could not be found. Apr 30 21:14:45.148358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Instance 85fdff58-4182-4941-b3a0-879915a49a4a could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:45.148358 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6835909a-1930-4fc1-a236-37d24e71dc25 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 404 len: 111 microversion: 2.1 time: 0.051496 Apr 30 21:14:45.148358 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 726/1370] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:45 2022] DELETE /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:45.153560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.154585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: 85fdff58-4182-4941-b3a0-879915a49a4a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:45.163219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.163768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.164645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.165096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.181194 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Instance 85fdff58-4182-4941-b3a0-879915a49a4a could not be found. Apr 30 21:14:45.181612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Instance 85fdff58-4182-4941-b3a0-879915a49a4a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:45.182486 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b837f26-7161-41c4-b050-ea614ab2746e tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a" status: 404 len: 111 microversion: 2.1 time: 0.032960 Apr 30 21:14:45.183295 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 645/1371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:45 2022] GET /compute/v2.1/servers/85fdff58-4182-4941-b3a0-879915a49a4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:45.192052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7845544b-cb02-46ab-ae91-38110153fae7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '.version_select at 0x7fdc20640790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.213750 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-7845544b-cb02-46ab-ae91-38110153fae7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Image not found. Apr 30 21:14:45.214482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7845544b-cb02-46ab-ae91-38110153fae7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:45.215463 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7845544b-cb02-46ab-ae91-38110153fae7 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587" status: 404 len: 62 microversion: 2.1 time: 0.027377 Apr 30 21:14:45.216081 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 727/1372] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:45 2022] DELETE /compute/v2.1/images/3d8c5463-fc02-4d0f-bce5-4340969b8587 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:14:45.224288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.225376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:45.231698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.232159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.232937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.233380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.251132 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a could not be found. Apr 30 21:14:45.251728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:45.252563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9940d382-b577-4798-865f-6eb4eafc17e1 tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 404 len: 111 microversion: 2.1 time: 0.032374 Apr 30 21:14:45.253114 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 646/1373] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:14:45 2022] DELETE /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:14:45.261098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.261720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] [instance: e53e9e70-9d1f-4677-b6e5-19e0a393b42a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:45.271313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.272581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.273405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.273973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.292076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] HTTP exception thrown: Instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a could not be found. Apr 30 21:14:45.292692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] Returning 404 to user: Instance e53e9e70-9d1f-4677-b6e5-19e0a393b42a could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:45.293619 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ba357851-4585-481f-824a-d5e3d1184fcc tempest-ImagesTestJSON-892995429 tempest-ImagesTestJSON-892995429-project] 10.222.0.23 "GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a" status: 404 len: 111 microversion: 2.1 time: 0.036339 Apr 30 21:14:45.294301 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 728/1374] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:45 2022] GET /compute/v2.1/servers/e53e9e70-9d1f-4677-b6e5-19e0a393b42a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:45.620673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.620673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:45.623719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.624213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.625011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:45.625461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:45.723569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08d85fd6-f416-4e92-bed7-4e329014b0da tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc21ae5040>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.807330 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08d85fd6-f416-4e92-bed7-4e329014b0da tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.090023 Apr 30 21:14:45.815032 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 729/1375] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:45 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:45.940866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:45.948601 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-992b8e2e-f48b-4990-a4de-baeecd0dc79e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.336663 Apr 30 21:14:45.949187 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 647/1376] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:45 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:45.972568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-38477230-5d2a-44d9-9e4b-1846c38e62db tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:45.974030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-38477230-5d2a-44d9-9e4b-1846c38e62db tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:46.130416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-38477230-5d2a-44d9-9e4b-1846c38e62db tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:46.140613 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-38477230-5d2a-44d9-9e4b-1846c38e62db tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1218 microversion: 2.1 time: 0.174927 Apr 30 21:14:46.153820 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 730/1377] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:45 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:46.825734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fbfc50ad-3fc3-4239-ad46-53b4b19aebc8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20787430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:46.945802 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fbfc50ad-3fc3-4239-ad46-53b4b19aebc8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.126878 Apr 30 21:14:46.948449 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 648/1378] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:46 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:46.972004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:46.973487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:46.984519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:46.985632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:46.987222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:46.988650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:47.162723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:47.163943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:47.181613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:47.182700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:47.185101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:47.185880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:47.199436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:47.230141 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b08f81d1-63cb-472b-aa67-a579cf9f5cac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.243986 Apr 30 21:14:47.235176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 731/1379] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:46 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:47.305209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:47.313877 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6f5bf632-cd57-4fef-b419-0dfac39a8532 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1222 microversion: 2.1 time: 0.157586 Apr 30 21:14:47.327898 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 649/1380] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:47 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:47.965336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7697b6fa-394d-46d2-9504-417760b7f9dc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2062dc10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:48.067160 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7697b6fa-394d-46d2-9504-417760b7f9dc tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.109890 Apr 30 21:14:48.069344 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 732/1381] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:47 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:48.231957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1757141062", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:48.252548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:48.253423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:48.265404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:48.267568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:48.272316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:48.273509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:48.340228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] validate_networks() for [('9f3cd876-8b51-4bde-a809-728e22df1c30', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:48.897257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:48.907420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-69857f3d-4dd1-4528-bf8b-aee0b30c144f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.664404 Apr 30 21:14:48.922278 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 733/1382] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:48 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:48.931914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:48.936515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:48.951725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:48.952516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:48.953504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:48.954201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:49.416554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:49.432850 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f0bab33c-3564-4b77-811a-46c44f98eee8 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1288 microversion: 2.1 time: 0.504309 Apr 30 21:14:49.436387 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 734/1383] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:48 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1288 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:49.456634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2e3b4e79-49de-45b1-ba3e-fde5b614f6a3 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc204e05e0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:49.552318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2e3b4e79-49de-45b1-ba3e-fde5b614f6a3 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.111815 Apr 30 21:14:49.570589 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 735/1384] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:49 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:49.826245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:14:49.826762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:14:49.827352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:14:49.827867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:14:49.828528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:14:49.861106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:49.869274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:49.875215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:49.878513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:49.939578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:49.940370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:49.949238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:49.965713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:49.972899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:49.978424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:50.000366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for project 711cc97213824857927f7626b41012cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:50.023962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for user ddcc9f1b17c94698a5df6ffc6482149f and project 711cc97213824857927f7626b41012cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:50.083001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:14:50.086259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:14:50.625306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:50.639334 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-14fd02f2-62b0-4fb1-8032-824a9c3a7e93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.703687 Apr 30 21:14:50.640610 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 736/1385] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:49 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:50.645474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-7c42ce9d-57c8-4b64-b775-58d642cf008b req-605a8a45-8d50-4951-ab01-b91482947e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "name": "network-vif-plugged", "status": "completed", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:50.667956 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46700c11-2440-4400-a146-ca4a48334d76 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.445166 Apr 30 21:14:50.675027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 650/1386] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:14:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:14:50.706996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7c42ce9d-57c8-4b64-b775-58d642cf008b req-605a8a45-8d50-4951-ab01-b91482947e62 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:50.712935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7c42ce9d-57c8-4b64-b775-58d642cf008b req-605a8a45-8d50-4951-ab01-b91482947e62 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:50.745170 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-7c42ce9d-57c8-4b64-b775-58d642cf008b req-605a8a45-8d50-4951-ab01-b91482947e62 service nova] Creating event network-vif-plugged:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch2-master-1 Apr 30 21:14:50.786716 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-7c42ce9d-57c8-4b64-b775-58d642cf008b req-605a8a45-8d50-4951-ab01-b91482947e62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144609 Apr 30 21:14:50.787876 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 737/1387] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:50.812066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:50.824831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:50.843533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:50.848303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:50.849188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:50.850146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:51.043676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e3377162-9639-4d99-bd9f-d1ffc1f65205 tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Calling method '.version_select at 0x7fdc2084c940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:51.083721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3377162-9639-4d99-bd9f-d1ffc1f65205 tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:51.091038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3377162-9639-4d99-bd9f-d1ffc1f65205 tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:51.092297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3377162-9639-4d99-bd9f-d1ffc1f65205 tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:51.094723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3377162-9639-4d99-bd9f-d1ffc1f65205 tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:51.190510 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e3377162-9639-4d99-bd9f-d1ffc1f65205 tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.493273 Apr 30 21:14:51.202613 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 651/1388] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:51.217795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:51.227652 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f9fadedc-b90c-48a9-9b66-6499eb7148c1 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1276 microversion: 2.1 time: 0.420049 Apr 30 21:14:51.228361 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 738/1389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:50 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1276 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:51.233989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d483668c-0591-43d7-81a3-8c0501f1c330 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:51.234711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d483668c-0591-43d7-81a3-8c0501f1c330 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:51.262323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3235dfbe-1488-4254-8b9a-fca01550db13 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc207aedc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:51.376545 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3235dfbe-1488-4254-8b9a-fca01550db13 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.152874 Apr 30 21:14:51.377239 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 652/1390] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:51 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:51.389717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-162d1fdf-3552-40b4-ac92-c2519b96e84a tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-522356066", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:51.395500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d483668c-0591-43d7-81a3-8c0501f1c330 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:51.404001 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d483668c-0591-43d7-81a3-8c0501f1c330 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1225 microversion: 2.1 time: 0.174212 Apr 30 21:14:51.406871 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 739/1391] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:51 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:51.499315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-162d1fdf-3552-40b4-ac92-c2519b96e84a tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:14:51.657344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:51.658130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:51.665134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:51.665790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:51.666709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:51.667249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:51.996296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:52.022114 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d876bea-2b84-466c-bd92-bce5d925dfac tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1313 microversion: 2.1 time: 0.357841 Apr 30 21:14:52.022114 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 740/1392] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:51 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:52.102803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-162d1fdf-3552-40b4-ac92-c2519b96e84a tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Getting quotas for project 6b8dcbd007194e4896da66708312f275. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:14:52.107617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-162d1fdf-3552-40b4-ac92-c2519b96e84a tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Getting quotas for user a97f31a7823845bea098470fa3a448cb and project 6b8dcbd007194e4896da66708312f275. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:14:52.121475 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-162d1fdf-3552-40b4-ac92-c2519b96e84a tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Apr 30 21:14:52.122648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-162d1fdf-3552-40b4-ac92-c2519b96e84a tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:14:52.139441 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-162d1fdf-3552-40b4-ac92-c2519b96e84a tempest-AbsoluteLimitsNegativeTestJSON-1167327201 tempest-AbsoluteLimitsNegativeTestJSON-1167327201-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.744755 Apr 30 21:14:52.139441 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 653/1393] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Apr 30 21:14:51 2022] POST /compute/v2.1/servers => generated 87 bytes in 747 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:14:52.245577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:52.246237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:52.256812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:52.259183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:52.260212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:52.262260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:52.389650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2415baf7-267c-4202-8c24-d3497f1cba0c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20815550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:52.469113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2415baf7-267c-4202-8c24-d3497f1cba0c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.082454 Apr 30 21:14:52.470060 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 654/1394] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:52 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:52.476695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3215afd0-eaf1-4130-8a46-c61e43f8bc16 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:52.478598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3215afd0-eaf1-4130-8a46-c61e43f8bc16 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:52.685471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3215afd0-eaf1-4130-8a46-c61e43f8bc16 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:52.693560 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3215afd0-eaf1-4130-8a46-c61e43f8bc16 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1225 microversion: 2.1 time: 0.221513 Apr 30 21:14:52.694718 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 655/1395] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:52 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:52.711137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:52.725557 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b2f8fc65-5ca4-4b5b-a7b1-efcf98db5759 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.482870 Apr 30 21:14:52.726978 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 741/1396] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:52 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:53.030435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:53.031338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:53.052488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:53.055315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:53.056392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:53.058039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:53.491617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a0721f2a-c779-4020-91a3-b0aa9efa0492 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26267c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:53.600071 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a0721f2a-c779-4020-91a3-b0aa9efa0492 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.110844 Apr 30 21:14:53.601116 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 742/1397] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:53 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:53.713556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:53.714363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:53.727938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:53.732271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:53.733478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:53.734155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:53.958095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:53.967981 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4392e64d-4ffe-4434-8fae-6b67f004bd10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1462 microversion: 2.1 time: 0.943216 Apr 30 21:14:53.988831 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 656/1398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:53 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1462 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:54.006959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:54.007596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:54.027418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:54.041173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:54.041699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:54.042609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:54.042786 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ee394cb-c486-463c-afb7-55599666320f tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1221 microversion: 2.1 time: 0.335333 Apr 30 21:14:54.043378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:54.053483 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 743/1399] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:53 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1221 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:54.065157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-968beaff-49d4-4f14-a055-1b30b71a377e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:54.069173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-968beaff-49d4-4f14-a055-1b30b71a377e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:54.082630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968beaff-49d4-4f14-a055-1b30b71a377e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:54.085479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968beaff-49d4-4f14-a055-1b30b71a377e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:54.086544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968beaff-49d4-4f14-a055-1b30b71a377e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:54.088863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968beaff-49d4-4f14-a055-1b30b71a377e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:54.842281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:54.850005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4943bfa6-803b-4502-a3b1-9f67df602237 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.859992 Apr 30 21:14:54.853513 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 657/1400] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:53 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:54.858898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7830ac9c-7841-407c-955b-c623b7cfaf86 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2074b0d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:54.976301 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7830ac9c-7841-407c-955b-c623b7cfaf86 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.121289 Apr 30 21:14:54.976901 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 658/1401] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:54 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:55.060734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:55.061899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:55.071312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.074154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.078728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.078728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.266812 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-968beaff-49d4-4f14-a055-1b30b71a377e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1613 microversion: 2.1 time: 1.209340 Apr 30 21:14:55.266812 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 744/1402] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:54 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1613 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:55.313681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:55.314744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:55.334582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.338269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.339415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.341011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.463136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9ecc7fabe57e4fc9accda390efb62b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98bd8e2e248d4b3599ea7038e73a0981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:55.476871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] flavor_id is None. Assuming migration. {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 30 21:14:55.478975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 21:14:55.702625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:55.732837 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c79a8c24-9341-43b6-8a75-4378a1a2e90c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1295 microversion: 2.1 time: 0.676065 Apr 30 21:14:55.748113 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 659/1403] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:55 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1295 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:55.758200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ed1925fd-664b-4dc4-911f-5b5044cd4417 req-d3bb4bbc-1a0f-401d-87b8-826299d2de7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8ea70e2-1dba-4ea9-97f7-31174159dca1", "tag": "062557a1-62cc-425d-97a6-043e7cd89a22"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:14:55.768240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ed1925fd-664b-4dc4-911f-5b5044cd4417 req-d3bb4bbc-1a0f-401d-87b8-826299d2de7d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.769602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ed1925fd-664b-4dc4-911f-5b5044cd4417 req-d3bb4bbc-1a0f-401d-87b8-826299d2de7d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.790071 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ed1925fd-664b-4dc4-911f-5b5044cd4417 req-d3bb4bbc-1a0f-401d-87b8-826299d2de7d service nova] Creating event network-changed:062557a1-62cc-425d-97a6-043e7cd89a22 for instance b8ea70e2-1dba-4ea9-97f7-31174159dca1 on nch2-master-1 Apr 30 21:14:55.797678 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ed1925fd-664b-4dc4-911f-5b5044cd4417 req-d3bb4bbc-1a0f-401d-87b8-826299d2de7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047740 Apr 30 21:14:55.799268 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 660/1404] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:14:55.875630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:55.876704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:55.885162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.886070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.887309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.888216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.945563 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-09839be8-0861-4222-abb4-58a1a1854d7e tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328/action" status: 202 len: 0 microversion: 2.1 time: 0.659526 Apr 30 21:14:55.949401 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 745/1405] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:14:55 2022] POST /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:14:55.967022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:55.967852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:55.991485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.991945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:55.992768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:55.993216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:56.390941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:56.423455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d8586e8-107a-495a-82cf-e7104a33c94d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1471 microversion: 2.1 time: 0.469381 Apr 30 21:14:56.430113 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 746/1406] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:55 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1471 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:56.437159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0475c1ea-ffa4-45ac-b3e5-91005ee72460 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26267310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:56.531053 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0475c1ea-ffa4-45ac-b3e5-91005ee72460 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.099476 Apr 30 21:14:56.532320 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 747/1407] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:56 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:56.757055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:56.757697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:56.764797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:56.765595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:56.766681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:56.767504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:57.137399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:57.158547 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab26bcde-0b81-48e5-87e4-a56ed94bcf55 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1283 microversion: 2.1 time: 0.410666 Apr 30 21:14:57.161422 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 748/1408] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:56 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1283 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:57.308893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:57.324469 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-90bbdb4c-6701-47e8-8a60-c1400cc98fb3 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 1.453465 Apr 30 21:14:57.325428 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 661/1409] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:55 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:57.445001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:57.449319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:57.459271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:57.464149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:57.465463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:57.466217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:57.545831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2b9cdc31-1fbe-4ae7-93c4-494bd318d91a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2074eca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:57.645489 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2b9cdc31-1fbe-4ae7-93c4-494bd318d91a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.104638 Apr 30 21:14:57.647595 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 662/1410] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:57 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:57.954834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:57.980765 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-458def86-86c8-430a-988c-c1ea1759021f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1471 microversion: 2.1 time: 0.539638 Apr 30 21:14:57.993042 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 749/1411] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:57 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:58.190218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:58.190898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:58.216826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:58.217617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:58.218668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:58.219297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:58.343573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:58.345845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:58.370535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:58.371249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:58.372180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:58.372642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:58.707724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:58.731163 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a5bf7c7-84b0-4a7e-9f51-280b00695c31 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.549643 Apr 30 21:14:58.732593 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 663/1412] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:58 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:58.751949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-292e92dc-30bb-4311-8fed-66994c89f70f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2074d040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:58.825469 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-292e92dc-30bb-4311-8fed-66994c89f70f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.091475 Apr 30 21:14:58.829951 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 664/1413] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:58 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:58.831587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:58.842394 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e99c3e45-c33f-4335-80b3-4465b2af3599 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.503416 Apr 30 21:14:58.854858 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 750/1414] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:58 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:14:59.000870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:59.001388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:59.024573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:59.027593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:59.030915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:59.035505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:59.393723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:14:59.416622 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46db06c2-4503-4cd2-9dd2-1bbace9de3c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1471 microversion: 2.1 time: 0.417310 Apr 30 21:14:59.420184 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 665/1415] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:58 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1471 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:14:59.762052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:14:59.763843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:14:59.794928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:59.796695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:59.798860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:14:59.801490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:14:59.851324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3b2bfc1c-f158-407e-8886-c41a46c20c63 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2074d8b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:00.161193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:00.186749 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e4d6ef6f-1dea-43dd-97c1-ca48465556a6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.440450 Apr 30 21:15:00.188340 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 751/1416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:14:59 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:00.196676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:00.207264 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3b2bfc1c-f158-407e-8886-c41a46c20c63 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1455 microversion: 2.1 time: 0.367935 Apr 30 21:15:00.212778 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 666/1417] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:59 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1455 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:00.213290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:00.241396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:00.241396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:00.242313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:00.255492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:00.437910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:00.438632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:00.461266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:00.466389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:00.467404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:00.467968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:00.892894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:00.906724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9c658ef-748c-462d-a03d-92269b558f04 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.715539 Apr 30 21:15:00.917664 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 752/1418] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:00 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:00.995842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:01.004672 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-40a85572-3832-4894-90ad-0c84f0e17aaa tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1471 microversion: 2.1 time: 0.571003 Apr 30 21:15:01.006467 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 667/1419] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:00 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1471 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:01.176454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-6072ee51-4a76-4068-a42f-3edfd6252348 req-08378a3d-c865-49b3-a40b-93b5de0f2a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3279965-3245-4077-96e6-ecaf57d00b9b", "tag": "3d880b11-1cc5-4a9c-90d6-9a894959be26"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:01.197931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6072ee51-4a76-4068-a42f-3edfd6252348 req-08378a3d-c865-49b3-a40b-93b5de0f2a77 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:01.198757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6072ee51-4a76-4068-a42f-3edfd6252348 req-08378a3d-c865-49b3-a40b-93b5de0f2a77 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:01.204458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:01.205392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:01.217392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:01.219707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:01.220797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:01.226046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:01.248090 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-6072ee51-4a76-4068-a42f-3edfd6252348 req-08378a3d-c865-49b3-a40b-93b5de0f2a77 service nova] Creating event network-changed:3d880b11-1cc5-4a9c-90d6-9a894959be26 for instance f3279965-3245-4077-96e6-ecaf57d00b9b on nch2-master-1 Apr 30 21:15:01.290959 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-6072ee51-4a76-4068-a42f-3edfd6252348 req-08378a3d-c865-49b3-a40b-93b5de0f2a77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118557 Apr 30 21:15:01.297369 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 753/1420] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:01.309078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ae7351d-303a-4a81-95f0-49261c685e3e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc261fb310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:01.711798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:01.720586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-485f8609-dcfc-418b-9f92-3d18702e9247 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.519879 Apr 30 21:15:01.736784 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 668/1421] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:01 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:01.924335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:01.925377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:01.940396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:01.941049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:01.946051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:01.946711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:02.419689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:02.429128 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-defb7f58-af0c-45f5-8199-de8fb4a00b9f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.508706 Apr 30 21:15:02.438951 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 669/1422] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:01 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:02.438951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:02.438951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:02.442759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:02.443647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:02.444466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:02.444911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:02.663483 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ae7351d-303a-4a81-95f0-49261c685e3e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1464 microversion: 2.1 time: 1.364257 Apr 30 21:15:02.664654 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 754/1423] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:01 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1464 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:02.675983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf4a558b-0de3-42c6-8ec8-77f59fa793ff tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26267430>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:02.778572 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cf4a558b-0de3-42c6-8ec8-77f59fa793ff tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 200 len: 1464 microversion: 2.1 time: 0.106322 Apr 30 21:15:02.779158 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 755/1424] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:02 2022] GET /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 1464 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:02.806332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:02.814310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:02.827382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:02.827857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:02.828667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:02.829115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:02.863465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:02.876077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-398ccfdd-522e-4643-9e95-5b1edb133807 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1471 microversion: 2.1 time: 0.444865 Apr 30 21:15:02.889843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 670/1425] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:02 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1471 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:02.899950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:02.900777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:02.910353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:02.911086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:02.912149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:02.912753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:03.213293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:03.222541 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-61cddc29-7866-4c66-8d8d-a8a365bac409 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1481 microversion: 2.1 time: 0.331262 Apr 30 21:15:03.236782 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 671/1426] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:02 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1481 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:03.241133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:03.253054 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-44272de0-3829-4243-84ff-86857cb62ff6 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.472726 Apr 30 21:15:03.253976 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 756/1427] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:02 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:03.447153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:03.448535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:03.455973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:03.457975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:03.459664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:03.461007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:03.641655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:03.654134 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9e8901b3-0df2-4d88-9a04-8e737401f4d5 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.211585 Apr 30 21:15:03.668322 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 672/1428] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:03 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:03.778178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8a4a478-afb8-420e-9a13-4741555a1a9f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc2629e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2026789897", "description": "tempest-description-1347217722"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:03.898949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:03.899710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:03.907884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:03.908501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:03.909359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:03.910131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:04.518046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:04.537367 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dfdb9117-40b3-4f9a-b039-3b82857369f3 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1471 microversion: 2.1 time: 0.644732 Apr 30 21:15:04.551072 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 673/1429] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:03 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1471 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:04.557572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:04.561085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:04.580027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:04.580833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:04.584567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:04.585225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:04.985232 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8a4a478-afb8-420e-9a13-4741555a1a9f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.493493 Apr 30 21:15:04.987035 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 757/1430] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:04.992599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:04.994041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:05.020734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:05.021416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:05.022189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:05.023263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:05.024682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:05.035979 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b37d854-bb41-4a42-8d2c-3c1242c7daa4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1468 microversion: 2.1 time: 0.483580 Apr 30 21:15:05.045165 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 674/1431] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:04 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1468 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:05.051864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:05.057399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:05.062548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:05.063011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:05.063813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:05.064257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:05.264457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:05.284055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-94f7208f-d0f6-484e-b02f-f5ac37365f0d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.295592 Apr 30 21:15:05.284660 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 758/1432] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:04 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:05.290482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a9bbd267-ca24-4d87-8e63-16ebaa3ed04a req-80691b46-5bc2-4588-92ce-287aa7df4dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ea70e2-1dba-4ea9-97f7-31174159dca1", "name": "network-vif-plugged", "status": "completed", "tag": "062557a1-62cc-425d-97a6-043e7cd89a22"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:05.300725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a9bbd267-ca24-4d87-8e63-16ebaa3ed04a req-80691b46-5bc2-4588-92ce-287aa7df4dd2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:05.301522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a9bbd267-ca24-4d87-8e63-16ebaa3ed04a req-80691b46-5bc2-4588-92ce-287aa7df4dd2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:05.321817 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a9bbd267-ca24-4d87-8e63-16ebaa3ed04a req-80691b46-5bc2-4588-92ce-287aa7df4dd2 service nova] Creating event network-vif-plugged:062557a1-62cc-425d-97a6-043e7cd89a22 for instance b8ea70e2-1dba-4ea9-97f7-31174159dca1 on nch2-master-1 Apr 30 21:15:05.329111 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a9bbd267-ca24-4d87-8e63-16ebaa3ed04a req-80691b46-5bc2-4588-92ce-287aa7df4dd2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043032 Apr 30 21:15:05.330118 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 759/1433] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:05.344093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:05.352600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-76f645c3-0e21-4c35-b6ab-4b03d15cff3b tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc261fb700>, body: {"security_group_rule": {"parent_group_id": "f59e524f-6c0d-4d38-8d0b-da4058aa72b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:05.359767 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-03aa33d1-1a18-4535-a180-f635369e88ae tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.313390 Apr 30 21:15:05.372990 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 675/1434] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:05 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:05.381097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-535cb11c-a350-406b-a987-e06fda03cdeb tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-248853971"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:05.382835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-535cb11c-a350-406b-a987-e06fda03cdeb tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:05.393272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-535cb11c-a350-406b-a987-e06fda03cdeb tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:05.394315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-535cb11c-a350-406b-a987-e06fda03cdeb tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:05.395554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-535cb11c-a350-406b-a987-e06fda03cdeb tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:05.396883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-535cb11c-a350-406b-a987-e06fda03cdeb tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:06.061943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-76f645c3-0e21-4c35-b6ab-4b03d15cff3b tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.724551 Apr 30 21:15:06.063087 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 760/1435] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:06.068779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:06.069801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:06.076381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:06.077050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:06.078075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:06.078584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:06.146495 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-535cb11c-a350-406b-a987-e06fda03cdeb tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "POST /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509/action" status: 202 len: 0 microversion: 2.1 time: 0.771046 Apr 30 21:15:06.152027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 676/1436] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:15:05 2022] POST /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:15:06.159299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ac4af24-8100-44ce-8375-7a2b291d3e36 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc2074e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1471080556", "description": "tempest-description-2133766266"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:06.239126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:06.250121 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d5730a4-df6a-4cbb-9e0a-b93e3aedc00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.185547 Apr 30 21:15:06.250882 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 761/1437] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:06 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:06.256407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1da94eba-0e1d-4fd9-8a02-de496c6a15b1 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2629e3a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:06.328267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1da94eba-0e1d-4fd9-8a02-de496c6a15b1 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1454 microversion: 2.1 time: 0.076186 Apr 30 21:15:06.334592 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 762/1438] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:06 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:06.339419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:06.340213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:06.346780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:06.347227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:06.350561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:06.350561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:06.535786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:06.549490 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d5b3a41-0dfc-4009-8f32-11008d787c7c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.213529 Apr 30 21:15:06.576607 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 763/1439] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:06 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:06.584883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:06.585788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:06.594559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:06.595296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:06.598064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:06.600193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:06.682401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ac4af24-8100-44ce-8375-7a2b291d3e36 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.527121 Apr 30 21:15:06.687462 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 677/1440] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:06 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:06.698079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-80a94d3c-537f-4024-8885-c40eafc77486 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc207945e0>, body: {"security_group_rule": {"parent_group_id": "e16e1d7b-31e4-43e0-9192-4ff3f9bbc508", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:06.789164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:06.797674 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ff3726e-10d6-4014-b3ea-928ecb536916 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1318 microversion: 2.1 time: 0.219646 Apr 30 21:15:06.798473 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 764/1441] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:06 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:07.202565 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-80a94d3c-537f-4024-8885-c40eafc77486 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.510944 Apr 30 21:15:07.203169 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 678/1442] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:06 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:15:07.214965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-83f1bcc4-a572-4234-98b9-129b7be50c50 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc262888b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1456510677", "description": "tempest-description-752880417"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:07.276490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:07.277406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:07.285851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:07.286929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:07.287755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:07.288185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:07.491744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:07.499289 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88532e85-461a-4145-af1f-f853db01822a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.227413 Apr 30 21:15:07.499851 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 679/1443] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:07 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:07.504483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2e4372c-4496-4105-84ea-763871336eb6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2072c280>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:07.549977 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2e4372c-4496-4105-84ea-763871336eb6 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1454 microversion: 2.1 time: 0.048724 Apr 30 21:15:07.556353 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 680/1444] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:07 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:07.556353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ebf24d30-598d-4f24-89f3-accd28668941 req-df9372fe-836c-4eda-bf75-e96617f3a7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c37ba-07cd-47b9-9a7b-17d799280bbb", "name": "network-vif-unplugged", "status": "completed", "tag": "0148cfe2-db7e-4096-b624-dd079aece8ea"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:07.563626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ebf24d30-598d-4f24-89f3-accd28668941 req-df9372fe-836c-4eda-bf75-e96617f3a7d6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:07.564087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ebf24d30-598d-4f24-89f3-accd28668941 req-df9372fe-836c-4eda-bf75-e96617f3a7d6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:07.575703 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ebf24d30-598d-4f24-89f3-accd28668941 req-df9372fe-836c-4eda-bf75-e96617f3a7d6 service nova] Creating event network-vif-unplugged:0148cfe2-db7e-4096-b624-dd079aece8ea for instance f17c37ba-07cd-47b9-9a7b-17d799280bbb on nch1-master-1 Apr 30 21:15:07.593239 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ebf24d30-598d-4f24-89f3-accd28668941 req-df9372fe-836c-4eda-bf75-e96617f3a7d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040165 Apr 30 21:15:07.595410 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 681/1445] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:07.604489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:07.605596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:07.615350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:07.616774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:07.618155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:07.618809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:07.714687 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-83f1bcc4-a572-4234-98b9-129b7be50c50 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.503585 Apr 30 21:15:07.715686 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 765/1446] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:07.726746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f2cb85f-0d87-4a5a-826a-c828f0b51263 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc26288e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-323564123", "description": "tempest-description-1298335943"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:07.786245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:07.794707 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-06f69946-e112-4c5d-b93f-ab14973a7071 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.197813 Apr 30 21:15:07.804881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 682/1447] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:07 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:07.815992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:07.816873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:07.823796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:07.830604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:07.830604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:07.830604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.027593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:08.035305 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-05291d16-eac4-40ea-9873-973747775753 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1468 microversion: 2.1 time: 0.223221 Apr 30 21:15:08.035881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 683/1448] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:07 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:08.165319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-471864612", "block_migration": true, "disk_over_commit": false}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:08.166741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:08.174823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.175295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.176097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.176603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.206124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lazy-loading 'flavor' on Instance uuid b8ea70e2-1dba-4ea9-97f7-31174159dca1 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:08.218073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Going to try to live migrate instance to tempest-host-471864612 {{(pid=130670) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:15:08.225152 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] HTTP exception thrown: Compute host tempest-host-471864612 could not be found. Apr 30 21:15:08.225787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Returning 400 to user: Compute host tempest-host-471864612 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:08.226628 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd33b718-26c2-4a10-9679-8171c67335aa tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1/action" status: 400 len: 99 microversion: 2.1 time: 0.177603 Apr 30 21:15:08.227189 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 684/1449] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Apr 30 21:15:08 2022] POST /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1/action => generated 99 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Apr 30 21:15:08.234937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:08.235553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:08.242352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.242817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.243606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.244053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.283361 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7f2cb85f-0d87-4a5a-826a-c828f0b51263 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.560611 Apr 30 21:15:08.285800 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 766/1450] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:15:08.295378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70811102-a401-40b0-942d-1ae27f27247b tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc26190790>, body: {"security_group_rule": {"parent_group_id": "81f92723-5729-4d8f-9a4c-a0457a4f1b5d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2ccc6199-3930-4a6b-b9cb-e8ae65f70901"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:08.452909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:08.465788 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aeb8865a-4328-4383-8cee-d94c69f0ad42 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1468 microversion: 2.1 time: 0.230501 Apr 30 21:15:08.465788 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 685/1451] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:08 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1468 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:08.516457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:08.517134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:08.525925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.526601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.527388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.529726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.739729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:08.753297 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-08434ed6-4940-4e57-8e24-6f7873d89ca8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.239134 Apr 30 21:15:08.753297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 686/1452] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:08 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:08.759315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-08dd047e-00ce-4df1-8d23-15eb922a5323 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2074d8b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:08.818032 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-08dd047e-00ce-4df1-8d23-15eb922a5323 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1454 microversion: 2.1 time: 0.062876 Apr 30 21:15:08.822107 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 687/1453] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:08 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:08.827149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1222418337", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:08.882158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:15:08.975430 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70811102-a401-40b0-942d-1ae27f27247b tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.683852 Apr 30 21:15:08.977428 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 767/1454] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:08 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:15:08.982713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:08.983618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:08.991646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.992228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:08.993635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:08.994376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:09.166057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:15:09.166939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:15:09.168312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:15:09.168933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:15:09.169745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:15:09.184488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:09.185266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:09.186572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:09.187188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:09.188091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:09.201317 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ebb19a79-bc29-4191-8b95-a9ba224ea62b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.222074 Apr 30 21:15:09.202022 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 768/1455] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:08 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:09.207647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c6e3e0d5-fb8d-4d59-94b6-851d2af7f634 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc26288f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1283073082", "description": "tempest-description-334977876"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:09.218203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Getting quotas for project 1a2d262c5cf4435aa19253f70823433f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:15:09.223079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Getting quotas for user d57b97f51d2f4aa6869b41518f14d3aa and project 1a2d262c5cf4435aa19253f70823433f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:15:09.235925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:15:09.238372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:15:09.369875 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f87ed48a-20e3-42a3-ab68-f6db8c0ecd2a tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546014 Apr 30 21:15:09.375818 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 688/1456] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:15:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:15:09.385850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9d523830-5d40-4b34-bdd4-77f676c0f125 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:09.387141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9d523830-5d40-4b34-bdd4-77f676c0f125 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:09.474779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d523830-5d40-4b34-bdd4-77f676c0f125 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:09.493878 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9d523830-5d40-4b34-bdd4-77f676c0f125 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1219 microversion: 2.1 time: 0.114023 Apr 30 21:15:09.497412 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 689/1457] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:09 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:09.630108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4a26db66-732a-4f31-8683-067aeb76c08b req-c4d2967c-0b91-4d2d-a860-35eb1470267c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3279965-3245-4077-96e6-ecaf57d00b9b", "name": "network-vif-plugged", "status": "completed", "tag": "3d880b11-1cc5-4a9c-90d6-9a894959be26"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:09.650021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4a26db66-732a-4f31-8683-067aeb76c08b req-c4d2967c-0b91-4d2d-a860-35eb1470267c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:09.650778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4a26db66-732a-4f31-8683-067aeb76c08b req-c4d2967c-0b91-4d2d-a860-35eb1470267c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:09.666228 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4a26db66-732a-4f31-8683-067aeb76c08b req-c4d2967c-0b91-4d2d-a860-35eb1470267c service nova] Creating event network-vif-plugged:3d880b11-1cc5-4a9c-90d6-9a894959be26 for instance f3279965-3245-4077-96e6-ecaf57d00b9b on nch2-master-1 Apr 30 21:15:09.671381 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4a26db66-732a-4f31-8683-067aeb76c08b req-c4d2967c-0b91-4d2d-a860-35eb1470267c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045897 Apr 30 21:15:09.672841 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 690/1458] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:09.773512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:09.774915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:09.792172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:09.794569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:09.798517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:09.799653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:09.844693 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c6e3e0d5-fb8d-4d59-94b6-851d2af7f634 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.641536 Apr 30 21:15:09.846178 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 769/1459] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:09.854494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aa6a954f-8f11-4194-8587-f1bf39702e14 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc262aa790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:09.949591 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aa6a954f-8f11-4194-8587-f1bf39702e14 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1454 microversion: 2.1 time: 0.083101 Apr 30 21:15:09.949591 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 770/1460] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:09 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:09.949591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3a881c00-8266-4216-969b-2eb801b67526 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc26288550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-905927650", "description": "tempest-description-34134145"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:10.143948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:10.175298 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c7a98aa7-1f7c-455f-a5a2-c217d266bdd2 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.406118 Apr 30 21:15:10.182482 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 691/1461] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:09 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:10.220634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:10.226709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:10.230509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:10.231042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:10.231897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:10.233009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:10.408913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:10.416893 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3a881c00-8266-4216-969b-2eb801b67526 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.478603 Apr 30 21:15:10.417279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b2ffb24-0989-46f4-8506-550e0c23d059 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1325 microversion: 2.1 time: 0.200878 Apr 30 21:15:10.423498 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 771/1462] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:09 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:10.423787 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 692/1463] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:10 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1325 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:10.428283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-50cb56a3-0c54-43fb-8a98-bb070b4b24b9 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc26210a60>, body: {"security_group_rule": {"parent_group_id": "0e38b424-0722-41aa-85e3-8d0407085f0d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "997fcbaf-ad8a-466a-8fcc-8601eacbb0ef"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:10.536092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:10.536985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:10.545385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:10.548125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:10.548858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:10.551260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:10.652946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:10.660503 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c797f76d-5ce4-45c4-a303-a173eade818f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1223 microversion: 2.1 time: 0.128886 Apr 30 21:15:10.661140 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 693/1464] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:10 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:10.946199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14567482-dc1e-4c09-a98c-db62899ed7ef tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20746dc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:11.003063 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14567482-dc1e-4c09-a98c-db62899ed7ef tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1454 microversion: 2.1 time: 0.062066 Apr 30 21:15:11.004096 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 694/1465] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:10 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:11.040648 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-50cb56a3-0c54-43fb-8a98-bb070b4b24b9 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.616130 Apr 30 21:15:11.041949 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 772/1466] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:11.057684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c8b119dd-5ce8-454b-aad8-d971d00eb395 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc2074ddc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:11.201081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:11.203815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:11.223560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.224346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.225432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.225975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.455378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:11.466603 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd20839c-ab48-41a5-8354-87ea9793af31 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.272732 Apr 30 21:15:11.469303 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 773/1467] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:11 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:11.477853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:11.478867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:11.487528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.488456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.500021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.521543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.537582 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c8b119dd-5ce8-454b-aad8-d971d00eb395 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/997fcbaf-ad8a-466a-8fcc-8601eacbb0ef" status: 202 len: 0 microversion: 2.1 time: 0.484026 Apr 30 21:15:11.538586 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 695/1468] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:11 2022] DELETE /compute/v2.1/os-security-groups/997fcbaf-ad8a-466a-8fcc-8601eacbb0ef => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:11.546833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dca89b2e-bc12-47bf-bf07-f19e0a73bf25 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc206f0d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:11.666987 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dca89b2e-bc12-47bf-bf07-f19e0a73bf25 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/0e38b424-0722-41aa-85e3-8d0407085f0d" status: 200 len: 247 microversion: 2.1 time: 0.123436 Apr 30 21:15:11.668589 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 696/1469] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:15:11 2022] GET /compute/v2.1/os-security-groups/0e38b424-0722-41aa-85e3-8d0407085f0d => generated 247 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:11.687859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:11.688605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:11.701705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.702936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.704550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.705014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.811883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:11.820915 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc7b3fa1-b19b-4aa3-bfda-51de8f3395bc tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1522 microversion: 2.1 time: 0.348933 Apr 30 21:15:11.821156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:11.822153 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 774/1470] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:11 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:11.828716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92ccaf99-5fae-4d5b-89f2-7b8b32c9e1f4 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc262675e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2098229423", "description": "tempest-description-924384236"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:11.830635 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8317927f-4d43-414f-9209-15c03a5a29df tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1271 microversion: 2.1 time: 0.147169 Apr 30 21:15:11.831566 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 697/1471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:11 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:11.854756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-70c3c60e-09f8-45ba-a6bc-8cd3164ce647 req-f351a9f8-6ee2-4d00-a706-302fbdfcf3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ac748-1dff-4324-8ad2-b5c50606e509", "name": "network-vif-plugged", "status": "completed", "tag": "45386324-e00d-4309-b5b4-97378c6cd56e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:11.870535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-70c3c60e-09f8-45ba-a6bc-8cd3164ce647 req-f351a9f8-6ee2-4d00-a706-302fbdfcf3cf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.871189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-70c3c60e-09f8-45ba-a6bc-8cd3164ce647 req-f351a9f8-6ee2-4d00-a706-302fbdfcf3cf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.898257 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-70c3c60e-09f8-45ba-a6bc-8cd3164ce647 req-f351a9f8-6ee2-4d00-a706-302fbdfcf3cf service nova] Creating event network-vif-plugged:45386324-e00d-4309-b5b4-97378c6cd56e for instance 5f8ac748-1dff-4324-8ad2-b5c50606e509 on nch1-master-1 Apr 30 21:15:11.911528 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-70c3c60e-09f8-45ba-a6bc-8cd3164ce647 req-f351a9f8-6ee2-4d00-a706-302fbdfcf3cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077580 Apr 30 21:15:11.913418 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 698/1472] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:11.927579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:11.928346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:11.938294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.938818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:11.939622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:11.940240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:12.433410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:12.446433 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7dadbe35-fea5-4f05-a434-76736d5fc347 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1522 microversion: 2.1 time: 0.529305 Apr 30 21:15:12.453979 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 699/1473] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:11 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:12.457062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-478add94-9708-49f9-afdf-2b46d5ad4951 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20708e50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:12.568318 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-478add94-9708-49f9-afdf-2b46d5ad4951 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1454 microversion: 2.1 time: 0.119637 Apr 30 21:15:12.575473 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 700/1474] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:12 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:12.589195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b1e01ee-14c1-4f79-ac60-214d3258ecad tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-828723886"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:12.590681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b1e01ee-14c1-4f79-ac60-214d3258ecad tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:12.601147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b1e01ee-14c1-4f79-ac60-214d3258ecad tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:12.603311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b1e01ee-14c1-4f79-ac60-214d3258ecad tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:12.606282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b1e01ee-14c1-4f79-ac60-214d3258ecad tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:12.607326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b1e01ee-14c1-4f79-ac60-214d3258ecad tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:12.763650 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92ccaf99-5fae-4d5b-89f2-7b8b32c9e1f4 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.940209 Apr 30 21:15:12.764286 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 775/1475] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:11 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:12.774413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:12.775284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:12.788722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:12.792719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:12.792719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:12.794912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:13.080629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:13.089299 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-797ee721-b84f-4fb9-b9dc-6c89fff2657d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.323327 Apr 30 21:15:13.090411 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 776/1476] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:12 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:13.109634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-171cd5c5-c9b4-4640-a520-bed1da1bb6c7 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc26226ee0>, body: {"security_group_rule": {"parent_group_id": "595bc950-aadf-4f27-8cf1-06d062ddf05c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:13.333279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b1e01ee-14c1-4f79-ac60-214d3258ecad tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b/action" status: 202 len: 0 microversion: 2.1 time: 0.746850 Apr 30 21:15:13.340599 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 701/1477] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:15:12 2022] POST /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:15:13.355068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:13.355992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:13.373326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:13.373812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:13.378281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:13.378281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:13.514647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:13.524304 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3831d172-27b0-4a8c-8f01-0825494e463b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1277 microversion: 2.1 time: 0.185651 Apr 30 21:15:13.525575 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 702/1478] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:13 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:13.532629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fd2b5ce-f15e-46ef-9879-65466d42fea9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '.version_select at 0x7fdc207949d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:13.945276 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-171cd5c5-c9b4-4640-a520-bed1da1bb6c7 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.853343 Apr 30 21:15:13.955141 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 777/1479] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:13.969887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ff30850-a382-4c47-a373-06992b26b13a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26267dc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:14.139879 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fd2b5ce-f15e-46ef-9879-65466d42fea9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/images/621e05ca-8db8-4e18-911a-5229b9344547" status: 204 len: 0 microversion: 2.1 time: 0.613702 Apr 30 21:15:14.141650 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 703/1480] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:13 2022] DELETE /compute/v2.1/images/621e05ca-8db8-4e18-911a-5229b9344547 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:15:14.150596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0cca3970-c3bc-442e-8670-79c16d324c6f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Action: 'create', calling method: .version_select at 0x7fdc2074e8b0>, body: {"security_group_rule": {"parent_group_id": "595bc950-aadf-4f27-8cf1-06d062ddf05c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:14.228509 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ff30850-a382-4c47-a373-06992b26b13a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1454 microversion: 2.1 time: 0.271415 Apr 30 21:15:14.235691 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 778/1481] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:13 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1454 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:14.247659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:14.254390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:14.271892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:14.272411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:14.290971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:14.297928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:14.703234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:14.712693 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7431eb9c-e40d-4fd9-8f4b-1d7a2afebfc1 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.475604 Apr 30 21:15:14.714665 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 779/1482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:14 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:14.731764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-57b6f3b2-caaa-431c-bc2e-67d4c301e390 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '.version_select at 0x7fdc26288e50>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:14.871133 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-57b6f3b2-caaa-431c-bc2e-67d4c301e390 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Image not found. Apr 30 21:15:14.873675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-57b6f3b2-caaa-431c-bc2e-67d4c301e390 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:14.878718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-57b6f3b2-caaa-431c-bc2e-67d4c301e390 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/images/621e05ca-8db8-4e18-911a-5229b9344547" status: 404 len: 62 microversion: 2.1 time: 0.158816 Apr 30 21:15:14.878718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 780/1483] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:14 2022] GET /compute/v2.1/images/621e05ca-8db8-4e18-911a-5229b9344547 => generated 62 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:15:14.889315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:14.892388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:14.914285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:14.917696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:14.919485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:14.922556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:15.299865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:15.310073 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2eb8db6e-e5d6-4fe3-81d1-58c9f9e6955d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1319 microversion: 2.1 time: 0.433244 Apr 30 21:15:15.310657 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 781/1484] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:14 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:15.320054 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0cca3970-c3bc-442e-8670-79c16d324c6f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.176480 Apr 30 21:15:15.322834 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 704/1485] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:14 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:15.334465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fae94590-4531-4ad5-bfbe-a51b508fae15 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc206a98b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:15.353553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:15.365317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:15.385099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:15.390721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:15.390721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:15.390721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:15.763616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:15.775437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b90591f4-6a24-4c74-88bc-49badc9f974d tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1540 microversion: 2.1 time: 0.434891 Apr 30 21:15:15.776602 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 782/1486] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:15 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1540 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:15.790168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1ec335eb-1f77-41e8-a36f-99ba10d6cabd tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc2629e280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:15.921513 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1ec335eb-1f77-41e8-a36f-99ba10d6cabd tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/595bc950-aadf-4f27-8cf1-06d062ddf05c" status: 200 len: 664 microversion: 2.1 time: 0.143540 Apr 30 21:15:15.922435 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 783/1487] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:15:15 2022] GET /compute/v2.1/os-security-groups/595bc950-aadf-4f27-8cf1-06d062ddf05c => generated 664 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:15.941488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:15.943972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:15.954392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:15.955786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:15.956786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:15.957392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:16.277133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:16.294481 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f3f0067-a9bb-459d-b85e-c5192d9a614c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.370712 Apr 30 21:15:16.298586 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 784/1488] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:15 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:16.309398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9ea5ccb-8b70-46c6-90b6-a06194a66386 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc262aaaf0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:16.724244 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9ea5ccb-8b70-46c6-90b6-a06194a66386 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/0b15860c-2b08-47fb-9010-7fa75343cdb1" status: 202 len: 0 microversion: 2.1 time: 0.423724 Apr 30 21:15:16.729313 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 785/1489] 10.222.0.23 () {58 vars in 1286 bytes} [Sat Apr 30 21:15:16 2022] DELETE /compute/v2.1/os-security-group-rules/0b15860c-2b08-47fb-9010-7fa75343cdb1 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:16.730773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:16.731398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:16.744515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:16.744906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:16.745724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:16.750013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:17.183275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:17.204939 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-015053ee-a510-42f7-9b23-01878e3b5184 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1319 microversion: 2.1 time: 0.472890 Apr 30 21:15:17.204939 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 786/1490] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:16 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:17.220243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8b7d42e4-6e92-4a97-af78-93e1585abb6a req-6a67c7a7-109c-41be-84dd-f9ef96bbc4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "219f9425-7fbc-424f-8c16-8db2a0f02edb", "tag": "58a25f77-e029-49da-8d04-dc69125045ee"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:17.231200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8b7d42e4-6e92-4a97-af78-93e1585abb6a req-6a67c7a7-109c-41be-84dd-f9ef96bbc4f7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:17.231907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8b7d42e4-6e92-4a97-af78-93e1585abb6a req-6a67c7a7-109c-41be-84dd-f9ef96bbc4f7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:17.254206 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8b7d42e4-6e92-4a97-af78-93e1585abb6a req-6a67c7a7-109c-41be-84dd-f9ef96bbc4f7 service nova] Creating event network-changed:58a25f77-e029-49da-8d04-dc69125045ee for instance 219f9425-7fbc-424f-8c16-8db2a0f02edb on nch1-master-1 Apr 30 21:15:17.300007 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8b7d42e4-6e92-4a97-af78-93e1585abb6a req-6a67c7a7-109c-41be-84dd-f9ef96bbc4f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089854 Apr 30 21:15:17.300630 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 787/1491] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:17.310037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e07614b8-84f5-48dd-855a-58e69a42ad3c tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc2629e280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:17.934894 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e07614b8-84f5-48dd-855a-58e69a42ad3c tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/595bc950-aadf-4f27-8cf1-06d062ddf05c" status: 202 len: 0 microversion: 2.1 time: 0.632974 Apr 30 21:15:17.935687 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 788/1492] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:17 2022] DELETE /compute/v2.1/os-security-groups/595bc950-aadf-4f27-8cf1-06d062ddf05c => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:17.941532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:17.942729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:17.954297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:17.954297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:17.954716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:17.955354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:18.168383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:18.178106 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e366f8bc-42a1-42a3-b1fb-60a8a8c3f847 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1535 microversion: 2.1 time: 0.240326 Apr 30 21:15:18.179059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 789/1493] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:17 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1535 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:18.200584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:18.200584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:18.205732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:18.206569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:18.207541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:18.208677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:18.451387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:18.462530 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cac242f-dad0-4a30-981d-2f2b82d2004c tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.272321 Apr 30 21:15:18.474190 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 790/1494] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:18 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:18.481742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e94d31ed-6ec9-4435-b2a0-2efdfb9e3a5f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc2629e280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:18.506914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-e94d31ed-6ec9-4435-b2a0-2efdfb9e3a5f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 997fcbaf-ad8a-466a-8fcc-8601eacbb0ef does not exist", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:15:18.507547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-e94d31ed-6ec9-4435-b2a0-2efdfb9e3a5f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Neutron security group 997fcbaf-ad8a-466a-8fcc-8601eacbb0ef not found {{(pid=130671) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:15:18.508273 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e94d31ed-6ec9-4435-b2a0-2efdfb9e3a5f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] HTTP exception thrown: Security group 997fcbaf-ad8a-466a-8fcc-8601eacbb0ef does not exist Apr 30 21:15:18.508273 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-10900b45-90de-4de0-b3db-2c59de8bd937'] Apr 30 21:15:18.509026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e94d31ed-6ec9-4435-b2a0-2efdfb9e3a5f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Returning 404 to user: Security group 997fcbaf-ad8a-466a-8fcc-8601eacbb0ef does not exist Apr 30 21:15:18.509026 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-10900b45-90de-4de0-b3db-2c59de8bd937'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:18.510014 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e94d31ed-6ec9-4435-b2a0-2efdfb9e3a5f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/997fcbaf-ad8a-466a-8fcc-8601eacbb0ef" status: 404 len: 194 microversion: 2.1 time: 0.034438 Apr 30 21:15:18.513848 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 791/1495] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:18 2022] DELETE /compute/v2.1/os-security-groups/997fcbaf-ad8a-466a-8fcc-8601eacbb0ef => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:18.519901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:18.521075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:18.529984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:18.530454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:18.531275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:18.531766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:18.781702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:18.790355 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cd6301f6-bd41-4d33-9afb-6acac5615c63 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1319 microversion: 2.1 time: 0.275361 Apr 30 21:15:18.791129 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 792/1496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:18 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:18.804541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b160cf65-726a-46c5-bf40-60fa836c14fe tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc204e0b80>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:19.173113 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b160cf65-726a-46c5-bf40-60fa836c14fe tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0e38b424-0722-41aa-85e3-8d0407085f0d" status: 202 len: 0 microversion: 2.1 time: 0.381081 Apr 30 21:15:19.177389 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 793/1497] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:18 2022] DELETE /compute/v2.1/os-security-groups/0e38b424-0722-41aa-85e3-8d0407085f0d => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:19.184472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4f866cd4-7083-4814-ac70-5f90dde7de30 req-e5fbb527-1edc-42e7-ae27-dc44d79412cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3279965-3245-4077-96e6-ecaf57d00b9b", "name": "network-vif-plugged", "status": "completed", "tag": "3d880b11-1cc5-4a9c-90d6-9a894959be26"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:19.204960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4f866cd4-7083-4814-ac70-5f90dde7de30 req-e5fbb527-1edc-42e7-ae27-dc44d79412cf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:19.205406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4f866cd4-7083-4814-ac70-5f90dde7de30 req-e5fbb527-1edc-42e7-ae27-dc44d79412cf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:19.234608 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4f866cd4-7083-4814-ac70-5f90dde7de30 req-e5fbb527-1edc-42e7-ae27-dc44d79412cf service nova] Creating event network-vif-plugged:3d880b11-1cc5-4a9c-90d6-9a894959be26 for instance f3279965-3245-4077-96e6-ecaf57d00b9b on nch2-master-1 Apr 30 21:15:19.250572 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4f866cd4-7083-4814-ac70-5f90dde7de30 req-e5fbb527-1edc-42e7-ae27-dc44d79412cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075232 Apr 30 21:15:19.252075 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 794/1498] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:19.267189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67a2d56a-b15c-4677-889d-708453d69842 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc262889d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:19.961577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67a2d56a-b15c-4677-889d-708453d69842 tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/2ccc6199-3930-4a6b-b9cb-e8ae65f70901" status: 202 len: 0 microversion: 2.1 time: 0.706618 Apr 30 21:15:19.962985 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 795/1499] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:19 2022] DELETE /compute/v2.1/os-security-groups/2ccc6199-3930-4a6b-b9cb-e8ae65f70901 => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:19.968680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:19.970531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:19.989036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:19.994421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:19.995448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:19.996065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:20.304797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:20.315738 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-07376dfa-540f-44d3-8124-37565fcd496c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1535 microversion: 2.1 time: 0.350740 Apr 30 21:15:20.318225 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 796/1500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:19 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1535 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:20.329550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:20.337354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:20.348849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:20.349668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:20.350756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:20.351410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:20.611569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:20.620387 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b4a3fcb-8a1d-46eb-9e52-77351683f751 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.300653 Apr 30 21:15:20.625256 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 797/1501] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:20 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:20.633957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:20.633957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:20.637880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:20.638434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:20.639347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:20.639999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:20.947880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:20.959782 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b27e822b-ac79-4a63-9024-7eaff69581da tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1319 microversion: 2.1 time: 0.333365 Apr 30 21:15:20.968760 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 798/1502] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:20 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:20.969677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fea1d0e3-7135-4da9-9c3d-c933c47d709f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc21010ee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:21.509798 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fea1d0e3-7135-4da9-9c3d-c933c47d709f tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/81f92723-5729-4d8f-9a4c-a0457a4f1b5d" status: 202 len: 0 microversion: 2.1 time: 0.547942 Apr 30 21:15:21.511243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 799/1503] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:20 2022] DELETE /compute/v2.1/os-security-groups/81f92723-5729-4d8f-9a4c-a0457a4f1b5d => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:21.517736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:21.524302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:21.540366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:21.541878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:21.542974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:21.546033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:21.758791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:21.772039 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-46050ac0-c485-4dcd-b6da-a7ddb0bcd597 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1535 microversion: 2.1 time: 0.256649 Apr 30 21:15:21.772914 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 800/1504] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:21 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1535 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:21.778221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53302769-117c-4b1c-b864-42118853ed0a tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc22f07790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:22.111663 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53302769-117c-4b1c-b864-42118853ed0a tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e16e1d7b-31e4-43e0-9192-4ff3f9bbc508" status: 202 len: 0 microversion: 2.1 time: 0.337266 Apr 30 21:15:22.115606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 801/1505] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:21 2022] DELETE /compute/v2.1/os-security-groups/e16e1d7b-31e4-43e0-9192-4ff3f9bbc508 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:22.121012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:22.122314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:22.135220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:22.136114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:22.139664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:22.140323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:22.406313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:22.418626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc193ba4-a0e5-4306-9b7b-db809b712e2f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.300535 Apr 30 21:15:22.420867 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 802/1506] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:22 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:22.427850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:22.438123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:22.450560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:22.452608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:22.453830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:22.456326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:22.722542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:22.732585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9937ec6c-931e-465b-a72b-4dbfac11a662 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1319 microversion: 2.1 time: 0.309308 Apr 30 21:15:22.734626 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 803/1507] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:22 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:22.740560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-09158274-d53b-4f0f-8117-d9b175f947ab tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] Calling method '.version_select at 0x7fdc26190c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:23.215925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-09158274-d53b-4f0f-8117-d9b175f947ab tempest-SecurityGroupRulesTestJSON-1345165706 tempest-SecurityGroupRulesTestJSON-1345165706-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f59e524f-6c0d-4d38-8d0b-da4058aa72b6" status: 202 len: 0 microversion: 2.1 time: 0.479826 Apr 30 21:15:23.217361 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 804/1508] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:22 2022] DELETE /compute/v2.1/os-security-groups/f59e524f-6c0d-4d38-8d0b-da4058aa72b6 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:23.224738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:23.225486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:23.255735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:23.258377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:23.263416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:23.265398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:23.548614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:23.583673 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4e6a0cf-8e2c-4da2-a25e-913a6a1be6e3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1535 microversion: 2.1 time: 0.365049 Apr 30 21:15:23.597247 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 805/1509] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:23 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1535 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:23.618589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2142964455", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "101af96d-46b7-4982-b0ed-3b0af2fa0ddf"}], "block_device_mapping_v2": [{"uuid": "632a7810-1a6f-420a-a6fd-57675408a8f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:23.740211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] validate_networks() for [('101af96d-46b7-4982-b0ed-3b0af2fa0ddf', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:15:24.418327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:15:24.418327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:15:24.418327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:15:24.418327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:15:24.418327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:15:24.424313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:24.424795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:24.426109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:24.426481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:24.455574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:15:24.460455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Getting quotas for user 8bd54cdc115e4ae9b202bd06c7658e4a and project 1a25f2505d5141c5b894bfd6515eb7f0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:15:24.564267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:15:24.573082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='632a7810-1a6f-420a-a6fd-57675408a8f7',volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:15:25.267969 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77b6d42a-57ce-4017-9ad9-b42033c8113a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653379 Apr 30 21:15:25.269525 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 806/1510] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:15:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:15:25.282496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:25.283407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:25.306709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:25.307441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:25.308527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:25.309082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:25.609669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:25.619335 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fb43a8d0-dc33-4799-a25f-afe780f29a85 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1476 microversion: 2.1 time: 0.348454 Apr 30 21:15:25.620486 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 807/1511] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:25 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:25.626305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:25.627228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:25.636954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:25.637650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:25.638637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:25.639324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:25.931502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:25.959640 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af498886-6352-4eeb-9f15-5c7d9ada4dc9 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1319 microversion: 2.1 time: 0.337550 Apr 30 21:15:25.963413 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 808/1512] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:25 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:25.973860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-dc29456f-c0f5-4620-9cd7-1d78992b4b43 req-b5ca7b40-c88f-4f13-8850-a51d1a005014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "219f9425-7fbc-424f-8c16-8db2a0f02edb", "name": "network-vif-plugged", "status": "completed", "tag": "58a25f77-e029-49da-8d04-dc69125045ee"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:25.991892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dc29456f-c0f5-4620-9cd7-1d78992b4b43 req-b5ca7b40-c88f-4f13-8850-a51d1a005014 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:25.995381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dc29456f-c0f5-4620-9cd7-1d78992b4b43 req-b5ca7b40-c88f-4f13-8850-a51d1a005014 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:26.024148 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-dc29456f-c0f5-4620-9cd7-1d78992b4b43 req-b5ca7b40-c88f-4f13-8850-a51d1a005014 service nova] Creating event network-vif-plugged:58a25f77-e029-49da-8d04-dc69125045ee for instance 219f9425-7fbc-424f-8c16-8db2a0f02edb on nch1-master-1 Apr 30 21:15:26.031120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-dc29456f-c0f5-4620-9cd7-1d78992b4b43 req-b5ca7b40-c88f-4f13-8850-a51d1a005014 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066295 Apr 30 21:15:26.038128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 809/1513] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:26.044494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:26.047067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:26.074203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:26.078327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:26.083999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:26.083999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:26.411599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:26.421645 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd2988f6-17b0-442c-a255-d14df275ac79 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1535 microversion: 2.1 time: 0.379791 Apr 30 21:15:26.429567 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 810/1514] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:26 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1535 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:26.434630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ebe879e5-e3d9-4778-b834-d8073abcae13 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:26.435257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ebe879e5-e3d9-4778-b834-d8073abcae13 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:26.492660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebe879e5-e3d9-4778-b834-d8073abcae13 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:26.499694 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ebe879e5-e3d9-4778-b834-d8073abcae13 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1053 microversion: 2.1 time: 0.069057 Apr 30 21:15:26.500339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 811/1515] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:26 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1053 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:26.512534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1817468736", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b894fca3-f633-42dd-93b5-bde3291d63a3"}], "block_device_mapping_v2": [{"uuid": "803f05ce-fab0-45aa-af84-09c627560405", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:26.594198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] validate_networks() for [('b894fca3-f633-42dd-93b5-bde3291d63a3', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:15:27.571726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:15:27.572862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:15:27.573517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:15:27.574114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:15:27.574813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:15:27.588023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:27.595477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:27.596831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:27.597487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:27.640396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:15:27.662650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Getting quotas for user dadac4f61fe141dba3ee726ca6cbf29a and project 77b426139c194813974502d1910c257f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:15:27.813219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:15:27.813219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='803f05ce-fab0-45aa-af84-09c627560405',volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:15:28.810585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.303701 Apr 30 21:15:28.812623 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 812/1516] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:15:28.823506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:28.823506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:28.829521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:28.830204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:28.831162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:28.831776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:29.018174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:29.027861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b1d6ae7-b449-4d2c-ab6a-208f3a2a4fbc tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1475 microversion: 2.1 time: 0.211811 Apr 30 21:15:29.027861 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 813/1517] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:28 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1475 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:29.032337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:29.032964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:29.048902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:29.049357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:29.050395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:29.051656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:29.391622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:29.449901 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-47741bce-da07-4ab7-b191-f54df69361f7 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1469 microversion: 2.1 time: 0.417625 Apr 30 21:15:29.452663 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 814/1518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:29 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1469 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:29.476841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:29.484256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:29.498481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:29.511660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:29.514969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:29.516171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.034323 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fae94590-4531-4ad5-bfbe-a51b508fae15 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1463 microversion: 2.1 time: 14.711496 Apr 30 21:15:30.042385 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 705/1519] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:15 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1463 bytes in 14713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:30.053935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:30.056594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:30.076505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.076963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.088866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.089349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.089740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:30.098809 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b0bd6143-2953-4bbd-8494-da77cec22bef tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1535 microversion: 2.1 time: 0.642847 Apr 30 21:15:30.102216 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 815/1520] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:29 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1535 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:30.109065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4be06fef-46b2-444c-9abe-2d3a6fd29e8b req-b6b06987-b267-4964-bf55-95fc96228e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "name": "network-vif-unplugged", "status": "completed", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:30.131174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4be06fef-46b2-444c-9abe-2d3a6fd29e8b req-b6b06987-b267-4964-bf55-95fc96228e04 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.132832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4be06fef-46b2-444c-9abe-2d3a6fd29e8b req-b6b06987-b267-4964-bf55-95fc96228e04 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.165577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4be06fef-46b2-444c-9abe-2d3a6fd29e8b req-b6b06987-b267-4964-bf55-95fc96228e04 service nova] Creating event network-vif-unplugged:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch1-master-1 Apr 30 21:15:30.185006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-4be06fef-46b2-444c-9abe-2d3a6fd29e8b req-b6b06987-b267-4964-bf55-95fc96228e04 service nova] Instance e8325361-70e7-47c5-bb69-2f9d2c45c328 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:15:30.211732 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4be06fef-46b2-444c-9abe-2d3a6fd29e8b req-b6b06987-b267-4964-bf55-95fc96228e04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107962 Apr 30 21:15:30.213041 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 816/1521] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:30.241280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:30.243180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:30.267329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.270313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.280128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.280128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.333885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:30.350688 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b63ff03-4994-44c4-940c-bef4576872c2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1169 microversion: 2.1 time: 0.310766 Apr 30 21:15:30.351284 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 706/1522] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:30 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1169 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:30.360287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:30.360287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:30.377750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.378278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.380483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.380958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.417089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lazy-loading 'flavor' on Instance uuid 219f9425-7fbc-424f-8c16-8db2a0f02edb {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:30.430631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:30.441168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:30.446348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:30.447756 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f075705-b42e-48d9-a3bc-e174e3a1eb75 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1185 microversion: 2.25 time: 0.233184 Apr 30 21:15:30.448779 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 817/1523] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:30 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1185 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:30.454621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff18cc45-831c-44e4-a356-0405450037d3 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26356a60>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:30.523403 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff18cc45-831c-44e4-a356-0405450037d3 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 200 len: 1463 microversion: 2.1 time: 0.071943 Apr 30 21:15:30.524587 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 818/1524] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:30 2022] GET /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 1463 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:30.531108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:30.532020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:30.549814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.555165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.557214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.558376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.708496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:30.727382 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22c0ae41-6b53-4118-aa53-b0d10eb0df9b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1475 microversion: 2.1 time: 0.198446 Apr 30 21:15:30.729203 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 819/1525] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:30 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:30.738043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:30.739591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:30.747558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.748451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.749700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.750183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.822280 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f94602f4-8cb9-4a11-be23-48818b569c32 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb/action" status: 202 len: 0 microversion: 2.1 time: 0.469669 Apr 30 21:15:30.823153 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 707/1526] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:15:30 2022] POST /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:30.838562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:30.839560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:30.864953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.865435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:30.866288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:30.866737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:31.173047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:31.185977 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-454b078d-9a4e-4d8f-862c-98471baef495 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1467 microversion: 2.1 time: 0.453184 Apr 30 21:15:31.186629 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 820/1527] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:30 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1467 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:31.249212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:31.257130 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-09c10997-0f86-4ffb-89a8-2bb3fb1e1d90 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1477 microversion: 2.1 time: 0.429540 Apr 30 21:15:31.257944 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 708/1528] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:30 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1477 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:31.262781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:31.263397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:31.269529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:31.270691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:31.271487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:31.272174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:31.308465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6db65927-fc25-4bfd-a9fc-7a5d8f653399 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Action: 'create', calling method: .version_select at 0x7fdc20540790>, body: {"keypair": {"name": "tempest-keypair-1558403537"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:31.323945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6db65927-fc25-4bfd-a9fc-7a5d8f653399 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Getting quotas for project 6309fd24cb2e4a5d8fde4f457d529d68. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:15:31.327809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6db65927-fc25-4bfd-a9fc-7a5d8f653399 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Getting quotas for user 8c1eeba696174da1be8aba8dcce6b112 and project 6309fd24cb2e4a5d8fde4f457d529d68. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:15:31.411831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:31.419238 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1df13fd1-e365-4236-998c-4590e3d4fcee tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1522 microversion: 2.1 time: 0.160332 Apr 30 21:15:31.428023 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 709/1529] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:31 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:31.487142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c0a8f723-2be2-4197-aed7-eecbd908e446 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc20746c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1398402537", "description": "tempest-description-1165078408"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:31.731363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6db65927-fc25-4bfd-a9fc-7a5d8f653399 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Getting quotas for project 6309fd24cb2e4a5d8fde4f457d529d68. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:15:31.735098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6db65927-fc25-4bfd-a9fc-7a5d8f653399 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Getting quotas for user 8c1eeba696174da1be8aba8dcce6b112 and project 6309fd24cb2e4a5d8fde4f457d529d68. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:15:31.748824 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6db65927-fc25-4bfd-a9fc-7a5d8f653399 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.560730 Apr 30 21:15:31.749465 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 821/1530] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:15:31 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:31.754462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-12ca69cd-79c7-430a-b6eb-c3fc2b09257a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1429142173"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:31.755670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-12ca69cd-79c7-430a-b6eb-c3fc2b09257a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:31.764408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12ca69cd-79c7-430a-b6eb-c3fc2b09257a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:31.764869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12ca69cd-79c7-430a-b6eb-c3fc2b09257a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:31.765662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12ca69cd-79c7-430a-b6eb-c3fc2b09257a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:31.766554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12ca69cd-79c7-430a-b6eb-c3fc2b09257a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:31.886479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c0a8f723-2be2-4197-aed7-eecbd908e446 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.465266 Apr 30 21:15:31.887297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 710/1531] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:31 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:31.892483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:31.893488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:31.900552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:31.901061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:31.902053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:31.902940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.102293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:32.110136 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a9df4f7-933d-4da9-af15-910b82a28f08 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1211 microversion: 2.1 time: 0.221591 Apr 30 21:15:32.110712 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 711/1532] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:31 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1211 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:32.115881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:32.116546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:32.122833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.123301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.124385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.124840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.161903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:15:32.370136 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-12ca69cd-79c7-430a-b6eb-c3fc2b09257a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "POST /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.619308 Apr 30 21:15:32.371441 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 822/1533] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:15:31 2022] POST /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:15:32.376902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:32.377687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:32.385942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.386646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.387445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.387897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.469668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:32.478531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:32.480204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:32.481577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6a25834b-8eb7-4d16-98bd-65848db7928d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1251 microversion: 2.25 time: 0.108812 Apr 30 21:15:32.482243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 823/1534] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:32 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1251 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:32.492227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:32.492227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:32.494633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.495141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.495932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.496377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.546785 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a618551-678b-44b6-8890-e4450f33789a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 204 len: 0 microversion: 2.1 time: 0.434782 Apr 30 21:15:32.547488 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 712/1535] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:15:32 2022] DELETE /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:15:32.556276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b9a4c3b5-47c3-4e2d-beb4-236b2d0120d7 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc206bcee0>, body: {"security_group_rule": {"parent_group_id": "d0b30ea8-7250-4641-9f75-8cbbb4964359", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:32.777172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:32.797551 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c9075d56-c7bd-4c9c-8009-763eecfef40f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1473 microversion: 2.1 time: 0.313830 Apr 30 21:15:32.798389 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 824/1536] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:32 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1473 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:32.815073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:32.815681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:32.823557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.824458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:32.825104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:32.825623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.170460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:33.181202 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f45fea99-9b15-4e72-8fb4-ed209427167f tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1477 microversion: 2.1 time: 0.370175 Apr 30 21:15:33.182087 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 825/1537] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:32 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1477 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:33.194038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e7274b2a-1b50-4379-81dc-b41e105742da req-7b027a13-635d-411f-adb3-018edda1e9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:33.199307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e7274b2a-1b50-4379-81dc-b41e105742da req-7b027a13-635d-411f-adb3-018edda1e9c6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.199947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e7274b2a-1b50-4379-81dc-b41e105742da req-7b027a13-635d-411f-adb3-018edda1e9c6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.214566 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e7274b2a-1b50-4379-81dc-b41e105742da req-7b027a13-635d-411f-adb3-018edda1e9c6 service nova] Creating event network-changed:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch1-master-1 Apr 30 21:15:33.220838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-e7274b2a-1b50-4379-81dc-b41e105742da req-7b027a13-635d-411f-adb3-018edda1e9c6 service nova] Instance e8325361-70e7-47c5-bb69-2f9d2c45c328 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:15:33.234433 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e7274b2a-1b50-4379-81dc-b41e105742da req-7b027a13-635d-411f-adb3-018edda1e9c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049972 Apr 30 21:15:33.236569 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 826/1538] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:33.241946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37e34ff2-7efb-4091-92c3-65f937b7eab9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc262fcdc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:33.298604 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37e34ff2-7efb-4091-92c3-65f937b7eab9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 0.060636 Apr 30 21:15:33.299625 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 827/1539] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:33 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:33.307176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:33.308402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:33.319757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.320474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.321666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.322567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.388738 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b9a4c3b5-47c3-4e2d-beb4-236b2d0120d7 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.836496 Apr 30 21:15:33.389982 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 713/1540] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:32 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:33.396317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:33.397211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:33.405412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.406072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.414329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.417022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.602936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:33.612702 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b180c963-1323-43ec-aa3c-d9107bdb0477 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1528 microversion: 2.1 time: 0.310724 Apr 30 21:15:33.623206 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 828/1541] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:33 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1528 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:33.629631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3cdcbca-4b0b-489a-8e6e-33edfc1d0653 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc261825e0>, body: {"security_group_rule": {"parent_group_id": "d0b30ea8-7250-4641-9f75-8cbbb4964359", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:33.686655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:33.699346 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c994f5a8-fd48-42ec-94ea-307df7f2c248 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.308069 Apr 30 21:15:33.712835 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 714/1542] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:33 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:33.718383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:33.719189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:33.725928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.726747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.727741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.728353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.766967 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e3cdcbca-4b0b-489a-8e6e-33edfc1d0653 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: This rule already exists in group d0b30ea8-7250-4641-9f75-8cbbb4964359 Apr 30 21:15:33.767957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3cdcbca-4b0b-489a-8e6e-33edfc1d0653 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 400 to user: This rule already exists in group d0b30ea8-7250-4641-9f75-8cbbb4964359 {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:33.768652 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e3cdcbca-4b0b-489a-8e6e-33edfc1d0653 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.144181 Apr 30 21:15:33.770391 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 829/1543] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:33 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:15:33.779583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-233fa6dc-aeb7-4b10-854f-cbd8bfc1c81c req-0f26f275-83a4-4267-aed7-f573877909bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ac748-1dff-4324-8ad2-b5c50606e509", "name": "network-vif-unplugged", "status": "completed", "tag": "45386324-e00d-4309-b5b4-97378c6cd56e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:33.785388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-233fa6dc-aeb7-4b10-854f-cbd8bfc1c81c req-0f26f275-83a4-4267-aed7-f573877909bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:33.785865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-233fa6dc-aeb7-4b10-854f-cbd8bfc1c81c req-0f26f275-83a4-4267-aed7-f573877909bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:33.806159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-233fa6dc-aeb7-4b10-854f-cbd8bfc1c81c req-0f26f275-83a4-4267-aed7-f573877909bf service nova] Creating event network-vif-unplugged:45386324-e00d-4309-b5b4-97378c6cd56e for instance 5f8ac748-1dff-4324-8ad2-b5c50606e509 on nch1-master-1 Apr 30 21:15:33.812702 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-233fa6dc-aeb7-4b10-854f-cbd8bfc1c81c req-0f26f275-83a4-4267-aed7-f573877909bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040956 Apr 30 21:15:33.813580 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 830/1544] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:33.819292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df07580f-cfe7-47c6-b06e-e60df6106e75 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Calling method '.version_select at 0x7fdc261fb160>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:34.122191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:34.137087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:34.140623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:34.142199 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b72068db-2164-4168-969d-c23d46d0880f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1293 microversion: 2.25 time: 0.427925 Apr 30 21:15:34.143184 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 715/1545] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:33 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1293 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:34.149572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:34.150278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:34.158397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:34.159109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:34.160169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:34.160856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:34.431650 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df07580f-cfe7-47c6-b06e-e60df6106e75 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/fa3e5d53-7209-4d2b-ab7a-f0adc7ab38df" status: 202 len: 0 microversion: 2.1 time: 0.616599 Apr 30 21:15:34.434200 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 831/1546] 10.222.0.23 () {58 vars in 1286 bytes} [Sat Apr 30 21:15:33 2022] DELETE /compute/v2.1/os-security-group-rules/fa3e5d53-7209-4d2b-ab7a-f0adc7ab38df => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:34.442293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c35c51c7-5780-4fba-8dbb-46b7c017018e req-33b77617-2383-4db7-9bca-3aa5547d75ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c545493b-8dac-45bb-8afa-bb8845cdeda6", "tag": "01bd63bd-e064-484d-a092-dec5a749a3ec"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:34.451373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c35c51c7-5780-4fba-8dbb-46b7c017018e req-33b77617-2383-4db7-9bca-3aa5547d75ec service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:34.451829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c35c51c7-5780-4fba-8dbb-46b7c017018e req-33b77617-2383-4db7-9bca-3aa5547d75ec service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:34.463549 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c35c51c7-5780-4fba-8dbb-46b7c017018e req-33b77617-2383-4db7-9bca-3aa5547d75ec service nova] Creating event network-changed:01bd63bd-e064-484d-a092-dec5a749a3ec for instance c545493b-8dac-45bb-8afa-bb8845cdeda6 on nch1-master-1 Apr 30 21:15:34.469084 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c35c51c7-5780-4fba-8dbb-46b7c017018e req-33b77617-2383-4db7-9bca-3aa5547d75ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033088 Apr 30 21:15:34.469931 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 832/1547] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:34.476431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:34.477364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:34.484005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:34.484672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:34.485649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:34.486303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:34.608143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:34.629027 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a927b741-9c5c-48ec-a66e-f7cf9b8b1417 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1470 microversion: 2.1 time: 0.484611 Apr 30 21:15:34.633413 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 716/1548] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:34 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1470 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:34.654368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7ef122c7-1b83-43d0-b922-af1734661ab7 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc206a9670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:34.727075 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7ef122c7-1b83-43d0-b922-af1734661ab7 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 0.078371 Apr 30 21:15:34.729944 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 717/1549] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:34 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:34.736813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fd78bd37-b8c5-466e-b4ff-b65b06e884dc tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc206d4280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-984077712", "description": "tempest-description-557619078"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:35.013963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:35.022681 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aed0d323-d7b9-4602-a188-1e4a2945865d tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1460 microversion: 2.1 time: 0.551435 Apr 30 21:15:35.023257 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 833/1550] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:34 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1460 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:35.039953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:35.040860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:35.047851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.048311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.049094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.049636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.266189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:35.293645 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7129721-1715-461a-9ccf-bf9be79ea8ea tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 200 len: 1528 microversion: 2.1 time: 0.259609 Apr 30 21:15:35.304911 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 834/1551] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:35 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 1528 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:35.310358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ad1e58a-4adf-4a31-b4d0-4900d2974a2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:35.311318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ad1e58a-4adf-4a31-b4d0-4900d2974a2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:35.318754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ad1e58a-4adf-4a31-b4d0-4900d2974a2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.319407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ad1e58a-4adf-4a31-b4d0-4900d2974a2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.320450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ad1e58a-4adf-4a31-b4d0-4900d2974a2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.320985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ad1e58a-4adf-4a31-b4d0-4900d2974a2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.533389 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fd78bd37-b8c5-466e-b4ff-b65b06e884dc tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.800613 Apr 30 21:15:35.535843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 718/1552] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:34 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:35.541683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:35.541683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:35.549314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.549801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.550597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.551044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.691099 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ad1e58a-4adf-4a31-b4d0-4900d2974a2b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "POST /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328/action" status: 202 len: 0 microversion: 2.1 time: 0.384208 Apr 30 21:15:35.692982 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 835/1553] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:15:35 2022] POST /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:35.698551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02d87b93-7801-47a1-88ea-6605115a3e24 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:35.699262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02d87b93-7801-47a1-88ea-6605115a3e24 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:35.705791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d87b93-7801-47a1-88ea-6605115a3e24 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.706252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d87b93-7801-47a1-88ea-6605115a3e24 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.707939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d87b93-7801-47a1-88ea-6605115a3e24 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.708593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d87b93-7801-47a1-88ea-6605115a3e24 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.742720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:35.753148 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb4af567-a619-460b-9a7e-e4117b2301d3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.217363 Apr 30 21:15:35.760937 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 719/1554] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:35 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:35.767165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:35.767802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:35.774812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.775604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.776597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:35.777302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:35.980076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:35.988304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:35.989829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:35.990945 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-73e67c11-23d5-4cb9-ba86-b5c70c52f69a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1281 microversion: 2.25 time: 0.228711 Apr 30 21:15:35.991508 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 720/1555] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:35 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:36.001657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-113e832b-766f-47bb-a346-8e4a6be5228b tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc2074eee0>, body: {"security_group_rule": {"parent_group_id": "eba6d452-b484-4069-9778-a6afa71bf13a", "ip_protocol": "tcp", "from_port": 2027268550, "to_port": 22}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:36.064589 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-113e832b-766f-47bb-a346-8e4a6be5228b tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: Invalid port range 2027268550:22. Former value cannot be greater than the later Apr 30 21:15:36.065202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-113e832b-766f-47bb-a346-8e4a6be5228b tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 400 to user: Invalid port range 2027268550:22. Former value cannot be greater than the later {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:36.066081 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-113e832b-766f-47bb-a346-8e4a6be5228b tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.073578 Apr 30 21:15:36.067198 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 721/1556] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:35 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:15:36.072133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1551690851", "imageRef": "c792b0d3-1f97-4a0f-8902-c7a3a7c4d927", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1152c707-7e0c-4173-990b-839e96baa458"}], "security_groups": [{"name": "tempest-securitygroup--1687056748"}], "key_name": "tempest-keypair-1558403537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:36.271875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] validate_networks() for [('1152c707-7e0c-4173-990b-839e96baa458', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:15:36.277006 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02d87b93-7801-47a1-88ea-6605115a3e24 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1611 microversion: 2.1 time: 0.582554 Apr 30 21:15:36.287847 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 836/1557] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:35 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1611 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:36.287847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b4c903f7-5037-4d41-98df-17b520c9e295 req-0185e798-fe92-4421-b14c-d899cea86be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff8d0ca-9b07-4f8b-b9af-bf18481b3550", "tag": "d31b0a65-0a8e-4414-bf95-4b3a788b6203"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:36.304031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b4c903f7-5037-4d41-98df-17b520c9e295 req-0185e798-fe92-4421-b14c-d899cea86be3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.304494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b4c903f7-5037-4d41-98df-17b520c9e295 req-0185e798-fe92-4421-b14c-d899cea86be3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.325048 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b4c903f7-5037-4d41-98df-17b520c9e295 req-0185e798-fe92-4421-b14c-d899cea86be3 service nova] Creating event network-changed:d31b0a65-0a8e-4414-bf95-4b3a788b6203 for instance aff8d0ca-9b07-4f8b-b9af-bf18481b3550 on nch2-master-1 Apr 30 21:15:36.331383 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b4c903f7-5037-4d41-98df-17b520c9e295 req-0185e798-fe92-4421-b14c-d899cea86be3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047848 Apr 30 21:15:36.332158 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 837/1558] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:36.337249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:36.338099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:36.346293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.347165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.348177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.348783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.642419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:36.650206 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bab12cbd-5d71-4a0b-b1fb-ab6421814a36 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.316802 Apr 30 21:15:36.659571 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 838/1559] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:36 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:36.659571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1b6ecdd-5778-444f-957a-694465d590e4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc205174c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:36.701813 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1b6ecdd-5778-444f-957a-694465d590e4 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 0.049704 Apr 30 21:15:36.702396 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 839/1560] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:36 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:36.707404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-78884037-eee6-4932-9138-b2377ed6cc07 req-a7b3945a-e11a-4d50-aaa5-42df1ca72c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3279965-3245-4077-96e6-ecaf57d00b9b", "name": "network-vif-unplugged", "status": "completed", "tag": "3d880b11-1cc5-4a9c-90d6-9a894959be26"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:36.716071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-78884037-eee6-4932-9138-b2377ed6cc07 req-a7b3945a-e11a-4d50-aaa5-42df1ca72c3e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.716527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-78884037-eee6-4932-9138-b2377ed6cc07 req-a7b3945a-e11a-4d50-aaa5-42df1ca72c3e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.727258 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-78884037-eee6-4932-9138-b2377ed6cc07 req-a7b3945a-e11a-4d50-aaa5-42df1ca72c3e service nova] Creating event network-vif-unplugged:3d880b11-1cc5-4a9c-90d6-9a894959be26 for instance f3279965-3245-4077-96e6-ecaf57d00b9b on nch2-master-1 Apr 30 21:15:36.732153 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-78884037-eee6-4932-9138-b2377ed6cc07 req-a7b3945a-e11a-4d50-aaa5-42df1ca72c3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028589 Apr 30 21:15:36.732749 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 840/1561] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:36.737778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e3e8fb4-e317-42ae-a45b-38424ddfc153 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc262e5ca0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1552602883", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:36.740120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-8e3e8fb4-e317-42ae-a45b-38424ddfc153 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: Security group id should be uuid Apr 30 21:15:36.740713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e3e8fb4-e317-42ae-a45b-38424ddfc153 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 400 to user: Security group id should be uuid {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:36.741534 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e3e8fb4-e317-42ae-a45b-38424ddfc153 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.007681 Apr 30 21:15:36.742089 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 841/1562] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:36 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:36.746434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-943073fb-be57-4758-bffd-3ae24a737ec2 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:36.747772 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:15:36.747772 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:15:36.748988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-943073fb-be57-4758-bffd-3ae24a737ec2 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.749447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-943073fb-be57-4758-bffd-3ae24a737ec2 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.750290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-943073fb-be57-4758-bffd-3ae24a737ec2 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.750735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-943073fb-be57-4758-bffd-3ae24a737ec2 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.774665 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-943073fb-be57-4758-bffd-3ae24a737ec2 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.031314 Apr 30 21:15:36.775259 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 842/1563] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:15:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:36.779833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:36.780749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:36.787624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.788088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.788884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.789333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.804016 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Instance f3279965-3245-4077-96e6-ecaf57d00b9b could not be found. Apr 30 21:15:36.804628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Instance f3279965-3245-4077-96e6-ecaf57d00b9b could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:36.805515 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f083748a-64fb-4192-a18e-14da2c4246d0 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 404 len: 111 microversion: 2.1 time: 0.029294 Apr 30 21:15:36.809084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 843/1564] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:36 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:36.811069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-746f1a30-09d8-4805-8b04-2d62d9e0eafa req-3091b709-069c-4cf6-8a58-efa6f1bef1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3279965-3245-4077-96e6-ecaf57d00b9b", "name": "network-vif-deleted", "tag": "3d880b11-1cc5-4a9c-90d6-9a894959be26"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:36.819549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-746f1a30-09d8-4805-8b04-2d62d9e0eafa req-3091b709-069c-4cf6-8a58-efa6f1bef1af service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.820009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-746f1a30-09d8-4805-8b04-2d62d9e0eafa req-3091b709-069c-4cf6-8a58-efa6f1bef1af service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.832435 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-746f1a30-09d8-4805-8b04-2d62d9e0eafa req-3091b709-069c-4cf6-8a58-efa6f1bef1af service nova] Creating event network-vif-deleted:3d880b11-1cc5-4a9c-90d6-9a894959be26 for instance f3279965-3245-4077-96e6-ecaf57d00b9b on nch2-master-1 Apr 30 21:15:36.838098 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-746f1a30-09d8-4805-8b04-2d62d9e0eafa req-3091b709-069c-4cf6-8a58-efa6f1bef1af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030769 Apr 30 21:15:36.838882 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 844/1565] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:36.844249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-256f9f3e-a2cd-4cc5-982f-24bcf4475816 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc262e58b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1928680120", "description": "tempest-description-504448987"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:36.920782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:15:36.921286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:15:36.921694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:15:36.922148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:15:36.922599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:15:36.932128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.932589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.933411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:36.933905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:36.952002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Getting quotas for project 6309fd24cb2e4a5d8fde4f457d529d68. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:15:36.956180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Getting quotas for user 8c1eeba696174da1be8aba8dcce6b112 and project 6309fd24cb2e4a5d8fde4f457d529d68. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:15:36.967178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:15:36.969457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c792b0d3-1f97-4a0f-8902-c7a3a7c4d927',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:15:37.094506 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8820b75-1f01-41ea-8dc5-4e70630ccb50 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.026264 Apr 30 21:15:37.095162 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 722/1566] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:15:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:15:37.099853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:37.100473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:37.106783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.107451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:37.108238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.108688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:37.257392 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-256f9f3e-a2cd-4cc5-982f-24bcf4475816 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.416926 Apr 30 21:15:37.265069 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 845/1567] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:36 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:37.271484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:37.273129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:37.276123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:37.284074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.284621 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cab747fc-cc92-40e2-9ac1-b7336d6db175 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.187987 Apr 30 21:15:37.285906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 723/1568] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:37 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:37.286491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:37.293108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1199386189", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:37.297257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.297874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:37.329148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Lazy-loading 'flavor' on Instance uuid 219f9425-7fbc-424f-8c16-8db2a0f02edb {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:37.343709 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 219f9425-7fbc-424f-8c16-8db2a0f02edb while it is in vm_state suspended Apr 30 21:15:37.345078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 219f9425-7fbc-424f-8c16-8db2a0f02edb while it is in vm_state suspended {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:37.345991 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-803ddb0b-8aa8-4aa1-8e0d-fecc5f632ef0 tempest-LiveMigrationNegativeTest-327357169 tempest-LiveMigrationNegativeTest-327357169-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb/action" status: 409 len: 155 microversion: 2.1 time: 0.079566 Apr 30 21:15:37.347065 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 846/1569] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:15:37 2022] POST /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb/action => generated 155 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:15:37.349699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] validate_networks() for [('9f3cd876-8b51-4bde-a809-728e22df1c30', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:15:37.352191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:37.354280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:37.362035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.362506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:37.363436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.363978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:37.661993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:37.675206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:37.678373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:37.679569 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d53921f2-6725-451b-a0fc-6c86fe911f18 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1281 microversion: 2.25 time: 0.331350 Apr 30 21:15:37.680296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 847/1570] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:37 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1281 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:37.691016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c870d8d-a104-42f0-9b72-6d3fefbb90be tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:37.692439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c870d8d-a104-42f0-9b72-6d3fefbb90be tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:37.816704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c870d8d-a104-42f0-9b72-6d3fefbb90be tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:37.828656 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c870d8d-a104-42f0-9b72-6d3fefbb90be tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1246 microversion: 2.1 time: 0.141036 Apr 30 21:15:37.829816 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 848/1571] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:37 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:37.835362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96385cb3-4093-4afb-9b51-af8b83517fb5 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc261908b0>, body: {"security_group_rule": {"parent_group_id": "a9cdea46-836a-4563-a015-3dc5b5ee5afa", "ip_protocol": "tempest-999-379991590", "from_port": 22, "to_port": 22}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:37.958150 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-96385cb3-4093-4afb-9b51-af8b83517fb5 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: Invalid IP protocol tempest-999-379991590. Apr 30 21:15:37.958657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96385cb3-4093-4afb-9b51-af8b83517fb5 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 400 to user: Invalid IP protocol tempest-999-379991590. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:37.959529 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96385cb3-4093-4afb-9b51-af8b83517fb5 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.128542 Apr 30 21:15:37.964698 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 849/1572] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:37 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:37.968983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:37.969497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:37.978351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.991544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:37.991544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:37.991544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.008035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:15:38.190305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:15:38.190774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:15:38.195473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:15:38.195473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:15:38.195473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:15:38.201840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.202546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.203378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.203837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.221404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for project 711cc97213824857927f7626b41012cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:15:38.225361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Getting quotas for user ddcc9f1b17c94698a5df6ffc6482149f and project 711cc97213824857927f7626b41012cb. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:15:38.236669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:15:38.238912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:15:38.362070 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-956d9284-e5a6-4550-8d3b-66635209f699 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.074498 Apr 30 21:15:38.362643 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 724/1573] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:15:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:15:38.367138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:38.368113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:38.374036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.374580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.375555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.385781 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1ac32a07-c045-4b0f-b29a-0a389ecca768 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 204 len: 0 microversion: 2.1 time: 0.416781 Apr 30 21:15:38.386448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.386535 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 850/1574] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:15:37 2022] DELETE /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:15:38.386535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef0c5869-24eb-4966-abc7-63e78fbcb9c5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26360430>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:38.446766 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef0c5869-24eb-4966-abc7-63e78fbcb9c5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 0.066089 Apr 30 21:15:38.447376 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 851/1575] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:38 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:38.462735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64ed30a3-a9c2-43fa-b395-cbcb529c3c23 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc262268b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1569886781", "description": "tempest-description-783063850"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:38.561354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:38.569578 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-30d91ed8-ee57-4d2d-8c32-c2a404596eb5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.205913 Apr 30 21:15:38.571927 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 725/1576] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:38 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:38.586924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:38.587558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:38.594770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.595611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.596072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.596507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.740369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:38.748579 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ed1f277-dd96-4d91-819c-dee1447f3001 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.165348 Apr 30 21:15:38.749157 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 726/1577] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:38 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:38.753571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2cc42f8-2506-4c37-8cfc-83252b129b23 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:38.754985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2cc42f8-2506-4c37-8cfc-83252b129b23 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:38.821022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2cc42f8-2506-4c37-8cfc-83252b129b23 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:38.827952 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2cc42f8-2506-4c37-8cfc-83252b129b23 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1225 microversion: 2.1 time: 0.077823 Apr 30 21:15:38.828533 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 727/1578] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:38 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:38.836168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:38.841433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:38.841843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-64ed30a3-a9c2-43fa-b395-cbcb529c3c23 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.382381 Apr 30 21:15:38.841994 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 852/1579] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:38.846588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:38.847323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:38.847438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.848409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.849254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.850068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.854976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.855441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:38.856334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:38.856793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.041156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:39.048486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:39.048656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-07173e6e-aee4-4595-a4fc-3914a27aea1c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1466 microversion: 2.1 time: 0.215877 Apr 30 21:15:39.049213 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 728/1580] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:38 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1466 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:39.053771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f138a524-2528-4399-86cf-abaeafad938e req-2125acba-4391-4932-8f3d-43fe7a98e7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "name": "network-vif-plugged", "status": "completed", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:39.058374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:39.059909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:39.061337 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a67f9696-6131-40c8-853e-f06f16261de4 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1281 microversion: 2.25 time: 0.218371 Apr 30 21:15:39.061920 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 853/1581] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:38 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:39.062030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f138a524-2528-4399-86cf-abaeafad938e req-2125acba-4391-4932-8f3d-43fe7a98e7f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:39.062373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f138a524-2528-4399-86cf-abaeafad938e req-2125acba-4391-4932-8f3d-43fe7a98e7f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.067135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:39.067758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:39.073640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:39.074156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.074947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:39.075413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.075590 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f138a524-2528-4399-86cf-abaeafad938e req-2125acba-4391-4932-8f3d-43fe7a98e7f6 service nova] Creating event network-vif-plugged:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch1-master-1 Apr 30 21:15:39.081106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-f138a524-2528-4399-86cf-abaeafad938e req-2125acba-4391-4932-8f3d-43fe7a98e7f6 service nova] Instance e8325361-70e7-47c5-bb69-2f9d2c45c328 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:15:39.092548 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f138a524-2528-4399-86cf-abaeafad938e req-2125acba-4391-4932-8f3d-43fe7a98e7f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 Apr 30 21:15:39.093179 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 729/1582] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:39.098772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1dc9a312-0d07-4b47-bd3f-9e4c764ef942 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc2074d700>, body: {"security_group_rule": {"parent_group_id": "55d03c3e-bc46-4f93-bfd6-ca1360afa6df", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:39.149096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:39.156750 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e80fe2d3-4bf8-4e4a-ab32-85acdecd4fb4 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1250 microversion: 2.1 time: 0.093837 Apr 30 21:15:39.157379 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 854/1583] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:39 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1250 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:39.169320 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1dc9a312-0d07-4b47-bd3f-9e4c764ef942 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Apr 30 21:15:39.169969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1dc9a312-0d07-4b47-bd3f-9e4c764ef942 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:39.170801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1dc9a312-0d07-4b47-bd3f-9e4c764ef942 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.076525 Apr 30 21:15:39.171360 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 730/1584] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:39 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:15:39.184889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6282e9a-2d11-440e-897c-bfdc95dbdaef tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc20bc6040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-806142422", "description": "tempest-description-2088542736"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:39.463416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ee5fa25-5812-4e52-b108-4946c24c472f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc207be8b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:39.514993 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ee5fa25-5812-4e52-b108-4946c24c472f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 0.058456 Apr 30 21:15:39.515563 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 731/1585] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:39 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:39.553941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6282e9a-2d11-440e-897c-bfdc95dbdaef tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.372846 Apr 30 21:15:39.554548 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 855/1586] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:15:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:15:39.566549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a7416dec-8630-49f4-a091-246fe8bc2b68 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc2074d4c0>, body: {"security_group_rule": {"parent_group_id": "54c48701-3e53-4f3b-b74c-b7bc06a2e796", "ip_protocol": "tcp", "from_port": 22, "to_port": 1838808876}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:39.590421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:39.592542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:39.599730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:39.600193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.601176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:39.601630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.616372 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a7416dec-8630-49f4-a091-246fe8bc2b68 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: Invalid port range 22:1838808876. Valid TCP ports should be between 1-65535 Apr 30 21:15:39.616990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a7416dec-8630-49f4-a091-246fe8bc2b68 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 400 to user: Invalid port range 22:1838808876. Valid TCP ports should be between 1-65535 {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:39.617854 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a7416dec-8630-49f4-a091-246fe8bc2b68 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.056176 Apr 30 21:15:39.618430 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 732/1587] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:39 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:15:39.628399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2d5afc4-87a2-4389-9b77-97e52fe1498f tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Action: 'create', calling method: .version_select at 0x7fdc20708550>, body: {"security_group_rule": {"parent_group_id": "b8fc0188-d28a-4a29-882a-1a38d0d81de9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:39.664350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-b2d5afc4-87a2-4389-9b77-97e52fe1498f tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b8fc0188-d28a-4a29-882a-1a38d0d81de9 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:15:39.664969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-b2d5afc4-87a2-4389-9b77-97e52fe1498f tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Neutron security group b8fc0188-d28a-4a29-882a-1a38d0d81de9 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:15:39.665525 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b2d5afc4-87a2-4389-9b77-97e52fe1498f tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: Security group b8fc0188-d28a-4a29-882a-1a38d0d81de9 does not exist Apr 30 21:15:39.665525 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-92ed22db-bb8c-4746-9ce8-b0c17395b3fa'] Apr 30 21:15:39.666320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2d5afc4-87a2-4389-9b77-97e52fe1498f tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 404 to user: Security group b8fc0188-d28a-4a29-882a-1a38d0d81de9 does not exist Apr 30 21:15:39.666320 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-92ed22db-bb8c-4746-9ce8-b0c17395b3fa'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:39.667401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2d5afc4-87a2-4389-9b77-97e52fe1498f tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.042999 Apr 30 21:15:39.673385 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 733/1588] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Apr 30 21:15:39 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:15:39.680231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df4aa272-899c-44cc-b788-73ddc6ab49b1 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Calling method '.version_select at 0x7fdc20708550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:39.713659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-df4aa272-899c-44cc-b788-73ddc6ab49b1 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 0ba3d680-dd25-4b7f-a04c-be63bef030fc does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:15:39.717272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-df4aa272-899c-44cc-b788-73ddc6ab49b1 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Neutron security group rule 0ba3d680-dd25-4b7f-a04c-be63bef030fc not found {{(pid=130670) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Apr 30 21:15:39.717272 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-df4aa272-899c-44cc-b788-73ddc6ab49b1 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] HTTP exception thrown: Security group rule 0ba3d680-dd25-4b7f-a04c-be63bef030fc does not exist Apr 30 21:15:39.717272 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-e061ac29-fcbd-4501-b39e-e536d4e486d8'] Apr 30 21:15:39.717272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df4aa272-899c-44cc-b788-73ddc6ab49b1 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Returning 404 to user: Security group rule 0ba3d680-dd25-4b7f-a04c-be63bef030fc does not exist Apr 30 21:15:39.717272 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-e061ac29-fcbd-4501-b39e-e536d4e486d8'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:39.717874 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df4aa272-899c-44cc-b788-73ddc6ab49b1 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/0ba3d680-dd25-4b7f-a04c-be63bef030fc" status: 404 len: 199 microversion: 2.1 time: 0.042670 Apr 30 21:15:39.718603 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 734/1589] 10.222.0.23 () {58 vars in 1286 bytes} [Sat Apr 30 21:15:39 2022] DELETE /compute/v2.1/os-security-group-rules/0ba3d680-dd25-4b7f-a04c-be63bef030fc => generated 199 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:39.730685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81f0b2ff-5d23-4356-98b1-2ef384a8a5a5 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Calling method '.version_select at 0x7fdc2072c040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:39.801885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:39.810005 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5254c170-c610-45e4-b610-682d8736f2a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.226161 Apr 30 21:15:39.811030 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 856/1590] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:39 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:15:39.816338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:39.817011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:39.823307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:39.823777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.824570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:39.825023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:39.998230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:40.006372 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d58ae1e4-4a28-451a-a5e7-31934e2d7b8e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.193976 Apr 30 21:15:40.006945 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 857/1591] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:39 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:40.012050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:40.012680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:40.021502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.022212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.023039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.023478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.051212 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81f0b2ff-5d23-4356-98b1-2ef384a8a5a5 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/54c48701-3e53-4f3b-b74c-b7bc06a2e796" status: 202 len: 0 microversion: 2.1 time: 0.326632 Apr 30 21:15:40.054948 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 735/1592] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:39 2022] DELETE /compute/v2.1/os-security-groups/54c48701-3e53-4f3b-b74c-b7bc06a2e796 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:40.061951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ead1af74-3a93-44cc-b56a-faa5d60374e2 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Calling method '.version_select at 0x7fdc2074d430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:40.098659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:40.106003 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dea42079-913d-42a3-bc3d-f099c2e67aa2 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1277 microversion: 2.1 time: 0.097971 Apr 30 21:15:40.106586 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 858/1593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:40 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:40.111008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:40.111610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:40.117836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.118390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.119196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.119641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.357076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:40.366959 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-50395153-38a3-44aa-aada-a998b50c4230 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1466 microversion: 2.1 time: 0.259282 Apr 30 21:15:40.371089 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 859/1594] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:40 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1466 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:40.376979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:40.377618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:40.386665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.387368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.388186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.388638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.501097 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ead1af74-3a93-44cc-b56a-faa5d60374e2 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/55d03c3e-bc46-4f93-bfd6-ca1360afa6df" status: 202 len: 0 microversion: 2.1 time: 0.444721 Apr 30 21:15:40.501681 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 736/1595] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:40 2022] DELETE /compute/v2.1/os-security-groups/55d03c3e-bc46-4f93-bfd6-ca1360afa6df => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:15:40.507530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:40.508278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:40.525156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.528911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.532786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:40.533169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:40.627014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:40.636155 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59d9becc-8a45-48d4-94d6-5ae64ea45751 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1316 microversion: 2.1 time: 0.133269 Apr 30 21:15:40.637085 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 737/1596] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:40 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1316 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:40.653729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-042b33a3-c12e-40a0-9cc8-bd200ea5992c tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Calling method '.version_select at 0x7fdc2074d310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:41.023846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:41.034731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:41.037433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:41.038889 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9894623f-7882-407c-b4f5-daa53fa9f1a6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1281 microversion: 2.25 time: 0.669558 Apr 30 21:15:41.049627 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 860/1597] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:40 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1281 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:41.056023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ed5ba0cd-4a15-4f6c-b7f4-d70456d1caee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2112a820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:41.105926 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ed5ba0cd-4a15-4f6c-b7f4-d70456d1caee tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 0.054666 Apr 30 21:15:41.106814 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 861/1598] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:41 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:41.112060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:41.112963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:41.121553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:41.122895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:41.123826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:41.124373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:41.569512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:41.591782 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-525f8d48-87c4-432c-8d95-b3298fd10ff8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.483658 Apr 30 21:15:41.593058 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 862/1599] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:41 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:41.598778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:41.599582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:41.609386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:41.610170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:41.611140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:41.611748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:41.918365 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-042b33a3-c12e-40a0-9cc8-bd200ea5992c tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a9cdea46-836a-4563-a015-3dc5b5ee5afa" status: 202 len: 0 microversion: 2.1 time: 1.269324 Apr 30 21:15:41.923292 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 738/1600] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:40 2022] DELETE /compute/v2.1/os-security-groups/a9cdea46-836a-4563-a015-3dc5b5ee5afa => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:41.929937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d3fb9820-c7c0-4438-8cab-f8e3ce24349a req-a87f776b-9176-4acc-b03c-0e75516752dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c37ba-07cd-47b9-9a7b-17d799280bbb", "name": "network-vif-plugged", "status": "completed", "tag": "0148cfe2-db7e-4096-b624-dd079aece8ea"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:41.961737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d3fb9820-c7c0-4438-8cab-f8e3ce24349a req-a87f776b-9176-4acc-b03c-0e75516752dd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:41.962242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d3fb9820-c7c0-4438-8cab-f8e3ce24349a req-a87f776b-9176-4acc-b03c-0e75516752dd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:41.981999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:41.988037 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d3fb9820-c7c0-4438-8cab-f8e3ce24349a req-a87f776b-9176-4acc-b03c-0e75516752dd service nova] Creating event network-vif-plugged:0148cfe2-db7e-4096-b624-dd079aece8ea for instance f17c37ba-07cd-47b9-9a7b-17d799280bbb on nch1-master-1 Apr 30 21:15:41.992192 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f91df5b-42b8-4877-9f9c-14c660eae46d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.397877 Apr 30 21:15:41.992791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 863/1601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:41 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:41.998518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:42.006655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:42.011632 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d3fb9820-c7c0-4438-8cab-f8e3ce24349a req-a87f776b-9176-4acc-b03c-0e75516752dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080742 Apr 30 21:15:42.011632 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 739/1602] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:42.025080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:42.030431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:42.031712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:42.034666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:42.035955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:42.040618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:42.043950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:42.044905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:42.046960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:42.051945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:42.240017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:42.251643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a030e0b-38f6-4850-8887-35ec907ccc47 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1283 microversion: 2.1 time: 0.257766 Apr 30 21:15:42.263171 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 864/1603] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:41 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1283 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:42.269670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:42.270602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:42.286443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:42.287148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:42.291134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:42.291827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:42.548829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:42.557660 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e579ae20-f0f6-4781-889b-ffac1412c09b tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1466 microversion: 2.1 time: 0.546871 Apr 30 21:15:42.562305 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 740/1604] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:42 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1466 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:42.573137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-985293d5-6170-48a1-8146-07f7f9883a45 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Calling method '.version_select at 0x7fdc206d41f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:43.056920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:43.075167 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-087eafdb-f644-4197-bf57-4a7086f64070 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.809585 Apr 30 21:15:43.080734 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 865/1605] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:42 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:43.093259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:43.100724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:43.118012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:43.120120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:43.121287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:43.123459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:43.483635 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-985293d5-6170-48a1-8146-07f7f9883a45 tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/eba6d452-b484-4069-9778-a6afa71bf13a" status: 202 len: 0 microversion: 2.1 time: 0.919864 Apr 30 21:15:43.484819 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 741/1606] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:42 2022] DELETE /compute/v2.1/os-security-groups/eba6d452-b484-4069-9778-a6afa71bf13a => generated 0 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:43.490596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ee113f6-ce12-4c14-a887-f5d687273c61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2074d8b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:43.524784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:43.551149 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ee113f6-ce12-4c14-a887-f5d687273c61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 0.064786 Apr 30 21:15:43.554408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:43.554408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:43.555049 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 742/1607] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:43 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:43.559197 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-51f0c92c-4e5f-4548-8c35-dfe3d6cd81f7 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1281 microversion: 2.25 time: 0.475894 Apr 30 21:15:43.560071 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 866/1608] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:43 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1281 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:43.577558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d2eecd98-a085-4741-842e-f013f4cd9aa8 req-c3ddf87c-6469-4fe0-8c73-3330a8966a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "219f9425-7fbc-424f-8c16-8db2a0f02edb", "name": "network-vif-deleted", "tag": "58a25f77-e029-49da-8d04-dc69125045ee"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:43.579123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:43.585332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:43.606979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:43.607917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:43.611318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d2eecd98-a085-4741-842e-f013f4cd9aa8 req-c3ddf87c-6469-4fe0-8c73-3330a8966a66 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:43.618998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:43.619810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:43.623505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d2eecd98-a085-4741-842e-f013f4cd9aa8 req-c3ddf87c-6469-4fe0-8c73-3330a8966a66 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:43.653522 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d2eecd98-a085-4741-842e-f013f4cd9aa8 req-c3ddf87c-6469-4fe0-8c73-3330a8966a66 service nova] Creating event network-vif-deleted:58a25f77-e029-49da-8d04-dc69125045ee for instance 219f9425-7fbc-424f-8c16-8db2a0f02edb on nch1-master-1 Apr 30 21:15:43.675371 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d2eecd98-a085-4741-842e-f013f4cd9aa8 req-c3ddf87c-6469-4fe0-8c73-3330a8966a66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113617 Apr 30 21:15:43.690880 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 867/1609] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:43.707110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:43.707880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:43.722063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:43.723024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:43.724555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:43.725632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:44.219772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:44.237309 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-638e04ea-1e3d-45f3-a4ae-809d20c178ef tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.544439 Apr 30 21:15:44.248851 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 868/1610] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:43 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:44.256411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:44.256631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:44.257668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:44.266965 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51873b6f-9122-4d05-856c-5bcd4a4f35a8 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.710989 Apr 30 21:15:44.270095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:44.271374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:44.274698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:44.288071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:44.288360 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 743/1611] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:43 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:44.310950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2c3488d-687f-4ba4-9137-67a125a861ad tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] Calling method '.version_select at 0x7fdc20708940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:44.751134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:44.772999 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e24543a5-c304-45d3-8d1e-d98aa21c4385 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1325 microversion: 2.1 time: 0.521272 Apr 30 21:15:44.777609 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 869/1612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:44 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1325 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:44.785873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:44.792990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:44.818123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:44.819887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:44.823897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:44.824789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:44.875490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:44.875976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:44.876498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lazy-loading 'fault' on Instance uuid 219f9425-7fbc-424f-8c16-8db2a0f02edb {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:45.019769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:45.053163 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-49bcf812-e8b5-4bf9-879a-f3032d65383c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 200 len: 1309 microversion: 2.1 time: 0.272896 Apr 30 21:15:45.053163 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 870/1613] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:44 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:45.133040 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2c3488d-687f-4ba4-9137-67a125a861ad tempest-SecurityGroupRulesNegativeTestJSON-1479545116 tempest-SecurityGroupRulesNegativeTestJSON-1479545116-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d0b30ea8-7250-4641-9f75-8cbbb4964359" status: 202 len: 0 microversion: 2.1 time: 0.838697 Apr 30 21:15:45.133040 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 744/1614] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:15:44 2022] DELETE /compute/v2.1/os-security-groups/d0b30ea8-7250-4641-9f75-8cbbb4964359 => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:15:45.139382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:45.140981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:45.153239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:45.154301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:45.155856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:45.156559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:45.255807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-db85cd64-8457-4793-ae91-6875fab93099 req-d86691c4-5e4d-461f-ad02-adfaaca7ccd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff8d0ca-9b07-4f8b-b9af-bf18481b3550", "name": "network-vif-plugged", "status": "completed", "tag": "d31b0a65-0a8e-4414-bf95-4b3a788b6203"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:45.283764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-db85cd64-8457-4793-ae91-6875fab93099 req-d86691c4-5e4d-461f-ad02-adfaaca7ccd7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:45.284229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-db85cd64-8457-4793-ae91-6875fab93099 req-d86691c4-5e4d-461f-ad02-adfaaca7ccd7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:45.339116 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-db85cd64-8457-4793-ae91-6875fab93099 req-d86691c4-5e4d-461f-ad02-adfaaca7ccd7 service nova] Creating event network-vif-plugged:d31b0a65-0a8e-4414-bf95-4b3a788b6203 for instance aff8d0ca-9b07-4f8b-b9af-bf18481b3550 on nch2-master-1 Apr 30 21:15:45.357835 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-db85cd64-8457-4793-ae91-6875fab93099 req-d86691c4-5e4d-461f-ad02-adfaaca7ccd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294345 Apr 30 21:15:45.363243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 871/1615] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:45.412892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a72e3e13-cfbd-45c5-bbe8-084b20aa67a0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc26226ee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:46.490881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:46.498671 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f4e0148-f2c3-49e2-9237-74fb98677d0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 1.368488 Apr 30 21:15:46.499207 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 745/1616] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:45 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:46.514200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:46.514825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:46.533488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:46.533965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:46.534803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:46.535252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.081440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:47.089432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:47.090966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:47.095903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8af52374-4001-4f18-b183-935326544bba tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1281 microversion: 2.25 time: 0.591941 Apr 30 21:15:47.095903 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 746/1617] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:46 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1281 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:47.097802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:47.102240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:47.108298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.108763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.109561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.110080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.328227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:47.341599 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dedd343d-f6bf-489b-9cb8-361cb28cd801 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.247656 Apr 30 21:15:47.343312 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 747/1618] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:47 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:47.349400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:47.350550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:47.358608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.359325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.360420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.361255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.524278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:47.543025 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-888aeb97-0a85-44f7-b6ad-fa0a4468f19b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.198464 Apr 30 21:15:47.543634 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 748/1619] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:47 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:47.564645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-52e97838-a81d-4003-933a-ba04538c4e71 req-ffb0a59e-9337-496d-8ec0-aab2e19db14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8", "tag": "4353948c-dd49-4e67-89ce-6381a6d54506"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:47.570627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-52e97838-a81d-4003-933a-ba04538c4e71 req-ffb0a59e-9337-496d-8ec0-aab2e19db14d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.570976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-52e97838-a81d-4003-933a-ba04538c4e71 req-ffb0a59e-9337-496d-8ec0-aab2e19db14d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.586329 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-52e97838-a81d-4003-933a-ba04538c4e71 req-ffb0a59e-9337-496d-8ec0-aab2e19db14d service nova] Creating event network-changed:4353948c-dd49-4e67-89ce-6381a6d54506 for instance 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 on nch2-master-1 Apr 30 21:15:47.592533 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-52e97838-a81d-4003-933a-ba04538c4e71 req-ffb0a59e-9337-496d-8ec0-aab2e19db14d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035875 Apr 30 21:15:47.596186 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 749/1620] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:47.671522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-46521c60-61b2-46be-8a2f-fd6bdde1be31 req-26c3cd79-ed58-4f30-8854-ce51bd0beb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361d2aa0-0533-433d-aec8-097fee016242", "tag": "f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:47.685563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-46521c60-61b2-46be-8a2f-fd6bdde1be31 req-26c3cd79-ed58-4f30-8854-ce51bd0beb19 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.685563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-46521c60-61b2-46be-8a2f-fd6bdde1be31 req-26c3cd79-ed58-4f30-8854-ce51bd0beb19 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.696642 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-46521c60-61b2-46be-8a2f-fd6bdde1be31 req-26c3cd79-ed58-4f30-8854-ce51bd0beb19 service nova] Creating event network-changed:f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e for instance 361d2aa0-0533-433d-aec8-097fee016242 on nch2-master-1 Apr 30 21:15:47.701721 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-46521c60-61b2-46be-8a2f-fd6bdde1be31 req-26c3cd79-ed58-4f30-8854-ce51bd0beb19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104403 Apr 30 21:15:47.702660 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 750/1621] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:47.711477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:47.712720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:47.719264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.719766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.720523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:47.721288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:47.986117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:47.996418 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d10d9248-0701-4227-a152-657385dc660a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1325 microversion: 2.1 time: 0.292431 Apr 30 21:15:47.999972 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 751/1622] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:47 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:48.006941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:48.007581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: 219f9425-7fbc-424f-8c16-8db2a0f02edb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:48.027659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:48.028226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:48.029113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:48.029591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:48.055019 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] HTTP exception thrown: Instance 219f9425-7fbc-424f-8c16-8db2a0f02edb could not be found. Apr 30 21:15:48.055569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Returning 404 to user: Instance 219f9425-7fbc-424f-8c16-8db2a0f02edb could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:48.056767 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d7d716d9-bebe-4a3a-be5f-1823c10fa89c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb" status: 404 len: 111 microversion: 2.1 time: 0.055785 Apr 30 21:15:48.057442 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 752/1623] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:47 2022] GET /compute/v2.1/servers/219f9425-7fbc-424f-8c16-8db2a0f02edb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:48.065007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:48.065842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:48.072859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:48.073358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:48.074358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:48.074809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:48.303169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:48.312376 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2a3456ea-f8a9-4fb1-9272-6c3d783599e5 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.253787 Apr 30 21:15:48.313272 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 753/1624] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:48 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:48.326302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:48.330418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:48.343962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:48.349266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:48.349266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:48.349266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:48.497216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:15:49.655071 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f1d53a26-3fd9-489a-b54d-83dd70abe791 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 204 len: 0 microversion: 2.1 time: 1.340255 Apr 30 21:15:49.661057 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 754/1625] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:15:48 2022] DELETE /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 0 bytes in 1343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:15:49.672580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:49.675916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:49.741309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:49.741878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:49.742736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:49.743207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.041372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:50.055884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:50.060896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:50.067133 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-40035185-fbc6-4fd9-bd94-33c8bffbe28b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1281 microversion: 2.25 time: 0.397702 Apr 30 21:15:50.080084 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 755/1626] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:49 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1281 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:50.088740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:50.093712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:50.105271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.106146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.114615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.114615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.312602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:50.322876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3948c63e-2970-4239-bb0b-d8168192e173 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1199 microversion: 2.1 time: 0.241352 Apr 30 21:15:50.323465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 756/1627] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:50 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1199 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:50.328850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:50.329476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:50.336635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.337262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.338090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.338545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.520005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:50.531434 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6bab502-2bef-4814-9211-dc6fc6015be5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.206808 Apr 30 21:15:50.532243 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 757/1628] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:50 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:50.548623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-1eadc4b6-8537-4969-b0fe-bd8b655e7fbf req-e77536f8-c13c-433c-9848-3c2eefa081e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c545493b-8dac-45bb-8afa-bb8845cdeda6", "name": "network-vif-plugged", "status": "completed", "tag": "01bd63bd-e064-484d-a092-dec5a749a3ec"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:50.562737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1eadc4b6-8537-4969-b0fe-bd8b655e7fbf req-e77536f8-c13c-433c-9848-3c2eefa081e1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.562737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1eadc4b6-8537-4969-b0fe-bd8b655e7fbf req-e77536f8-c13c-433c-9848-3c2eefa081e1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.574537 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-1eadc4b6-8537-4969-b0fe-bd8b655e7fbf req-e77536f8-c13c-433c-9848-3c2eefa081e1 service nova] Creating event network-vif-plugged:01bd63bd-e064-484d-a092-dec5a749a3ec for instance c545493b-8dac-45bb-8afa-bb8845cdeda6 on nch1-master-1 Apr 30 21:15:50.580223 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-1eadc4b6-8537-4969-b0fe-bd8b655e7fbf req-e77536f8-c13c-433c-9848-3c2eefa081e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046387 Apr 30 21:15:50.581429 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 758/1629] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:50.596698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:50.598494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:50.608920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.609509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.610487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.611022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.838157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:50.846960 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98849cf9-d001-4b98-b06d-53db6c17397e tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1325 microversion: 2.1 time: 0.258377 Apr 30 21:15:50.857449 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 759/1630] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:50 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:50.862538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:50.863824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:50.877311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.877957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:50.879156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:50.879707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:51.619019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:51.633483 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec52884f-24e5-4d87-a78b-5ac4fc253b10 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.772167 Apr 30 21:15:51.644765 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 760/1631] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:50 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:51.650237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:51.661851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:51.661851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:51.661851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:51.661851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:51.670390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:52.553836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:52.572103 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b4b9db6e-7132-4fec-b981-d73f16b33f2c tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1474 microversion: 2.1 time: 0.925489 Apr 30 21:15:52.573689 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 761/1632] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:51 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1474 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:52.602532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:52.605289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:52.629974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:52.653005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:52.654747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:52.655409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:53.133548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:53.145593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:53.147119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:53.148325 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23adb873-1db0-41c7-b8e3-2d79635b87db tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1477 microversion: 2.25 time: 0.573390 Apr 30 21:15:53.148864 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 762/1633] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:52 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1477 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:53.527479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:53.528516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:53.539718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:53.542403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:53.543263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:53.543717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:53.738493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:53.746176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-91cfa906-0ea8-4576-a771-580d467321dc tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1382 microversion: 2.1 time: 0.579068 Apr 30 21:15:53.746739 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 763/1634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:53 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1382 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:53.751150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:53.751759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:53.757418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:53.757928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:53.758711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:53.759148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:53.887724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:53.895698 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b1dea2a-a534-4751-b76c-ee6fb19915c4 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.148002 Apr 30 21:15:53.896274 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 764/1635] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:53 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:53.900734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:53.901299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:53.906912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:53.907373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:53.908172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:53.908623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:54.089075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:54.113058 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ecf7bb6-6812-4d11-afc0-39d0ddb379eb tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1325 microversion: 2.1 time: 0.213997 Apr 30 21:15:54.114407 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 765/1636] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:53 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:54.120706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-86f6802c-ec3e-43bb-8e15-37300942aed1 req-ba5da465-74a3-45e3-9714-5f143f4eb5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "name": "network-vif-unplugged", "status": "completed", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}, {"server_uuid": "8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8", "name": "network-vif-plugged", "status": "completed", "tag": "4353948c-dd49-4e67-89ce-6381a6d54506"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:54.150268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-86f6802c-ec3e-43bb-8e15-37300942aed1 req-ba5da465-74a3-45e3-9714-5f143f4eb5ad service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:54.155243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-86f6802c-ec3e-43bb-8e15-37300942aed1 req-ba5da465-74a3-45e3-9714-5f143f4eb5ad service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:54.174359 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-86f6802c-ec3e-43bb-8e15-37300942aed1 req-ba5da465-74a3-45e3-9714-5f143f4eb5ad service nova] Creating event network-vif-unplugged:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch2-master-1 Apr 30 21:15:54.180282 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-86f6802c-ec3e-43bb-8e15-37300942aed1 req-ba5da465-74a3-45e3-9714-5f143f4eb5ad service nova] Creating event network-vif-plugged:4353948c-dd49-4e67-89ce-6381a6d54506 for instance 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 on nch2-master-1 Apr 30 21:15:54.195801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-86f6802c-ec3e-43bb-8e15-37300942aed1 req-ba5da465-74a3-45e3-9714-5f143f4eb5ad service nova] Instance e8325361-70e7-47c5-bb69-2f9d2c45c328 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:15:54.233205 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-86f6802c-ec3e-43bb-8e15-37300942aed1 req-ba5da465-74a3-45e3-9714-5f143f4eb5ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.117240 Apr 30 21:15:54.234117 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 766/1637] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:54.264185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:54.265415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:54.276311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:54.277137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:54.279277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:54.279944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:54.735223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:54.746383 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aee81e22-9b79-4590-9bda-9826e8cc9f0a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.495266 Apr 30 21:15:54.756722 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 767/1638] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:54 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:54.761800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:54.762411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:54.773879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:54.774341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:54.776354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:54.776808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.114575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid aff8d0ca-9b07-4f8b-b9af-bf18481b3550 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:55.170465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9ac5e7b-8cb5-43a5-8110-e2f9b91c79d2 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1970 microversion: 2.25 time: 0.412291 Apr 30 21:15:55.171276 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 768/1639] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:54 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1970 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:55.184421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:55.184992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:55.217583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.218250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.222891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.223529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.352146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.352824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.353661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lazy-loading 'fault' on Instance uuid b8ea70e2-1dba-4ea9-97f7-31174159dca1 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:55.420715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57b97f51d2f4aa6869b41518f14d3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2d262c5cf4435aa19253f70823433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:55.430667 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93cc9cb6-82be-48d1-beec-3b563d4b98ea tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 200 len: 1308 microversion: 2.1 time: 0.256378 Apr 30 21:15:55.437935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 769/1640] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:55 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:55.458130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb3cdfa5-a80b-47af-8c2b-9ada1ff1cf40 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:55.458767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb3cdfa5-a80b-47af-8c2b-9ada1ff1cf40 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:55.479165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb3cdfa5-a80b-47af-8c2b-9ada1ff1cf40 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.479628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb3cdfa5-a80b-47af-8c2b-9ada1ff1cf40 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.480432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb3cdfa5-a80b-47af-8c2b-9ada1ff1cf40 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.480881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb3cdfa5-a80b-47af-8c2b-9ada1ff1cf40 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.804307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb3cdfa5-a80b-47af-8c2b-9ada1ff1cf40 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1533 microversion: 2.1 time: 0.365186 Apr 30 21:15:55.812222 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 770/1641] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:55 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1533 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:55.830045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f97df183-25b8-45fe-b33a-95315ee9404f req-a9d1e936-35d1-44ed-9577-15fd0c6f9074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ea70e2-1dba-4ea9-97f7-31174159dca1", "name": "network-vif-deleted", "tag": "062557a1-62cc-425d-97a6-043e7cd89a22"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:55.861424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f97df183-25b8-45fe-b33a-95315ee9404f req-a9d1e936-35d1-44ed-9577-15fd0c6f9074 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.864011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f97df183-25b8-45fe-b33a-95315ee9404f req-a9d1e936-35d1-44ed-9577-15fd0c6f9074 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.896294 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f97df183-25b8-45fe-b33a-95315ee9404f req-a9d1e936-35d1-44ed-9577-15fd0c6f9074 service nova] Creating event network-vif-deleted:062557a1-62cc-425d-97a6-043e7cd89a22 for instance b8ea70e2-1dba-4ea9-97f7-31174159dca1 on nch2-master-1 Apr 30 21:15:55.919318 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f97df183-25b8-45fe-b33a-95315ee9404f req-a9d1e936-35d1-44ed-9577-15fd0c6f9074 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099228 Apr 30 21:15:55.920637 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 771/1642] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:55.939012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:55.942377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:55.960509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.960982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:55.961820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:55.963015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:56.260319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:56.276616 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c027375-5033-47ff-8a5d-f3004851b459 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.354140 Apr 30 21:15:56.287643 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 772/1643] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:55 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:56.292601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:56.293224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:56.309183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:56.309695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:56.310883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:56.311381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:56.857950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:56.867998 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6e8a1ca-ade6-4392-a485-ee8ee31773a4 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1325 microversion: 2.1 time: 0.579145 Apr 30 21:15:56.877839 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 773/1644] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:56 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1325 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:56.886047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:56.892636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:56.922759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:56.923257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:56.924067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:56.924522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:57.479173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid aff8d0ca-9b07-4f8b-b9af-bf18481b3550 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:57.541176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cce7e862-c377-486e-a471-2dfe50f95edd tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1970 microversion: 2.25 time: 0.657543 Apr 30 21:15:57.569321 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 774/1645] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:15:56 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1970 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:15:57.608067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:57.609251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:57.626953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:57.631195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:57.632247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:57.632799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:57.930111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:57.946169 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-472b6e73-3144-4018-abd4-4ea55683b96e tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.351064 Apr 30 21:15:57.966730 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 775/1646] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:57 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:57.972239 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a72e3e13-cfbd-45c5-bbe8-084b20aa67a0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1455 microversion: 2.1 time: 12.602043 Apr 30 21:15:57.978253 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 872/1647] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:45 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1455 bytes in 12609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:57.978408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7fa11ce9-1ecf-48ae-a9ee-4be03d5c16f6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:57.978408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7fa11ce9-1ecf-48ae-a9ee-4be03d5c16f6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:57.984874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fa11ce9-1ecf-48ae-a9ee-4be03d5c16f6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:57.988622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fa11ce9-1ecf-48ae-a9ee-4be03d5c16f6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:57.989944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fa11ce9-1ecf-48ae-a9ee-4be03d5c16f6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:57.990568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fa11ce9-1ecf-48ae-a9ee-4be03d5c16f6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:57.995265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:57.996546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] [instance: b8ea70e2-1dba-4ea9-97f7-31174159dca1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:58.005891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.006670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.007650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.008237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.028154 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] HTTP exception thrown: Instance b8ea70e2-1dba-4ea9-97f7-31174159dca1 could not be found. Apr 30 21:15:58.028953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] Returning 404 to user: Instance b8ea70e2-1dba-4ea9-97f7-31174159dca1 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:15:58.030137 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3552af5e-1879-47e3-a823-8512a7d7a781 tempest-LiveMigrationNegativeTest-1170411866 tempest-LiveMigrationNegativeTest-1170411866-project] 10.222.0.23 "GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1" status: 404 len: 111 microversion: 2.1 time: 0.055936 Apr 30 21:15:58.031728 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 873/1648] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:57 2022] GET /compute/v2.1/servers/b8ea70e2-1dba-4ea9-97f7-31174159dca1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:58.335284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:58.335971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:58.348540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.349188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.350210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.350808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.373783 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7fa11ce9-1ecf-48ae-a9ee-4be03d5c16f6 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1533 microversion: 2.1 time: 0.405524 Apr 30 21:15:58.374378 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 776/1649] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:57 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1533 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:58.408736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6449fd0f-9233-41cb-8e0c-4cabe556a015 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:58.411892 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:15:58.411892 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:15:58.424329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6449fd0f-9233-41cb-8e0c-4cabe556a015 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.428975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6449fd0f-9233-41cb-8e0c-4cabe556a015 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.428975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6449fd0f-9233-41cb-8e0c-4cabe556a015 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.428975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6449fd0f-9233-41cb-8e0c-4cabe556a015 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.469121 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6449fd0f-9233-41cb-8e0c-4cabe556a015 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077960 Apr 30 21:15:58.469812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 777/1650] 10.222.0.23 () {60 vars in 1216 bytes} [Sat Apr 30 21:15:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:15:58.487112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:58.491106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:58.508705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.509179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.510012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.510466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.806933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:58.836055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b0138330-f534-4cdc-8878-e3f2dff75a10 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1469 microversion: 2.1 time: 0.802612 Apr 30 21:15:58.844961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:15:58.863201 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 874/1651] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:58 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1469 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:58.869689 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4c25febf-4ca9-4973-9906-2e19d874352a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1523 microversion: 2.1 time: 0.398359 Apr 30 21:15:58.870655 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 778/1652] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:15:58 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:15:58.875053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22141e7e-cf25-4d9b-92f5-1bd834483b22 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:58.875486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-cb00e97a-fe6c-450a-a272-36f1bd8f8366 req-ef5a8d8d-1597-476e-abf9-1b7d54c5bb5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:58.879801 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:15:58.879801 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:15:58.884439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22141e7e-cf25-4d9b-92f5-1bd834483b22 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.884439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22141e7e-cf25-4d9b-92f5-1bd834483b22 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.884439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22141e7e-cf25-4d9b-92f5-1bd834483b22 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.889079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22141e7e-cf25-4d9b-92f5-1bd834483b22 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.891059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cb00e97a-fe6c-450a-a272-36f1bd8f8366 req-ef5a8d8d-1597-476e-abf9-1b7d54c5bb5c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:58.893089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cb00e97a-fe6c-450a-a272-36f1bd8f8366 req-ef5a8d8d-1597-476e-abf9-1b7d54c5bb5c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:58.917564 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-cb00e97a-fe6c-450a-a272-36f1bd8f8366 req-ef5a8d8d-1597-476e-abf9-1b7d54c5bb5c service nova] Creating event network-changed:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch2-master-1 Apr 30 21:15:58.934042 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-22141e7e-cf25-4d9b-92f5-1bd834483b22 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062379 Apr 30 21:15:58.935727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-cb00e97a-fe6c-450a-a272-36f1bd8f8366 req-ef5a8d8d-1597-476e-abf9-1b7d54c5bb5c service nova] Instance e8325361-70e7-47c5-bb69-2f9d2c45c328 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:15:58.935953 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 779/1653] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:15:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:58.941007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:58.942775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:58.963220 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-cb00e97a-fe6c-450a-a272-36f1bd8f8366 req-ef5a8d8d-1597-476e-abf9-1b7d54c5bb5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098026 Apr 30 21:15:58.964063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 875/1654] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:15:59.005536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:59.005536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:59.006160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:15:59.006978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:59.007067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:59.007155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:59.007239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:59.007239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:59.007239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:59.007239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:59.037837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'flavor' on Instance uuid aff8d0ca-9b07-4f8b-b9af-bf18481b3550 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:59.061985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Going to try to live migrate instance to nch1-master-1 {{(pid=130670) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:15:59.068044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:15:59.594391 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fdf3ef17-b152-44b7-8220-2b3e39a7c183 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 204 len: 0 microversion: 2.1 time: 0.626782 Apr 30 21:15:59.600382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 876/1655] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:15:58 2022] DELETE /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:15:59.618536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:15:59.625953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:15:59.654895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:59.661622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:59.664989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:15:59.666445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:15:59.740986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lazy-loading 'flavor' on Instance uuid c545493b-8dac-45bb-8afa-bb8845cdeda6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:15:59.774511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Going to try to live migrate instance to nch2-master-1 {{(pid=130671) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:16:04.115516 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d12d583f-5b53-4c75-a0fc-adaec432895d tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6/action" status: 202 len: 0 microversion: 2.1 time: 4.510616 Apr 30 21:16:04.115516 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 877/1656] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:15:59 2022] POST /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6/action => generated 0 bytes in 4513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:16:04.117065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:04.117845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:04.136063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.136913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.139361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.140771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.316699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:04.325188 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c16bfeae-221a-431b-bc29-7def8b586da7 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.212696 Apr 30 21:16:04.328814 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 878/1657] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:04 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:04.330719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc313e55-fa7c-4d71-b324-73ed882db9c8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2124c8b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:04.352949 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-526a5a3e-488c-4851-8f34-564048639cae tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550/action" status: 202 len: 0 microversion: 2.25 time: 5.415745 Apr 30 21:16:04.353576 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 780/1658] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:15:58 2022] POST /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550/action => generated 0 bytes in 5417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:04.358541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:04.362056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:04.373652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.379009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.379893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.380361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.407141 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc313e55-fa7c-4d71-b324-73ed882db9c8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1464 microversion: 2.1 time: 0.079618 Apr 30 21:16:04.414455 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 879/1659] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:04 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1464 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:04.421082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:04.421380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.421881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.422017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:04.422356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lazy-loading 'fault' on Instance uuid 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:04.431288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.432032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.433309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.434098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.474191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcc9f1b17c94698a5df6ffc6482149f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711cc97213824857927f7626b41012cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:04.483224 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ccd23ae1-e1b0-42ec-85b5-346b9f87e2dd tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 200 len: 1315 microversion: 2.1 time: 0.128474 Apr 30 21:16:04.483907 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 781/1660] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:04 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 1315 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:04.489375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6e8197a9-6fb5-489d-aa80-5d98b0e66a0f req-0ae928e1-c657-4a0b-a8ac-a020afdfae3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "name": "network-vif-plugged", "status": "completed", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:04.497931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6e8197a9-6fb5-489d-aa80-5d98b0e66a0f req-0ae928e1-c657-4a0b-a8ac-a020afdfae3e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.498442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6e8197a9-6fb5-489d-aa80-5d98b0e66a0f req-0ae928e1-c657-4a0b-a8ac-a020afdfae3e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.511700 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6e8197a9-6fb5-489d-aa80-5d98b0e66a0f req-0ae928e1-c657-4a0b-a8ac-a020afdfae3e service nova] Creating event network-vif-plugged:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch2-master-1 Apr 30 21:16:04.516946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6e8197a9-6fb5-489d-aa80-5d98b0e66a0f req-0ae928e1-c657-4a0b-a8ac-a020afdfae3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031645 Apr 30 21:16:04.518141 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 782/1661] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:04.586232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:04.595294 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b88141bd-32eb-43be-b7c6-a4ee55db3f0a tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1462 microversion: 2.1 time: 0.179241 Apr 30 21:16:04.596048 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 880/1662] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:04 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1462 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:04.601505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-47c33fdf-d866-4b41-9429-009f7e5ef15a req-6e3fcf48-3aa2-47ea-a061-283ad4947d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8", "name": "network-vif-deleted", "tag": "4353948c-dd49-4e67-89ce-6381a6d54506"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:04.609797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-47c33fdf-d866-4b41-9429-009f7e5ef15a req-6e3fcf48-3aa2-47ea-a061-283ad4947d1e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.610524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-47c33fdf-d866-4b41-9429-009f7e5ef15a req-6e3fcf48-3aa2-47ea-a061-283ad4947d1e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.623298 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-47c33fdf-d866-4b41-9429-009f7e5ef15a req-6e3fcf48-3aa2-47ea-a061-283ad4947d1e service nova] Creating event network-vif-deleted:4353948c-dd49-4e67-89ce-6381a6d54506 for instance 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 on nch2-master-1 Apr 30 21:16:04.629397 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-47c33fdf-d866-4b41-9429-009f7e5ef15a req-6e3fcf48-3aa2-47ea-a061-283ad4947d1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Apr 30 21:16:04.630250 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 881/1663] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:04.636600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:04.637477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:04.645657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.646339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.647134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:04.647583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:04.724544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f44e52c-ad89-48ce-847b-d157028f1e71 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Action: 'create', calling method: .version_select at 0x7fdc208759d0>, body: {"keypair": {"name": "tempest-keypair-1786017507"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:04.740937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f44e52c-ad89-48ce-847b-d157028f1e71 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Getting quotas for project e06b74e20cb74d5f9eb71ef0ad13dc99. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:04.745676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f44e52c-ad89-48ce-847b-d157028f1e71 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Getting quotas for user 58114c225ebe4062af97802f266bbd6f and project e06b74e20cb74d5f9eb71ef0ad13dc99. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:04.867124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:04.878503 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-573b4cd2-efef-498d-872d-005f152afc15 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.246067 Apr 30 21:16:04.879310 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 882/1664] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:04 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:04.968066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7853e53e-c0f7-4ac9-8c0c-4e669178e7fd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Calling method '.version_select at 0x7fdc26360b80>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:05.016016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f44e52c-ad89-48ce-847b-d157028f1e71 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Getting quotas for project e06b74e20cb74d5f9eb71ef0ad13dc99. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:05.022242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f44e52c-ad89-48ce-847b-d157028f1e71 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Getting quotas for user 58114c225ebe4062af97802f266bbd6f and project e06b74e20cb74d5f9eb71ef0ad13dc99. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:05.042051 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f44e52c-ad89-48ce-847b-d157028f1e71 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.521881 Apr 30 21:16:05.046973 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7853e53e-c0f7-4ac9-8c0c-4e669178e7fd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35" status: 200 len: 371 microversion: 2.1 time: 0.165498 Apr 30 21:16:05.048344 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 783/1665] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:16:04 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:05.048692 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 883/1666] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:16:04 2022] GET /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35 => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:05.054894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:05.055655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:05.056131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-757304b7-3bd4-4645-9c14-f41627fa90bf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20bc6310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:05.063552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.064020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.066012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.066653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.140670 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-757304b7-3bd4-4645-9c14-f41627fa90bf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 200 len: 1464 microversion: 2.1 time: 0.089977 Apr 30 21:16:05.148221 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 884/1667] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:05 2022] GET /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 1464 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:05.154036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9652b30a-f289-41ac-8190-e5113715f5a4 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:05.154741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9652b30a-f289-41ac-8190-e5113715f5a4 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:05.169115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9652b30a-f289-41ac-8190-e5113715f5a4 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.170113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9652b30a-f289-41ac-8190-e5113715f5a4 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.171128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9652b30a-f289-41ac-8190-e5113715f5a4 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.171720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9652b30a-f289-41ac-8190-e5113715f5a4 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.629069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:05.647114 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9652b30a-f289-41ac-8190-e5113715f5a4 tempest-MigrationsAdminTest-445606690 tempest-MigrationsAdminTest-445606690-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1613 microversion: 2.1 time: 0.497099 Apr 30 21:16:05.650534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:05.651403 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 885/1668] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:05 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1613 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:05.655359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:05.656555 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-939b2f5e-7d0b-4215-b516-f37862b17031 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.607137 Apr 30 21:16:05.660854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f3162d8-ffd3-4a79-a379-ac5d41fd3c2a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Action: 'update', calling method: .version_select at 0x7fdc262f6a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:05.671523 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 784/1669] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:05 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:05.685310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:05.685310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:05.693889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.694358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.699258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.701197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.763386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f3162d8-ffd3-4a79-a379-ac5d41fd3c2a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.763386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f3162d8-ffd3-4a79-a379-ac5d41fd3c2a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.763386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f3162d8-ffd3-4a79-a379-ac5d41fd3c2a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:05.763925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f3162d8-ffd3-4a79-a379-ac5d41fd3c2a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:05.958775 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f3162d8-ffd3-4a79-a379-ac5d41fd3c2a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35" status: 200 len: 328 microversion: 2.1 time: 0.305805 Apr 30 21:16:05.966806 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 886/1670] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:05 2022] PUT /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35 => generated 328 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:05.981250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:05.984302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:06.005532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.023603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.025072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.026707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.145426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:06.165389 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e75a31da-3759-4187-ae0f-eaf68061bc61 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1468 microversion: 2.1 time: 0.490741 Apr 30 21:16:06.166245 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 785/1671] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:05 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1468 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:06.183646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.184630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:06.199025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.199796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.201018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.201478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.238728 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Instance 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 could not be found. Apr 30 21:16:06.239376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Instance 8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:06.241373 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-155df360-2103-4120-b6ed-efeebe13f339 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8" status: 404 len: 111 microversion: 2.1 time: 0.070701 Apr 30 21:16:06.242175 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 786/1672] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:06 2022] GET /compute/v2.1/servers/8d3b93d5-4212-4e02-97cd-5ca9ba2d7ac8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:06.248001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.248832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:06.289483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.290359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.291415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.292113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.342424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:06.410418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:06.419042 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-47f141bb-206f-4d44-97cd-82df04f4dbce tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.450934 Apr 30 21:16:06.420329 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 887/1673] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:05 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:06.426044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.426940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:06.437452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.438011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.438833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.439264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.655455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:06.671421 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f9286b36-3b8b-48a4-a7d4-24da19bcf19e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 204 len: 0 microversion: 2.1 time: 0.427730 Apr 30 21:16:06.676399 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 787/1674] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:06 2022] DELETE /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:06.679945 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-34439bd5-b764-437a-b75c-061e1c1ca04b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.258353 Apr 30 21:16:06.682609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0683b1fd-f044-4eb1-9288-31a414f59065 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.686422 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 888/1675] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:06 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:06.695436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-faa00568-dcd8-488a-b4e2-824b0ba16848 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20df6a60>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.782365 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0683b1fd-f044-4eb1-9288-31a414f59065 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35" status: 202 len: 0 microversion: 2.1 time: 0.104118 Apr 30 21:16:06.783259 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 788/1676] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:16:06 2022] DELETE /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:16:06.790401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c7e0267d-4230-4658-9a09-6c7ea7fc33e9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '.version_select at 0x7fdc2077b310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.836634 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c7e0267d-4230-4658-9a09-6c7ea7fc33e9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Image not found. Apr 30 21:16:06.837883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c7e0267d-4230-4658-9a09-6c7ea7fc33e9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:06.838767 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c7e0267d-4230-4658-9a09-6c7ea7fc33e9 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/images/621e05ca-8db8-4e18-911a-5229b9344547" status: 404 len: 62 microversion: 2.1 time: 0.054553 Apr 30 21:16:06.839654 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 789/1677] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:06 2022] DELETE /compute/v2.1/images/621e05ca-8db8-4e18-911a-5229b9344547 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:16:06.854415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-82d4146a-338b-4d33-88e7-b918cb9b2548 req-f6c906a5-45ee-450b-8e7e-7fccf628f52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c37ba-07cd-47b9-9a7b-17d799280bbb", "name": "network-vif-unplugged", "status": "completed", "tag": "0148cfe2-db7e-4096-b624-dd079aece8ea"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:06.873855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-82d4146a-338b-4d33-88e7-b918cb9b2548 req-f6c906a5-45ee-450b-8e7e-7fccf628f52a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.874319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-82d4146a-338b-4d33-88e7-b918cb9b2548 req-f6c906a5-45ee-450b-8e7e-7fccf628f52a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.909994 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-82d4146a-338b-4d33-88e7-b918cb9b2548 req-f6c906a5-45ee-450b-8e7e-7fccf628f52a service nova] Creating event network-vif-unplugged:0148cfe2-db7e-4096-b624-dd079aece8ea for instance f17c37ba-07cd-47b9-9a7b-17d799280bbb on nch1-master-1 Apr 30 21:16:06.918142 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-faa00568-dcd8-488a-b4e2-824b0ba16848 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-04-30T21%3A14%3A02Z" status: 200 len: 2800 microversion: 2.1 time: 0.217266 Apr 30 21:16:06.921169 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-82d4146a-338b-4d33-88e7-b918cb9b2548 req-f6c906a5-45ee-450b-8e7e-7fccf628f52a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076441 Apr 30 21:16:06.922231 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 790/1678] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:06.928231 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 889/1679] 10.222.0.23 () {58 vars in 1198 bytes} [Sat Apr 30 21:16:06 2022] GET /compute/v2.1/images?changes-since=2022-04-30T21%3A14%3A02Z => generated 2800 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:06.931677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.933249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:06.937211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:06.939937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:06.946172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.950370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.951475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.951984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.952456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.953254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:06.953646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:06.953831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.214561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:07.227915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:07.230719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:07.231929 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0eefde99-42c8-40b5-9785-626788afc14b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.302590 Apr 30 21:16:07.234802 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 890/1680] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:06 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:07.236309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:07.241363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b8e9916-348f-4fa7-b90d-195bb5482de1 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Calling method '.version_select at 0x7fdc262fcca0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.248242 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a556295a-d48c-4b03-ab1e-86db79172386 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1468 microversion: 2.1 time: 0.324528 Apr 30 21:16:07.258382 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 791/1681] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:06 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:07.266056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.271859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:07.287794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.288530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.291526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.294107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.333397 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Instance f3279965-3245-4077-96e6-ecaf57d00b9b could not be found. Apr 30 21:16:07.334138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Instance f3279965-3245-4077-96e6-ecaf57d00b9b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:07.337251 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e294840-0615-403c-a211-b8a9b8c77ca3 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 404 len: 111 microversion: 2.1 time: 0.074874 Apr 30 21:16:07.342371 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 792/1682] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:07 2022] DELETE /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:07.350537 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b8e9916-348f-4fa7-b90d-195bb5482de1 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35" status: 200 len: 371 microversion: 2.1 time: 0.114562 Apr 30 21:16:07.354198 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 891/1683] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:16:07 2022] GET /compute/v2.1/os-quota-sets/b10d40a3f3b64a0f9052b75936cb0c35 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:07.360963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2adc53b-c60a-432c-b676-4087b3b4a4d5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20875430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.383147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.384750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: f3279965-3245-4077-96e6-ecaf57d00b9b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:07.394284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.400114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.404162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.404800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.431702 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Instance f3279965-3245-4077-96e6-ecaf57d00b9b could not be found. Apr 30 21:16:07.439721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Instance f3279965-3245-4077-96e6-ecaf57d00b9b could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:07.440901 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-282b1a7b-5596-4306-bc34-d7bb52451b87 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b" status: 404 len: 111 microversion: 2.1 time: 0.085588 Apr 30 21:16:07.446769 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 892/1684] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:07 2022] GET /compute/v2.1/servers/f3279965-3245-4077-96e6-ecaf57d00b9b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:07.452885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.459179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:07.470181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.470902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.472425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.473026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.526166 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2adc53b-c60a-432c-b676-4087b3b4a4d5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-702201742" status: 200 len: 484 microversion: 2.1 time: 0.182077 Apr 30 21:16:07.527034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 793/1685] 10.222.0.23 () {58 vars in 1228 bytes} [Sat Apr 30 21:16:07 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-702201742 => generated 484 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:07.532204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0c58be0-4285-42fa-917e-f9b33a22ca6c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '.version_select at 0x7fdc206cc700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.639180 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0c58be0-4285-42fa-917e-f9b33a22ca6c tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994827377" status: 202 len: 0 microversion: 2.1 time: 0.110219 Apr 30 21:16:07.640146 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 794/1686] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:16:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994827377 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:16:07.649936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:07.657538 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5cb9e8d9-35be-414d-ad60-26e164752071 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.209464 Apr 30 21:16:07.659838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbfb9b7f-a8d9-45f0-8c9d-9668732928ec tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc207e8dc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.670710 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 893/1687] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:07 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:07.687602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1821c98-dac2-4750-ab93-9ef37d6ce418 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Calling method '.version_select at 0x7fdc2124ca60>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.859515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cbfb9b7f-a8d9-45f0-8c9d-9668732928ec tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?server=f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 958 microversion: 2.1 time: 0.217744 Apr 30 21:16:07.865019 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 795/1688] 10.222.0.23 () {58 vars in 1208 bytes} [Sat Apr 30 21:16:07 2022] GET /compute/v2.1/images?server=f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 958 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:07.866952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:07.867094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:07.874390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.874870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:07.875677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:07.876127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:08.120255 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1821c98-dac2-4750-ab93-9ef37d6ce418 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107/defaults" status: 200 len: 371 microversion: 2.1 time: 0.437212 Apr 30 21:16:08.121163 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 894/1689] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:16:07 2022] GET /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107/defaults => generated 371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:08.126365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cb9f3563-de8d-4cb6-a382-162c8305eda0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc262e5700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:08.204061 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cb9f3563-de8d-4cb6-a382-162c8305eda0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 484 microversion: 2.1 time: 0.081330 Apr 30 21:16:08.204836 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 895/1690] 10.222.0.23 () {58 vars in 1316 bytes} [Sat Apr 30 21:16:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 484 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:08.227867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:08.227867 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ca7eedf-cfac-415a-a308-86d5b1562d50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.365255 Apr 30 21:16:08.227867 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 796/1691] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:07 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:08.234165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c940ec0f-1b39-4bbc-aab8-9eff84785c41 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20cfa9d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:08.256103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:08.260624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:08.277091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:08.277615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:08.278478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:08.278925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:08.306985 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c940ec0f-1b39-4bbc-aab8-9eff84785c41 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 484 microversion: 2.1 time: 0.087106 Apr 30 21:16:08.315876 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 896/1692] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Apr 30 21:16:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 484 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:08.331379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:08.332347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:08.339360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:08.340105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:08.342950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:08.342950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:08.761090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:08.771568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:08.774205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:08.775348 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16a45536-76cb-4d03-948a-63440e072d7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.528698 Apr 30 21:16:08.777179 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 797/1693] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:08 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:08.781251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3c77fe5d-a3ab-4303-9e37-e0e10d3155f5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc206cc3a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:08.829503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:08.837490 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90376598-7e78-4785-a795-22ed6bdd4047 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1468 microversion: 2.1 time: 0.520231 Apr 30 21:16:08.839017 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 897/1694] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:08 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1468 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:08.855312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa027f21-6b53-4235-b326-174785077d56 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Action: 'update', calling method: .version_select at 0x7fdc21aa2700>, body: {"quota_set": {"ram": "5120"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:08.957920 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3c77fe5d-a3ab-4303-9e37-e0e10d3155f5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3705 microversion: 2.1 time: 0.180444 Apr 30 21:16:08.967224 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 798/1695] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:16:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3705 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:08.972654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:08.973308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:08.980360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:08.989935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:08.989935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:08.989935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.083367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa027f21-6b53-4235-b326-174785077d56 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.083758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa027f21-6b53-4235-b326-174785077d56 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.084633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa027f21-6b53-4235-b326-174785077d56 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.085060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa027f21-6b53-4235-b326-174785077d56 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.246270 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa027f21-6b53-4235-b326-174785077d56 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12" status: 200 len: 328 microversion: 2.1 time: 0.396726 Apr 30 21:16:09.247520 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 898/1696] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:08 2022] PUT /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12 => generated 328 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:09.261171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8fd4bea1-c586-4c7a-90c7-30351d345759"}], "security_groups": [{"name": "tempest-securitygroup--941516855"}], "key_name": "tempest-keypair-1786017507", "user_data": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:09.286588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:09.306342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45101b60-1ce0-42d1-bc6a-8effb56bc28c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.338008 Apr 30 21:16:09.306944 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 799/1697] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:08 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:09.312575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7786cb96-c73a-4e2d-9378-bbd2d5e35386 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2077b310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:09.474515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] validate_networks() for [('8fd4bea1-c586-4c7a-90c7-30351d345759', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:16:09.505237 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7786cb96-c73a-4e2d-9378-bbd2d5e35386 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.196674 Apr 30 21:16:09.505912 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 800/1698] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:16:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:09.511310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-1da069ab-ee2d-43b4-be37-5a9f9f527d99 req-8f6e3725-6017-48a6-b4d0-aa42fe186b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361d2aa0-0533-433d-aec8-097fee016242", "name": "network-vif-plugged", "status": "completed", "tag": "f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:09.551806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1da069ab-ee2d-43b4-be37-5a9f9f527d99 req-8f6e3725-6017-48a6-b4d0-aa42fe186b20 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.552940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1da069ab-ee2d-43b4-be37-5a9f9f527d99 req-8f6e3725-6017-48a6-b4d0-aa42fe186b20 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.569847 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-1da069ab-ee2d-43b4-be37-5a9f9f527d99 req-8f6e3725-6017-48a6-b4d0-aa42fe186b20 service nova] Creating event network-vif-plugged:f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e for instance 361d2aa0-0533-433d-aec8-097fee016242 on nch2-master-1 Apr 30 21:16:09.575659 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-1da069ab-ee2d-43b4-be37-5a9f9f527d99 req-8f6e3725-6017-48a6-b4d0-aa42fe186b20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068207 Apr 30 21:16:09.576969 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 801/1699] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:09.585172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:09.585942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:09.592667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.593136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.594039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.594497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.793384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:09.801672 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0000690c-5328-4c03-b51e-e0aef2e8062b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.223271 Apr 30 21:16:09.802532 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 802/1700] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:09 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:09.806721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-13eecd47-ef1f-4c96-8d18-ed4b41aa2bb4 req-927a6813-6415-4ce5-ad2f-f937ccdd93a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325361-70e7-47c5-bb69-2f9d2c45c328", "name": "network-vif-deleted", "tag": "3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:09.814893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13eecd47-ef1f-4c96-8d18-ed4b41aa2bb4 req-927a6813-6415-4ce5-ad2f-f937ccdd93a9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.815382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13eecd47-ef1f-4c96-8d18-ed4b41aa2bb4 req-927a6813-6415-4ce5-ad2f-f937ccdd93a9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.829486 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-13eecd47-ef1f-4c96-8d18-ed4b41aa2bb4 req-927a6813-6415-4ce5-ad2f-f937ccdd93a9 service nova] Creating event network-vif-deleted:3dbdc08f-4bdc-41d2-b0fb-a7b7a9bcacf9 for instance e8325361-70e7-47c5-bb69-2f9d2c45c328 on nch2-master-1 Apr 30 21:16:09.836472 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-13eecd47-ef1f-4c96-8d18-ed4b41aa2bb4 req-927a6813-6415-4ce5-ad2f-f937ccdd93a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031321 Apr 30 21:16:09.836472 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 803/1701] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:09.840614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a7e1a09-9a61-4039-8501-1a1d149fb1ae tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Calling method '.version_select at 0x7fdc20822790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:09.928991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a7e1a09-9a61-4039-8501-1a1d149fb1ae tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.929449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a7e1a09-9a61-4039-8501-1a1d149fb1ae tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.930325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a7e1a09-9a61-4039-8501-1a1d149fb1ae tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:09.930771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a7e1a09-9a61-4039-8501-1a1d149fb1ae tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:09.950888 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a7e1a09-9a61-4039-8501-1a1d149fb1ae tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12/detail" status: 200 len: 916 microversion: 2.1 time: 0.113104 Apr 30 21:16:09.959454 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 804/1702] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:16:09 2022] GET /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12/detail => generated 916 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:09.959454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4aa3c826-20aa-4627-be23-b621785caf69 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '.version_select at 0x7fdc207d7b80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.014859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:16:10.015618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:16:10.017079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:16:10.017554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:16:10.019764 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-4aa3c826-20aa-4627-be23-b621785caf69 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Image not found. Apr 30 21:16:10.020084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4aa3c826-20aa-4627-be23-b621785caf69 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:10.020941 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4aa3c826-20aa-4627-be23-b621785caf69 tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/images/da6f619a-1015-4f9e-933f-d894c5edac4d" status: 404 len: 62 microversion: 2.1 time: 0.068170 Apr 30 21:16:10.021497 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 805/1703] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:09 2022] DELETE /compute/v2.1/images/da6f619a-1015-4f9e-933f-d894c5edac4d => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:16:10.022483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:16:10.029789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2c0a0c81-d9f5-4145-9663-40acdfef757c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc206d44c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.046635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.047108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.048027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.051595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.079047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Getting quotas for project e06b74e20cb74d5f9eb71ef0ad13dc99. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:10.081237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Getting quotas for user 58114c225ebe4062af97802f266bbd6f and project e06b74e20cb74d5f9eb71ef0ad13dc99. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:10.095432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:16:10.099188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:16:10.127162 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2c0a0c81-d9f5-4145-9663-40acdfef757c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.101436 Apr 30 21:16:10.128114 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 806/1704] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:10.135239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.135989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:10.142361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.142825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.144300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.144750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.252874 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a1da3f80-cffe-4722-8e80-e07e8456fa8a tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.004018 Apr 30 21:16:10.253558 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 899/1705] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:16:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:16:10.262377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.263211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:10.276894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:10.284455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.285864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.286761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.286978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:10.287349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.288744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:10.290040 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b623ec0a-81a0-447f-a79b-f3656ab72645 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.160859 Apr 30 21:16:10.290837 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 807/1706] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:10.297527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.298245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:10.304709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.305917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.306720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.307208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.325988 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Instance 427c1770-3b54-49dc-b533-f3e65b86634f could not be found. Apr 30 21:16:10.326603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Instance 427c1770-3b54-49dc-b533-f3e65b86634f could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:10.327345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.329340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.330054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lazy-loading 'fault' on Instance uuid e8325361-70e7-47c5-bb69-2f9d2c45c328 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:10.339440 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c929360b-a416-4d4b-99cf-a6c39d0d7e2a tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 404 len: 111 microversion: 2.1 time: 0.033746 Apr 30 21:16:10.340094 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 808/1707] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:10 2022] DELETE /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:10.347450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71ec6282-f4b4-426c-9214-b3dd433a809b tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20875940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.390435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:10.399932 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f43ba7c-626a-4f7f-bb86-1507f99d0a02 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 200 len: 1303 microversion: 2.1 time: 0.143747 Apr 30 21:16:10.401059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 900/1708] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:10.405813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Action: 'update', calling method: .version_select at 0x7fdc205408b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:10.491229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.492025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.492855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.493306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.500834 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71ec6282-f4b4-426c-9214-b3dd433a809b tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-04-30T21%3A13%3A43Z" status: 200 len: 7020 microversion: 2.1 time: 0.159193 Apr 30 21:16:10.502071 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 809/1709] 10.222.0.23 () {58 vars in 1219 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/images/detail?changes-since=2022-04-30T21%3A13%3A43Z => generated 7020 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:10.507920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f37317a-774d-4201-9319-d22adaa6cb18 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.508748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f37317a-774d-4201-9319-d22adaa6cb18 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:10.544550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.545247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.546159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.546611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.588380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f37317a-774d-4201-9319-d22adaa6cb18 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:10.595336 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f37317a-774d-4201-9319-d22adaa6cb18 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1226 microversion: 2.1 time: 0.091320 Apr 30 21:16:10.596006 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 810/1710] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:10.601559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.602199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:10.613077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.613077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.613433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.614124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.669395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9130ad3c-8c2e-40e4-8377-20b539108936 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12?user_id=10ff20f9eceb4fc3931d65d8145351da" status: 200 len: 328 microversion: 2.1 time: 0.266938 Apr 30 21:16:10.675646 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 901/1711] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:16:10 2022] PUT /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12?user_id=10ff20f9eceb4fc3931d65d8145351da => generated 328 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:10.675646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.676133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] [instance: 427c1770-3b54-49dc-b533-f3e65b86634f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:10.682078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.682573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.683366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.683813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.699026 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] HTTP exception thrown: Instance 427c1770-3b54-49dc-b533-f3e65b86634f could not be found. Apr 30 21:16:10.699633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] Returning 404 to user: Instance 427c1770-3b54-49dc-b533-f3e65b86634f could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:10.700531 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e5f2148-870c-4194-ba6f-17cc920c892b tempest-ImagesOneServerNegativeTestJSON-1482043863 tempest-ImagesOneServerNegativeTestJSON-1482043863-project] 10.222.0.23 "GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f" status: 404 len: 111 microversion: 2.1 time: 0.029292 Apr 30 21:16:10.701272 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 902/1712] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/servers/427c1770-3b54-49dc-b533-f3e65b86634f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:10.707333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26c2a158-cc25-4ad6-8ffe-f18a0a9ccd9a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20d52f70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.791374 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26c2a158-cc25-4ad6-8ffe-f18a0a9ccd9a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-702201742" status: 200 len: 664 microversion: 2.1 time: 0.089134 Apr 30 21:16:10.793094 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 903/1713] 10.222.0.23 () {58 vars in 1249 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-702201742 => generated 664 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:10.802870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8791c8c-6390-4242-baf5-98793b40a5f0 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Calling method '.version_select at 0x7fdc20cfa0d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.819841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:10.834338 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bf8d5a67-1272-4ff6-acf1-c46876cdd677 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1372 microversion: 2.1 time: 0.236578 Apr 30 21:16:10.844656 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 811/1714] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:10.844656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c4e0e74c-75a6-4134-9975-e865480acdfe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc207e8c10>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.909638 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c4e0e74c-75a6-4134-9975-e865480acdfe tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1466 microversion: 2.1 time: 0.072696 Apr 30 21:16:10.910729 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 812/1715] 10.222.0.23 () {58 vars in 1337 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1466 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:10.916110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:10.917243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:10.925777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.926123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.927189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:10.927831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:10.940957 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8791c8c-6390-4242-baf5-98793b40a5f0 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12?user_id=10ff20f9eceb4fc3931d65d8145351da" status: 200 len: 370 microversion: 2.1 time: 0.146793 Apr 30 21:16:10.943605 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 904/1716] 10.222.0.23 () {58 vars in 1322 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/os-quota-sets/a4181df959bf41a0ac303ffa81490f12?user_id=10ff20f9eceb4fc3931d65d8145351da => generated 370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:10.954226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e308681-f1f4-45f9-8ce1-a535ce364156 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20bc6040>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.030086 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e308681-f1f4-45f9-8ce1-a535ce364156 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1466 microversion: 2.1 time: 0.085338 Apr 30 21:16:11.030942 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 905/1717] 10.222.0.23 () {58 vars in 1323 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1466 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:11.043968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cbcc67b-2da6-4bf4-a70e-82224c38f039 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20eacb80>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.222817 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cbcc67b-2da6-4bf4-a70e-82224c38f039 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7795 microversion: 2.1 time: 0.182521 Apr 30 21:16:11.224411 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 906/1718] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7795 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:11.242253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-970116b0-1853-46a5-894e-9a1ead3e611d tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20d52670>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.379232 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-970116b0-1853-46a5-894e-9a1ead3e611d tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.140926 Apr 30 21:16:11.389627 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 907/1719] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:11.413800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.414768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:11.423049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.423803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.425418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.426027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.580596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:11.588869 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2260316c-0e6b-4651-a2ee-5d848d3341d8 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.676950 Apr 30 21:16:11.595964 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 813/1720] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:10 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:11.618350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-725eaeee-dd78-4c20-8736-0844529b26f5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc208751f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.715084 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-725eaeee-dd78-4c20-8736-0844529b26f5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d" status: 200 len: 784 microversion: 2.1 time: 0.108572 Apr 30 21:16:11.729979 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 814/1721] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d => generated 784 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:11.738967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.740306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: e8325361-70e7-47c5-bb69-2f9d2c45c328] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:11.754842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:11.760718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.760718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.760718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.760718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.769604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:11.771153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:11.772356 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fcb5d629-6389-4fd4-8c5a-4c2e514bb707 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.380840 Apr 30 21:16:11.772926 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 908/1722] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:11.781268 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] HTTP exception thrown: Instance e8325361-70e7-47c5-bb69-2f9d2c45c328 could not be found. Apr 30 21:16:11.782345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Returning 404 to user: Instance e8325361-70e7-47c5-bb69-2f9d2c45c328 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:11.788014 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cbab134d-4c61-4b6a-b54d-6e26b4b8eab9 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328" status: 404 len: 111 microversion: 2.1 time: 0.052074 Apr 30 21:16:11.788014 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 815/1723] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/servers/e8325361-70e7-47c5-bb69-2f9d2c45c328 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:11.788275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.788275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:11.791337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b427017-4c73-4db3-b190-766014e873ad tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc2077be50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.807185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.807640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.808435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.808883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.902014 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b427017-4c73-4db3-b190-766014e873ad tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.115941 Apr 30 21:16:11.902923 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 816/1724] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:11.907845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.908368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:11.916136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.916606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.922730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:11.922730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:11.927120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:11.942552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d82ac77-d6eb-4a53-b15e-ad889f100aa2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1230 microversion: 2.1 time: 0.158956 Apr 30 21:16:11.944019 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 909/1725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1230 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:11.955041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-29e0f305-8957-48fa-9b61-9b818c35eb12 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Calling method '.version_select at 0x7fdc20d5b670>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:11.965714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:12.201086 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-29e0f305-8957-48fa-9b61-9b818c35eb12 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107/defaults" status: 200 len: 371 microversion: 2.1 time: 0.254327 Apr 30 21:16:12.202187 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 910/1726] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:16:11 2022] GET /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107/defaults => generated 371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:12.208522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:12.209203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:12.221098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:12.221599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:12.226718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:12.227216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:12.363720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d510a803-32ae-4772-959f-16d8d2e68b5f tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 204 len: 0 microversion: 2.1 time: 0.459247 Apr 30 21:16:12.364607 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 817/1727] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:11 2022] DELETE /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:12.370201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5a907a17-66ee-4705-b0a7-c1f97893e656 req-4fd10551-40bd-413c-b02e-31ef289f53d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c545493b-8dac-45bb-8afa-bb8845cdeda6", "name": "network-vif-unplugged", "status": "completed", "tag": "01bd63bd-e064-484d-a092-dec5a749a3ec"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:12.381074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5a907a17-66ee-4705-b0a7-c1f97893e656 req-4fd10551-40bd-413c-b02e-31ef289f53d7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:12.381839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5a907a17-66ee-4705-b0a7-c1f97893e656 req-4fd10551-40bd-413c-b02e-31ef289f53d7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:12.397852 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5a907a17-66ee-4705-b0a7-c1f97893e656 req-4fd10551-40bd-413c-b02e-31ef289f53d7 service nova] Creating event network-vif-unplugged:01bd63bd-e064-484d-a092-dec5a749a3ec for instance c545493b-8dac-45bb-8afa-bb8845cdeda6 on nch1-master-1 Apr 30 21:16:12.405228 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5a907a17-66ee-4705-b0a7-c1f97893e656 req-4fd10551-40bd-413c-b02e-31ef289f53d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038612 Apr 30 21:16:12.405862 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 818/1728] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:12.411649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59b95ad3-6b66-4a7d-9ba9-ad68211e01bf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc207e8940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:12.543802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:12.556671 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f571d4f5-6de5-4b87-978e-e2bb9386b296 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1559 microversion: 2.1 time: 0.353015 Apr 30 21:16:12.558197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 911/1729] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:12 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1559 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:12.574653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2db35eb9-21fd-4585-9077-885ed7fd5a55 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20bc6f70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:13.081625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db35eb9-21fd-4585-9077-885ed7fd5a55 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:13.084505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db35eb9-21fd-4585-9077-885ed7fd5a55 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:13.086843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db35eb9-21fd-4585-9077-885ed7fd5a55 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:13.087479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db35eb9-21fd-4585-9077-885ed7fd5a55 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.019892 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59b95ad3-6b66-4a7d-9ba9-ad68211e01bf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa" status: 204 len: 0 microversion: 2.1 time: 1.612503 Apr 30 21:16:14.020472 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 819/1730] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:12 2022] DELETE /compute/v2.1/images/60d63f1f-fb43-42d3-bc43-a1a3e99a86aa => generated 0 bytes in 1614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:14.025099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:14.025897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:14.032924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.033381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.034831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.035274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.171916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:14.180270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f9592b87-0e54-4e67-83af-70b5b8402281 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 200 len: 1533 microversion: 2.1 time: 0.158766 Apr 30 21:16:14.180859 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 820/1731] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:14 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 1533 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:14.186151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a45e6e7-06d6-4265-9c48-03371fc61bfb tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:14.186681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a45e6e7-06d6-4265-9c48-03371fc61bfb tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:14.193644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a45e6e7-06d6-4265-9c48-03371fc61bfb tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.194139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a45e6e7-06d6-4265-9c48-03371fc61bfb tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.194950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a45e6e7-06d6-4265-9c48-03371fc61bfb tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.195400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a45e6e7-06d6-4265-9c48-03371fc61bfb tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.273568 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7a45e6e7-06d6-4265-9c48-03371fc61bfb tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091544 Apr 30 21:16:14.278736 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 821/1732] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:16:14 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:14.280084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:14.280084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:14.286364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.287019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.287814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.288435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.483368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:14.512826 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b5032b4-d443-443c-908f-62e35573fc9c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.237520 Apr 30 21:16:14.518768 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 822/1733] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:14 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:14.525595 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2db35eb9-21fd-4585-9077-885ed7fd5a55 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107" status: 200 len: 329 microversion: 2.1 time: 1.963121 Apr 30 21:16:14.526929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 912/1734] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Apr 30 21:16:12 2022] PUT /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107 => generated 329 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:14.530313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:14.540406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:14.546906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:14.550020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:14.554504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.555849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.556879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.558317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.560250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.560833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.561776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:14.562623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:14.715355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:14.724951 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7eb5eaea-7fc0-407a-8d9a-e629022810c5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1286 microversion: 2.1 time: 0.196741 Apr 30 21:16:14.735661 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 913/1735] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:14 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:14.868037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22549665-9c47-47ce-b95c-5c998c25ca6b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc21072820>, body: {"keypair": {"name": "tempest-keypair-1296726480"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:14.884482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-22549665-9c47-47ce-b95c-5c998c25ca6b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:14.884989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:14.888537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-22549665-9c47-47ce-b95c-5c998c25ca6b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:14.893258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:14.895193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:14.896604 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7ccc0739-2299-4a2b-9edb-29c9083feddd tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.373270 Apr 30 21:16:14.897375 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 823/1736] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:14 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:14.902685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d27bf76-a6bc-436b-8fe7-192eac9361d9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc207ae820>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:15.191920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-22549665-9c47-47ce-b95c-5c998c25ca6b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:15.198272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-22549665-9c47-47ce-b95c-5c998c25ca6b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:15.215256 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22549665-9c47-47ce-b95c-5c998c25ca6b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.477503 Apr 30 21:16:15.216231 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 914/1737] 10.222.0.23 () {62 vars in 1197 bytes} [Sat Apr 30 21:16:14 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 480 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:15.229076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-91bc288e-d621-4b90-95ad-e6215d7104a4 req-8855c6d0-bfc9-49f3-b821-10735b43b5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff8d0ca-9b07-4f8b-b9af-bf18481b3550", "name": "network-vif-unplugged", "status": "completed", "tag": "d31b0a65-0a8e-4414-bf95-4b3a788b6203"}, {"name": "network-changed", "server_uuid": "c545493b-8dac-45bb-8afa-bb8845cdeda6", "tag": "01bd63bd-e064-484d-a092-dec5a749a3ec"}, {"name": "network-changed", "server_uuid": "aff8d0ca-9b07-4f8b-b9af-bf18481b3550", "tag": "d31b0a65-0a8e-4414-bf95-4b3a788b6203"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:15.245636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-91bc288e-d621-4b90-95ad-e6215d7104a4 req-8855c6d0-bfc9-49f3-b821-10735b43b5bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:15.246353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-91bc288e-d621-4b90-95ad-e6215d7104a4 req-8855c6d0-bfc9-49f3-b821-10735b43b5bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:15.292255 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-91bc288e-d621-4b90-95ad-e6215d7104a4 req-8855c6d0-bfc9-49f3-b821-10735b43b5bf service nova] Creating event network-vif-unplugged:d31b0a65-0a8e-4414-bf95-4b3a788b6203 for instance aff8d0ca-9b07-4f8b-b9af-bf18481b3550 on nch2-master-1 Apr 30 21:16:15.292255 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-91bc288e-d621-4b90-95ad-e6215d7104a4 req-8855c6d0-bfc9-49f3-b821-10735b43b5bf service nova] Creating event network-changed:01bd63bd-e064-484d-a092-dec5a749a3ec for instance c545493b-8dac-45bb-8afa-bb8845cdeda6 on nch1-master-1 Apr 30 21:16:15.292255 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-91bc288e-d621-4b90-95ad-e6215d7104a4 req-8855c6d0-bfc9-49f3-b821-10735b43b5bf service nova] Creating event network-changed:d31b0a65-0a8e-4414-bf95-4b3a788b6203 for instance aff8d0ca-9b07-4f8b-b9af-bf18481b3550 on nch2-master-1 Apr 30 21:16:15.303778 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-91bc288e-d621-4b90-95ad-e6215d7104a4 req-8855c6d0-bfc9-49f3-b821-10735b43b5bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.079432 Apr 30 21:16:15.306954 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 915/1738] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:15.317581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe93efd4-231d-49dd-b572-4ce8e5d32cde tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20d5b040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:15.573860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe93efd4-231d-49dd-b572-4ce8e5d32cde tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:15.575036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe93efd4-231d-49dd-b572-4ce8e5d32cde tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:15.576047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe93efd4-231d-49dd-b572-4ce8e5d32cde tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:15.576659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe93efd4-231d-49dd-b572-4ce8e5d32cde tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:16.796203 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d27bf76-a6bc-436b-8fe7-192eac9361d9 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e" status: 204 len: 0 microversion: 2.1 time: 1.897021 Apr 30 21:16:16.796850 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 824/1739] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:14 2022] DELETE /compute/v2.1/images/ea086cf8-3d6f-4de1-b9e6-ebd76bc9b76e => generated 0 bytes in 1899 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:16.803359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:16.803985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 0c53ede2-815a-4f0f-b0d3-2b632bc5b638] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:16.811460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:16.812150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:16.812948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:16.813394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:16.827465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] HTTP exception thrown: Instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 could not be found. Apr 30 21:16:16.828083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Returning 404 to user: Instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:16.828937 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98e7e15c-b521-4965-877a-5c1b03bf0d93 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638" status: 404 len: 111 microversion: 2.1 time: 0.031117 Apr 30 21:16:16.829850 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 825/1740] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:16 2022] GET /compute/v2.1/servers/0c53ede2-815a-4f0f-b0d3-2b632bc5b638 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:16.835206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c0b3a1d3-f7b6-4be5-b386-30787fb4da18 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc207d7670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:16.842432 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c0b3a1d3-f7b6-4be5-b386-30787fb4da18 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1296726480" status: 200 len: 706 microversion: 2.2 time: 0.011428 Apr 30 21:16:16.850665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 826/1741] 10.222.0.23 () {60 vars in 1257 bytes} [Sat Apr 30 21:16:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1296726480 => generated 706 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:16.850665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:16.850665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:16.854635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:16.855290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:16.856254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:16.856695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:17.006699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:17.014725 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1fdef665-0db7-4141-a074-d03899271774 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.170795 Apr 30 21:16:17.015304 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 827/1742] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:16 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:17.023187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:17.024184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:17.030389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:17.030849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:17.031649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:17.033166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:17.195378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:17.211712 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-37ddecc3-e6f9-43b6-bc7a-7d21e184bb3e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.191360 Apr 30 21:16:17.211712 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 828/1743] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:17 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:17.395055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:17.395687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:17.402263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:17.402997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:17.403646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:17.403973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:17.568640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:17.578352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:17.580956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:17.581164 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-04988268-37ab-46b9-aa93-0720982f2e8a tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.370868 Apr 30 21:16:17.596637 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 829/1744] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:17 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:17.678029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-20abfd71-16ae-4b80-9103-7837ca1208f1 req-20b694de-76c0-40f7-82f0-8d906ca7c410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361d2aa0-0533-433d-aec8-097fee016242", "tag": "f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:17.687171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-20abfd71-16ae-4b80-9103-7837ca1208f1 req-20b694de-76c0-40f7-82f0-8d906ca7c410 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:17.696272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-20abfd71-16ae-4b80-9103-7837ca1208f1 req-20b694de-76c0-40f7-82f0-8d906ca7c410 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:17.715448 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-20abfd71-16ae-4b80-9103-7837ca1208f1 req-20b694de-76c0-40f7-82f0-8d906ca7c410 service nova] Creating event network-changed:f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e for instance 361d2aa0-0533-433d-aec8-097fee016242 on nch2-master-1 Apr 30 21:16:17.726207 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-20abfd71-16ae-4b80-9103-7837ca1208f1 req-20b694de-76c0-40f7-82f0-8d906ca7c410 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130641 Apr 30 21:16:17.727881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 830/1745] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:17.738123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-72ce0193-0ba0-4f2b-b44f-6d3d4adb39ce tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc20746280>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:18.138916 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe93efd4-231d-49dd-b572-4ce8e5d32cde tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107" status: 200 len: 329 microversion: 2.1 time: 2.830666 Apr 30 21:16:18.139673 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 916/1746] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Apr 30 21:16:15 2022] PUT /compute/v2.1/os-quota-sets/c94e34a3041e471c92d5e3e4ea8da107 => generated 329 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:18.145507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:18.146865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:18.155620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:18.156280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:18.161158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:18.161158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:18.185507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:18.642562 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b83654fe-4d45-43d7-a08b-be40063ce00b tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 204 len: 0 microversion: 2.1 time: 0.501312 Apr 30 21:16:18.643193 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 917/1747] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:18 2022] DELETE /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:18.648911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0e76737-b001-4950-8fc9-26065b4cf809 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc20b67280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:18.792329 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0e76737-b001-4950-8fc9-26065b4cf809 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296726480" status: 204 len: 0 microversion: 2.2 time: 0.147343 Apr 30 21:16:18.797787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 918/1748] 10.222.0.23 () {60 vars in 1260 bytes} [Sat Apr 30 21:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296726480 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:18.798123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c596e2f0-d49f-4f99-9b71-170f9f4222d5 req-378bb633-7419-4b2f-b5ad-8c86b033a050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c53ede2-815a-4f0f-b0d3-2b632bc5b638", "name": "network-vif-deleted", "tag": "a54ef22f-4479-4001-901d-54698448f1a0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:18.807442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c596e2f0-d49f-4f99-9b71-170f9f4222d5 req-378bb633-7419-4b2f-b5ad-8c86b033a050 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:18.807903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c596e2f0-d49f-4f99-9b71-170f9f4222d5 req-378bb633-7419-4b2f-b5ad-8c86b033a050 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:18.818389 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c596e2f0-d49f-4f99-9b71-170f9f4222d5 req-378bb633-7419-4b2f-b5ad-8c86b033a050 service nova] Creating event network-vif-deleted:a54ef22f-4479-4001-901d-54698448f1a0 for instance 0c53ede2-815a-4f0f-b0d3-2b632bc5b638 on nch1-master-1 Apr 30 21:16:18.823157 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c596e2f0-d49f-4f99-9b71-170f9f4222d5 req-378bb633-7419-4b2f-b5ad-8c86b033a050 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029140 Apr 30 21:16:18.823743 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 919/1749] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:18.828696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:18.829395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:18.835556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:18.836010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:18.836796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:18.837247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:18.981998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:18.990095 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c2270593-51af-4e94-a0dc-21b16a5f2ba6 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.165198 Apr 30 21:16:18.990778 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 920/1750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:18 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:18.995489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:18.996332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:19.002491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.002958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.003784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.004237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.134640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:19.142188 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-144584c6-935f-4572-ac07-bb3deaa3b7a5 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.150317 Apr 30 21:16:19.142793 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 921/1751] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:18 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:19.147279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:19.147891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:19.153588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.154077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.154854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.155297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.290677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:19.301488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:19.315090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:19.315090 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd489e21-e5bd-4098-82e7-c7142f99a175 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.160634 Apr 30 21:16:19.315090 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 922/1752] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:19 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:19.315090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:19.315090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:19.316665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.317117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.317934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.318443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.417853 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-72ce0193-0ba0-4f2b-b44f-6d3d4adb39ce tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f" status: 204 len: 0 microversion: 2.1 time: 1.686503 Apr 30 21:16:19.421803 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 831/1753] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:17 2022] DELETE /compute/v2.1/images/61648fce-ed54-4842-b661-6125a9391e1f => generated 0 bytes in 1689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:19.424336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a6cf114b-abdb-43c9-b4e8-f547cc54136b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc207d7670>, body: {"keypair": {"name": "tempest-keypair-1788367832"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:19.438678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-a6cf114b-abdb-43c9-b4e8-f547cc54136b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:19.443645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-a6cf114b-abdb-43c9-b4e8-f547cc54136b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:19.455933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:19.464142 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ebbef16e-55d0-42eb-a294-9d6208299b2e tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1469 microversion: 2.1 time: 0.158321 Apr 30 21:16:19.464715 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 923/1754] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:19 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:19.473542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:19.474145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:19.480804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.484452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.484452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.484452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.514143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:19.600191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-a6cf114b-abdb-43c9-b4e8-f547cc54136b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:19.603944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-a6cf114b-abdb-43c9-b4e8-f547cc54136b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:19.618135 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a6cf114b-abdb-43c9-b4e8-f547cc54136b tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.198579 Apr 30 21:16:19.623542 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 832/1755] 10.222.0.23 () {62 vars in 1197 bytes} [Sat Apr 30 21:16:19 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:19.629105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c1a9c31f-6bd2-4dff-8569-79feb43f6a71 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc207d71f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:19.767113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c1a9c31f-6bd2-4dff-8569-79feb43f6a71 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788367832" status: 204 len: 0 microversion: 2.2 time: 0.142232 Apr 30 21:16:19.768197 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 833/1756] 10.222.0.23 () {60 vars in 1260 bytes} [Sat Apr 30 21:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788367832 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:16:19.774017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-67bb9c1f-0e02-43e6-9936-aa2260494229 req-2a8fdfae-00a0-4870-9258-28721e786ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422d9d7c-80c8-4693-925c-f434084a7bd1", "tag": "a648764a-35bc-4bbd-b4e5-9b7bf42d6e11"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:19.782598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-67bb9c1f-0e02-43e6-9936-aa2260494229 req-2a8fdfae-00a0-4870-9258-28721e786ed6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.783060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-67bb9c1f-0e02-43e6-9936-aa2260494229 req-2a8fdfae-00a0-4870-9258-28721e786ed6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.795026 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-67bb9c1f-0e02-43e6-9936-aa2260494229 req-2a8fdfae-00a0-4870-9258-28721e786ed6 service nova] Creating event network-changed:a648764a-35bc-4bbd-b4e5-9b7bf42d6e11 for instance 422d9d7c-80c8-4693-925c-f434084a7bd1 on nch1-master-1 Apr 30 21:16:19.799941 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-67bb9c1f-0e02-43e6-9936-aa2260494229 req-2a8fdfae-00a0-4870-9258-28721e786ed6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029609 Apr 30 21:16:19.800538 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 834/1757] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:19.805663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4243e7f1-e586-4a24-af12-8e76353adf05 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc206f0ca0>, body: {"keypair": {"name": "tempest-keypair-836782338", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:19.819566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-4243e7f1-e586-4a24-af12-8e76353adf05 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:19.825265 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-00dd5b14-2cb0-4e8f-8539-d5a738427270 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 204 len: 0 microversion: 2.1 time: 0.355300 Apr 30 21:16:19.825805 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 924/1758] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:19 2022] DELETE /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:19.828690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-4243e7f1-e586-4a24-af12-8e76353adf05 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:19.834896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:19.835828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:19.842632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.843347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.844309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:19.844921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:19.918025 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4243e7f1-e586-4a24-af12-8e76353adf05 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.116259 Apr 30 21:16:19.920163 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 835/1759] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Apr 30 21:16:19 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Apr 30 21:16:19.928835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0fc6d625-90f3-492e-8bd4-2817918b7849 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc20822b80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:19.988126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:19.995668 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cf567be9-3489-41db-8c42-7036cea4e1d0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1473 microversion: 2.1 time: 0.165589 Apr 30 21:16:19.996237 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 925/1760] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:19 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:20.011076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:20.011785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:20.018294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.018988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.020141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.020299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.067183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0fc6d625-90f3-492e-8bd4-2817918b7849 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836782338" status: 204 len: 0 microversion: 2.2 time: 0.142385 Apr 30 21:16:20.067702 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 836/1761] 10.222.0.23 () {60 vars in 1257 bytes} [Sat Apr 30 21:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836782338 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:16:20.076832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca57c6e4-defa-40bb-ab42-3bf8f92dd7af tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc208fe700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1666909837"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:20.091799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ca57c6e4-defa-40bb-ab42-3bf8f92dd7af tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:20.095754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ca57c6e4-defa-40bb-ab42-3bf8f92dd7af tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:20.229770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:20.238507 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-873960de-411e-4db7-bdb7-d9fac7cfd4e2 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.230465 Apr 30 21:16:20.239354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 926/1762] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:20 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:20.244111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:20.244877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:20.252893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.254136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.254920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.255362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.467353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ca57c6e4-defa-40bb-ab42-3bf8f92dd7af tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:20.471682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ca57c6e4-defa-40bb-ab42-3bf8f92dd7af tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:20.475424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:20.483487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-569cbf18-debf-4f20-ae58-1b6f185ee697 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.242754 Apr 30 21:16:20.484191 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 927/1763] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:20 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:20.490843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:20.491805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:20.492296 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca57c6e4-defa-40bb-ab42-3bf8f92dd7af tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.419277 Apr 30 21:16:20.494892 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 837/1764] 10.222.0.23 () {62 vars in 1197 bytes} [Sat Apr 30 21:16:20 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 422 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:16:20.499254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.499794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.500658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.501175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.507656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:20.508534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:20.515796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.516586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.517548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:20.518171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:20.801427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:20.807688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:20.820112 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3c60fcd6-42be-41c9-9627-db52bc23f92d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1469 microversion: 2.1 time: 0.316957 Apr 30 21:16:20.821115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 838/1765] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:20 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:20.836926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:20.839740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-010ea7e0-4665-439c-932c-8c953eaca6c5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc206f0ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-857809089"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:20.841879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:20.844357 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5871672-6698-44a0-a96a-66e8d1b50594 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.358305 Apr 30 21:16:20.845141 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 928/1766] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:20 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:20.863564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-010ea7e0-4665-439c-932c-8c953eaca6c5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:20.870072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-010ea7e0-4665-439c-932c-8c953eaca6c5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:21.013839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:21.016218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:21.027859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.028808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.030027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.030717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.173548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-010ea7e0-4665-439c-932c-8c953eaca6c5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:21.178125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-010ea7e0-4665-439c-932c-8c953eaca6c5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:21.193590 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-010ea7e0-4665-439c-932c-8c953eaca6c5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.371217 Apr 30 21:16:21.194744 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 839/1767] 10.222.0.23 () {62 vars in 1197 bytes} [Sat Apr 30 21:16:20 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 373 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:21.204441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-442eb143-bc67-4294-86a7-8255dc2655b2 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc208feaf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-776843796"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:21.218566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-442eb143-bc67-4294-86a7-8255dc2655b2 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:21.222535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-442eb143-bc67-4294-86a7-8255dc2655b2 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:21.391200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:21.401631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-72bd2fc4-9671-4432-9367-bd55657b3cdf tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1473 microversion: 2.1 time: 0.391930 Apr 30 21:16:21.402264 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 929/1768] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:21 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1473 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:21.407168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:21.413267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:21.421879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.422695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.423670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.424285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.465096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-442eb143-bc67-4294-86a7-8255dc2655b2 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:21.472900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-442eb143-bc67-4294-86a7-8255dc2655b2 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:21.500978 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-442eb143-bc67-4294-86a7-8255dc2655b2 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.300338 Apr 30 21:16:21.501877 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 840/1769] 10.222.0.23 () {62 vars in 1197 bytes} [Sat Apr 30 21:16:21 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 302 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:16:21.512280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-af7add0f-8ae5-42f9-85a8-c10a4caf4b20 req-e79789a3-8fd2-433e-b32a-8a07c6cc78b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3604c457-9d04-40ae-8d64-1e3a9c5997b9", "name": "network-vif-deleted", "tag": "847cb3b0-ee43-4565-9188-e7bd64f115af"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:21.523961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-af7add0f-8ae5-42f9-85a8-c10a4caf4b20 req-e79789a3-8fd2-433e-b32a-8a07c6cc78b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.524912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-af7add0f-8ae5-42f9-85a8-c10a4caf4b20 req-e79789a3-8fd2-433e-b32a-8a07c6cc78b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.543115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-af7add0f-8ae5-42f9-85a8-c10a4caf4b20 req-e79789a3-8fd2-433e-b32a-8a07c6cc78b7 service nova] Creating event network-vif-deleted:847cb3b0-ee43-4565-9188-e7bd64f115af for instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 on nch2-master-1 Apr 30 21:16:21.544516 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-af7add0f-8ae5-42f9-85a8-c10a4caf4b20 req-e79789a3-8fd2-433e-b32a-8a07c6cc78b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041058 Apr 30 21:16:21.545941 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 841/1770] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:21.553401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:21.554389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:21.566210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.566210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.566210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.566210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.752677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:21.779955 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ae4ab69c-7114-453b-8362-b44fcc6b286c tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.376388 Apr 30 21:16:21.790010 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 930/1771] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:21 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:21.806319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5077b947-a5cc-4501-869c-1a7fcea7da2e tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc20d52ca0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:21.825448 ncdv-master-1 devstack@n-api.service[130671]: WARNING oslo_db.sqlalchemy.utils [None req-5077b947-a5cc-4501-869c-1a7fcea7da2e tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 30 21:16:21.842781 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5077b947-a5cc-4501-869c-1a7fcea7da2e tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.057253 Apr 30 21:16:21.846280 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 931/1772] 10.222.0.23 () {60 vars in 1176 bytes} [Sat Apr 30 21:16:21 2022] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:21.859779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:21.860417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:21.878885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.887010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.887931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.888473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.935900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:21.936359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:21.936815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lazy-loading 'fault' on Instance uuid 3604c457-9d04-40ae-8d64-1e3a9c5997b9 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:22.005912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:22.015879 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56412904-2258-422e-ad10-99678f34d2a2 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.467812 Apr 30 21:16:22.025323 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 842/1773] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:21 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:22.032474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-66f12c10-e33f-417c-bc67-ec3c92327209 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc208f2af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:22.081539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:22.098792 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-74af7592-7096-481a-9361-a3d79e7af500 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 200 len: 1303 microversion: 2.1 time: 0.249830 Apr 30 21:16:22.099688 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 932/1774] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:21 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 1303 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:22.107245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:22.108593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:22.115614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:22.116327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:22.117240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:22.122833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:22.131341 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-66f12c10-e33f-417c-bc67-ec3c92327209 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-776843796" status: 204 len: 0 microversion: 2.2 time: 0.111196 Apr 30 21:16:22.135664 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 843/1775] 10.222.0.23 () {60 vars in 1317 bytes} [Sat Apr 30 21:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-776843796 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:22.144038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-140100e5-6b7e-43f3-a895-4cbdeb41adb5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc209c7af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:22.299165 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-140100e5-6b7e-43f3-a895-4cbdeb41adb5 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-857809089" status: 204 len: 0 microversion: 2.2 time: 0.161659 Apr 30 21:16:22.301790 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 844/1776] 10.222.0.23 () {60 vars in 1317 bytes} [Sat Apr 30 21:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-857809089 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:22.322973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81e5627d-d3f4-4023-a1a9-f420cb66a8fc tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc20875790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:22.406575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:22.417339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:22.420145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:22.421689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea83c4d8-2c90-426c-bc86-72b1b03db1fb tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.320750 Apr 30 21:16:22.422849 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 933/1777] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:22 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:22.436101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:22.436780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:22.457161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:22.457600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:22.458607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:22.466485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:22.466829 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81e5627d-d3f4-4023-a1a9-f420cb66a8fc tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1666909837" status: 204 len: 0 microversion: 2.2 time: 0.151525 Apr 30 21:16:22.468296 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 845/1778] 10.222.0.23 () {60 vars in 1320 bytes} [Sat Apr 30 21:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1666909837 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:22.484811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-63cd0de6-8930-46ca-b88a-4a63015f9055 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc208751f0>, body: {"keypair": {"name": "tempest-keypair-605708259"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:22.521747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-63cd0de6-8930-46ca-b88a-4a63015f9055 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:22.534664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-63cd0de6-8930-46ca-b88a-4a63015f9055 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:22.725097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:22.733229 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4cf47213-0b77-43b9-b376-3fde71cc98e0 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1473 microversion: 2.1 time: 0.307842 Apr 30 21:16:22.734387 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 934/1779] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:22 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:22.796759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:22.797692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:22.806531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:22.806989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:22.816287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:22.816960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:23.031694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-63cd0de6-8930-46ca-b88a-4a63015f9055 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:23.037624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-63cd0de6-8930-46ca-b88a-4a63015f9055 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:23.054047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:23.071285 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f099ef9d-da42-42b1-bad1-059eabb70a50 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.278732 Apr 30 21:16:23.080752 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-63cd0de6-8930-46ca-b88a-4a63015f9055 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.596647 Apr 30 21:16:23.080752 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 846/1780] 10.222.0.23 () {62 vars in 1197 bytes} [Sat Apr 30 21:16:22 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 598 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:23.082020 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 935/1781] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:22 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:23.086078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:23.087137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:23.088204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c7271ef-a675-4053-975c-44a24ff0919c tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc20ba63a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:23.094248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:23.095028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:23.097662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:23.098236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:23.100983 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c7271ef-a675-4053-975c-44a24ff0919c tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-605708259" status: 200 len: 706 microversion: 2.2 time: 0.016629 Apr 30 21:16:23.124855 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 936/1782] 10.222.0.23 () {60 vars in 1254 bytes} [Sat Apr 30 21:16:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-605708259 => generated 706 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:23.146709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:23.147677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 3604c457-9d04-40ae-8d64-1e3a9c5997b9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:23.163686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:23.164495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:23.165623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:23.166857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:23.203643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] HTTP exception thrown: Instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 could not be found. Apr 30 21:16:23.204738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Returning 404 to user: Instance 3604c457-9d04-40ae-8d64-1e3a9c5997b9 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:23.206970 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0e99782b-2574-4c5b-8b0c-6b74c05d8e88 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9" status: 404 len: 111 microversion: 2.1 time: 0.078079 Apr 30 21:16:23.207713 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 937/1783] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:23 2022] GET /compute/v2.1/servers/3604c457-9d04-40ae-8d64-1e3a9c5997b9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:23.213823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ce802f0-f20b-4780-a4ec-251eeff9823c tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc21baa550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:23.217055 ncdv-master-1 devstack@n-api.service[130671]: WARNING oslo_db.sqlalchemy.utils [None req-5ce802f0-f20b-4780-a4ec-251eeff9823c tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 30 21:16:23.223718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ce802f0-f20b-4780-a4ec-251eeff9823c tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 563 microversion: 2.2 time: 0.014658 Apr 30 21:16:23.225068 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 938/1784] 10.222.0.23 () {60 vars in 1176 bytes} [Sat Apr 30 21:16:23 2022] GET /compute/v2.1/os-keypairs => generated 563 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:23.234839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:23.238074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:23.243708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:23.244168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:23.245142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:23.245958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:23.263346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:23.280178 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18fa1fbb-606c-40a1-bc40-4c6299a68d75 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.202449 Apr 30 21:16:23.282424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 847/1785] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:23 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:23.289267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-941e2407-72ee-4969-851f-857a7ef8d875 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc2094cdc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:23.312912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:23.416471 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-941e2407-72ee-4969-851f-857a7ef8d875 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605708259" status: 204 len: 0 microversion: 2.2 time: 0.132456 Apr 30 21:16:23.423737 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 848/1786] 10.222.0.23 () {60 vars in 1257 bytes} [Sat Apr 30 21:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605708259 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:23.429253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Action: 'create', calling method: .version_select at 0x7fdc209c7ee0>, body: {"keypair": {"name": "tempest-keypair-1283222240", "type": "x509"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:23.478730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:23.486073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:23.558834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.processutils [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcrf_u9e8/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcrf_u9e8/temp.key -subj /CN=758c281bb61043f1a7d743fb11071944 -extensions v3_req_client {{(pid=130670) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:16:23.999670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.processutils [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcrf_u9e8/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcrf_u9e8/temp.key -subj /CN=758c281bb61043f1a7d743fb11071944 -extensions v3_req_client" returned: 0 in 0.441s {{(pid=130670) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:16:24.001235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.processutils [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcrf_u9e8/temp.key -password pass: {{(pid=130670) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:16:24.023595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.processutils [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcrf_u9e8/temp.key -password pass:" returned: 0 in 0.022s {{(pid=130670) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:16:24.240070 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cdda0edc-853c-43d9-8f42-0a050717c5c5 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 204 len: 0 microversion: 2.1 time: 1.013638 Apr 30 21:16:24.240824 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 939/1787] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:23 2022] DELETE /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:24.246055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:24.246763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:24.252764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.253221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.254025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.254471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.310251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:24.315079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Getting quotas for user 758c281bb61043f1a7d743fb11071944 and project 0f441a03b7f34ed8844de96c148d37a9. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:24.333590 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51bee7d4-1f22-4d3e-835e-186084abed49 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.910083 Apr 30 21:16:24.337743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 849/1788] 10.222.0.23 () {62 vars in 1197 bytes} [Sat Apr 30 21:16:23 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 914 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:16:24.353104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-60664361-2c9b-416a-9588-d7e075c2fb0d req-40515d38-8306-4ae1-bf11-abae786d6bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ac748-1dff-4324-8ad2-b5c50606e509", "name": "network-vif-deleted", "tag": "45386324-e00d-4309-b5b4-97378c6cd56e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:24.370696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60664361-2c9b-416a-9588-d7e075c2fb0d req-40515d38-8306-4ae1-bf11-abae786d6bf8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.371057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60664361-2c9b-416a-9588-d7e075c2fb0d req-40515d38-8306-4ae1-bf11-abae786d6bf8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.398416 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-60664361-2c9b-416a-9588-d7e075c2fb0d req-40515d38-8306-4ae1-bf11-abae786d6bf8 service nova] Creating event network-vif-deleted:45386324-e00d-4309-b5b4-97378c6cd56e for instance 5f8ac748-1dff-4324-8ad2-b5c50606e509 on nch1-master-1 Apr 30 21:16:24.405191 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-60664361-2c9b-416a-9588-d7e075c2fb0d req-40515d38-8306-4ae1-bf11-abae786d6bf8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066666 Apr 30 21:16:24.406191 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 850/1789] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:24.412010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:24.415615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:24.421866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.422335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.423152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.424070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.445152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:24.453155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:24.454710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:24.455886 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cda58122-bd04-4025-a6f3-2e73a66e2db2 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.213964 Apr 30 21:16:24.456468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 940/1790] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:24 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:24.460881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:24.461493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:24.462523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.463069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.463592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lazy-loading 'fault' on Instance uuid 5f8ac748-1dff-4324-8ad2-b5c50606e509 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:24.467663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.468308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.469299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.469740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.522403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:24.534885 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8b82745b-aefe-4bb9-a84f-92908c00f2a8 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1307 microversion: 2.1 time: 0.126671 Apr 30 21:16:24.535905 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 851/1791] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:24 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:24.540599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:24.541531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:24.549120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.550448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.551468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.552083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.666644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:24.674382 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4190d529-96e4-479b-98e6-be4583986236 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1392 microversion: 2.1 time: 0.216929 Apr 30 21:16:24.674996 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 941/1792] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:24 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:24.680942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:24.681955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:24.689067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.689529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.690915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.691370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.796855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:24.805693 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f915568b-c713-4f9d-a730-111e39843056 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1468 microversion: 2.1 time: 0.268627 Apr 30 21:16:24.809206 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 852/1793] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:24 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1468 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:24.811680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67fbfd75-4600-41fc-8831-08e29198674d tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc207f10d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:24.819411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67fbfd75-4600-41fc-8831-08e29198674d tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1283222240" status: 200 len: 1534 microversion: 2.2 time: 0.012107 Apr 30 21:16:24.819977 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 853/1794] 10.222.0.23 () {60 vars in 1257 bytes} [Sat Apr 30 21:16:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1283222240 => generated 1534 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:24.923032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:24.931203 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-14bb8b64-bd07-4642-94c9-b2b6af5cc8aa tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.254973 Apr 30 21:16:24.931794 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 942/1795] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:24 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:24.942164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-bde41a21-17bd-499f-bab6-283f5a0433d4 req-31532d46-5bdb-4347-b843-00c1c41cec83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422d9d7c-80c8-4693-925c-f434084a7bd1", "name": "network-vif-plugged", "status": "completed", "tag": "a648764a-35bc-4bbd-b4e5-9b7bf42d6e11"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:24.952141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ef77835-9f13-4f3f-b484-8823cdc6d4d6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Action: 'update', calling method: .version_select at 0x7fdc2094c160>, body: {"quota_set": {"ram": "5120"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:24.952649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bde41a21-17bd-499f-bab6-283f5a0433d4 req-31532d46-5bdb-4347-b843-00c1c41cec83 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:24.953111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bde41a21-17bd-499f-bab6-283f5a0433d4 req-31532d46-5bdb-4347-b843-00c1c41cec83 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:24.966056 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-bde41a21-17bd-499f-bab6-283f5a0433d4 req-31532d46-5bdb-4347-b843-00c1c41cec83 service nova] Creating event network-vif-plugged:a648764a-35bc-4bbd-b4e5-9b7bf42d6e11 for instance 422d9d7c-80c8-4693-925c-f434084a7bd1 on nch1-master-1 Apr 30 21:16:24.971191 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-bde41a21-17bd-499f-bab6-283f5a0433d4 req-31532d46-5bdb-4347-b843-00c1c41cec83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037551 Apr 30 21:16:24.972367 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 943/1796] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:24.986365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b7d53be-5636-459a-872c-ef42771ff448 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc21072c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:24.986365 ncdv-master-1 devstack@n-api.service[130671]: WARNING oslo_db.sqlalchemy.utils [None req-2b7d53be-5636-459a-872c-ef42771ff448 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 30 21:16:24.986365 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b7d53be-5636-459a-872c-ef42771ff448 tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.012634 Apr 30 21:16:24.986847 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 944/1797] 10.222.0.23 () {60 vars in 1176 bytes} [Sat Apr 30 21:16:24 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:24.996186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6818a925-f5a6-48f2-8c2d-595bde8ff4be tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] Calling method '.version_select at 0x7fdc21aa2af0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:25.012169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef77835-9f13-4f3f-b484-8823cdc6d4d6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.012627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef77835-9f13-4f3f-b484-8823cdc6d4d6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.013437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef77835-9f13-4f3f-b484-8823cdc6d4d6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.013910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef77835-9f13-4f3f-b484-8823cdc6d4d6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.086743 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6818a925-f5a6-48f2-8c2d-595bde8ff4be tempest-KeyPairsV22TestJSON-1190915648 tempest-KeyPairsV22TestJSON-1190915648-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283222240" status: 204 len: 0 microversion: 2.2 time: 0.094002 Apr 30 21:16:25.087303 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 945/1798] 10.222.0.23 () {60 vars in 1260 bytes} [Sat Apr 30 21:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283222240 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:25.201656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ef77835-9f13-4f3f-b484-8823cdc6d4d6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20" status: 200 len: 240 microversion: 2.36 time: 0.380295 Apr 30 21:16:25.202342 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 854/1799] 10.222.0.23 () {62 vars in 1302 bytes} [Sat Apr 30 21:16:24 2022] PUT /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20 => generated 240 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:25.212895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e9a8246-9570-49d9-a992-7653736299f7 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Calling method '.version_select at 0x7fdc20d2d8b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:25.294261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e9a8246-9570-49d9-a992-7653736299f7 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.294952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e9a8246-9570-49d9-a992-7653736299f7 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.295588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e9a8246-9570-49d9-a992-7653736299f7 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.296037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e9a8246-9570-49d9-a992-7653736299f7 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.314927 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e9a8246-9570-49d9-a992-7653736299f7 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20/detail" status: 200 len: 672 microversion: 2.36 time: 0.105811 Apr 30 21:16:25.315587 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 946/1800] 10.222.0.23 () {60 vars in 1303 bytes} [Sat Apr 30 21:16:25 2022] GET /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20/detail => generated 672 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:25.474368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:25.474999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:25.481582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.482082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.482876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.483326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.552272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:25.553030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:25.560385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.561127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.561963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.562553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.622056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.623748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.624252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lazy-loading 'fault' on Instance uuid 5f8ac748-1dff-4324-8ad2-b5c50606e509 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:25.660995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:25.685025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:25.687155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:25.691309 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d7df9052-365f-4023-a053-765f78d74a25 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1487 microversion: 2.25 time: 0.220813 Apr 30 21:16:25.702317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:25.702624 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 855/1801] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:25 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1487 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:25.702727 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1aa47b91-9ad0-4716-acba-ca2320a6fa2c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 200 len: 1307 microversion: 2.1 time: 0.151662 Apr 30 21:16:25.702727 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 947/1802] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:25 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:25.704881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:25.705732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:25.712268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Action: 'update', calling method: .version_select at 0x7fdc2094cdc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:25.712466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.712858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.713687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.714995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.867363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:25.869212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.869851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.870674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.871130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.875629 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0641a847-4edf-4b53-8d1e-cb64168d47b9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1382 microversion: 2.1 time: 0.174256 Apr 30 21:16:25.884791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 948/1803] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:25 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1382 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:25.884791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:25.884791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:25.889536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.890130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.890981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.891492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.914940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.915364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:25.916179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:25.916623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.043855 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3198efeb-d70a-46d6-a493-23bff9be771f tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20?user_id=18a05a12418f437cb6590d22f27ebf9e" status: 200 len: 240 microversion: 2.36 time: 0.350733 Apr 30 21:16:26.044656 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 856/1804] 10.222.0.23 () {62 vars in 1383 bytes} [Sat Apr 30 21:16:25 2022] PUT /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20?user_id=18a05a12418f437cb6590d22f27ebf9e => generated 240 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:26.049791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-62b8fee4-aee6-4da7-a763-5272f772b223 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '.version_select at 0x7fdc207aef70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.052314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62b8fee4-aee6-4da7-a763-5272f772b223 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.052778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62b8fee4-aee6-4da7-a763-5272f772b223 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.066095 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-62b8fee4-aee6-4da7-a763-5272f772b223 tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3479 microversion: 2.1 time: 0.019873 Apr 30 21:16:26.068369 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 857/1805] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:16:26 2022] GET /compute/v2.1/os-migrations => generated 3479 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:26.071013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:26.071235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.071861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:26.078453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.078917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.079552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-91a813a7-47b9-4e76-8ddc-554231535891 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1468 microversion: 2.1 time: 0.201444 Apr 30 21:16:26.079769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.080228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.080412 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 949/1806] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:25 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1468 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:26.085785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b381aa13-dfec-4de2-b4fb-2c4df591a25c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Calling method '.version_select at 0x7fdc20d52310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.189526 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b381aa13-dfec-4de2-b4fb-2c4df591a25c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20?user_id=18a05a12418f437cb6590d22f27ebf9e" status: 200 len: 282 microversion: 2.36 time: 0.107290 Apr 30 21:16:26.199095 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 950/1807] 10.222.0.23 () {60 vars in 1363 bytes} [Sat Apr 30 21:16:26 2022] GET /compute/v2.1/os-quota-sets/2490d5f1ec364da1829500bfa3c79b20?user_id=18a05a12418f437cb6590d22f27ebf9e => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:26.206121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df414335-2f55-4015-bdb5-4291d9421b1a tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.207111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df414335-2f55-4015-bdb5-4291d9421b1a tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:26.216032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df414335-2f55-4015-bdb5-4291d9421b1a tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.217047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df414335-2f55-4015-bdb5-4291d9421b1a tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.218525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df414335-2f55-4015-bdb5-4291d9421b1a tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.219757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df414335-2f55-4015-bdb5-4291d9421b1a tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.290175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:26.300720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6a32c6f-d7ea-4911-8a7e-5ae81d6aa636 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.230224 Apr 30 21:16:26.300720 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 858/1808] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:26 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:26.454646 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df414335-2f55-4015-bdb5-4291d9421b1a tempest-LiveMigrationTest-343940872 tempest-LiveMigrationTest-343940872-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1533 microversion: 2.1 time: 0.253517 Apr 30 21:16:26.456919 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 951/1809] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:26 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1533 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:26.491724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.492446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:26.498749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.501819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.501819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.501819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.534832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:26.713608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.715714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:26.728226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.729455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.731490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.732159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.884598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:26.893082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:26.895529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:26.897104 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-282b1c31-d8c7-4345-b852-354a19176813 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1477 microversion: 2.25 time: 0.191047 Apr 30 21:16:26.897877 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 952/1810] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:26 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:16:26.902363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.903180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: 5f8ac748-1dff-4324-8ad2-b5c50606e509] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:26.909152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.909611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.910454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.911052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.926873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] HTTP exception thrown: Instance 5f8ac748-1dff-4324-8ad2-b5c50606e509 could not be found. Apr 30 21:16:26.927481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Returning 404 to user: Instance 5f8ac748-1dff-4324-8ad2-b5c50606e509 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:26.928327 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-46df579a-7243-486c-99b4-a7bc4a597913 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509" status: 404 len: 111 microversion: 2.1 time: 0.029522 Apr 30 21:16:26.928856 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 953/1811] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:26 2022] GET /compute/v2.1/servers/5f8ac748-1dff-4324-8ad2-b5c50606e509 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:26.933409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-989a25ae-07ea-4bc9-916d-4cf00e4d4c5a tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '.version_select at 0x7fdc205765e0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.936148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-989a25ae-07ea-4bc9-916d-4cf00e4d4c5a tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.936599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-989a25ae-07ea-4bc9-916d-4cf00e4d4c5a tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.949119 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-989a25ae-07ea-4bc9-916d-4cf00e4d4c5a tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 4294 microversion: 2.25 time: 0.019307 Apr 30 21:16:26.949744 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 954/1812] 10.222.0.23 () {60 vars in 1183 bytes} [Sat Apr 30 21:16:26 2022] GET /compute/v2.1/os-migrations => generated 4294 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:26.959988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:26.960513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:26.966927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.967385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.968170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:26.968707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:26.996996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:27.056191 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32c95c27-c36d-4e4b-8416-f45ec4bb403e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 204 len: 0 microversion: 2.1 time: 0.566985 Apr 30 21:16:27.057895 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 859/1813] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:26 2022] DELETE /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:27.064841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:27.066558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:27.074767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.075583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.076638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.077254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.253917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] Lazy-loading 'services' on Instance uuid aff8d0ca-9b07-4f8b-b9af-bf18481b3550 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:27.292855 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-892a6fc2-709f-49ee-855a-06e712176f20 tempest-LiveAutoBlockMigrationV225Test-718230883 tempest-LiveAutoBlockMigrationV225Test-718230883-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1970 microversion: 2.25 time: 0.233087 Apr 30 21:16:27.297589 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 860/1814] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:27 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1970 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:27.298941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:27.299828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:27.307884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.308600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.309901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.310621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.465338 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1451c52-8449-4b09-9ee8-107c229f0dac tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 204 len: 0 microversion: 2.1 time: 0.511811 Apr 30 21:16:27.465888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:27.466013 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 955/1815] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:26 2022] DELETE /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:27.468500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:27.469201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:27.471405 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9b8b51b-522f-4f25-809a-8b859babf25a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1388 microversion: 2.1 time: 0.176401 Apr 30 21:16:27.472073 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 861/1816] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:27 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1388 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:27.476484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-1699e445-51be-42a7-8f52-fbcc004c0969 req-0ec025a5-2ce4-4a8d-9aab-e61e54c5abd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63136ef9-512e-4d74-9427-5db9addb1129", "name": "network-vif-deleted", "tag": "5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:27.483819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.484279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.484415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1699e445-51be-42a7-8f52-fbcc004c0969 req-0ec025a5-2ce4-4a8d-9aab-e61e54c5abd0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.484807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1699e445-51be-42a7-8f52-fbcc004c0969 req-0ec025a5-2ce4-4a8d-9aab-e61e54c5abd0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.485055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.485491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.497815 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-1699e445-51be-42a7-8f52-fbcc004c0969 req-0ec025a5-2ce4-4a8d-9aab-e61e54c5abd0 service nova] Creating event network-vif-deleted:5f58ff46-e195-4c4e-b64b-a0a5cbe61c9b for instance 63136ef9-512e-4d74-9427-5db9addb1129 on nch1-master-1 Apr 30 21:16:27.503448 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-1699e445-51be-42a7-8f52-fbcc004c0969 req-0ec025a5-2ce4-4a8d-9aab-e61e54c5abd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Apr 30 21:16:27.504127 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 862/1817] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:27.510802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:27.511904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:27.523035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.523711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.525107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.525972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.565868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:27.579558 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d3d26e7-d824-4700-9852-3e5b4eeea6cb tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1426 microversion: 2.1 time: 0.114954 Apr 30 21:16:27.580145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 956/1818] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:27 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:27.593509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:27.593509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:27.607617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.609618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.611278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.614398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.647127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:27.724606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:27.732697 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e2ea2e1-dc3e-468b-ac71-9f3b0c607959 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1351 microversion: 2.1 time: 0.227426 Apr 30 21:16:27.736943 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 863/1819] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:27 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1351 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:27.738028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:27.738652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:27.744509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.744974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.749143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:27.749143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:27.907523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:27.919971 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f541bd52-ded8-481e-af12-0e557656fa94 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1474 microversion: 2.1 time: 0.185575 Apr 30 21:16:27.930203 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 864/1820] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:27 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1474 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:28.037513 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2e19b65d-008e-4925-825c-22aac4ddbe7b tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 204 len: 0 microversion: 2.25 time: 0.455711 Apr 30 21:16:28.038706 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 957/1821] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:16:27 2022] DELETE /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:16:28.047268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:28.048433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:28.059284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.061403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.062395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.063522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.291245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:28.302065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:28.303745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:28.305047 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f470377-e9d5-49e3-86c1-5857783496d5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1483 microversion: 2.25 time: 0.262393 Apr 30 21:16:28.307605 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 865/1822] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:28 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1483 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:28.489748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:28.490490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:28.496709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.497167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.497988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.498442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.598737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:28.599432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:28.606574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:28.617824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.618553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.619427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.619869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.625629 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80ebb46f-02dc-4504-a984-93f4dfba7900 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1346 microversion: 2.1 time: 0.140488 Apr 30 21:16:28.639384 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 958/1823] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:28 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:28.675924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b98a2d22-dcd3-474b-85a6-17f418dc62c1 req-0fe6f798-8713-455d-b975-8be315411d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c545493b-8dac-45bb-8afa-bb8845cdeda6", "name": "network-vif-deleted", "tag": "01bd63bd-e064-484d-a092-dec5a749a3ec"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:28.705877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b98a2d22-dcd3-474b-85a6-17f418dc62c1 req-0fe6f798-8713-455d-b975-8be315411d86 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.706436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b98a2d22-dcd3-474b-85a6-17f418dc62c1 req-0fe6f798-8713-455d-b975-8be315411d86 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.745111 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b98a2d22-dcd3-474b-85a6-17f418dc62c1 req-0fe6f798-8713-455d-b975-8be315411d86 service nova] Creating event network-vif-deleted:01bd63bd-e064-484d-a092-dec5a749a3ec for instance c545493b-8dac-45bb-8afa-bb8845cdeda6 on nch2-master-1 Apr 30 21:16:28.758127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b98a2d22-dcd3-474b-85a6-17f418dc62c1 req-0fe6f798-8713-455d-b975-8be315411d86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087465 Apr 30 21:16:28.759171 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 959/1824] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:28.762738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:28.766288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:28.767262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:28.776079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.777151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.777942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.778557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.783823 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10c17aa4-c9f1-43af-ab79-f4620c8c808d tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1298 microversion: 2.1 time: 0.190982 Apr 30 21:16:28.785379 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 866/1825] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:28 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1298 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:28.918226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:28.926039 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ff544e2-8549-4865-b7de-bc80ba9c010c tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1541 microversion: 2.1 time: 0.165241 Apr 30 21:16:28.926595 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 960/1826] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:28 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1541 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:28.938224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:28.938852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:28.944570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a676691-1660-49ca-90d7-199dcb726e17 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:28.945073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a676691-1660-49ca-90d7-199dcb726e17 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:28.945691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.946257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.947183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.947712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.951447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a676691-1660-49ca-90d7-199dcb726e17 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.953222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a676691-1660-49ca-90d7-199dcb726e17 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:28.953222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a676691-1660-49ca-90d7-199dcb726e17 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:28.953222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a676691-1660-49ca-90d7-199dcb726e17 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.100027 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a676691-1660-49ca-90d7-199dcb726e17 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160836 Apr 30 21:16:29.100981 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 961/1827] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:16:28 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:29.157955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:29.173038 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-39f04a79-9cfc-4a80-9b41-4fa3f6f9ad3a tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1474 microversion: 2.1 time: 0.239519 Apr 30 21:16:29.173636 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 867/1828] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:28 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1474 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:29.327654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:29.328408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:29.335957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.336644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.337626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.338104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.560666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:29.572736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:29.574427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:29.575907 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6efb64dc-7688-4056-879d-8cdffd0b7a7d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1483 microversion: 2.25 time: 0.256772 Apr 30 21:16:29.576499 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 962/1829] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:29 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1483 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:29.642938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:29.644384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:29.653853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.654543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.655540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.656018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.728979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.729968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.730658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lazy-loading 'fault' on Instance uuid c545493b-8dac-45bb-8afa-bb8845cdeda6 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:29.793438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:29.807027 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-399eb78e-57f3-4c22-811e-b0c73652127d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 200 len: 1189 microversion: 2.1 time: 0.167800 Apr 30 21:16:29.813485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:29.816037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:29.817617 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 868/1830] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:29 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 1189 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:29.824714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.825172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.826011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.826448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.859890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:29.860321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:29.860768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lazy-loading 'fault' on Instance uuid 63136ef9-512e-4d74-9427-5db9addb1129 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:29.904160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce42480cd844664991774f07ca47e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8bde5d9ca44f859b5536d3398b63d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:29.912753 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75d8d7c5-d5fa-4a89-ac42-0225cc75c1ca tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 200 len: 1303 microversion: 2.1 time: 0.115638 Apr 30 21:16:29.913508 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 963/1831] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:29 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:30.207600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:30.208217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:30.219547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.220006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.221016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.221563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.405595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:30.413902 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-53877988-4fb1-4439-8d73-6e988e1b785e tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1474 microversion: 2.1 time: 0.213548 Apr 30 21:16:30.415185 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 869/1832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:30 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1474 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:30.601370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:30.601999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:30.608571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.609033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.609919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.610558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.771756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:30.783509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:30.786367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:30.787568 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b564c373-2ec1-4a9c-ae0c-02bbdcce3b74 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1483 microversion: 2.25 time: 0.190989 Apr 30 21:16:30.788182 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 964/1833] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:30 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1483 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:30.826065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:30.826810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: c545493b-8dac-45bb-8afa-bb8845cdeda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:30.834259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.834838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.835925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.836676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.852128 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] HTTP exception thrown: Instance c545493b-8dac-45bb-8afa-bb8845cdeda6 could not be found. Apr 30 21:16:30.852792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Returning 404 to user: Instance c545493b-8dac-45bb-8afa-bb8845cdeda6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:30.853776 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4d183ae4-613e-40ad-9b4c-5b4e86e709b4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6" status: 404 len: 111 microversion: 2.1 time: 0.033414 Apr 30 21:16:30.854411 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 870/1834] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:30 2022] GET /compute/v2.1/servers/c545493b-8dac-45bb-8afa-bb8845cdeda6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:30.931497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:30.932439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] [instance: 63136ef9-512e-4d74-9427-5db9addb1129] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:30.942006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.942945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.944020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:30.944927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:30.984126 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] HTTP exception thrown: Instance 63136ef9-512e-4d74-9427-5db9addb1129 could not be found. Apr 30 21:16:30.990006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] Returning 404 to user: Instance 63136ef9-512e-4d74-9427-5db9addb1129 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:30.990006 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b010ac7e-5272-4a8c-9a61-33a94eeb1e16 tempest-MigrationsAdminTest-242795420 tempest-MigrationsAdminTest-242795420-project] 10.222.0.23 "GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129" status: 404 len: 111 microversion: 2.1 time: 0.059322 Apr 30 21:16:30.990006 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 965/1835] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:30 2022] GET /compute/v2.1/servers/63136ef9-512e-4d74-9427-5db9addb1129 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:31.430990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:31.431950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:31.441734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:31.441734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:31.442435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:31.442974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:31.642184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5cb5b3e2-5c70-42e7-8486-ac8bb816e062 req-cb2361f3-e5ce-431d-bb7a-ead3e936f998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422d9d7c-80c8-4693-925c-f434084a7bd1", "tag": "a648764a-35bc-4bbd-b4e5-9b7bf42d6e11"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:31.654102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:31.671430 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9342c295-741d-4443-9048-a4db1223041c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1474 microversion: 2.1 time: 0.235876 Apr 30 21:16:31.671430 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 871/1836] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:31 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:31.671981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5cb5b3e2-5c70-42e7-8486-ac8bb816e062 req-cb2361f3-e5ce-431d-bb7a-ead3e936f998 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:31.671981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5cb5b3e2-5c70-42e7-8486-ac8bb816e062 req-cb2361f3-e5ce-431d-bb7a-ead3e936f998 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:31.713226 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5cb5b3e2-5c70-42e7-8486-ac8bb816e062 req-cb2361f3-e5ce-431d-bb7a-ead3e936f998 service nova] Creating event network-changed:a648764a-35bc-4bbd-b4e5-9b7bf42d6e11 for instance 422d9d7c-80c8-4693-925c-f434084a7bd1 on nch1-master-1 Apr 30 21:16:31.724917 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5cb5b3e2-5c70-42e7-8486-ac8bb816e062 req-cb2361f3-e5ce-431d-bb7a-ead3e936f998 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090579 Apr 30 21:16:31.727247 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 966/1837] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:16:31.812435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:31.814010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:31.820923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:31.821391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:31.822231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:31.822678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:32.689276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:32.690371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:32.712595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:32.713064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:32.737802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:32.738534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:32.864042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:32.889611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:32.896206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:32.914126 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35e268e7-459c-49d8-8dcc-6d5e92e6eec5 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1483 microversion: 2.25 time: 1.109854 Apr 30 21:16:32.915094 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 872/1838] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:31 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1483 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:32.979154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2cc38da7684af39aed81a0e05d60a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33635f00a9e48818fe1081019a2ceb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:32.992781 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-519988cb-25bf-4db1-b76d-5db9d31a9626 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 200 len: 1303 microversion: 2.1 time: 0.308702 Apr 30 21:16:32.993913 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 967/1839] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:32 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 1303 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:33.837443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-fc104281-5fe9-4d80-abae-667a046fb3fe req-f7534c06-cd37-4fba-bd95-69c8af0e08ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17c37ba-07cd-47b9-9a7b-17d799280bbb", "name": "network-vif-deleted", "tag": "0148cfe2-db7e-4096-b624-dd079aece8ea"}, {"server_uuid": "aff8d0ca-9b07-4f8b-b9af-bf18481b3550", "name": "network-vif-deleted", "tag": "d31b0a65-0a8e-4414-bf95-4b3a788b6203"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:33.850865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fc104281-5fe9-4d80-abae-667a046fb3fe req-f7534c06-cd37-4fba-bd95-69c8af0e08ce service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:33.851584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fc104281-5fe9-4d80-abae-667a046fb3fe req-f7534c06-cd37-4fba-bd95-69c8af0e08ce service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:33.878422 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-fc104281-5fe9-4d80-abae-667a046fb3fe req-f7534c06-cd37-4fba-bd95-69c8af0e08ce service nova] Creating event network-vif-deleted:0148cfe2-db7e-4096-b624-dd079aece8ea for instance f17c37ba-07cd-47b9-9a7b-17d799280bbb on nch1-master-1 Apr 30 21:16:33.880897 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-fc104281-5fe9-4d80-abae-667a046fb3fe req-f7534c06-cd37-4fba-bd95-69c8af0e08ce service nova] Creating event network-vif-deleted:d31b0a65-0a8e-4414-bf95-4b3a788b6203 for instance aff8d0ca-9b07-4f8b-b9af-bf18481b3550 on nch1-master-1 Apr 30 21:16:33.894466 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-fc104281-5fe9-4d80-abae-667a046fb3fe req-f7534c06-cd37-4fba-bd95-69c8af0e08ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061128 Apr 30 21:16:33.895100 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 873/1840] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:16:33.945723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:33.946390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:33.954276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:33.955014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:33.957463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:33.958110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:34.000402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:34.002049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:34.003379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lazy-loading 'fault' on Instance uuid aff8d0ca-9b07-4f8b-b9af-bf18481b3550 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:34.013348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:34.014155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] [instance: f17c37ba-07cd-47b9-9a7b-17d799280bbb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:34.027748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:34.028484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:34.029327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:34.029793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:34.058285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:34.062423 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] HTTP exception thrown: Instance f17c37ba-07cd-47b9-9a7b-17d799280bbb could not be found. Apr 30 21:16:34.063227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Returning 404 to user: Instance f17c37ba-07cd-47b9-9a7b-17d799280bbb could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:34.064512 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c87efd8c-6ddd-4c5d-9478-6755081f4c3f tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb" status: 404 len: 111 microversion: 2.1 time: 0.055976 Apr 30 21:16:34.066158 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 874/1841] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:34 2022] GET /compute/v2.1/servers/f17c37ba-07cd-47b9-9a7b-17d799280bbb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:34.068287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:34.070074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:34.071451 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b226925-cc2f-4ebb-b6a2-3552d7c102af tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 200 len: 1271 microversion: 2.25 time: 0.140461 Apr 30 21:16:34.076589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f99912b8-4f28-472c-b04f-ab0626fcb02c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc209c7a60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:34.091400 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 968/1842] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:33 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:35.094551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:35.095166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: aff8d0ca-9b07-4f8b-b9af-bf18481b3550] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:35.113205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:35.114109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:35.115640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:35.116245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:35.136995 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] HTTP exception thrown: Instance aff8d0ca-9b07-4f8b-b9af-bf18481b3550 could not be found. Apr 30 21:16:35.138029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Returning 404 to user: Instance aff8d0ca-9b07-4f8b-b9af-bf18481b3550 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:35.139040 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6ee93338-07e1-4e32-a7db-b83dae19de23 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550" status: 404 len: 111 microversion: 2.25 time: 0.050119 Apr 30 21:16:35.139959 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 969/1843] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:35 2022] GET /compute/v2.1/servers/aff8d0ca-9b07-4f8b-b9af-bf18481b3550 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:16:35.209445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f99912b8-4f28-472c-b04f-ab0626fcb02c tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/images/6f73709b-da95-4aee-828f-c952262618a0" status: 204 len: 0 microversion: 2.1 time: 1.139304 Apr 30 21:16:35.210136 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 875/1844] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:34 2022] DELETE /compute/v2.1/images/6f73709b-da95-4aee-828f-c952262618a0 => generated 0 bytes in 1141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:35.219376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe7d0f3f-66b4-4bb1-8841-9cb79000d599 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc21cb6940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:36.329623 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe7d0f3f-66b4-4bb1-8841-9cb79000d599 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/images/e84f5342-ab96-46b8-bf21-c62729b65811" status: 204 len: 0 microversion: 2.1 time: 1.115154 Apr 30 21:16:36.331259 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 970/1845] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:35 2022] DELETE /compute/v2.1/images/e84f5342-ab96-46b8-bf21-c62729b65811 => generated 0 bytes in 1117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:36.338952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c546b625-5d47-4532-925a-69868e19e1b5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] Calling method '.version_select at 0x7fdc208fe430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:37.327100 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c546b625-5d47-4532-925a-69868e19e1b5 tempest-ListImageFiltersTestJSON-1216330649 tempest-ListImageFiltersTestJSON-1216330649-project] 10.222.0.23 "DELETE /compute/v2.1/images/15e0057f-71f5-44b3-8ca2-02d2a40fec86" status: 204 len: 0 microversion: 2.1 time: 0.989325 Apr 30 21:16:37.327100 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 876/1846] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:36 2022] DELETE /compute/v2.1/images/15e0057f-71f5-44b3-8ca2-02d2a40fec86 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:37.710765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:37.711394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:37.717932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:37.719043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:37.719854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:37.720303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:37.750163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:37.942463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c67c430a-a9b3-4c6f-a0ee-7b28613646f7 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Action: 'create', calling method: .version_select at 0x7fdc204c2160>, body: {"keypair": {"name": "tempest-keypair-1575200531"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:37.989671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c67c430a-a9b3-4c6f-a0ee-7b28613646f7 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for project b9c121a94ec3445baa05dcaa3dc22af2. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:37.994934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c67c430a-a9b3-4c6f-a0ee-7b28613646f7 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for user 5df6ea2992c04a97af023bfb428ac44e and project b9c121a94ec3445baa05dcaa3dc22af2. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:38.137542 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1744fb17-36a3-4b7c-b966-f1ee3514de73 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "DELETE /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 204 len: 0 microversion: 2.1 time: 0.437032 Apr 30 21:16:38.141880 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 877/1847] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:37 2022] DELETE /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:16:38.149415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:38.150173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:38.171908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:38.182362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:38.186051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:38.186051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:38.241875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c67c430a-a9b3-4c6f-a0ee-7b28613646f7 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for project b9c121a94ec3445baa05dcaa3dc22af2. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:38.253215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c67c430a-a9b3-4c6f-a0ee-7b28613646f7 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for user 5df6ea2992c04a97af023bfb428ac44e and project b9c121a94ec3445baa05dcaa3dc22af2. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:38.280374 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c67c430a-a9b3-4c6f-a0ee-7b28613646f7 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.582119 Apr 30 21:16:38.281304 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 971/1848] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:16:37 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:38.386046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:38.394672 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b344b99f-2568-48a5-ad80-b8f4f8f30a9d tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1500 microversion: 2.1 time: 0.251295 Apr 30 21:16:38.405540 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 878/1849] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:38 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1500 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:38.747807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f72b609d-cc78-401b-9254-8cc6b2679848 tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] Calling method '.version_select at 0x7fdc204c21f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:38.748903 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:16:38.748903 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:16:38.770451 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f72b609d-cc78-401b-9254-8cc6b2679848 tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.487950 Apr 30 21:16:38.771637 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 972/1850] 10.222.0.23 () {60 vars in 1225 bytes} [Sat Apr 30 21:16:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:38.783400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1d1c8f8e-561c-495d-b1dd-4039b22d6012 tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] Action: 'update', calling method: .version_select at 0x7fdc206d4e50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:38.786714 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:16:38.786714 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:16:39.413285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:39.413983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:39.425127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:39.425722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:39.426652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:39.427173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:39.509347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:39.518891 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84fa0be3-a9d9-42f9-bba8-50cb574aa0a3 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1458 microversion: 2.1 time: 0.109215 Apr 30 21:16:39.529615 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 973/1851] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:39 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1458 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:39.540367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-93e2f32f-e9e4-40c0-a651-0ea90c22553e req-88fea5d0-11b4-4e7e-86c5-bea0b3904baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c246e5-490c-4639-8c9a-4b088609cc2e", "name": "network-vif-deleted", "tag": "2ecc5d88-fb01-4e83-9ea8-85d7acd6114b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:39.554791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-93e2f32f-e9e4-40c0-a651-0ea90c22553e req-88fea5d0-11b4-4e7e-86c5-bea0b3904baf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:39.561300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-93e2f32f-e9e4-40c0-a651-0ea90c22553e req-88fea5d0-11b4-4e7e-86c5-bea0b3904baf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:39.568337 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-93e2f32f-e9e4-40c0-a651-0ea90c22553e req-88fea5d0-11b4-4e7e-86c5-bea0b3904baf service nova] Creating event network-vif-deleted:2ecc5d88-fb01-4e83-9ea8-85d7acd6114b for instance 27c246e5-490c-4639-8c9a-4b088609cc2e on nch1-master-1 Apr 30 21:16:39.573485 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-93e2f32f-e9e4-40c0-a651-0ea90c22553e req-88fea5d0-11b4-4e7e-86c5-bea0b3904baf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042406 Apr 30 21:16:39.574751 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 974/1852] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:39.708650 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1d1c8f8e-561c-495d-b1dd-4039b22d6012 tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.924652 Apr 30 21:16:39.709493 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 879/1853] 10.222.0.23 () {62 vars in 1246 bytes} [Sat Apr 30 21:16:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:39.722987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4f31b4f-418e-4b15-b0d5-411799e68a11 tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] Calling method '.version_select at 0x7fdc20d5b5e0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:39.724346 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:16:39.724346 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:16:39.760397 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4f31b4f-418e-4b15-b0d5-411799e68a11 tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.042544 Apr 30 21:16:39.762564 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 975/1854] 10.222.0.23 () {60 vars in 1225 bytes} [Sat Apr 30 21:16:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:39.773559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b662c6c-d945-4a10-aa1f-94e9e11f7f3e tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] Action: 'update', calling method: .version_select at 0x7fdc207ae940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:40.543908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:40.547282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:40.566064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:40.567452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:40.568490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:40.569206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:40.614325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:40.615031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:40.615652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lazy-loading 'fault' on Instance uuid 27c246e5-490c-4639-8c9a-4b088609cc2e {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:40.653983 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b662c6c-d945-4a10-aa1f-94e9e11f7f3e tempest-QuotaClassesAdmin257Test-453779740 tempest-QuotaClassesAdmin257Test-453779740-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.886413 Apr 30 21:16:40.654706 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 880/1855] 10.222.0.23 () {62 vars in 1246 bytes} [Sat Apr 30 21:16:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:16:40.670604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:40.694174 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cb90e4d8-429a-4822-acc1-9369960885d1 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 200 len: 1301 microversion: 2.1 time: 0.159850 Apr 30 21:16:40.694804 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 976/1856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:40 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:41.302084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-355839295", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:41.360259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:16:41.620703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:16:41.621274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:16:41.621914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:16:41.622775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:16:41.623496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:16:41.641704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:41.646908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:41.647848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:41.648303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:41.672072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Getting quotas for project 25bcc72715fa4ba88d3ca6b371eb1f93. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:41.678370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Getting quotas for user 0067ff081d1946149db58fd383e81bff and project 25bcc72715fa4ba88d3ca6b371eb1f93. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:41.695843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:16:41.698964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:16:41.712588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:41.713219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 27c246e5-490c-4639-8c9a-4b088609cc2e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:41.722458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:41.722919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:41.723716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:41.724672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:41.747874 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] HTTP exception thrown: Instance 27c246e5-490c-4639-8c9a-4b088609cc2e could not be found. Apr 30 21:16:41.749672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Returning 404 to user: Instance 27c246e5-490c-4639-8c9a-4b088609cc2e could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:41.752835 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c10fc33-ac71-4e42-9e2b-21bc5177675e tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e" status: 404 len: 111 microversion: 2.1 time: 0.043657 Apr 30 21:16:41.758546 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 977/1857] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:41 2022] GET /compute/v2.1/servers/27c246e5-490c-4639-8c9a-4b088609cc2e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:16:41.770147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:41.770713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:41.782271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:41.782744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:41.783576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:41.788064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:41.843896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:41.958284 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-da340377-5ca1-41ec-a032-982dcfc183f9 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833679 Apr 30 21:16:41.959384 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 881/1858] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:16:41.973714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e2101a38-6fa5-4c46-a99b-8da0ec42d90d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:41.974501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e2101a38-6fa5-4c46-a99b-8da0ec42d90d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:42.036683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e2101a38-6fa5-4c46-a99b-8da0ec42d90d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:42.044351 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e2101a38-6fa5-4c46-a99b-8da0ec42d90d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1222 microversion: 2.1 time: 0.077587 Apr 30 21:16:42.046696 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 882/1859] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:41 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:42.361381 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a66d1a80-2213-4680-aa72-81aaea43817b tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 204 len: 0 microversion: 2.1 time: 0.597992 Apr 30 21:16:42.366909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 978/1860] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:41 2022] DELETE /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:42.382116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:42.382829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:42.397204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:42.402321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:42.407584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:42.407584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:42.553565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:42.561864 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d3d812c6-1e1d-4592-bf66-76ead4972ed9 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1485 microversion: 2.1 time: 0.192308 Apr 30 21:16:42.563502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 883/1861] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:42 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1485 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:43.066147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7e777093-731a-4333-84db-e1ad3c02a636 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:43.066892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7e777093-731a-4333-84db-e1ad3c02a636 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:43.182002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7e777093-731a-4333-84db-e1ad3c02a636 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:43.194599 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7e777093-731a-4333-84db-e1ad3c02a636 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1222 microversion: 2.1 time: 0.134737 Apr 30 21:16:43.196538 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 979/1862] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:43 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:43.581710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:43.582913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:43.590837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:43.591584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:43.592554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:43.593005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:43.610584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-99d5f962-d960-4ca7-b684-578e7826ddde req-60d64605-8fa7-4a94-a45e-f2f2cc314a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f26a54-dfce-45a0-9dc2-3bd5be9f87c8", "name": "network-vif-deleted", "tag": "4306ca96-09e1-476e-90ee-9c1a1813cb5f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:43.620653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-99d5f962-d960-4ca7-b684-578e7826ddde req-60d64605-8fa7-4a94-a45e-f2f2cc314a6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:43.621403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-99d5f962-d960-4ca7-b684-578e7826ddde req-60d64605-8fa7-4a94-a45e-f2f2cc314a6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:43.643829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-99d5f962-d960-4ca7-b684-578e7826ddde req-60d64605-8fa7-4a94-a45e-f2f2cc314a6a service nova] Creating event network-vif-deleted:4306ca96-09e1-476e-90ee-9c1a1813cb5f for instance 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 on nch1-master-1 Apr 30 21:16:43.649556 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-99d5f962-d960-4ca7-b684-578e7826ddde req-60d64605-8fa7-4a94-a45e-f2f2cc314a6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043027 Apr 30 21:16:43.650827 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 980/1863] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:43.688112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:43.697930 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7de8e67c-66c2-4737-81c5-37c74acd897a tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1443 microversion: 2.1 time: 0.121440 Apr 30 21:16:43.699187 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 884/1864] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:43 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1443 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:44.212639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:44.213362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:44.220623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:44.222299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:44.223306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:44.223758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:44.300764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:44.308940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c708f97d-6cdd-4c83-8bf5-d4dc8a96e20a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1274 microversion: 2.1 time: 0.101202 Apr 30 21:16:44.310359 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 981/1865] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:44 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:44.715172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:44.717062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:44.730338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:44.731507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:44.733878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:44.734453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:44.799868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:44.800979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:44.803870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lazy-loading 'fault' on Instance uuid 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:44.972671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:44.980356 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1eeed4b5-aa7b-477f-b114-4600b7b777aa tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 200 len: 1300 microversion: 2.1 time: 0.269122 Apr 30 21:16:44.982652 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 885/1866] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:44 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:45.327629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:45.328340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:45.342822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:45.343728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:45.344813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:45.346952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:45.572035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:45.582775 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fdce1346-fde8-4a0a-9d66-0a80a047cf25 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1280 microversion: 2.1 time: 0.259591 Apr 30 21:16:45.583365 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 982/1867] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:45 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:45.999079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:46.000746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:46.009465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.010156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:46.011379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.012048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:46.027685 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] HTTP exception thrown: Instance 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 could not be found. Apr 30 21:16:46.028853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Returning 404 to user: Instance 89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:46.034236 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-39b51204-fa82-4b2c-97ca-5fd68d7024c5 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8" status: 404 len: 111 microversion: 2.1 time: 0.034818 Apr 30 21:16:46.034236 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 886/1868] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:45 2022] GET /compute/v2.1/servers/89f26a54-dfce-45a0-9dc2-3bd5be9f87c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:46.040427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:46.041495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:46.048286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.048756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:46.049589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.050063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:46.090871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:46.574543 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f43eca3-c434-42a4-b4a9-5b028fb5aea4 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 204 len: 0 microversion: 2.1 time: 0.538529 Apr 30 21:16:46.576162 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 983/1869] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:16:46 2022] DELETE /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:16:46.587419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:46.588471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:46.601153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:46.602928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:46.621917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.624041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:46.625714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.626860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.628320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:46.628874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:46.633156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:46.633814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:47.442037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:47.451227 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-24eac7cf-227e-4ddb-ac96-2a5caa8699eb tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1322 microversion: 2.1 time: 0.855189 Apr 30 21:16:47.452150 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 984/1870] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:46 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1322 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:47.578555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:47.608365 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f75ffee-75e0-4898-b3b5-12f1eb7bbbca tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1500 microversion: 2.1 time: 1.026773 Apr 30 21:16:47.610127 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 887/1871] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:46 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1500 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:47.624365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:47.626130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:47.637290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:47.638871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:47.639942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:47.640588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:47.693013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:47.703623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71ad46a6-d80c-4da2-b2c7-d51b4fa354e0 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Calling method '.version_select at 0x7fdc20455700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:47.839599 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71ad46a6-d80c-4da2-b2c7-d51b4fa354e0 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 371 microversion: 2.1 time: 0.386331 Apr 30 21:16:47.842128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 985/1872] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:16:47 2022] GET /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:47.892009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e64645b3-949a-44c9-a643-00ae21fedf61 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20d5bc10>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:47.999643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e64645b3-949a-44c9-a643-00ae21fedf61 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.015884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e64645b3-949a-44c9-a643-00ae21fedf61 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:48.019937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e64645b3-949a-44c9-a643-00ae21fedf61 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.019937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e64645b3-949a-44c9-a643-00ae21fedf61 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:48.127875 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7d64e0cd-dfcb-4f29-9982-7067dd658ad6 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 204 len: 0 microversion: 2.25 time: 0.515319 Apr 30 21:16:48.132229 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 888/1873] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:16:47 2022] DELETE /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:16:48.138545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:48.139271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:48.156419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.157022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:48.157963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.158536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:48.234699 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e64645b3-949a-44c9-a643-00ae21fedf61 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 328 microversion: 2.1 time: 0.373317 Apr 30 21:16:48.237526 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 986/1874] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:47 2022] PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:48.471809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:48.473526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:48.485404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.488862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:48.488862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.488862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:48.555437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:48.565363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:48.567139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:48.568189 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b268e3f1-1adb-4c84-a7a2-a6b94c2f1487 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1564 microversion: 2.25 time: 0.434687 Apr 30 21:16:48.568986 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 889/1875] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:48 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1564 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:48.708970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1835533513", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:48.772168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:16:48.883673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:48.907951 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-badc3933-2036-4cd9-abdd-3a65cbd7ecf8 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1322 microversion: 2.1 time: 0.434382 Apr 30 21:16:48.908719 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 987/1876] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:48 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:48.931216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:48.931974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:48.956285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.957453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:48.962332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:48.962827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:49.107549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a25f2505d5141c5b894bfd6515eb7f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:49.138641 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a8e384e-a790-4247-8e31-6127b36dc417 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 200 len: 1295 microversion: 2.1 time: 0.228175 Apr 30 21:16:49.139618 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 988/1877] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:48 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 1295 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:49.151418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-6d9a4108-bf98-4b91-bca4-ba2db9f01416 req-bdd963fb-c9a4-4e31-9331-9c23d5e6f479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6c5822-07aa-4e1d-9424-ee70b0405349", "name": "network-vif-deleted", "tag": "ac54aba9-ad17-45b1-8ed2-985784924902"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:49.166240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6d9a4108-bf98-4b91-bca4-ba2db9f01416 req-bdd963fb-c9a4-4e31-9331-9c23d5e6f479 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:49.166779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6d9a4108-bf98-4b91-bca4-ba2db9f01416 req-bdd963fb-c9a4-4e31-9331-9c23d5e6f479 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:49.189129 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-6d9a4108-bf98-4b91-bca4-ba2db9f01416 req-bdd963fb-c9a4-4e31-9331-9c23d5e6f479 service nova] Creating event network-vif-deleted:ac54aba9-ad17-45b1-8ed2-985784924902 for instance ae6c5822-07aa-4e1d-9424-ee70b0405349 on nch1-master-1 Apr 30 21:16:49.198945 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-6d9a4108-bf98-4b91-bca4-ba2db9f01416 req-bdd963fb-c9a4-4e31-9331-9c23d5e6f479 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054157 Apr 30 21:16:49.208517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 989/1878] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:49.401856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:16:49.402497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:16:49.403990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:16:49.404768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:16:49.405319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:16:49.417306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:49.417988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:49.419815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:49.420352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:49.451065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Getting quotas for project 5782d01316e94d33b40d6d00fd572811. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:49.458205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Getting quotas for user 435506a91f1a4e4eae6ecdc81c9bec8c and project 5782d01316e94d33b40d6d00fd572811. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:49.473912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.utils [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] cores quota exceeded for 5782d01316e94d33b40d6d00fd572811, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130670) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 30 21:16:49.475285 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Apr 30 21:16:49.476369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:49.481905 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a1f8a9b-ed64-41c2-8779-3d5898325548 tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.907623 Apr 30 21:16:49.481905 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 890/1879] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:16:48 2022] POST /compute/v2.1/servers => generated 111 bytes in 910 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:49.494003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6dbebfc9-cd68-402e-862d-119271caf0bd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Action: 'update', calling method: .version_select at 0x7fdc204d43a0>, body: {"quota_set": {"cores": 20}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:49.597104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:49.599766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:49.606892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:49.607411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:49.608532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:49.609858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:49.799322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6dbebfc9-cd68-402e-862d-119271caf0bd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:49.799322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6dbebfc9-cd68-402e-862d-119271caf0bd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:49.799322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6dbebfc9-cd68-402e-862d-119271caf0bd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:49.799322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6dbebfc9-cd68-402e-862d-119271caf0bd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:50.078893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:50.094761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:50.097090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:50.098364 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0863556f-a957-44b6-8141-3dda89502311 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1564 microversion: 2.25 time: 0.510718 Apr 30 21:16:50.102430 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 891/1880] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:49 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1564 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:50.121341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:50.122089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:50.122949 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6dbebfc9-cd68-402e-862d-119271caf0bd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 329 microversion: 2.1 time: 0.636190 Apr 30 21:16:50.124190 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 990/1881] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:49 2022] PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 329 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:50.136094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:50.136553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:50.139821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7976aff1-aa11-49e2-9d9e-d025339a7eb9 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Calling method '.version_select at 0x7fdc20455c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:50.141428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:50.141961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:50.291587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7976aff1-aa11-49e2-9d9e-d025339a7eb9 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 371 microversion: 2.1 time: 0.158263 Apr 30 21:16:50.317905 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 991/1882] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:16:50 2022] GET /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:16:50.332583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:50.333834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] [instance: ae6c5822-07aa-4e1d-9424-ee70b0405349] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:50.351151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:50.354394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:50.369322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:50.373528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:50.410294 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] HTTP exception thrown: Instance ae6c5822-07aa-4e1d-9424-ee70b0405349 could not be found. Apr 30 21:16:50.410947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] Returning 404 to user: Instance ae6c5822-07aa-4e1d-9424-ee70b0405349 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:50.415709 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21a0b604-42c4-4615-bcfa-72850625b209 tempest-LiveMigrationTest-1354815034 tempest-LiveMigrationTest-1354815034-project] 10.222.0.23 "GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349" status: 404 len: 111 microversion: 2.1 time: 0.092311 Apr 30 21:16:50.416658 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 992/1883] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:50 2022] GET /compute/v2.1/servers/ae6c5822-07aa-4e1d-9424-ee70b0405349 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:50.428316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:50.442975 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8480d42f-d183-472f-ab2c-d98174d3cde4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1322 microversion: 2.1 time: 0.339215 Apr 30 21:16:50.443710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b10f8f4-f15d-4e53-85d1-0a11bb7dfe4f tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20576f70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:50.447049 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 892/1884] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:50 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:50.567220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b10f8f4-f15d-4e53-85d1-0a11bb7dfe4f tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:50.568115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b10f8f4-f15d-4e53-85d1-0a11bb7dfe4f tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:50.574859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b10f8f4-f15d-4e53-85d1-0a11bb7dfe4f tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:50.574859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b10f8f4-f15d-4e53-85d1-0a11bb7dfe4f tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:50.725858 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b10f8f4-f15d-4e53-85d1-0a11bb7dfe4f tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 328 microversion: 2.1 time: 0.304458 Apr 30 21:16:50.726677 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 993/1885] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:50 2022] PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:50.839229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1762609653", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:50.890827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:16:51.120774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:51.124271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:51.136877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.137605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.138634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.139179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.191495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.192059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.192831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lazy-loading 'fault' on Instance uuid 77da7802-0fa5-4899-89bc-0300c2599af7 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:51.311209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:51.312742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:16:51.313217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:16:51.314088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:16:51.314088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:16:51.314587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:16:51.320861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:51.323060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:51.324609 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ea06234-6dfe-4b3a-bbf7-765ecfcb9c49 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 200 len: 1352 microversion: 2.25 time: 0.207603 Apr 30 21:16:51.328886 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 994/1886] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:51 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 1352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:51.333134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-2c069f8a-b19a-4f15-8da0-0772cc30573a req-d1965a8e-662b-4b9a-be47-4fa628ca8bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e64ab98-a770-4da4-ac98-65a1a31c12d6", "tag": "aacc958a-929b-46bc-9103-7128cb8bc80d"}, {"server_uuid": "77da7802-0fa5-4899-89bc-0300c2599af7", "name": "network-vif-deleted", "tag": "2514de9a-e593-441c-b26f-47d347c23ccb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:51.335110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.335764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.336922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.337523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.343150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2c069f8a-b19a-4f15-8da0-0772cc30573a req-d1965a8e-662b-4b9a-be47-4fa628ca8bb7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.343715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2c069f8a-b19a-4f15-8da0-0772cc30573a req-d1965a8e-662b-4b9a-be47-4fa628ca8bb7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.360547 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-2c069f8a-b19a-4f15-8da0-0772cc30573a req-d1965a8e-662b-4b9a-be47-4fa628ca8bb7 service nova] Creating event network-changed:aacc958a-929b-46bc-9103-7128cb8bc80d for instance 2e64ab98-a770-4da4-ac98-65a1a31c12d6 on nch2-master-1 Apr 30 21:16:51.361709 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-2c069f8a-b19a-4f15-8da0-0772cc30573a req-d1965a8e-662b-4b9a-be47-4fa628ca8bb7 service nova] Creating event network-vif-deleted:2514de9a-e593-441c-b26f-47d347c23ccb for instance 77da7802-0fa5-4899-89bc-0300c2599af7 on nch2-master-1 Apr 30 21:16:51.369053 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-2c069f8a-b19a-4f15-8da0-0772cc30573a req-d1965a8e-662b-4b9a-be47-4fa628ca8bb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041864 Apr 30 21:16:51.370779 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 995/1887] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:51.372086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Getting quotas for project 5782d01316e94d33b40d6d00fd572811. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:51.378998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Getting quotas for user 435506a91f1a4e4eae6ecdc81c9bec8c and project 5782d01316e94d33b40d6d00fd572811. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:51.395928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.utils [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] instances quota exceeded for 5782d01316e94d33b40d6d00fd572811, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130670) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 30 21:16:51.396647 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Apr 30 21:16:51.397395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:51.398425 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-17abd346-1a89-47b0-a7c6-3a098d29217a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.565272 Apr 30 21:16:51.399335 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 893/1888] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:16:50 2022] POST /compute/v2.1/servers => generated 119 bytes in 567 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:51.410173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9209d767-b866-4fac-86a7-48bbd1582beb tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Action: 'update', calling method: .version_select at 0x7fdc2046f160>, body: {"quota_set": {"instances": 10}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:51.473151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:51.473966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:51.484216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.485518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.486593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.487245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.523599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9209d767-b866-4fac-86a7-48bbd1582beb tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.528663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9209d767-b866-4fac-86a7-48bbd1582beb tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.531987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9209d767-b866-4fac-86a7-48bbd1582beb tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:51.533034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9209d767-b866-4fac-86a7-48bbd1582beb tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:51.805884 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9209d767-b866-4fac-86a7-48bbd1582beb tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 329 microversion: 2.1 time: 0.401574 Apr 30 21:16:51.807138 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 996/1889] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:51 2022] PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 329 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:51.815306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-928144613", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "03738ce1-c48f-4ad4-be94-161589abefe2"}], "security_groups": [{"name": "tempest-securitygroup--1223763057"}], "key_name": "tempest-keypair-1575200531", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6639f2c6-65d9-49ac-ba19-1bfddc2cceae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:52.231108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:52.241536 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e674ce9-ea1d-4b89-a351-8140b3070cb7 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1322 microversion: 2.1 time: 0.783955 Apr 30 21:16:52.242778 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 894/1890] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:51 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:52.259685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-052c15b7-2a05-4c85-8b9d-bfa8f454d64b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Calling method '.version_select at 0x7fdc20ac4310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:52.366453 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-052c15b7-2a05-4c85-8b9d-bfa8f454d64b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 371 microversion: 2.1 time: 0.111664 Apr 30 21:16:52.368528 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 895/1891] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:16:52 2022] GET /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:52.398855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:52.399068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] validate_networks() for [('03738ce1-c48f-4ad4-be94-161589abefe2', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:16:52.400697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 77da7802-0fa5-4899-89bc-0300c2599af7] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:52.418674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:52.419143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:52.419961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:52.420443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:52.460244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] HTTP exception thrown: Instance 77da7802-0fa5-4899-89bc-0300c2599af7 could not be found. Apr 30 21:16:52.461135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Returning 404 to user: Instance 77da7802-0fa5-4899-89bc-0300c2599af7 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:52.462206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-998d8c66-e380-4472-9514-df12f8f4055e tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7" status: 404 len: 111 microversion: 2.25 time: 0.092080 Apr 30 21:16:52.466248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 896/1892] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:52 2022] GET /compute/v2.1/servers/77da7802-0fa5-4899-89bc-0300c2599af7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:16:52.472592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e354083d-4389-4d98-bb55-f2f51f44e924 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20beb430>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:52.563366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e354083d-4389-4d98-bb55-f2f51f44e924 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:52.564594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e354083d-4389-4d98-bb55-f2f51f44e924 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:52.566408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e354083d-4389-4d98-bb55-f2f51f44e924 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:52.567189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e354083d-4389-4d98-bb55-f2f51f44e924 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:52.730706 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e354083d-4389-4d98-bb55-f2f51f44e924 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 325 microversion: 2.1 time: 0.263280 Apr 30 21:16:52.731838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 897/1893] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:52 2022] PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:52.766592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:52.770042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:52.788360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:52.789109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:52.790257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:52.790871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:52.830867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:53.300289 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bbea15ee-9d6a-482d-b4a0-8140e3b61869 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 204 len: 0 microversion: 2.25 time: 0.565678 Apr 30 21:16:53.305883 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 898/1894] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:16:52 2022] DELETE /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:16:53.338618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-935127649", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:53.468100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:16:53.993698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for project b9c121a94ec3445baa05dcaa3dc22af2. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:53.999902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for user 5df6ea2992c04a97af023bfb428ac44e and project b9c121a94ec3445baa05dcaa3dc22af2. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:54.044155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:16:54.045178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:16:54.045837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:16:54.046942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:16:54.047527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:16:54.084104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.084525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:54.094668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.095518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:54.162476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for project b9c121a94ec3445baa05dcaa3dc22af2. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:54.173026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Getting quotas for user 5df6ea2992c04a97af023bfb428ac44e and project b9c121a94ec3445baa05dcaa3dc22af2. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:54.305963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:16:54.308497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6639f2c6-65d9-49ac-ba19-1bfddc2cceae',volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:16:54.407987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:16:54.408954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:16:54.409454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:16:54.417413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:16:54.417413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:16:54.421674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.422441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:54.423277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.423761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:54.450058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Getting quotas for project 5782d01316e94d33b40d6d00fd572811. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:16:54.455739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Getting quotas for user 435506a91f1a4e4eae6ecdc81c9bec8c and project 5782d01316e94d33b40d6d00fd572811. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:16:54.476259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.utils [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] ram quota exceeded for 5782d01316e94d33b40d6d00fd572811, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130670) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 30 21:16:54.478449 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Apr 30 21:16:54.479666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:54.482172 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-65f04ab3-6477-44c3-b09c-bfa085e7074c tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.165380 Apr 30 21:16:54.483649 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 899/1895] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:16:53 2022] POST /compute/v2.1/servers => generated 110 bytes in 1177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:54.490645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:54.491716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:54.503301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.504298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:54.505579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.506132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:54.910947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:54.925407 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3c7b8f6e-1ea7-4064-9550-01409d839e43 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1322 microversion: 2.1 time: 0.440024 Apr 30 21:16:54.929787 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 900/1896] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:54 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:54.943080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:54.943791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:54.957587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.961942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:54.963150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:54.963842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:55.056696 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.247293 Apr 30 21:16:55.059505 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 997/1897] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:16:51 2022] POST /compute/v2.1/servers => generated 407 bytes in 3251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:16:55.065954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4e33967-a116-49cb-960e-ecac42c5f1ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Action: 'update', calling method: .version_select at 0x7fdc204c25e0>, body: {"quota_set": {"ram": 51200}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:55.115348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:55.127812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:55.132651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:55.134616 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c566efa2-79cc-40ae-bce7-61743851f63f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1507 microversion: 2.25 time: 0.201473 Apr 30 21:16:55.135401 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 901/1898] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:54 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:55.143856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea6253ad-6d59-440c-8c15-4350734c723a"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:55.146277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:55.154241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:55.156415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:55.158533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:55.161113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:55.452108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e33967-a116-49cb-960e-ecac42c5f1ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:55.454477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e33967-a116-49cb-960e-ecac42c5f1ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:55.456172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e33967-a116-49cb-960e-ecac42c5f1ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:55.456865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e33967-a116-49cb-960e-ecac42c5f1ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:55.680552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4e33967-a116-49cb-960e-ecac42c5f1ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 200 len: 329 microversion: 2.1 time: 0.617831 Apr 30 21:16:55.680552 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 998/1899] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:55 2022] PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 329 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:55.693942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-daf896d6-275f-4de0-a607-e8f47624da5b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:55.694667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-daf896d6-275f-4de0-a607-e8f47624da5b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:56.115078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-daf896d6-275f-4de0-a607-e8f47624da5b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:56.115731 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "POST /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977588 Apr 30 21:16:56.116109 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 902/1900] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:16:55 2022] POST /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments => generated 194 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:56.121650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-98d1eca8-a6f7-4f9e-b0e1-644906e133d5 req-18b54b51-19e7-446c-b39b-a37da89b69d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1645e8a-0c59-4c61-b10a-636c7fe28621", "name": "network-vif-deleted", "tag": "b109dd6d-2c6c-45b3-b525-5062d226cde4"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:56.133556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-98d1eca8-a6f7-4f9e-b0e1-644906e133d5 req-18b54b51-19e7-446c-b39b-a37da89b69d8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:56.134309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-98d1eca8-a6f7-4f9e-b0e1-644906e133d5 req-18b54b51-19e7-446c-b39b-a37da89b69d8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:56.140683 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-daf896d6-275f-4de0-a607-e8f47624da5b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1121 microversion: 2.1 time: 0.459013 Apr 30 21:16:56.142206 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 999/1901] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:55 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1121 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:56.148898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0fe173fc-3014-4e1e-b7b1-493be669e44a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Action: 'update', calling method: .version_select at 0x7fdc20455e50>, body: {"quota_set": {"ram": 0}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:56.151756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0fe173fc-3014-4e1e-b7b1-493be669e44a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '435506a91f1a4e4eae6ecdc81c9bec8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5782d01316e94d33b40d6d00fd572811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:56.153294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0fe173fc-3014-4e1e-b7b1-493be669e44a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:56.154422 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0fe173fc-3014-4e1e-b7b1-493be669e44a tempest-QuotasAdminNegativeTest-1488226835 tempest-QuotasAdminNegativeTest-1488226835-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811" status: 403 len: 116 microversion: 2.1 time: 0.011211 Apr 30 21:16:56.155146 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1000/1902] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:16:56 2022] PUT /compute/v2.1/os-quota-sets/5782d01316e94d33b40d6d00fd572811 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:56.155856 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-98d1eca8-a6f7-4f9e-b0e1-644906e133d5 req-18b54b51-19e7-446c-b39b-a37da89b69d8 service nova] Creating event network-vif-deleted:b109dd6d-2c6c-45b3-b525-5062d226cde4 for instance a1645e8a-0c59-4c61-b10a-636c7fe28621 on nch2-master-1 Apr 30 21:16:56.170900 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-98d1eca8-a6f7-4f9e-b0e1-644906e133d5 req-18b54b51-19e7-446c-b39b-a37da89b69d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051249 Apr 30 21:16:56.172052 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 903/1903] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:56.177480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-841f9f37-2196-4dad-8656-53c9346d9bdf req-106d80b9-477d-4c47-a50a-a9867d03cc01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e64ab98-a770-4da4-ac98-65a1a31c12d6", "name": "network-vif-plugged", "status": "completed", "tag": "aacc958a-929b-46bc-9103-7128cb8bc80d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:16:56.182350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:56.184110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:56.216792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-841f9f37-2196-4dad-8656-53c9346d9bdf req-106d80b9-477d-4c47-a50a-a9867d03cc01 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:56.216792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-841f9f37-2196-4dad-8656-53c9346d9bdf req-106d80b9-477d-4c47-a50a-a9867d03cc01 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:56.227663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:56.234546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:56.234546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:56.234843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-841f9f37-2196-4dad-8656-53c9346d9bdf req-106d80b9-477d-4c47-a50a-a9867d03cc01 service nova] Creating event network-vif-plugged:aacc958a-929b-46bc-9103-7128cb8bc80d for instance 2e64ab98-a770-4da4-ac98-65a1a31c12d6 on nch2-master-1 Apr 30 21:16:56.237157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:56.240126 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-841f9f37-2196-4dad-8656-53c9346d9bdf req-106d80b9-477d-4c47-a50a-a9867d03cc01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083292 Apr 30 21:16:56.241327 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1001/1904] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:16:56.262592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:56.264561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:56.290512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:56.291218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:56.292900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:56.293509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:56.358096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:56.358723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:56.363120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lazy-loading 'fault' on Instance uuid a1645e8a-0c59-4c61-b10a-636c7fe28621 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:16:56.545473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:56.554894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:56.556703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:56.557921 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-632e3890-63b4-477d-937e-5ab628d61ed3 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 200 len: 1352 microversion: 2.25 time: 0.315273 Apr 30 21:16:56.559204 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1002/1905] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:56 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 1352 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:16:56.679037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:56.688050 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f206991c-74e4-43d4-b4ad-8aa0531c06df tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1322 microversion: 2.1 time: 0.514061 Apr 30 21:16:56.691424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 904/1906] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:56 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:57.166300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:57.172417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:57.185632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.187170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:57.188299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.189872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:57.468088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:57.478849 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-728b5d9d-d19d-41e6-bbb3-81120f002138 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1163 microversion: 2.1 time: 0.322590 Apr 30 21:16:57.479680 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1003/1907] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:57 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1163 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:16:57.578375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:57.578980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: a1645e8a-0c59-4c61-b10a-636c7fe28621] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:57.593404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.594322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:57.602174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.602174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:57.628148 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] HTTP exception thrown: Instance a1645e8a-0c59-4c61-b10a-636c7fe28621 could not be found. Apr 30 21:16:57.629237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Returning 404 to user: Instance a1645e8a-0c59-4c61-b10a-636c7fe28621 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:16:57.636466 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-514eb56c-3c85-4df9-ab05-c692510f0759 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621" status: 404 len: 111 microversion: 2.25 time: 0.056276 Apr 30 21:16:57.636466 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 905/1908] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:57 2022] GET /compute/v2.1/servers/a1645e8a-0c59-4c61-b10a-636c7fe28621 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:16:57.643840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:57.644712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:57.651683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.652663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:57.652944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.653384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:57.692562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:16:57.715524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:57.717679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:57.756113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.757666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:57.759696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:57.761791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:58.127885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:58.142792 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-963e2940-2408-4ddd-a935-89226a8ba01a tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1322 microversion: 2.1 time: 0.438158 Apr 30 21:16:58.147682 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 906/1909] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:57 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:58.167738 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3f648925-a4ab-4edc-968d-1ffe7883278f tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 204 len: 0 microversion: 2.25 time: 0.531780 Apr 30 21:16:58.171564 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1004/1910] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:16:57 2022] DELETE /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:16:58.191116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:58.192001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:58.207268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:58.209587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:58.213201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:58.214726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:58.506878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:58.510676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:58.523691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:58.526604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:58.527530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:58.528166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:58.758925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:58.786012 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2146691-d01f-45b4-b5b1-39d923acbdcf tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1237 microversion: 2.1 time: 0.293230 Apr 30 21:16:58.787981 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1005/1911] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:58 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1237 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:16:58.905018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:58.935546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:58.938798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:16:58.941405 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cdb2f7f6-11ce-4d36-a338-78b9e4c64b6d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1565 microversion: 2.25 time: 0.764466 Apr 30 21:16:58.950064 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 907/1912] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:16:58 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1565 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:16:59.161615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:59.162559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:59.169591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:59.170794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:59.171783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:59.172538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:59.807342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:16:59.808594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:16:59.819239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:59.829449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:16:59.831804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:16:59.832811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:00.013550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:00.023918 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c7fd6a15-a063-43ce-9201-ec19807080d4 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1472 microversion: 2.1 time: 0.866722 Apr 30 21:17:00.037923 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1006/1913] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:59 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1472 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:00.315869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-24899737", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:00.383592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:17:00.627739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:00.645512 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5eb34917-26dc-48dc-b901-e1b26e36a575 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1305 microversion: 2.1 time: 0.837974 Apr 30 21:17:00.647345 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 908/1914] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:16:59 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1305 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:00.656505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:00.657610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:00.665127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:00.666644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:00.667866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:00.668490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.085467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:01.086026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:01.086611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:01.087123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:01.087637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:01.104707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.109315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.111845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.111845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.166269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Getting quotas for project 246c0a9cc007483ab7bd3cd40249f291. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:01.176365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:01.182925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Getting quotas for user 1886e7319ac64348a1b019b9329a92de and project 246c0a9cc007483ab7bd3cd40249f291. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:01.185848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:01.193482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:01.196801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-741b3abe-67a5-43b1-94a6-259c27e6be08 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1565 microversion: 2.25 time: 0.547491 Apr 30 21:17:01.210134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:17:01.210134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:01.210806 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 909/1915] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:00 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1565 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:01.216027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:01.226933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:01.235356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.236653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.237670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.241653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.325325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:01.325994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:01.334550 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-37794dcb-7e73-46c5-bd1d-a4f503f5bca3 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.122340 Apr 30 21:17:01.340155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 910/1916] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:17:01 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6/diagnostics => generated 117 bytes in 124 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:01.344588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6baca69e-3f6d-4652-9fc8-2da3d913a508 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:01.346478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6baca69e-3f6d-4652-9fc8-2da3d913a508 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:01.394911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6baca69e-3f6d-4652-9fc8-2da3d913a508 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.397317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6baca69e-3f6d-4652-9fc8-2da3d913a508 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.397317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6baca69e-3f6d-4652-9fc8-2da3d913a508 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.397317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6baca69e-3f6d-4652-9fc8-2da3d913a508 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.439334 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0b33831-b3be-43c0-b06f-759e07f0e50c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391270 Apr 30 21:17:01.440096 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1007/1917] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:17:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:17:01.450732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6baca69e-3f6d-4652-9fc8-2da3d913a508 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111215 Apr 30 21:17:01.457101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 911/1918] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:17:01 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:01.457350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-89e8af98-0190-43de-9552-20d0be65f624 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:01.458340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-89e8af98-0190-43de-9552-20d0be65f624 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:01.471353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:01.475907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:01.492197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.494642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.496638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.498773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.552761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:17:01.636065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-89e8af98-0190-43de-9552-20d0be65f624 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:01.649879 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-89e8af98-0190-43de-9552-20d0be65f624 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1220 microversion: 2.1 time: 0.196966 Apr 30 21:17:01.654817 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 912/1919] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:01 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1220 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:01.656475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:01.657489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:01.664350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.665071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.667890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:01.668477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:01.861331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lazy-loading 'services' on Instance uuid 361d2aa0-0533-433d-aec8-097fee016242 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:17:01.973731 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ad43a58-ab69-4cc8-b51a-a68470dd4a16 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 204 len: 0 microversion: 2.1 time: 0.513563 Apr 30 21:17:01.975033 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1008/1920] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:17:01 2022] DELETE /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:17:01.985801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-be2ecc7a-63ac-41ff-9978-f0e2c7ac2fa8 req-f77c2454-6fbd-4391-97a3-7c8ea0deb5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff0823b-a621-444c-a64b-dfd437b832df", "tag": "39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:02.004582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-be2ecc7a-63ac-41ff-9978-f0e2c7ac2fa8 req-f77c2454-6fbd-4391-97a3-7c8ea0deb5b3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.009748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-be2ecc7a-63ac-41ff-9978-f0e2c7ac2fa8 req-f77c2454-6fbd-4391-97a3-7c8ea0deb5b3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.044545 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-be2ecc7a-63ac-41ff-9978-f0e2c7ac2fa8 req-f77c2454-6fbd-4391-97a3-7c8ea0deb5b3 service nova] Creating event network-changed:39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0 for instance 7ff0823b-a621-444c-a64b-dfd437b832df on nch1-master-1 Apr 30 21:17:02.055602 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-be2ecc7a-63ac-41ff-9978-f0e2c7ac2fa8 req-f77c2454-6fbd-4391-97a3-7c8ea0deb5b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078309 Apr 30 21:17:02.057369 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1009/1921] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:02.069611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-bae79946-a18f-459b-983a-d249de289df0 req-c8ae26f0-a550-4cb0-b09d-94120d38a144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aab508f-4be3-49d3-bb5f-b19f4f328bcd", "name": "network-vif-deleted", "tag": "154e4208-4965-4648-9e7c-f22621d3423a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:02.086692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bae79946-a18f-459b-983a-d249de289df0 req-c8ae26f0-a550-4cb0-b09d-94120d38a144 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.089032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bae79946-a18f-459b-983a-d249de289df0 req-c8ae26f0-a550-4cb0-b09d-94120d38a144 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.110936 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-bae79946-a18f-459b-983a-d249de289df0 req-c8ae26f0-a550-4cb0-b09d-94120d38a144 service nova] Creating event network-vif-deleted:154e4208-4965-4648-9e7c-f22621d3423a for instance 0aab508f-4be3-49d3-bb5f-b19f4f328bcd on nch2-master-1 Apr 30 21:17:02.117108 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-bae79946-a18f-459b-983a-d249de289df0 req-c8ae26f0-a550-4cb0-b09d-94120d38a144 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057936 Apr 30 21:17:02.117822 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1010/1922] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:02.123506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:02.129361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:02.131756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.132214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.133374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.134065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.232658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-90b487de-1000-42a8-a799-a32d94e3d9c8 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "DELETE /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments/ea6253ad-6d59-440c-8c15-4350734c723a" status: 202 len: 0 microversion: 2.1 time: 0.579832 Apr 30 21:17:02.233423 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 913/1923] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:17:01 2022] DELETE /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments/ea6253ad-6d59-440c-8c15-4350734c723a => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:02.239305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:02.240272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:02.250310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.252221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.253043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.253643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.338064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:02.348184 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9741fd25-8af9-469c-bb0b-a28d117e81cc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1293 microversion: 2.1 time: 0.228708 Apr 30 21:17:02.348972 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1011/1924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:02 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1293 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:02.355466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:02.362798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:02.364408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.365156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.366351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.367061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.416618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:02.417072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:02.417529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lazy-loading 'fault' on Instance uuid 0aab508f-4be3-49d3-bb5f-b19f4f328bcd {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:17:02.495377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:02.505846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:02.507905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:02.509465 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0b895561-eaeb-4de5-890d-f8c7355781bc tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1352 microversion: 2.25 time: 0.159117 Apr 30 21:17:02.510512 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1012/1925] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:02 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1352 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:02.586402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:02.594179 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-20c227a4-a25e-467b-a8de-44ea89f8881d tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1478 microversion: 2.1 time: 0.359549 Apr 30 21:17:02.594753 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 914/1926] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:02 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1478 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:02.670816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-48661696-181e-4141-917b-2a7e304727dc tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:02.671453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-48661696-181e-4141-917b-2a7e304727dc tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:02.818541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-48661696-181e-4141-917b-2a7e304727dc tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:02.830852 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-48661696-181e-4141-917b-2a7e304727dc tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1220 microversion: 2.1 time: 0.163648 Apr 30 21:17:02.840057 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1013/1927] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:02 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1220 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:03.353809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-63669c10-c6da-4378-bd51-a3f1f505d13f tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] Action: 'create', calling method: .version_select at 0x7fdc20a31ee0>, body: {"security_group": {"name": "tempest-securitygroup-375070038", "description": "tempest-description-1224440808"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:03.370403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:03.371342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:03.396940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:03.410445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:03.411140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:03.411606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:03.754788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:03.766039 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b3487917-0f8b-44fa-8726-ef186733eedc tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1293 microversion: 2.1 time: 0.399876 Apr 30 21:17:03.766728 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1014/1928] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:03 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1293 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:03.774013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:03.774713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:03.781031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:03.785730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:03.785730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:03.785730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:03.862275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:03.862730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:03.878476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lazy-loading 'fault' on Instance uuid 0aab508f-4be3-49d3-bb5f-b19f4f328bcd {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:17:03.944358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:03.953067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:03.954556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dadac4f61fe141dba3ee726ca6cbf29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b426139c194813974502d1910c257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:03.955746 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-40bbf503-ceaf-4b57-b14d-a9e5bb0f947d tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 200 len: 1352 microversion: 2.25 time: 0.186269 Apr 30 21:17:03.956309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1015/1929] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:03 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 1352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:03.962964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:03.963576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:03.969869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:03.972576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:03.972576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:03.972576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:04.232193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:04.242284 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6937af87-046b-48b6-a630-07a4425a84fd tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1478 microversion: 2.1 time: 0.284480 Apr 30 21:17:04.242886 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1016/1930] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:03 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1478 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:04.259726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:04.260632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:04.267377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:04.267880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:04.268851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:04.269685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:04.707821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:04.720334 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-513e18bd-e5a9-417a-a8ef-fb00da77c93d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1272 microversion: 2.1 time: 0.476148 Apr 30 21:17:04.722148 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1017/1931] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:04 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:04.733354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-415a210a-679f-4a96-93ce-640a563ad9dd tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:04.736233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-415a210a-679f-4a96-93ce-640a563ad9dd tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:04.748510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-415a210a-679f-4a96-93ce-640a563ad9dd tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:04.752077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-415a210a-679f-4a96-93ce-640a563ad9dd tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:04.752077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-415a210a-679f-4a96-93ce-640a563ad9dd tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:04.752077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-415a210a-679f-4a96-93ce-640a563ad9dd tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:04.792730 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-415a210a-679f-4a96-93ce-640a563ad9dd tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068715 Apr 30 21:17:04.795774 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1018/1932] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:17:04 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:17:04.809580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:04.810660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:04.820092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:04.820844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:04.834703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:04.836811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:04.913613 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-63669c10-c6da-4378-bd51-a3f1f505d13f tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.834324 Apr 30 21:17:04.914254 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 915/1933] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:17:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:04.931744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71aa0fce-a205-4017-a1a5-b0a82961fc31 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] Action: 'create', calling method: .version_select at 0x7fdc20d8a160>, body: {"security_group": {"name": "tempest-securitygroup-2005355925", "description": "tempest-description-1989046076"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:05.334516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:05.342165 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55f4901b-597d-4f39-94c6-b37a09561a28 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1293 microversion: 2.1 time: 0.538579 Apr 30 21:17:05.342751 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1019/1934] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:04 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1293 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:05.360185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e870554-efd6-4daa-bdeb-e56ce33baaab tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:05.363177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e870554-efd6-4daa-bdeb-e56ce33baaab tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:05.371882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e870554-efd6-4daa-bdeb-e56ce33baaab tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.372649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e870554-efd6-4daa-bdeb-e56ce33baaab tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.374358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e870554-efd6-4daa-bdeb-e56ce33baaab tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.374979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e870554-efd6-4daa-bdeb-e56ce33baaab tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.417149 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e870554-efd6-4daa-bdeb-e56ce33baaab tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061434 Apr 30 21:17:05.417149 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1020/1935] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:17:05 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:17:05.480118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:05.480737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] [instance: 0aab508f-4be3-49d3-bb5f-b19f4f328bcd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:05.494589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.495292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.496329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.496968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.519237 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] HTTP exception thrown: Instance 0aab508f-4be3-49d3-bb5f-b19f4f328bcd could not be found. Apr 30 21:17:05.520107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] Returning 404 to user: Instance 0aab508f-4be3-49d3-bb5f-b19f4f328bcd could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:05.521128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b13e34a0-5a88-469c-b85e-e8f9a20096a1 tempest-LiveAutoBlockMigrationV225Test-1505936978 tempest-LiveAutoBlockMigrationV225Test-1505936978-project] 10.222.0.23 "GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd" status: 404 len: 111 microversion: 2.25 time: 0.103840 Apr 30 21:17:05.529569 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1021/1936] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:05 2022] GET /compute/v2.1/servers/0aab508f-4be3-49d3-bb5f-b19f4f328bcd => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:17:05.568700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-89477e39-f1d6-4570-bbbf-2c782870026a req-81565be9-8974-471f-8e46-8f49fce38a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e64ab98-a770-4da4-ac98-65a1a31c12d6", "name": "network-vif-deleted", "tag": "aacc958a-929b-46bc-9103-7128cb8bc80d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:05.584267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-89477e39-f1d6-4570-bbbf-2c782870026a req-81565be9-8974-471f-8e46-8f49fce38a3f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.585036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-89477e39-f1d6-4570-bbbf-2c782870026a req-81565be9-8974-471f-8e46-8f49fce38a3f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.608241 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-89477e39-f1d6-4570-bbbf-2c782870026a req-81565be9-8974-471f-8e46-8f49fce38a3f service nova] Creating event network-vif-deleted:aacc958a-929b-46bc-9103-7128cb8bc80d for instance 2e64ab98-a770-4da4-ac98-65a1a31c12d6 on nch2-master-1 Apr 30 21:17:05.615071 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-89477e39-f1d6-4570-bbbf-2c782870026a req-81565be9-8974-471f-8e46-8f49fce38a3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084006 Apr 30 21:17:05.618621 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1022/1937] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:05.625025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:05.631099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:05.639088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.640098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.641666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.642795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.734917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.735448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.736463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lazy-loading 'fault' on Instance uuid 2e64ab98-a770-4da4-ac98-65a1a31c12d6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:17:05.747402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71aa0fce-a205-4017-a1a5-b0a82961fc31 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.825877 Apr 30 21:17:05.755211 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 916/1938] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:17:04 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:05.760346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:05.761012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:05.768298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.768764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.769585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.770803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.806112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:17:05.832802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0067ff081d1946149db58fd383e81bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bcc72715fa4ba88d3ca6b371eb1f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:05.842780 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b26d6a72-b166-4427-887e-09890a65a106 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 200 len: 1312 microversion: 2.1 time: 0.222676 Apr 30 21:17:05.852817 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1023/1939] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:05 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:05.858056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:05.858983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:05.867604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.870619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:05.882376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:05.882912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:06.025611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:06.034651 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55c62209-100c-4a01-9dc4-513be17fce2d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1278 microversion: 2.1 time: 0.180382 Apr 30 21:17:06.047492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1024/1940] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:05 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:06.186758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c2d81b0-c987-497d-97d8-c603cfc7384c tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Action: 'create', calling method: .version_select at 0x7fdc20dbeca0>, body: {"security_group": {"name": "tempest-securitygroup-1053522678", "description": "tempest-description-2088623141"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:06.215936 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-623680cd-9c90-48c7-b20b-10932b48f14f tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "DELETE /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 204 len: 0 microversion: 2.1 time: 0.459150 Apr 30 21:17:06.216540 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 917/1941] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:17:05 2022] DELETE /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:17:06.226733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:06.235069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:06.248643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:06.249111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:06.249954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:06.250398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:06.586392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:06.597096 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94c85ab5-2e83-4df6-b475-8de949d3297c tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1683 microversion: 2.1 time: 0.374164 Apr 30 21:17:06.598969 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 918/1942] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:06 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:06.604169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:06.605016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:06.612865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:06.614230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:06.615785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:06.616408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.030876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:07.042480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9cdae010-c899-48b5-9415-e69239391087 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1293 microversion: 2.1 time: 0.439484 Apr 30 21:17:07.042480 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 919/1943] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:06 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1293 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:07.045092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:07.047445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] [instance: 2e64ab98-a770-4da4-ac98-65a1a31c12d6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:07.058200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.059464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.061522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.062123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.080068 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] HTTP exception thrown: Instance 2e64ab98-a770-4da4-ac98-65a1a31c12d6 could not be found. Apr 30 21:17:07.080837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] Returning 404 to user: Instance 2e64ab98-a770-4da4-ac98-65a1a31c12d6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:07.081944 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-36b8d97e-5c86-44ca-becc-c789fdef32f5 tempest-ServerDiagnosticsNegativeTest-755895242 tempest-ServerDiagnosticsNegativeTest-755895242-project] 10.222.0.23 "GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6" status: 404 len: 111 microversion: 2.1 time: 0.040475 Apr 30 21:17:07.082588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 920/1944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:07 2022] GET /compute/v2.1/servers/2e64ab98-a770-4da4-ac98-65a1a31c12d6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:07.087760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:07.088500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:07.099918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.100602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.101635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.102451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.152536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:17:07.326970 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c2d81b0-c987-497d-97d8-c603cfc7384c tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.283604 Apr 30 21:17:07.333899 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1025/1945] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:17:06 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:07.353234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:07.353917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:07.362791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.364673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.366526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.367165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.590488 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44a5c3e8-d3a9-4a3a-9ce0-b8739a4f08c4 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "DELETE /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 204 len: 0 microversion: 2.1 time: 0.505850 Apr 30 21:17:07.592254 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 921/1946] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:17:07 2022] DELETE /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:17:07.603703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-739b3b1f-209c-469e-ae85-7e4e169c54da tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Action: 'create', calling method: .version_select at 0x7fdc211179d0>, body: {"security_group": {"name": "tempest-securitygroup-1061693372", "description": "tempest-description-1348300777"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:07.654682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:07.669130 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-346a3399-9dd3-4efb-b81a-7fe85cf2c093 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1320 microversion: 2.1 time: 0.336309 Apr 30 21:17:07.669389 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1026/1947] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:07 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:07.675773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:07.676759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:07.683832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.684310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:07.685715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:07.686984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:08.129326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:08.138903 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d244299-b259-44ac-91fb-c7926209a56e tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1666 microversion: 2.1 time: 0.468013 Apr 30 21:17:08.139524 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1027/1948] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:07 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1666 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:08.149727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:08.151003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:08.157872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:08.165263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:08.165263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:08.165263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:08.563454 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-739b3b1f-209c-469e-ae85-7e4e169c54da tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.969230 Apr 30 21:17:08.565741 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 922/1949] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:17:07 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:08.571371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:08.575780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:08.586934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:08.587808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:08.588990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:08.589669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:08.607584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:08.623066 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-13e07266-2956-474d-99db-6721c20e464b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1683 microversion: 2.1 time: 0.481352 Apr 30 21:17:08.625464 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1028/1950] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:08 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1683 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:08.634797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Calling method '.version_select at 0x7fdc20eac790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:09.122715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:09.132473 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e1bfb63-3377-4275-bc7f-a885d656cf44 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1293 microversion: 2.1 time: 0.565456 Apr 30 21:17:09.143796 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 923/1951] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:08 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1293 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:09.149620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:09.150538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:09.158140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:09.158798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:09.163548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:09.164276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:09.465811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:09.474198 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59cd8fd0-d1bf-4e29-a68a-1aee64a2fb51 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1320 microversion: 2.1 time: 0.328965 Apr 30 21:17:09.483102 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 924/1952] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:09 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:09.483102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-00e4b3dd-2ade-4b52-9d3f-005b64be381f req-b3286043-ea8b-4e91-9e8d-2aa946543f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff0823b-a621-444c-a64b-dfd437b832df", "name": "network-vif-plugged", "status": "completed", "tag": "39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:09.490309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-00e4b3dd-2ade-4b52-9d3f-005b64be381f req-b3286043-ea8b-4e91-9e8d-2aa946543f12 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:09.490863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-00e4b3dd-2ade-4b52-9d3f-005b64be381f req-b3286043-ea8b-4e91-9e8d-2aa946543f12 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:09.507281 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-00e4b3dd-2ade-4b52-9d3f-005b64be381f req-b3286043-ea8b-4e91-9e8d-2aa946543f12 service nova] Creating event network-vif-plugged:39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0 for instance 7ff0823b-a621-444c-a64b-dfd437b832df on nch1-master-1 Apr 30 21:17:09.512944 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-00e4b3dd-2ade-4b52-9d3f-005b64be381f req-b3286043-ea8b-4e91-9e8d-2aa946543f12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Apr 30 21:17:09.518874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 925/1953] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:09.522674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:09.523594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:09.531476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:09.531951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:09.533386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:09.533870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:10.440434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:10.454911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-01c59b46-6a28-4d3e-93d2-022e689ba4dc tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1666 microversion: 2.1 time: 0.936337 Apr 30 21:17:10.464801 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 926/1954] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:09 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1666 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:10.470502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:10.471137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:10.495617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:10.495617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:10.495617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:10.495617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:10.689266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:10.709109 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3cc08e71-910f-4f5a-9c67-ae2c3d0198e1 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1615 microversion: 2.1 time: 0.242419 Apr 30 21:17:10.711123 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 927/1955] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:10 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1615 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:10.731004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9466cdaf-f126-46dd-8e76-7741845e47f9 req-c9b47bea-1a97-4dfc-9c9a-f3aea2902c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6cff9c-417f-4781-974c-f36e3b467218", "tag": "4e609015-29a3-4678-9e4b-9b00ec55c21f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:10.752979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9466cdaf-f126-46dd-8e76-7741845e47f9 req-c9b47bea-1a97-4dfc-9c9a-f3aea2902c98 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:10.753443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9466cdaf-f126-46dd-8e76-7741845e47f9 req-c9b47bea-1a97-4dfc-9c9a-f3aea2902c98 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:10.793458 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9466cdaf-f126-46dd-8e76-7741845e47f9 req-c9b47bea-1a97-4dfc-9c9a-f3aea2902c98 service nova] Creating event network-changed:4e609015-29a3-4678-9e4b-9b00ec55c21f for instance ca6cff9c-417f-4781-974c-f36e3b467218 on nch2-master-1 Apr 30 21:17:10.808002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9466cdaf-f126-46dd-8e76-7741845e47f9 req-c9b47bea-1a97-4dfc-9c9a-f3aea2902c98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091459 Apr 30 21:17:10.809896 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 928/1956] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:10.817118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:10.818147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:10.829135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:10.829859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:10.831551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:10.832165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:11.316077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:11.356803 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e375ec4-c46d-4e13-bdab-16dbd637bdd8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1293 microversion: 2.1 time: 0.543438 Apr 30 21:17:11.359715 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 929/1957] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:10 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1293 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:11.371163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:11.386899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:11.402262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:11.405595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:11.407118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:11.408697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:11.764141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:11.774344 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cbe6b16c-fb79-4e1a-8c38-ff4728c617e2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1320 microversion: 2.1 time: 0.411752 Apr 30 21:17:11.775416 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 930/1958] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:11 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:11.780217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ddc28b5c-6b0c-4eb8-924a-a487276dee81 req-526a5117-30f0-4195-b440-309fb7d94de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422d9d7c-80c8-4693-925c-f434084a7bd1", "name": "network-vif-deleted", "tag": "a648764a-35bc-4bbd-b4e5-9b7bf42d6e11"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:11.790725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ddc28b5c-6b0c-4eb8-924a-a487276dee81 req-526a5117-30f0-4195-b440-309fb7d94de8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:11.793406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ddc28b5c-6b0c-4eb8-924a-a487276dee81 req-526a5117-30f0-4195-b440-309fb7d94de8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:11.810393 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ddc28b5c-6b0c-4eb8-924a-a487276dee81 req-526a5117-30f0-4195-b440-309fb7d94de8 service nova] Creating event network-vif-deleted:a648764a-35bc-4bbd-b4e5-9b7bf42d6e11 for instance 422d9d7c-80c8-4693-925c-f434084a7bd1 on nch1-master-1 Apr 30 21:17:11.816852 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ddc28b5c-6b0c-4eb8-924a-a487276dee81 req-526a5117-30f0-4195-b440-309fb7d94de8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039322 Apr 30 21:17:11.817459 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 931/1959] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:11.826940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:11.827679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:11.836910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:11.837855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:11.838657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:11.839523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:11.910958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:11.912607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:11.912607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lazy-loading 'fault' on Instance uuid 422d9d7c-80c8-4693-925c-f434084a7bd1 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:17:11.976004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58114c225ebe4062af97802f266bbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:11.986341 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2966548e-df47-42de-bc29-fd9ae53e5d04 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 200 len: 1316 microversion: 2.1 time: 0.165683 Apr 30 21:17:11.986955 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 932/1960] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:11 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:12.012105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:12.012759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:12.037254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:12.041262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:12.042957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:12.043935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:12.063611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c193e08-7615-486e-8d3f-06223d054c0e does not exist", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:17:12.064830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Neutron security group 9c193e08-7615-486e-8d3f-06223d054c0e not found {{(pid=130671) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:17:12.065398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.security_groups [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Security Group ID 9c193e08-7615-486e-8d3f-06223d054c0e does not exist {{(pid=130671) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Apr 30 21:17:12.108075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c193e08-7615-486e-8d3f-06223d054c0e does not exist", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:17:12.108923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Neutron security group 9c193e08-7615-486e-8d3f-06223d054c0e not found {{(pid=130671) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:17:12.109692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.security_groups [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Security Group ID 9c193e08-7615-486e-8d3f-06223d054c0e does not exist {{(pid=130671) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Apr 30 21:17:12.145725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:12.146454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:12.147148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lazy-loading 'fault' on Instance uuid 361d2aa0-0533-433d-aec8-097fee016242 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:17:12.270370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1eeba696174da1be8aba8dcce6b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6309fd24cb2e4a5d8fde4f457d529d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:12.288502 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d17374fe-d7f0-485c-9b84-f2f8ccf5ef0d tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 200 len: 1332 microversion: 2.1 time: 0.293447 Apr 30 21:17:12.288745 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 933/1961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:11 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:12.377116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:12.379032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:12.400691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:12.402016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:12.402338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:12.402982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:12.749400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:12.774098 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-579ef99c-461e-4406-9a13-c6e3907b75af tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1484 microversion: 2.1 time: 0.402106 Apr 30 21:17:12.788995 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 934/1962] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:12 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1484 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:17:12.801411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:12.803601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:12.814754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:12.819404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:12.819404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:12.819404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.097692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:13.113168 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-caf2a6e9-6174-4a43-8447-7f5641fef254 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1320 microversion: 2.1 time: 0.322905 Apr 30 21:17:13.122314 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 935/1963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:12 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:13.122314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16bef145-5f7d-4426-865d-818fab4c8066 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:13.122314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16bef145-5f7d-4426-865d-818fab4c8066 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:13.136861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16bef145-5f7d-4426-865d-818fab4c8066 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:13.137461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16bef145-5f7d-4426-865d-818fab4c8066 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.138397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16bef145-5f7d-4426-865d-818fab4c8066 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:13.138926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16bef145-5f7d-4426-865d-818fab4c8066 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.331089 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16bef145-5f7d-4426-865d-818fab4c8066 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.213911 Apr 30 21:17:13.333486 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 936/1964] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:17:13 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df/os-interface => generated 285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:13.348863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b7802265-cce0-4ae3-9ccf-df274a8ea8ac req-205acf3a-f692-4bf3-aa19-4dcb123d35bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361d2aa0-0533-433d-aec8-097fee016242", "name": "network-vif-deleted", "tag": "f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:13.363989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b7802265-cce0-4ae3-9ccf-df274a8ea8ac req-205acf3a-f692-4bf3-aa19-4dcb123d35bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:13.364869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b7802265-cce0-4ae3-9ccf-df274a8ea8ac req-205acf3a-f692-4bf3-aa19-4dcb123d35bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.380758 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b7802265-cce0-4ae3-9ccf-df274a8ea8ac req-205acf3a-f692-4bf3-aa19-4dcb123d35bf service nova] Creating event network-vif-deleted:f5c25d5e-aa76-4f72-b1c8-789e9bf2ba7e for instance 361d2aa0-0533-433d-aec8-097fee016242 on nch2-master-1 Apr 30 21:17:13.389637 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b7802265-cce0-4ae3-9ccf-df274a8ea8ac req-205acf3a-f692-4bf3-aa19-4dcb123d35bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045620 Apr 30 21:17:13.393381 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 937/1965] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:13.400846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:13.402425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] [instance: 422d9d7c-80c8-4693-925c-f434084a7bd1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:13.414871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:13.415910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.416921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:13.417558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.441204 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] HTTP exception thrown: Instance 422d9d7c-80c8-4693-925c-f434084a7bd1 could not be found. Apr 30 21:17:13.442146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Returning 404 to user: Instance 422d9d7c-80c8-4693-925c-f434084a7bd1 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:13.443014 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-daf29edb-38c7-46e0-a572-50a3c02a2495 tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1" status: 404 len: 111 microversion: 2.1 time: 0.047859 Apr 30 21:17:13.443625 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 938/1966] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:13 2022] GET /compute/v2.1/servers/422d9d7c-80c8-4693-925c-f434084a7bd1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:13.452644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:13.453520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:13.461127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:13.461600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.462740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:13.463192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:13.480085 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] HTTP exception thrown: Instance 361d2aa0-0533-433d-aec8-097fee016242 could not be found. Apr 30 21:17:13.480620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Returning 404 to user: Instance 361d2aa0-0533-433d-aec8-097fee016242 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:13.481658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3b480d8a-b6cc-41da-92ca-0de70d68c28b tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 404 len: 111 microversion: 2.1 time: 0.033117 Apr 30 21:17:13.486490 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 939/1967] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:13 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:13.492029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5b7f59b-f58a-4600-b7cf-88ed115fca9d tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] Calling method '.version_select at 0x7fdc208fea60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:13.580881 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5b7f59b-f58a-4600-b7cf-88ed115fca9d tempest-ServersTestFqdnHostnames-1191117519 tempest-ServersTestFqdnHostnames-1191117519-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786017507" status: 202 len: 0 microversion: 2.1 time: 0.093273 Apr 30 21:17:13.587298 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 940/1968] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786017507 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:13.588182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fec4a131-aee5-43e0-bcb3-52691e924448 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '.version_select at 0x7fdc20d2d700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:13.670887 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fec4a131-aee5-43e0-bcb3-52691e924448 tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558403537" status: 202 len: 0 microversion: 2.1 time: 0.087336 Apr 30 21:17:13.674097 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 941/1969] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558403537 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:13.932269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2cb80e5a-aad3-4d55-ad36-728f5cad9a37 tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] Calling method '.version_select at 0x7fdc20cfc3a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:13.934214 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:13.934214 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:17:13.960553 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1b1177e-fe52-4398-8e6b-3fdd4560c510 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11099 microversion: 2.1 time: 5.330539 Apr 30 21:17:13.972705 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1029/1970] 10.222.0.23 () {58 vars in 1190 bytes} [Sat Apr 30 21:17:08 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11099 bytes in 5336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:17:13.973216 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2cb80e5a-aad3-4d55-ad36-728f5cad9a37 tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.288340 Apr 30 21:17:13.973216 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 942/1971] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Apr 30 21:17:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:13.977062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30cf66f5-14f7-4a62-b2a0-32e332f91ade tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20dbe160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:13.979548 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:13.979548 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:17:13.991805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a54ed36-790a-4826-8d2b-616f0f0b20b6 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] Calling method '.version_select at 0x7fdc20cfc4c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:14.885719 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a54ed36-790a-4826-8d2b-616f0f0b20b6 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.906112 Apr 30 21:17:14.886389 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 943/1972] 10.222.0.23 () {58 vars in 1190 bytes} [Sat Apr 30 21:17:13 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:14.891504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:14.892128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:14.899534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:14.904579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:14.904579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:14.904579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.055852 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30cf66f5-14f7-4a62-b2a0-32e332f91ade tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.084449 Apr 30 21:17:15.056465 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1030/1973] 10.222.0.23 () {60 vars in 1205 bytes} [Sat Apr 30 21:17:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:15.244908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:15.260731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e8c883c-9a09-4160-b7f3-f1fe10831bac tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:15.261971 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:15.261971 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:17:15.262535 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b82f8522-76eb-4daa-abeb-67624b8d7c1f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1320 microversion: 2.1 time: 0.374453 Apr 30 21:17:15.263401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e8c883c-9a09-4160-b7f3-f1fe10831bac tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.263875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e8c883c-9a09-4160-b7f3-f1fe10831bac tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.264710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e8c883c-9a09-4160-b7f3-f1fe10831bac tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.264949 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 944/1974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:14 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:15.265157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e8c883c-9a09-4160-b7f3-f1fe10831bac tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.273529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d56a3f85-712a-4a23-802d-236188feb240 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Calling method '.version_select at 0x7fdc20bc1670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:15.327093 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e8c883c-9a09-4160-b7f3-f1fe10831bac tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.269189 Apr 30 21:17:15.327974 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1031/1975] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:17:15 2022] GET /compute/v2.1/os-services => generated 947 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:15.340321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-861ff25f-7f09-43ae-99ad-8e56134c814c tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] Calling method '.version_select at 0x7fdc20488b80>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:15.341457 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:15.341457 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:17:15.352532 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-861ff25f-7f09-43ae-99ad-8e56134c814c tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017204 Apr 30 21:17:15.353512 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1032/1976] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Apr 30 21:17:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:15.358432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7bbb2871-f76c-4c3d-82e4-8f50347f8480 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:15.360000 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:15.360000 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:17:15.361881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bbb2871-f76c-4c3d-82e4-8f50347f8480 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.362346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bbb2871-f76c-4c3d-82e4-8f50347f8480 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.363509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bbb2871-f76c-4c3d-82e4-8f50347f8480 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.364174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bbb2871-f76c-4c3d-82e4-8f50347f8480 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.392833 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7bbb2871-f76c-4c3d-82e4-8f50347f8480 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.037867 Apr 30 21:17:15.394271 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1033/1977] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:17:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:15.409826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5d7c9874-d9d6-43e9-9419-02064a6f6d82 tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] Action: 'update', calling method: .version_select at 0x7fdc20470160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:15.409826 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:15.409826 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:17:15.840017 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d56a3f85-712a-4a23-802d-236188feb240 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/10664e80-a31b-4647-917f-910689850073" status: 202 len: 0 microversion: 2.1 time: 0.571945 Apr 30 21:17:15.840620 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 945/1978] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:17:15 2022] DELETE /compute/v2.1/os-security-groups/10664e80-a31b-4647-917f-910689850073 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:15.846044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d80732ca-495b-4d79-a4f8-d4d7a36aa93e tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:15.847323 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:15.847323 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:17:15.848554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80732ca-495b-4d79-a4f8-d4d7a36aa93e tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.849021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80732ca-495b-4d79-a4f8-d4d7a36aa93e tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.849867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80732ca-495b-4d79-a4f8-d4d7a36aa93e tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.859687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80732ca-495b-4d79-a4f8-d4d7a36aa93e tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.895605 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d80732ca-495b-4d79-a4f8-d4d7a36aa93e tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.053725 Apr 30 21:17:15.902722 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 946/1979] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:17:15 2022] GET /compute/v2.1/os-services => generated 947 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:15.909967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b2b64b9c-43ed-40ec-a80a-d1f8a3cdf3be req-55d81254-22ea-4e8e-abdb-80dbef782e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6cff9c-417f-4781-974c-f36e3b467218", "name": "network-vif-plugged", "status": "completed", "tag": "4e609015-29a3-4678-9e4b-9b00ec55c21f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:15.918197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b2b64b9c-43ed-40ec-a80a-d1f8a3cdf3be req-55d81254-22ea-4e8e-abdb-80dbef782e68 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.918658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b2b64b9c-43ed-40ec-a80a-d1f8a3cdf3be req-55d81254-22ea-4e8e-abdb-80dbef782e68 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.935270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b2b64b9c-43ed-40ec-a80a-d1f8a3cdf3be req-55d81254-22ea-4e8e-abdb-80dbef782e68 service nova] Creating event network-vif-plugged:4e609015-29a3-4678-9e4b-9b00ec55c21f for instance ca6cff9c-417f-4781-974c-f36e3b467218 on nch2-master-1 Apr 30 21:17:15.940310 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b2b64b9c-43ed-40ec-a80a-d1f8a3cdf3be req-55d81254-22ea-4e8e-abdb-80dbef782e68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036092 Apr 30 21:17:15.941468 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 947/1980] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:15.954572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:15.954572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:15.965450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.967807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:15.969114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:15.970354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:16.258920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:16.268852 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1c76ff8c-9829-41aa-bc72-6f909dce394f tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1484 microversion: 2.1 time: 0.325834 Apr 30 21:17:16.269528 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 948/1981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:15 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1484 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:16.289226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ffef8c48-bb35-4f38-83b8-80c59f9f4e39 req-bc7d09ba-a560-464a-a92c-baf7474d6ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff0823b-a621-444c-a64b-dfd437b832df", "tag": "39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:16.301019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ffef8c48-bb35-4f38-83b8-80c59f9f4e39 req-bc7d09ba-a560-464a-a92c-baf7474d6ff3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:16.301667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ffef8c48-bb35-4f38-83b8-80c59f9f4e39 req-bc7d09ba-a560-464a-a92c-baf7474d6ff3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:16.316893 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ffef8c48-bb35-4f38-83b8-80c59f9f4e39 req-bc7d09ba-a560-464a-a92c-baf7474d6ff3 service nova] Creating event network-changed:39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0 for instance 7ff0823b-a621-444c-a64b-dfd437b832df on nch1-master-1 Apr 30 21:17:16.322722 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ffef8c48-bb35-4f38-83b8-80c59f9f4e39 req-bc7d09ba-a560-464a-a92c-baf7474d6ff3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051747 Apr 30 21:17:16.323419 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 949/1982] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:16.331200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3718cc90-6bed-4992-b85b-410e8b7503d0 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] Calling method '.version_select at 0x7fdc20ac4040>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:16.650670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3718cc90-6bed-4992-b85b-410e8b7503d0 tempest-SecurityGroupsTestAdminJSON-1050104987 tempest-SecurityGroupsTestAdminJSON-1050104987-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/8f1b84cf-76df-49f1-9ee1-26d59977b11e" status: 202 len: 0 microversion: 2.1 time: 0.325785 Apr 30 21:17:16.655149 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 950/1983] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:17:16 2022] DELETE /compute/v2.1/os-security-groups/8f1b84cf-76df-49f1-9ee1-26d59977b11e => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:16.663587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aea7cf92-81d7-4916-863b-b5c4248948dd tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:16.667622 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:16.667622 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:17:16.671719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aea7cf92-81d7-4916-863b-b5c4248948dd tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:16.672913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aea7cf92-81d7-4916-863b-b5c4248948dd tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:16.674142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aea7cf92-81d7-4916-863b-b5c4248948dd tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:16.675038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aea7cf92-81d7-4916-863b-b5c4248948dd tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:16.707206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aea7cf92-81d7-4916-863b-b5c4248948dd tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.049922 Apr 30 21:17:16.707637 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 951/1984] 10.222.0.23 () {58 vars in 1195 bytes} [Sat Apr 30 21:17:16 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:17:16.723393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:16.724200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:16.728900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5d7c9874-d9d6-43e9-9419-02064a6f6d82 tempest-QuotaClassesAdminTestJSON-2095862081 tempest-QuotaClassesAdminTestJSON-2095862081-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.325907 Apr 30 21:17:16.729999 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1034/1985] 10.222.0.23 () {60 vars in 1205 bytes} [Sat Apr 30 21:17:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:16.735359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8dc126e2-687c-4e05-a3cf-bbcc8c9e7a43 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] Calling method '.version_select at 0x7fdc21baad30>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:16.738626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:16.738857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:16.739618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:16.740064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:16.962348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:16.972198 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d9c07f8-6ebf-4668-8a10-5c9c8e36b40f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1320 microversion: 2.1 time: 0.263437 Apr 30 21:17:16.972780 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 952/1986] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:16 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:16.978706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-33f0c80c-003c-4477-a5ba-d2be770adc12 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:16.988697 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:16.988697 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:17:16.993859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f0c80c-003c-4477-a5ba-d2be770adc12 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:16.994333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f0c80c-003c-4477-a5ba-d2be770adc12 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:16.995155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f0c80c-003c-4477-a5ba-d2be770adc12 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:16.997007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f0c80c-003c-4477-a5ba-d2be770adc12 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:17.059989 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-33f0c80c-003c-4477-a5ba-d2be770adc12 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.084612 Apr 30 21:17:17.066568 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 953/1987] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:17:16 2022] GET /compute/v2.1/os-services => generated 947 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:17.090174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb67036f-6063-4a34-b3a1-fb868b6d4f53 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:17.095161 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:17.095161 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:17:17.098018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb67036f-6063-4a34-b3a1-fb868b6d4f53 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:17.098766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb67036f-6063-4a34-b3a1-fb868b6d4f53 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:17.099829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb67036f-6063-4a34-b3a1-fb868b6d4f53 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:17.100525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb67036f-6063-4a34-b3a1-fb868b6d4f53 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:17.134832 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb67036f-6063-4a34-b3a1-fb868b6d4f53 tempest-ServicesAdminNegativeTestJSON-2126272548 tempest-ServicesAdminNegativeTestJSON-2126272548-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.052590 Apr 30 21:17:17.141166 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 954/1988] 10.222.0.23 () {58 vars in 1197 bytes} [Sat Apr 30 21:17:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:17:17.342853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-72f6faa6-eca0-479e-a83f-52c8477671b8 tempest-ServicesAdminNegativeTestJSON-1360264056 tempest-ServicesAdminNegativeTestJSON-1360264056-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:17.345165 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:17:17.345165 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:17:17.346391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-72f6faa6-eca0-479e-a83f-52c8477671b8 tempest-ServicesAdminNegativeTestJSON-1360264056 tempest-ServicesAdminNegativeTestJSON-1360264056-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0456dee72dcd4379ada78762526035e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cda5776322242b285e71514efc4f9d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:17.348508 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8dc126e2-687c-4e05-a3cf-bbcc8c9e7a43 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e0454bef-8a68-46b7-80a6-d12edbe02425" status: 202 len: 0 microversion: 2.1 time: 0.617393 Apr 30 21:17:17.349094 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1035/1989] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:17:16 2022] DELETE /compute/v2.1/os-security-groups/e0454bef-8a68-46b7-80a6-d12edbe02425 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:17.349785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-72f6faa6-eca0-479e-a83f-52c8477671b8 tempest-ServicesAdminNegativeTestJSON-1360264056 tempest-ServicesAdminNegativeTestJSON-1360264056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:17.350664 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-72f6faa6-eca0-479e-a83f-52c8477671b8 tempest-ServicesAdminNegativeTestJSON-1360264056 tempest-ServicesAdminNegativeTestJSON-1360264056-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.208053 Apr 30 21:17:17.360991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7473405-c23a-4b73-8cdf-776c296fbb71 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] Calling method '.version_select at 0x7fdc20d3c820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:17.366230 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 955/1990] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:17:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:17.993782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:17.994834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:18.012437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:18.012992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:18.014080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:18.014631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:18.139916 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7473405-c23a-4b73-8cdf-776c296fbb71 tempest-SecurityGroupsTestAdminJSON-326733461 tempest-SecurityGroupsTestAdminJSON-326733461-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/521ec3aa-0d3f-465c-ab12-2c57903e2235" status: 202 len: 0 microversion: 2.1 time: 0.786107 Apr 30 21:17:18.140644 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1036/1991] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:17:17 2022] DELETE /compute/v2.1/os-security-groups/521ec3aa-0d3f-465c-ab12-2c57903e2235 => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:18.241873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:18.251645 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f7b98a9-7643-4fa2-8716-0b3301a2336a tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1469 microversion: 2.1 time: 0.262038 Apr 30 21:17:18.265914 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 956/1992] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:17 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:18.623405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-29076f9d-75bc-4513-b85b-699b94e3840d tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:18.623405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-29076f9d-75bc-4513-b85b-699b94e3840d tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] [instance: b6001423-718d-4550-bcdf-38ff6895dac1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:18.632027 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-29076f9d-75bc-4513-b85b-699b94e3840d tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] HTTP exception thrown: Instance b6001423-718d-4550-bcdf-38ff6895dac1 could not be found. Apr 30 21:17:18.632955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-29076f9d-75bc-4513-b85b-699b94e3840d tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Returning 404 to user: Instance b6001423-718d-4550-bcdf-38ff6895dac1 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:18.634161 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-29076f9d-75bc-4513-b85b-699b94e3840d tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b6001423-718d-4550-bcdf-38ff6895dac1/action" status: 404 len: 111 microversion: 2.1 time: 0.361119 Apr 30 21:17:18.635508 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1037/1993] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:17:18 2022] POST /compute/v2.1/servers/b6001423-718d-4550-bcdf-38ff6895dac1/action => generated 111 bytes in 363 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:18.836747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-919075592", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:18.914625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:17:19.261355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:19.262070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:19.264180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:19.264797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:19.265542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:19.295051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:19.299991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:19.306406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:19.317560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:19.348356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Getting quotas for project 246c0a9cc007483ab7bd3cd40249f291. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:19.354624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Getting quotas for user 1886e7319ac64348a1b019b9329a92de and project 246c0a9cc007483ab7bd3cd40249f291. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:19.369377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:17:19.372171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:19.591243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf515932-a5fd-45a0-bcc4-32b07ed95c75 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758551 Apr 30 21:17:19.597876 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 957/1994] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:17:19.604497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e44800a9-be48-4a14-b205-051b6de694d0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:19.605135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e44800a9-be48-4a14-b205-051b6de694d0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:19.900083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e44800a9-be48-4a14-b205-051b6de694d0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:19.907874 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e44800a9-be48-4a14-b205-051b6de694d0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1221 microversion: 2.1 time: 0.308588 Apr 30 21:17:19.907874 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1038/1995] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:19 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1221 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:17:20.934094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48adca04-8a33-4d3e-b35b-7c48ffb6a88b tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:20.936333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-48adca04-8a33-4d3e-b35b-7c48ffb6a88b tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:21.119948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-48adca04-8a33-4d3e-b35b-7c48ffb6a88b tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:21.129077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-48adca04-8a33-4d3e-b35b-7c48ffb6a88b tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1221 microversion: 2.1 time: 0.208533 Apr 30 21:17:21.140306 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 958/1996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:20 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:22.146959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:22.147826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:22.155097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:22.155550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:22.156328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:22.157001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:22.266961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:22.295370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37c91dc3-5a0f-4ec0-a754-97ebace99064 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1273 microversion: 2.1 time: 0.151957 Apr 30 21:17:22.310647 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1039/1997] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:22 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:23.156628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:23.157232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:23.176579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:23.176963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:23.177803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:23.178263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:23.215305 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] HTTP exception thrown: Instance 361d2aa0-0533-433d-aec8-097fee016242 could not be found. Apr 30 21:17:23.215936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Returning 404 to user: Instance 361d2aa0-0533-433d-aec8-097fee016242 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:23.216812 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75522e42-80ca-4f9f-97f3-919978f5df2a tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "DELETE /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 404 len: 111 microversion: 2.1 time: 0.064956 Apr 30 21:17:23.218153 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 959/1998] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:17:23 2022] DELETE /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:23.228711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:23.229942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] [instance: 361d2aa0-0533-433d-aec8-097fee016242] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:23.243833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:23.244496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:23.246174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:23.246797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:23.284422 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] HTTP exception thrown: Instance 361d2aa0-0533-433d-aec8-097fee016242 could not be found. Apr 30 21:17:23.287638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] Returning 404 to user: Instance 361d2aa0-0533-433d-aec8-097fee016242 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:23.288736 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f20bf61-f1ed-4181-8cd6-647f448a21de tempest-AttachSCSIVolumeTestJSON-1824069812 tempest-AttachSCSIVolumeTestJSON-1824069812-project] 10.222.0.23 "GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242" status: 404 len: 111 microversion: 2.1 time: 0.064857 Apr 30 21:17:23.292743 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1040/1999] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:23 2022] GET /compute/v2.1/servers/361d2aa0-0533-433d-aec8-097fee016242 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:23.312854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:23.314172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:23.336173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:23.336647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:23.337502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:23.348955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:23.540378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:23.551883 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-63280315-9d6e-45e1-86b3-e66f546d948c tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1291 microversion: 2.1 time: 0.242942 Apr 30 21:17:23.561428 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 960/2000] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:23 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1291 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:24.570995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:24.572381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:24.588325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:24.588784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:24.589576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:24.590063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:24.713246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:24.731432 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8189737-61a8-4c05-9ede-67cf6b87bdb3 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1279 microversion: 2.1 time: 0.164497 Apr 30 21:17:24.732453 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1041/2001] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:24 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:25.751693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:25.752351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:25.762750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:25.763701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:25.764686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:25.765781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:25.932783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1790403771", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:25.941947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:25.954334 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb309f6e-658b-48d6-9ff5-3e0761da1428 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1321 microversion: 2.1 time: 0.206595 Apr 30 21:17:25.955039 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1042/2002] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:25 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:17:26.006573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:17:26.222378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:26.223139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:26.223633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:26.224216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:26.224814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:26.234631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:26.235783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:26.236974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:26.239713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:26.264597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:26.270561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:26.292549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:17:26.295102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:26.507021 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c410d2b1-168e-4fe5-85f2-73e89d10570b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045985 Apr 30 21:17:26.509922 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 961/2003] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:17:26.521710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f582f11-ba11-4046-a28e-a42f1d0f391e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:26.522690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f582f11-ba11-4046-a28e-a42f1d0f391e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:26.667800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb2b22ed-2d11-4949-b0e1-b851f03ecff7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Action: 'create', calling method: .version_select at 0x7fdc2098c160>, body: {"keypair": {"name": "tempest-keypair-1856707096"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:26.717625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb2b22ed-2d11-4949-b0e1-b851f03ecff7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Getting quotas for project b57cf4c7f250443a8afd9460085f6951. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:26.731726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb2b22ed-2d11-4949-b0e1-b851f03ecff7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Getting quotas for user f0c43fdc22254d7f9c5999e044c4f844 and project b57cf4c7f250443a8afd9460085f6951. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:26.760979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2f582f11-ba11-4046-a28e-a42f1d0f391e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:26.772583 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f582f11-ba11-4046-a28e-a42f1d0f391e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1217 microversion: 2.1 time: 0.255812 Apr 30 21:17:26.780669 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1043/2004] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:26 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:26.973249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:26.973900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:27.008577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:27.009073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:27.013951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:27.015371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:27.421249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:27.430396 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f6d3ae3f-3f28-46b4-8285-898767044599 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1321 microversion: 2.1 time: 0.462138 Apr 30 21:17:27.431282 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1044/2005] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:26 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:27.460441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb2b22ed-2d11-4949-b0e1-b851f03ecff7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Getting quotas for project b57cf4c7f250443a8afd9460085f6951. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:27.465977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb2b22ed-2d11-4949-b0e1-b851f03ecff7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Getting quotas for user f0c43fdc22254d7f9c5999e044c4f844 and project b57cf4c7f250443a8afd9460085f6951. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:27.497320 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb2b22ed-2d11-4949-b0e1-b851f03ecff7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.836087 Apr 30 21:17:27.498518 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 962/2006] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Apr 30 21:17:26 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 838 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:17:27.652266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-714488349", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": "none"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:27.712453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:27.712881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:27.713382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:27.713824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:27.714274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:27.723764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:27.724214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:27.725027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:27.725455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:27.743243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Getting quotas for project 7eac2a1411444a6293feba25da6fead3. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:27.748824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Getting quotas for user 6a323f0848cb404092fe96f6c4168468 and project 7eac2a1411444a6293feba25da6fead3. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:27.771274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:17:27.775220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:27.800359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93ba94c6-d7ad-472d-9adc-62dc69f8b08a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:27.801265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93ba94c6-d7ad-472d-9adc-62dc69f8b08a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:27.887690 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-066dc151-1910-4821-8c8d-367894743fee tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.378147 Apr 30 21:17:27.889730 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1045/2007] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 30 21:17:27.902770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1715c427-5e3e-4fb0-93f7-65df19f56e17 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:27.904420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1715c427-5e3e-4fb0-93f7-65df19f56e17 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:27.914109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93ba94c6-d7ad-472d-9adc-62dc69f8b08a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:27.935360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93ba94c6-d7ad-472d-9adc-62dc69f8b08a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1217 microversion: 2.1 time: 0.140719 Apr 30 21:17:27.955677 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 963/2008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:27 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:27.966041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-30c8d3a4-d1f6-4435-9897-956d2de91cd4 req-68de0d6d-0c38-4d9f-b49a-b2ef46f27f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2986b8a8-07d6-418d-9fa3-cb89d1fa7958", "tag": "5cc75f37-023f-4221-84dd-6dfe9677944f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:27.978841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-30c8d3a4-d1f6-4435-9897-956d2de91cd4 req-68de0d6d-0c38-4d9f-b49a-b2ef46f27f82 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:27.981014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-30c8d3a4-d1f6-4435-9897-956d2de91cd4 req-68de0d6d-0c38-4d9f-b49a-b2ef46f27f82 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:28.003235 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-30c8d3a4-d1f6-4435-9897-956d2de91cd4 req-68de0d6d-0c38-4d9f-b49a-b2ef46f27f82 service nova] Creating event network-changed:5cc75f37-023f-4221-84dd-6dfe9677944f for instance 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 on nch1-master-1 Apr 30 21:17:28.018418 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-30c8d3a4-d1f6-4435-9897-956d2de91cd4 req-68de0d6d-0c38-4d9f-b49a-b2ef46f27f82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059812 Apr 30 21:17:28.020531 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 964/2009] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:28.040465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1715c427-5e3e-4fb0-93f7-65df19f56e17 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:28.048954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1715c427-5e3e-4fb0-93f7-65df19f56e17 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:28.050495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1715c427-5e3e-4fb0-93f7-65df19f56e17 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:28.059776 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1715c427-5e3e-4fb0-93f7-65df19f56e17 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "PUT /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1358 microversion: 2.75 time: 0.162613 Apr 30 21:17:28.075694 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1046/2010] 10.222.0.23 () {62 vars in 1296 bytes} [Sat Apr 30 21:17:27 2022] PUT /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:28.079625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa7230a6-17c6-4924-a899-230d3c1a54e9 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:28.080621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aa7230a6-17c6-4924-a899-230d3c1a54e9 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:28.157531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aa7230a6-17c6-4924-a899-230d3c1a54e9 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:28.175383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aa7230a6-17c6-4924-a899-230d3c1a54e9 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:28.179158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aa7230a6-17c6-4924-a899-230d3c1a54e9 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:28.202645 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aa7230a6-17c6-4924-a899-230d3c1a54e9 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1358 microversion: 2.75 time: 0.124976 Apr 30 21:17:28.202645 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 965/2011] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:28 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1358 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:28.449184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:28.450114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:28.460282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:28.461002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:28.462781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:28.463431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:28.972223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:28.974549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:28.978890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:28.989381 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c492064c-6348-475c-8d0f-1270e3aa5a23 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1321 microversion: 2.1 time: 0.544562 Apr 30 21:17:29.006819 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1047/2012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:28 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:29.007297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:29.007951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:29.008938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:29.009569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:29.106741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:29.123920 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6e9c11e-bce6-44c4-bba5-955d0e9246e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1269 microversion: 2.1 time: 0.155905 Apr 30 21:17:29.129072 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 966/2013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:28 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:29.222002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-833b12b5-d340-4552-9b03-6cb9de0b31e6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:29.222623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-833b12b5-d340-4552-9b03-6cb9de0b31e6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:29.341709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-833b12b5-d340-4552-9b03-6cb9de0b31e6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:29.349846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-833b12b5-d340-4552-9b03-6cb9de0b31e6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:29.351607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-833b12b5-d340-4552-9b03-6cb9de0b31e6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:29.357458 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-833b12b5-d340-4552-9b03-6cb9de0b31e6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1358 microversion: 2.75 time: 0.140776 Apr 30 21:17:29.370315 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1048/2014] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:29 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:30.008483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:30.009697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:30.018628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:30.023812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:30.023812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:30.023812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:30.145993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:30.146620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:30.164505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:30.165433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:30.166679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:30.167753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:30.365837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:30.395197 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ba1da08-d5c9-43ba-b20b-01b2f8af7ff0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1275 microversion: 2.1 time: 0.234250 Apr 30 21:17:30.433471 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1049/2015] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:30 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:17:30.446646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:30.448928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:30.579053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:30.579053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:30.579053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:30.579053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:30.582455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:30.582455 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cafda13f-8f64-4b8e-b13d-1b42b1d3ca03 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1321 microversion: 2.1 time: 0.556468 Apr 30 21:17:30.582455 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 967/2016] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:30 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:30.667886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:30.678273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:30.679818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:30.685419 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-62aedc26-3531-463f-929b-4dc23323615e tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1410 microversion: 2.75 time: 0.250038 Apr 30 21:17:30.686032 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1050/2017] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:30 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1410 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:31.454231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:31.455460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:31.467209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:31.468001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:31.469496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:31.470827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:31.597115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:31.598372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:31.634474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:31.635282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:31.636361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:31.638748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:31.924396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:31.936582 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-58bd53fd-c0b0-485d-96dd-e4e3abe26f93 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1275 microversion: 2.1 time: 0.490297 Apr 30 21:17:31.942400 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 968/2018] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:31 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1275 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:31.955208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:31.956719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:31.976261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:31.979121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:31.983774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:31.985103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:32.338486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:32.377730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:32.381591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:32.401359 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ac3d61a0-e553-4f31-a17f-02160664f05a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1416 microversion: 2.75 time: 0.456736 Apr 30 21:17:32.402932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 969/2019] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:31 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1416 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:32.461296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:32.472734 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d017f1f7-128e-4781-8691-077079ecffa0 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1321 microversion: 2.1 time: 0.882088 Apr 30 21:17:32.472734 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1051/2020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:31 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1321 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:32.960823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:32.962051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:32.972578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:32.979977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:32.981251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:32.981987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:33.183789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:33.194751 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46294cb8-13f2-4ccf-9539-564bbd014496 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1275 microversion: 2.1 time: 0.239911 Apr 30 21:17:33.198436 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 970/2021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:32 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:33.426119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:33.427478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:33.436720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:33.437645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:33.438705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:33.439317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:33.489914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:33.490852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:33.500955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:33.511414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:33.511414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:33.511414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:33.694015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:33.732574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:33.748784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:33.763891 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80cf7bba-c2c1-4fec-814c-2e583dd3be3a tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1416 microversion: 2.75 time: 0.342712 Apr 30 21:17:33.782070 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1052/2022] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:33 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1416 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:33.818967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1711013862", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1f054da6-523b-43c4-83a2-ca0049497cde"}, {"port": "eeb95bf2-7a04-4881-a1c4-a027f2905abd", "tag": "port-1"}, {"port": "bb19e621-b828-4d48-80fb-51c3c27d3aae", "tag": "port-2"}, {"uuid": "dcb46efb-f856-4d0a-9c79-6edd64276510", "tag": "net-1"}, {"uuid": "dcb46efb-f856-4d0a-9c79-6edd64276510"}, {"uuid": "491ca467-fa0f-4500-813a-eee0ea86bd57", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "491ca467-fa0f-4500-813a-eee0ea86bd57", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "acace4b6-8088-43ff-9975-029ca62df01f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2c40c928-cd22-4b64-8d73-211240864fa6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "80f5c8d3-2b42-46ef-9de8-ca18b38a1f28", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--74255143"}], "key_name": "tempest-keypair-1856707096", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:34.089933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:34.103910 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-01858d3e-9c6f-4954-b6c1-340b7c98848f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1321 microversion: 2.1 time: 0.618859 Apr 30 21:17:34.112188 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 971/2023] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:33 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1321 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:34.157886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] validate_networks() for [('1f054da6-523b-43c4-83a2-ca0049497cde', None, None, None, None, None), (None, None, 'eeb95bf2-7a04-4881-a1c4-a027f2905abd', None, None, None), (None, None, 'bb19e621-b828-4d48-80fb-51c3c27d3aae', None, None, None), ('dcb46efb-f856-4d0a-9c79-6edd64276510', None, None, None, None, None), ('dcb46efb-f856-4d0a-9c79-6edd64276510', None, None, None, None, None), ('491ca467-fa0f-4500-813a-eee0ea86bd57', '10.2.2.100', None, None, None, None), ('491ca467-fa0f-4500-813a-eee0ea86bd57', '10.2.2.200', None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:17:34.218430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:34.219621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:34.238712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:34.239320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:34.250732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:34.251603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:35.366961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:35.379978 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb476586-db48-47e8-a815-bf0ac45f42d5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 1.168592 Apr 30 21:17:35.390197 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 972/2024] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:34 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:17:35.396674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:35.397552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:35.425045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:35.425884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:35.427558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:35.428183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:35.659633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:35.671106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:35.673343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:35.685727 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2245092e-e708-4c96-9d60-a29831487ffa tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1437 microversion: 2.75 time: 0.292750 Apr 30 21:17:35.687512 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 973/2025] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:35 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1437 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:35.693329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:35.694174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:35.704376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:35.704986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:35.706831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:35.712898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:36.320787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:36.333990 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9afa11e2-b7a7-4955-bfd6-b97a937eb7af tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1321 microversion: 2.1 time: 0.645227 Apr 30 21:17:36.335743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 974/2026] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:35 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1321 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:36.341594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a3070734-59d1-4cfc-9a79-80cb5c42850d req-aee3137e-fcce-45af-8cfa-27de69b31d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2986b8a8-07d6-418d-9fa3-cb89d1fa7958", "name": "network-vif-plugged", "status": "completed", "tag": "5cc75f37-023f-4221-84dd-6dfe9677944f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:36.353714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a3070734-59d1-4cfc-9a79-80cb5c42850d req-aee3137e-fcce-45af-8cfa-27de69b31d23 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:36.354433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a3070734-59d1-4cfc-9a79-80cb5c42850d req-aee3137e-fcce-45af-8cfa-27de69b31d23 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:36.367742 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a3070734-59d1-4cfc-9a79-80cb5c42850d req-aee3137e-fcce-45af-8cfa-27de69b31d23 service nova] Creating event network-vif-plugged:5cc75f37-023f-4221-84dd-6dfe9677944f for instance 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 on nch1-master-1 Apr 30 21:17:36.373715 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a3070734-59d1-4cfc-9a79-80cb5c42850d req-aee3137e-fcce-45af-8cfa-27de69b31d23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036423 Apr 30 21:17:36.374844 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 975/2027] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:36.382762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:36.384869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:36.394332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:36.397675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:36.397675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:36.397675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:36.560521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:36.565629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:36.568506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:36.569128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:36.569570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:36.839803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:36.865516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:36.869144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:36.870240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:36.870714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:37.124484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:37.134815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:37.141466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:37.162085 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ef0abb23-7c60-4163-b90e-bac33facfe38 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "POST /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607/action" status: 202 len: 1494 microversion: 2.75 time: 0.785119 Apr 30 21:17:37.184172 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 976/2028] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:17:36 2022] POST /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607/action => generated 1494 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 30 21:17:37.191081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:37.191784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:37.202491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:37.202491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:37.203944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:37.204411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:37.758129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:37.770089 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-545ad169-cebf-4279-b00d-1070a5eabd35 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 0.584644 Apr 30 21:17:37.770915 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 977/2029] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:37 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:37.775758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:37.786769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:37.803933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:37.804313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:37.805115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:37.805556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:37.999418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:38.008011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:38.010723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:38.016288 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44c0d8b7-9fee-44e8-bbbb-dcc2a6feb939 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.244187 Apr 30 21:17:38.028622 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 978/2030] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:37 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:38.034600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:38.035240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:38.042215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:38.044145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:38.044145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:38.044928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:38.644141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:38.658217 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-62561ff6-d86c-48ba-9b43-668172aa3bd4 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1471 microversion: 2.1 time: 0.627292 Apr 30 21:17:38.675872 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 979/2031] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:38 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1471 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:38.701379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f619cea2-632f-4b98-88fc-99e725e7290e req-a14739d2-d654-4864-b456-2a9b2f4393b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2190c553-068c-486e-b740-cca74445af33", "tag": "3bf656ae-1f28-4b83-93e5-60f173aa4d0f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:38.722312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f619cea2-632f-4b98-88fc-99e725e7290e req-a14739d2-d654-4864-b456-2a9b2f4393b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:38.722312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f619cea2-632f-4b98-88fc-99e725e7290e req-a14739d2-d654-4864-b456-2a9b2f4393b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:38.757076 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f619cea2-632f-4b98-88fc-99e725e7290e req-a14739d2-d654-4864-b456-2a9b2f4393b7 service nova] Creating event network-changed:3bf656ae-1f28-4b83-93e5-60f173aa4d0f for instance 2190c553-068c-486e-b740-cca74445af33 on nch2-master-1 Apr 30 21:17:38.772496 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f619cea2-632f-4b98-88fc-99e725e7290e req-a14739d2-d654-4864-b456-2a9b2f4393b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080117 Apr 30 21:17:38.773922 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 980/2032] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:38.798113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:38.798113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:38.811753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:38.812225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:38.813063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:38.813505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:38.858835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lazy-loading 'flavor' on Instance uuid 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:17:39.264270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49415660-f5b2-435d-8d5f-570d412d9cdd tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958/action" status: 202 len: 0 microversion: 2.1 time: 0.486599 Apr 30 21:17:39.264965 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 981/2033] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:17:38 2022] POST /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:17:39.299892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:39.307042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:39.316460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:39.317185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:39.318769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:39.325565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:40.175702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:40.181328 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ccf847f3-62c9-4b42-9ee1-d9bf9971dd6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 0.889774 Apr 30 21:17:40.181950 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 982/2034] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:39 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:40.188315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:40.189126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:40.206680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:40.206680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:40.208544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:40.209917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:40.371879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:40.410158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:40.410618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:40.418682 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-53f0dbd7-ec0e-4516-bc61-849bfa877f51 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.234563 Apr 30 21:17:40.420503 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 983/2035] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:40 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:40.425877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-220185a9-77ac-4a08-a514-be525e562ff6 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:40.427144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-220185a9-77ac-4a08-a514-be525e562ff6 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:40.435602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-220185a9-77ac-4a08-a514-be525e562ff6 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:40.436265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-220185a9-77ac-4a08-a514-be525e562ff6 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:40.438296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-220185a9-77ac-4a08-a514-be525e562ff6 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:40.439119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-220185a9-77ac-4a08-a514-be525e562ff6 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:41.386613 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-220185a9-77ac-4a08-a514-be525e562ff6 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1613 microversion: 2.1 time: 0.964809 Apr 30 21:17:41.387306 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 984/2036] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:40 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1613 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:41.396239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:41.398026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:41.408306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:41.409014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:41.410679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:41.412447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:41.882322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:41.890831 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-237e319a-fcb6-4332-a5ef-64a2e98ced78 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 0.502079 Apr 30 21:17:41.891544 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 985/2037] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:41 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:41.896472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:41.897063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:41.903731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:41.904187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:41.905891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:41.905891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:41.992855 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] HTTP exception thrown: Cannot 'migrate' instance 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 while it is in vm_state suspended Apr 30 21:17:41.993702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Returning 409 to user: Cannot 'migrate' instance 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 while it is in vm_state suspended {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:41.994570 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5d06f6d2-7d7a-47ca-94ae-fc9af5a99201 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958/action" status: 409 len: 148 microversion: 2.1 time: 0.102107 Apr 30 21:17:41.995126 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 986/2038] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:17:41 2022] POST /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958/action => generated 148 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:17:42.005282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:42.006389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:42.012654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:42.013366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:42.014464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:42.015066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:42.120459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:42.130013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:42.131526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:42.137339 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f3fddeab-d4ac-4fce-9f33-a2efb6c0fd70 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.141048 Apr 30 21:17:42.138150 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 987/2039] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:41 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:42.144895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-abb667f2-5a57-4159-9fbd-3ca92440a810 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:42.146411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-abb667f2-5a57-4159-9fbd-3ca92440a810 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:42.147718 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-abb667f2-5a57-4159-9fbd-3ca92440a810 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218/action" status: 400 len: 144 microversion: 2.1 time: 0.007776 Apr 30 21:17:42.154069 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 988/2040] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:17:42 2022] POST /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218/action => generated 144 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:17:42.159856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-89921397-c9d2-4cee-b0b6-e53ef6a37c13 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:42.167093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-89921397-c9d2-4cee-b0b6-e53ef6a37c13 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:42.167093 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-89921397-c9d2-4cee-b0b6-e53ef6a37c13 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218/action" status: 400 len: 120 microversion: 2.1 time: 0.007061 Apr 30 21:17:42.167093 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 989/2041] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:17:42 2022] POST /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218/action => generated 120 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:17:42.173216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6959f911-fc64-45ca-9dd3-7c15c8440a26 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:42.174325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6959f911-fc64-45ca-9dd3-7c15c8440a26 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Failed to fetch instance by id 999 {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 30 21:17:42.174834 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-6959f911-fc64-45ca-9dd3-7c15c8440a26 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] HTTP exception thrown: Instance 999 could not be found. Apr 30 21:17:42.175431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6959f911-fc64-45ca-9dd3-7c15c8440a26 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:42.176229 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6959f911-fc64-45ca-9dd3-7c15c8440a26 tempest-ServersAdminNegativeTestJSON-1360757712 tempest-ServersAdminNegativeTestJSON-1360757712-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.008070 Apr 30 21:17:42.176743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 990/2042] 10.222.0.23 () {60 vars in 1178 bytes} [Sat Apr 30 21:17:42 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:17:42.185978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:42.187803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:42.192717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:42.193260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:42.194289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:42.194799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:42.230792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:17:42.669286 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-573acad4-3785-4033-ac42-5c12a9121880 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 204 len: 0 microversion: 2.1 time: 0.487347 Apr 30 21:17:42.674144 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 991/2043] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:17:42 2022] DELETE /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:17:42.680321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:42.681222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:42.689094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:42.689784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:42.691001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:42.691613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:43.250576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:43.251937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:43.252666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:43.253301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:43.254265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:43.265146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:43.278299 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a860e37-b1af-4d7f-a15c-1de57f15124d tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1468 microversion: 2.1 time: 0.602691 Apr 30 21:17:43.279338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:43.287044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:43.287044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:43.287044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:43.294179 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 992/2044] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:42 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1468 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:43.305974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:43.306540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:43.320023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:43.320478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:43.324587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:43.325063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:43.325682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Getting quotas for project b57cf4c7f250443a8afd9460085f6951. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:43.358634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Getting quotas for user f0c43fdc22254d7f9c5999e044c4f844 and project b57cf4c7f250443a8afd9460085f6951. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:43.608530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:17:43.625016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='acace4b6-8088-43ff-9975-029ca62df01f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2c40c928-cd22-4b64-8d73-211240864fa6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80f5c8d3-2b42-46ef-9de8-ca18b38a1f28',volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:43.650827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:43.659641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec2e2323-f932-4685-81eb-c4e0e51e109b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 0.364256 Apr 30 21:17:43.660225 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 993/2045] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:43 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:43.675307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:43.675937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:43.687003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:43.687521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:43.688324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:43.688770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:43.818200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:43.834780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:43.837325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:43.852510 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a11a897d-69ce-4420-8a84-2f2c7dd43159 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.189876 Apr 30 21:17:43.853570 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 994/2046] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:43 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:43.994030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-57f99814-6fcd-4b69-8336-f66649bd68e8 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Action: 'create', calling method: .version_select at 0x7fdc2094c310>, body: {"pool": null} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:45.130937 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd59acc6-600e-495b-9503-abb09ff60d50 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 11.318475 Apr 30 21:17:45.141268 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1053/2047] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Apr 30 21:17:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 11330 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 30 21:17:45.169965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:45.171073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:45.209575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:45.215859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:45.216728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:45.217173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:45.475517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:45.492884 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2104908-e5a7-48ef-866d-b86703f9dbc2 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 200 len: 1426 microversion: 2.1 time: 0.347058 Apr 30 21:17:45.493901 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1054/2048] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:45 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 1426 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:45.513067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:45.513707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:45.538992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:45.539450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:45.552122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:45.554212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:46.005316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:46.013577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59750b9b-bcb3-4fb1-8450-2372093b438f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 0.518340 Apr 30 21:17:46.014741 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1055/2049] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:45 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:46.020730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:46.022007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:46.028730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:46.032008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:46.032008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:46.032008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:46.554511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:46.575378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:46.595995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:46.617312 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d83d2eb-e141-4671-b21c-60a50adfe270 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.600572 Apr 30 21:17:46.619057 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1056/2050] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:46 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:46.625405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ab7fb551-2c8e-42b1-b40c-41215d9ed61f req-44a1a144-b337-4817-a943-025ec4f23b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2986b8a8-07d6-418d-9fa3-cb89d1fa7958", "name": "network-vif-deleted", "tag": "5cc75f37-023f-4221-84dd-6dfe9677944f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:46.660942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ab7fb551-2c8e-42b1-b40c-41215d9ed61f req-44a1a144-b337-4817-a943-025ec4f23b07 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:46.662823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ab7fb551-2c8e-42b1-b40c-41215d9ed61f req-44a1a144-b337-4817-a943-025ec4f23b07 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:46.680128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ab7fb551-2c8e-42b1-b40c-41215d9ed61f req-44a1a144-b337-4817-a943-025ec4f23b07 service nova] Creating event network-vif-deleted:5cc75f37-023f-4221-84dd-6dfe9677944f for instance 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 on nch1-master-1 Apr 30 21:17:46.688422 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ab7fb551-2c8e-42b1-b40c-41215d9ed61f req-44a1a144-b337-4817-a943-025ec4f23b07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067161 Apr 30 21:17:46.689100 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1057/2051] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:46.696001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-98be28ef-49b5-46a8-ac69-67ed19eb8603 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:46.696681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98be28ef-49b5-46a8-ac69-67ed19eb8603 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:46.981270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98be28ef-49b5-46a8-ac69-67ed19eb8603 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:46.989590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98be28ef-49b5-46a8-ac69-67ed19eb8603 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:46.996989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98be28ef-49b5-46a8-ac69-67ed19eb8603 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:46.998591 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-98be28ef-49b5-46a8-ac69-67ed19eb8603 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1286 microversion: 2.32 time: 0.308100 Apr 30 21:17:47.003123 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1058/2052] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:46 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1286 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:47.121297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3921e313-db8a-449a-a0ce-fefa60ae6207 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Action: 'create', calling method: .version_select at 0x7fdc203aab80>, body: {"keypair": {"name": "tempest-keypair-410651990"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:47.136558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3921e313-db8a-449a-a0ce-fefa60ae6207 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for project 7c032d189cb14ea297194dffa380eae5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:47.143325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3921e313-db8a-449a-a0ce-fefa60ae6207 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for user bfe17212ef4a49fd954bbf17317ccd67 and project 7c032d189cb14ea297194dffa380eae5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:47.558487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3921e313-db8a-449a-a0ce-fefa60ae6207 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for project 7c032d189cb14ea297194dffa380eae5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:47.577262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3921e313-db8a-449a-a0ce-fefa60ae6207 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for user bfe17212ef4a49fd954bbf17317ccd67 and project 7c032d189cb14ea297194dffa380eae5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:47.608316 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3921e313-db8a-449a-a0ce-fefa60ae6207 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.603810 Apr 30 21:17:47.610171 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1059/2053] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:17:47 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:47.646083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4d3a94a7-2bc2-410c-888d-6e0081bb16f9 req-f4ed91ea-8d9b-42dd-bc64-c18f3244e318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2190c553-068c-486e-b740-cca74445af33", "name": "network-vif-plugged", "status": "completed", "tag": "3bf656ae-1f28-4b83-93e5-60f173aa4d0f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:47.716503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d3a94a7-2bc2-410c-888d-6e0081bb16f9 req-f4ed91ea-8d9b-42dd-bc64-c18f3244e318 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:47.719591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d3a94a7-2bc2-410c-888d-6e0081bb16f9 req-f4ed91ea-8d9b-42dd-bc64-c18f3244e318 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:47.747712 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4d3a94a7-2bc2-410c-888d-6e0081bb16f9 req-f4ed91ea-8d9b-42dd-bc64-c18f3244e318 service nova] Creating event network-vif-plugged:3bf656ae-1f28-4b83-93e5-60f173aa4d0f for instance 2190c553-068c-486e-b740-cca74445af33 on nch2-master-1 Apr 30 21:17:47.758862 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4d3a94a7-2bc2-410c-888d-6e0081bb16f9 req-f4ed91ea-8d9b-42dd-bc64-c18f3244e318 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147029 Apr 30 21:17:47.766526 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1060/2054] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:47.772533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:47.777895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: 2986b8a8-07d6-418d-9fa3-cb89d1fa7958] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:47.798239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:47.798706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:47.799734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:47.803285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:47.804958 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-57f99814-6fcd-4b69-8336-f66649bd68e8 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.949945 Apr 30 21:17:47.805558 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 995/2055] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:17:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:47.813093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:47.813969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:47.833961 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] HTTP exception thrown: Instance 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 could not be found. Apr 30 21:17:47.837147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Returning 404 to user: Instance 2986b8a8-07d6-418d-9fa3-cb89d1fa7958 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:47.841410 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a7181662-4f52-4f92-88b2-5922ce120353 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958" status: 404 len: 111 microversion: 2.1 time: 0.073199 Apr 30 21:17:47.844940 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1061/2056] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:47 2022] GET /compute/v2.1/servers/2986b8a8-07d6-418d-9fa3-cb89d1fa7958 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:47.846451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:47.846992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:47.848593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:47.859603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:47.859887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:47.865564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:47.882011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:47.891728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:47.893926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:47.895944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:48.115661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:48.124993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:48.135847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:48.144509 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a9ae9d6-482b-4450-8fb1-7ae07e246178 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.301034 Apr 30 21:17:48.145105 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1062/2057] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:47 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:48.161638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2fa797d3-815a-4890-b28c-041db8ce9382 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Action: 'create', calling method: .version_select at 0x7fdc203bbaf0>, body: {"pool": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:48.604560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:48.614030 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2204c5f9-19df-4a13-9f6e-80e4fbb71aa8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 0.806997 Apr 30 21:17:48.615949 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 996/2058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:47 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:48.631383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:48.632228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:48.655850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:48.655850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:48.655850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:48.655850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:48.718910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:17:49.177637 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-605381d5-517e-4684-8f77-6af6611cb620 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 204 len: 0 microversion: 2.1 time: 0.559568 Apr 30 21:17:49.178780 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 997/2059] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:17:48 2022] DELETE /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:17:49.188162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:49.188943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:49.213124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:49.213516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:49.215355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:49.215994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:49.594177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:49.609628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:49.615424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:49.619183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1a449e8d-0b7a-4981-b03b-0cd495661d2e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1584 microversion: 2.32 time: 0.437032 Apr 30 21:17:49.622051 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 998/2060] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:49 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1584 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:49.637188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:49.645190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:49.668548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:49.669951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:49.671091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:49.672458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:49.860924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:49.875547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:49.879300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:49.892845 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c199131c-5da4-482c-a706-ca695eae4548 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.269143 Apr 30 21:17:49.908564 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 999/2061] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:49 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:49.919969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:49.924462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:49.940627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:49.942175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:49.943445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:49.944192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:50.285392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:50.293482 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-414e4eb7-970b-487e-b116-95a66229af7f tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1475 microversion: 2.1 time: 0.383300 Apr 30 21:17:50.303658 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1000/2062] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:49 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1475 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:50.310541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:50.311520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:50.318181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:50.320361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:50.320361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:50.320361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:50.844150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:50.877480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45e405e6-cc48-4b7f-b147-49b9084d3f38 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1317 microversion: 2.1 time: 0.571888 Apr 30 21:17:50.878396 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1001/2063] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:50 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:50.886226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:50.887133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:50.910482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:50.915201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:50.915201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:50.916536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:51.571076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:51.583294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:51.585016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:51.586444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e77ddf9d-d3c8-43c2-84b6-ba846b05864d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1660 microversion: 2.32 time: 0.706907 Apr 30 21:17:51.587276 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1002/2064] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:50 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1660 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:51.603492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:51.604449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:51.613196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:51.618564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:51.619504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:51.620482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:51.815976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:51.831544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:51.837648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:51.838380 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8625644b-1677-4672-8f1a-5b4f219ec1d5 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.239136 Apr 30 21:17:51.839156 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1003/2065] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:51 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:51.845298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:51.846270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:51.854049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:51.854768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:51.856584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:51.857394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:52.242959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1886e7319ac64348a1b019b9329a92de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246c0a9cc007483ab7bd3cd40249f291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:52.255835 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5b42cd5-1f81-4375-80d9-27aed9f34ad9 tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 200 len: 1475 microversion: 2.1 time: 0.415258 Apr 30 21:17:52.257846 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1004/2066] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:51 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 1475 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:52.270237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:52.271435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:52.293682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:52.294479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:52.295475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:52.297044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:52.872341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:52.883793 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-76c3bbdd-8f9b-4113-bf91-fe8293828e46 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1466 microversion: 2.1 time: 0.623368 Apr 30 21:17:52.890357 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1005/2067] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:52 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1466 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:52.907644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:52.910961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:52.928911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:52.931684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:52.931684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:52.932604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:53.457182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:53.467451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:53.469666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:53.470908 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-276446b1-de2a-4e92-ab3f-6db76d1b7418 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1705 microversion: 2.32 time: 0.578381 Apr 30 21:17:53.471490 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1006/2068] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:52 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1705 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:53.489367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:53.490227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:53.505772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:53.507741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:53.508585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:53.509045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:53.673691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:53.694980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:53.705925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:53.739986 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d4ff3c57-a31f-4315-9fc1-3beaa834634b tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.235801 Apr 30 21:17:53.742595 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1007/2069] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:53 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:53.825045 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2fa797d3-815a-4890-b28c-041db8ce9382 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.677412 Apr 30 21:17:53.825722 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1063/2070] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:17:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:53.834559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1162225471", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "754dca2d-ae1a-474d-84c8-c3a2c085f38c"}], "security_groups": [{"name": "tempest-securitygroup--944141613"}], "key_name": "tempest-keypair-410651990", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:53.929732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f24ef2f-66d6-492f-a219-8a80c05c3c69 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:53.931398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f24ef2f-66d6-492f-a219-8a80c05c3c69 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:53.942333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f24ef2f-66d6-492f-a219-8a80c05c3c69 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:53.945542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f24ef2f-66d6-492f-a219-8a80c05c3c69 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:53.945542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f24ef2f-66d6-492f-a219-8a80c05c3c69 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:53.946263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f24ef2f-66d6-492f-a219-8a80c05c3c69 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:54.095558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] validate_networks() for [('754dca2d-ae1a-474d-84c8-c3a2c085f38c', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:17:54.689943 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f24ef2f-66d6-492f-a219-8a80c05c3c69 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1617 microversion: 2.1 time: 0.936674 Apr 30 21:17:54.701844 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1008/2071] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:53 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1617 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:54.710573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:54.711577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] [instance: ca6cff9c-417f-4781-974c-f36e3b467218] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:54.718883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:54.719497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:54.720660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:54.721125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:54.742975 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] HTTP exception thrown: Instance ca6cff9c-417f-4781-974c-f36e3b467218 could not be found. Apr 30 21:17:54.744461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] Returning 404 to user: Instance ca6cff9c-417f-4781-974c-f36e3b467218 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:17:54.745519 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6052fd5-6862-4818-8380-124d671fe40e tempest-ServersAdminNegativeTestJSON-1098926609 tempest-ServersAdminNegativeTestJSON-1098926609-project] 10.222.0.23 "GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218" status: 404 len: 111 microversion: 2.1 time: 0.047726 Apr 30 21:17:54.749115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1009/2072] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:54 2022] GET /compute/v2.1/servers/ca6cff9c-417f-4781-974c-f36e3b467218 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:54.770224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-991b726f-c0f6-446f-afdc-5e5a61dcba69 req-212b4c39-fc07-4a2c-b14c-651bba8e0b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6cff9c-417f-4781-974c-f36e3b467218", "name": "network-vif-deleted", "tag": "4e609015-29a3-4678-9e4b-9b00ec55c21f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:54.774529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for project 7c032d189cb14ea297194dffa380eae5. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:54.781245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-991b726f-c0f6-446f-afdc-5e5a61dcba69 req-212b4c39-fc07-4a2c-b14c-651bba8e0b5b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:54.781728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-991b726f-c0f6-446f-afdc-5e5a61dcba69 req-212b4c39-fc07-4a2c-b14c-651bba8e0b5b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:54.793891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for user bfe17212ef4a49fd954bbf17317ccd67 and project 7c032d189cb14ea297194dffa380eae5. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:54.794200 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-991b726f-c0f6-446f-afdc-5e5a61dcba69 req-212b4c39-fc07-4a2c-b14c-651bba8e0b5b service nova] Creating event network-vif-deleted:4e609015-29a3-4678-9e4b-9b00ec55c21f for instance ca6cff9c-417f-4781-974c-f36e3b467218 on nch2-master-1 Apr 30 21:17:54.799461 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-991b726f-c0f6-446f-afdc-5e5a61dcba69 req-212b4c39-fc07-4a2c-b14c-651bba8e0b5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050769 Apr 30 21:17:54.800154 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1010/2073] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:54.809062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8d729173-4536-4a5d-b9fd-71f3c49c7b85 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Action: 'create', calling method: .version_select at 0x7fdc20d86a60>, body: {"pool": null} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:54.841285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:54.843906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:54.844789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:54.846491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:54.851321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:54.887057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:54.890859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:54.891176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:54.891949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:54.935878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for project 7c032d189cb14ea297194dffa380eae5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:54.948023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Getting quotas for user bfe17212ef4a49fd954bbf17317ccd67 and project 7c032d189cb14ea297194dffa380eae5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:54.966946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:17:54.975265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:55.234621 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9eaeed2-c4fd-4965-9833-1fde0a9979ef tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.405010 Apr 30 21:17:55.239230 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1064/2074] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:17:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:17:55.248096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:55.248721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:55.283193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:55.287627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:55.289190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:55.289840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:55.891028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:55.915621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:55.917794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:55.919756 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21db393a-f86c-4b8f-83a5-8c4fec43929d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1750 microversion: 2.32 time: 0.679381 Apr 30 21:17:55.922204 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1065/2075] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:55 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1750 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:55.927828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-259b75df-879f-4f51-9702-88673b4dfea3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: .version_select at 0x7fdc20455d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-236248434", "policies": ["affinity"]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:55.976390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-259b75df-879f-4f51-9702-88673b4dfea3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:55.987239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-259b75df-879f-4f51-9702-88673b4dfea3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:56.209211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-259b75df-879f-4f51-9702-88673b4dfea3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:56.215581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-259b75df-879f-4f51-9702-88673b4dfea3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:56.229476 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-259b75df-879f-4f51-9702-88673b4dfea3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.305674 Apr 30 21:17:56.230326 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1066/2076] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:17:55 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:56.235694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:56.243325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:56.244014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:56.244327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:56.245112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:56.245553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:56.339010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:56.369863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:56.371280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:56.387840 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cb61a997-5309-45a8-b959-3bfb8e018d84 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.156281 Apr 30 21:17:56.398988 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1067/2077] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:56 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:56.406977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e16bab58-5a5b-4bf0-93e1-75e08ca8b900 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:56.407600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e16bab58-5a5b-4bf0-93e1-75e08ca8b900 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:56.486430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e16bab58-5a5b-4bf0-93e1-75e08ca8b900 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:56.509822 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e16bab58-5a5b-4bf0-93e1-75e08ca8b900 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1269 microversion: 2.1 time: 0.093752 Apr 30 21:17:56.509822 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1068/2078] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:56 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:56.542326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1780228188", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8aeb6ac2-9a78-487d-afaf-34842678fb54"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:56.671853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:17:57.249951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:57.250549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:57.256332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:57.256332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:57.256332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:57.303201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:57.306760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:57.306760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:57.306760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:57.328542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:57.336746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:57.352488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Going to run 2 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:17:57.354076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:57.542403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130671) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Apr 30 21:17:57.557956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:57.565091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:57.753904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:57.774119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:57.846707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=a4bb5b19-edd9-4351-babc-faf38634044f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:17:58.007554 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8d729173-4536-4a5d-b9fd-71f3c49c7b85 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.202919 Apr 30 21:17:58.008389 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1011/2079] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:17:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:17:58.084270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:58.104283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:58.269000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:17:58.276499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:17:58.318530 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c47025c9-1a4c-4a55-af4e-ad141c76f406 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.810457 Apr 30 21:17:58.319150 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1069/2080] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:17:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 1812 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 30 21:17:58.325422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:58.326104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:58.353979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:58.354463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:58.358284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:58.362540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:58.485924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-343420963", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "31094596-75a5-4a74-a7ff-4154b6b0b753"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:58.635908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] validate_networks() for [('31094596-75a5-4a74-a7ff-4154b6b0b753', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:17:58.922386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:58.951663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:58.968433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:58.977247 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c46f4da0-fb54-479e-a2a3-d0be497019aa tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1828 microversion: 2.32 time: 0.655055 Apr 30 21:17:58.985185 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1070/2081] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:58 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1828 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:59.003250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:59.004496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:59.021501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:59.021992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:59.022805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:59.023247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:59.216237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:59.230093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:59.232314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:59.242671 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-795862e1-29db-41db-9bc3-47eb0df5fa25 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.250568 Apr 30 21:17:59.260500 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1071/2082] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:17:58 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:17:59.265514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:17:59.266493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:17:59.279325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:59.281274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:59.511963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:59.511963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:17:59.513528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:17:59.522169 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f555eab-0494-4aac-8a92-3c0e3d1b9be6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1329 microversion: 2.1 time: 0.270643 Apr 30 21:17:59.529804 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1072/2083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:17:59 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1329 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:17:59.529804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5003a503-f908-4596-9847-236177d4d13c tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Action: 'create', calling method: .version_select at 0x7fdc204b2a60>, body: {"pool": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:17:59.945808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:17:59.945808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:17:59.945808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:17:59.945808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:17:59.946722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:17:59.978822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:17:59.983269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:00.011511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:00.011964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:00.039029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Getting quotas for project 14cb627425b94ce890bd232988d4f051. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:00.046012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Getting quotas for user 0140b2412e3b455eabd9ce46e39027e2 and project 14cb627425b94ce890bd232988d4f051. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:00.068369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:18:00.076381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:18:00.284183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e0dca2a4-eafc-42b1-8e72-b5a4451b7fdd tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.273214 Apr 30 21:18:00.291284 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1012/2084] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:18:00.298106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:00.304086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:00.305212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Searching by: {'deleted': False, 'project_id': '327a580f2f8645c28e9590806928ed91'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:18:00.351336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:00.356411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:00.357886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:00.359195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:00.497955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:18:00.608151 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e6d98248-3348-4bd2-8a49-d4c6d9689bb4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.315552 Apr 30 21:18:00.613705 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1013/2085] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:18:00 2022] GET /compute/v2.1/servers => generated 1004 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:00.619612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:00.620957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:00.648641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:00.648641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:00.648641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:00.648641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:01.362080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:01.386512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:01.388678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:01.390867 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e7fdc616-f4f2-4172-95eb-866de4651062 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1828 microversion: 2.32 time: 0.779555 Apr 30 21:18:01.392135 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1014/2086] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:00 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1828 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:01.399138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:01.399918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:01.418998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:01.419692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:01.420987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:01.421536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:01.539220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:01.567717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:01.570120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:01.587930 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab5a8a9c-47a0-4b83-badb-119f342d5f80 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.191391 Apr 30 21:18:01.588812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1015/2087] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:01 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:01.597582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d3ac537b-06b9-4c47-8765-4f8db72e152f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:01.599285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d3ac537b-06b9-4c47-8765-4f8db72e152f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:01.744641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d3ac537b-06b9-4c47-8765-4f8db72e152f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:01.779704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d3ac537b-06b9-4c47-8765-4f8db72e152f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1231 microversion: 2.1 time: 0.189292 Apr 30 21:18:01.781117 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1016/2088] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:01 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1231 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:01.788007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:01.789696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:01.797054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:01.799070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:01.800597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:01.801569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:02.194419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:02.205922 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a57ffe3e-595e-44fd-86bb-19912e846ff4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1394 microversion: 2.1 time: 0.422242 Apr 30 21:18:02.206051 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1017/2089] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:01 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1394 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:02.227839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:02.228471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:02.240750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:02.241207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:02.242684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:02.242684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:02.430907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:02.441056 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2af9fa55-334a-4c52-b452-6453f8ef8768 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1271 microversion: 2.1 time: 0.217949 Apr 30 21:18:02.441961 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1018/2090] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:02 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:02.453021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-da2cc4aa-19ef-442a-bfcd-2813f1b103cd req-2327cc99-dfaa-4d5f-b728-b76da1af2a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:02.461263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-da2cc4aa-19ef-442a-bfcd-2813f1b103cd req-2327cc99-dfaa-4d5f-b728-b76da1af2a79 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:02.461722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-da2cc4aa-19ef-442a-bfcd-2813f1b103cd req-2327cc99-dfaa-4d5f-b728-b76da1af2a79 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:02.474687 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-da2cc4aa-19ef-442a-bfcd-2813f1b103cd req-2327cc99-dfaa-4d5f-b728-b76da1af2a79 service nova] Creating event network-changed:0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:02.479960 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-da2cc4aa-19ef-442a-bfcd-2813f1b103cd req-2327cc99-dfaa-4d5f-b728-b76da1af2a79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030930 Apr 30 21:18:02.480850 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1019/2091] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:02.486763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:02.487482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:02.494879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:02.495543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:02.497172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:02.497828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.044694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.055223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.059664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.059664 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0dcfb0a6-867d-4f03-aafe-8f526e73e1d8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1849 microversion: 2.32 time: 0.577101 Apr 30 21:18:03.070883 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1020/2092] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:02 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1849 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:03.076075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:03.077509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:03.084841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.085634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.088150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.089079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.169787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.178613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.181355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.190563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ade1e340-a501-48e8-9031-011f5e412fa6 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1446 microversion: 2.75 time: 0.117649 Apr 30 21:18:03.191411 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1021/2093] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:03 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:03.196576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:03.197548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:03.204973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.208580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.208580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.208580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.369483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.380383 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2c70e07-41d3-4655-93ce-49eaf2d1002d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1227 microversion: 2.1 time: 0.187668 Apr 30 21:18:03.384737 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1022/2094] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:03 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1227 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:03.392360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:03.396760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:03.417572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.419434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.421384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.421872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.658580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.669848 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f31843ed-ccbb-40c6-a832-0a571d24b11a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1394 microversion: 2.1 time: 0.281176 Apr 30 21:18:03.673562 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1023/2095] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:03 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1394 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:03.678768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:03.679616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:03.697049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.697733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.698751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:03.699355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:03.898718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:03.926903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc79e5a9-dfc5-4456-86fc-66966e67d88b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1279 microversion: 2.1 time: 0.248907 Apr 30 21:18:03.928834 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1024/2096] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:03 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:04.080412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:04.081152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:04.089052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:04.094153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:04.094153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:04.094153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.096537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.104533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.106068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.107516 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a1f23e2f-5d1d-4d77-aae4-85ead29fa849 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 1.033468 Apr 30 21:18:05.119372 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1025/2097] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:04 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:05.125179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:05.125824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:05.132277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.132732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.133778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.134338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.296975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.306537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.308601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.314865 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1df9457c-d625-47fc-9e5c-917a1e537dc8 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1452 microversion: 2.75 time: 0.194084 Apr 30 21:18:05.315624 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1026/2098] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:05 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:05.334252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:05.335380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:05.341941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.344172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.344172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.344636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.464342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.472333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-308bdafa-3760-4f93-b315-74f427547447 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1291 microversion: 2.1 time: 0.141948 Apr 30 21:18:05.472919 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1027/2099] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:05 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1291 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:05.477274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-1905021f-b38d-4722-b243-d58469ac7ab1 req-89f58b4b-e94e-428e-9799-9bb26d8a0b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82314835-d00b-4591-9555-c35fb57a2d41", "tag": "ce1d8c5d-0c68-4c48-aa37-9fbce01b179e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:05.485906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1905021f-b38d-4722-b243-d58469ac7ab1 req-89f58b4b-e94e-428e-9799-9bb26d8a0b8c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.486369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1905021f-b38d-4722-b243-d58469ac7ab1 req-89f58b4b-e94e-428e-9799-9bb26d8a0b8c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.497558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-1905021f-b38d-4722-b243-d58469ac7ab1 req-89f58b4b-e94e-428e-9799-9bb26d8a0b8c service nova] Creating event network-changed:ce1d8c5d-0c68-4c48-aa37-9fbce01b179e for instance 82314835-d00b-4591-9555-c35fb57a2d41 on nch1-master-1 Apr 30 21:18:05.504404 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-1905021f-b38d-4722-b243-d58469ac7ab1 req-89f58b4b-e94e-428e-9799-9bb26d8a0b8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028728 Apr 30 21:18:05.504404 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1028/2100] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:05.513614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-712763fc-d412-4ad6-96ad-dccaa6a530af req-082e3cdd-cec6-4614-a674-24b38bfc14ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "eeb95bf2-7a04-4881-a1c4-a027f2905abd"}, {"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "bb19e621-b828-4d48-80fb-51c3c27d3aae"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:05.517641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-712763fc-d412-4ad6-96ad-dccaa6a530af req-082e3cdd-cec6-4614-a674-24b38bfc14ce service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.518206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-712763fc-d412-4ad6-96ad-dccaa6a530af req-082e3cdd-cec6-4614-a674-24b38bfc14ce service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.521286 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5003a503-f908-4596-9847-236177d4d13c tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.996901 Apr 30 21:18:05.523985 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1073/2101] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:17:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:05.531926 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-712763fc-d412-4ad6-96ad-dccaa6a530af req-082e3cdd-cec6-4614-a674-24b38bfc14ce service nova] Creating event network-changed:eeb95bf2-7a04-4881-a1c4-a027f2905abd for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:05.532450 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-712763fc-d412-4ad6-96ad-dccaa6a530af req-082e3cdd-cec6-4614-a674-24b38bfc14ce service nova] Creating event network-changed:bb19e621-b828-4d48-80fb-51c3c27d3aae for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:05.534770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:05.542083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:05.542236 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-712763fc-d412-4ad6-96ad-dccaa6a530af req-082e3cdd-cec6-4614-a674-24b38bfc14ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033775 Apr 30 21:18:05.542236 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1029/2102] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:05.545274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:05.546804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:05.547546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.548396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.549522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.550127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.555098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.555743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.556723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:05.557845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:05.744451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:05.753641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8fe78cda-899e-4a5a-ba8a-3317742f769f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1277 microversion: 2.1 time: 0.212808 Apr 30 21:18:05.767441 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1030/2103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:05 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:05.772815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34bbe689-3b0c-4f26-aafc-3cc37268c5ee tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Calling method '.version_select at 0x7fdc206941f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:06.087507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:06.102082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3e4dc3d0-ee42-4c01-a6b2-b41378c07822 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1394 microversion: 2.1 time: 0.576475 Apr 30 21:18:06.103512 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1074/2104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:05 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1394 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:06.126891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:06.127775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:06.135912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:06.136664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:06.137815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:06.138445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:06.245916 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-34bbe689-3b0c-4f26-aafc-3cc37268c5ee tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/8c67fa75-cfd9-4ca9-b36b-b009015f50db" status: 200 len: 141 microversion: 2.1 time: 0.476869 Apr 30 21:18:06.250112 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1031/2105] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:18:05 2022] GET /compute/v2.1/os-floating-ips/8c67fa75-cfd9-4ca9-b36b-b009015f50db => generated 141 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:06.258438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d44e209-0572-40c9-9fee-306bd0f9e14b tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Calling method '.version_select at 0x7fdc262b5280>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:06.534847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:06.553613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:06.590534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:06.596379 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e3f0501-6f41-4e92-82e0-0c03a225c4d1 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.473447 Apr 30 21:18:06.598084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1075/2106] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:06 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:06.626727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:06.627640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:06.658825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:06.660649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:06.664050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:06.665231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:07.019375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:07.028025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:07.030185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:07.036552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8ca76f7-360b-476f-a69b-408d07f7c949 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1452 microversion: 2.75 time: 0.435692 Apr 30 21:18:07.037159 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1076/2107] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:06 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1452 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:07.042272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:07.042953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:07.051452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:07.052148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:07.053059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:07.053742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:07.197705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:07.208325 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70b1928c-9e38-4942-abb3-eead68659e99 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1289 microversion: 2.1 time: 0.169294 Apr 30 21:18:07.215555 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1077/2108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:07 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1289 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:07.221648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:07.222243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:07.230297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:07.230764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:07.231945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:07.232403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:07.400628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:07.410467 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22bd25e7-83a0-477c-a12d-c97cd88d86aa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1277 microversion: 2.1 time: 0.199971 Apr 30 21:18:07.411791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1078/2109] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:07 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:07.416936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:07.418078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:07.425332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:07.426594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:07.427867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:07.428307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:08.256728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:08.265803 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67e856a5-6e5e-4169-b8e3-85fa37841dc5 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1394 microversion: 2.1 time: 0.852713 Apr 30 21:18:08.266711 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1079/2110] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:07 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1394 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:08.272007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:08.272894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:08.279935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:08.281942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:08.282480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:08.283101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:09.003319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:09.018380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:09.022851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:09.024361 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8442615e-420b-4754-a0e6-99fd40a53132 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.756516 Apr 30 21:18:09.035997 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1080/2111] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:08 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:09.188001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-795207512", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "2b0ff999-a515-444e-abae-4e4b3a0965ad"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:09.252681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] validate_networks() for [('2b0ff999-a515-444e-abae-4e4b3a0965ad', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:18:09.750107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d44e209-0572-40c9-9fee-306bd0f9e14b tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/8c67fa75-cfd9-4ca9-b36b-b009015f50db" status: 202 len: 0 microversion: 2.1 time: 3.495239 Apr 30 21:18:09.750779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1032/2112] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:06 2022] DELETE /compute/v2.1/os-floating-ips/8c67fa75-cfd9-4ca9-b36b-b009015f50db => generated 0 bytes in 3497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:18:09.756398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:09.757106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:09.763388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:09.764114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:09.765734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:09.766451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:09.898025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:09.906341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:09.910639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:09.913343 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f78d070f-242b-462d-8e95-95a34232f563 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1437 microversion: 2.75 time: 0.161350 Apr 30 21:18:09.914096 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1033/2113] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:09 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1437 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:09.918700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:09.919397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:09.926045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:09.926573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:09.927435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:09.927946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.397780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:10.418427 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a3882a06-4130-4911-a69c-7f953a05d20d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1331 microversion: 2.1 time: 0.503078 Apr 30 21:18:10.428191 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1034/2114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:09 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1331 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:10.428191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-be473368-acf0-4a1a-9479-2cf01eeb7525 req-06a782bf-ce6a-4171-a8f6-6db1d607ae0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "b3fce87b-a558-49fc-83b7-71bd012b7290"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:10.437366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-be473368-acf0-4a1a-9479-2cf01eeb7525 req-06a782bf-ce6a-4171-a8f6-6db1d607ae0a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.437850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-be473368-acf0-4a1a-9479-2cf01eeb7525 req-06a782bf-ce6a-4171-a8f6-6db1d607ae0a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.454564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-be473368-acf0-4a1a-9479-2cf01eeb7525 req-06a782bf-ce6a-4171-a8f6-6db1d607ae0a service nova] Creating event network-changed:b3fce87b-a558-49fc-83b7-71bd012b7290 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:10.457734 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-be473368-acf0-4a1a-9479-2cf01eeb7525 req-06a782bf-ce6a-4171-a8f6-6db1d607ae0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037534 Apr 30 21:18:10.458377 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1035/2115] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:10.463936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:10.464640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:10.473215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.473398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.475525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.475525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.584410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:18:10.585963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:18:10.590603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:18:10.590603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:18:10.590603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:18:10.597814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.598396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.599314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.599862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.620233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Getting quotas for project 6c823086e6504aa0ac38c2b9b86970b2. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:10.625910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Getting quotas for user 993cfa563e564a5f924d7e75d118f1d8 and project 6c823086e6504aa0ac38c2b9b86970b2. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:10.640448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:18:10.643913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:18:10.809612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30607d79-0562-46c3-ad67-6b2432d1304c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.756243 Apr 30 21:18:10.815623 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1081/2116] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:18:10.822139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-2def28be-a801-4ba9-af08-22feb1c50549 req-24ee85b9-4b2c-4c84-9f64-3cecd4872fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12866d20-3561-4d1a-a90d-2817908511cd", "tag": "1eef8960-f1dd-4d32-8f61-7fd980d9c83e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:10.876286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2def28be-a801-4ba9-af08-22feb1c50549 req-24ee85b9-4b2c-4c84-9f64-3cecd4872fa6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.877038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2def28be-a801-4ba9-af08-22feb1c50549 req-24ee85b9-4b2c-4c84-9f64-3cecd4872fa6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.899233 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-2def28be-a801-4ba9-af08-22feb1c50549 req-24ee85b9-4b2c-4c84-9f64-3cecd4872fa6 service nova] Creating event network-changed:1eef8960-f1dd-4d32-8f61-7fd980d9c83e for instance 12866d20-3561-4d1a-a90d-2817908511cd on nch2-master-1 Apr 30 21:18:10.909865 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-2def28be-a801-4ba9-af08-22feb1c50549 req-24ee85b9-4b2c-4c84-9f64-3cecd4872fa6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097016 Apr 30 21:18:10.911003 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1082/2117] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:10.924845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:10.926243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:10.934945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.935639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:10.936649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:10.937336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:11.240039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:11.257087 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e65e2fb9-24a6-432c-aa88-6888df3bbe53 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1319 microversion: 2.1 time: 0.793161 Apr 30 21:18:11.257087 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1036/2118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:10 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:11.267919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5ffa990-52e2-4137-9675-e7cce96847bf tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Calling method '.version_select at 0x7fdc20c3ab80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:11.775143 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5ffa990-52e2-4137-9675-e7cce96847bf tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.519855 Apr 30 21:18:11.776811 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1037/2119] 10.222.0.23 () {58 vars in 1163 bytes} [Sat Apr 30 21:18:11 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:18:11.826446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:11.837199 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ed0f65d3-7028-4d26-9b3c-4381bbec0745 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1394 microversion: 2.1 time: 0.924617 Apr 30 21:18:11.837811 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1083/2120] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:10 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1394 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:11.854674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:11.855967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:11.864699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:11.865429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:11.866431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:11.867089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:11.931625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:11.933426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:11.941093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:11.941610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:11.942440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:11.942890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.032143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:18:12.032700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:18:12.033199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:18:12.033627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:18:12.034108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:18:12.296300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:12.302895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:12.303698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.304713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:12.305339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.457210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:12.467539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:12.469154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:12.470401 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bab9084c-87d3-4eeb-bab4-6a9f66d66460 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.631044 Apr 30 21:18:12.470959 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1084/2121] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:11 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:12.476200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:12.477023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:12.489444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:12.490283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.491581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:12.492659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.505474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:12.548865 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70794752-dd86-4574-b89a-44e048abc881 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607/action" status: 202 len: 1940 microversion: 2.75 time: 0.765874 Apr 30 21:18:12.548865 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1038/2122] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:18:11 2022] POST /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607/action => generated 1940 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 30 21:18:12.552818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b5691d25-aa0b-4a06-8155-f15180cdc13b req-a776ad63-890c-4377-b2f8-933dfa20766c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82314835-d00b-4591-9555-c35fb57a2d41", "name": "network-vif-plugged", "status": "completed", "tag": "ce1d8c5d-0c68-4c48-aa37-9fbce01b179e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:12.570051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b5691d25-aa0b-4a06-8155-f15180cdc13b req-a776ad63-890c-4377-b2f8-933dfa20766c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:12.572271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b5691d25-aa0b-4a06-8155-f15180cdc13b req-a776ad63-890c-4377-b2f8-933dfa20766c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.587130 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b5691d25-aa0b-4a06-8155-f15180cdc13b req-a776ad63-890c-4377-b2f8-933dfa20766c service nova] Creating event network-vif-plugged:ce1d8c5d-0c68-4c48-aa37-9fbce01b179e for instance 82314835-d00b-4591-9555-c35fb57a2d41 on nch1-master-1 Apr 30 21:18:12.594198 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b5691d25-aa0b-4a06-8155-f15180cdc13b req-a776ad63-890c-4377-b2f8-933dfa20766c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045876 Apr 30 21:18:12.595212 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1039/2123] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:12.600403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:12.601244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:12.608882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:12.609346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.610170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:12.610820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:12.650957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:12.661607 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7f128689-208c-4c6c-8830-93303bc742df tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1221 microversion: 2.1 time: 0.189328 Apr 30 21:18:12.662806 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1085/2124] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:12 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:12.674723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fce52413-712d-48db-8754-334d3b0f321a tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Calling method '.version_select at 0x7fdc2041fdc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:12.977285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:12.985328 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c3b3e4a1-fed9-43cc-9cb5-c55aa57ff99a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1331 microversion: 2.1 time: 0.388852 Apr 30 21:18:12.985935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1040/2125] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:12 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1331 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:12.990575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:12.991197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:12.999944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.000417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.001222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.001667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.008912 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fce52413-712d-48db-8754-334d3b0f321a tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.344485 Apr 30 21:18:13.009504 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1086/2126] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:18:12 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:13.013966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d0ea8c20-7b2c-49eb-8593-c1c03df8ca75 req-1b48c86a-f467-4b3f-b980-ee1eb4b7e8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bb5b19-edd9-4351-babc-faf38634044f", "tag": "a28b17c3-a6e2-4e33-a643-c161b9604200"}, {"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382"}, {"name": "network-changed", "server_uuid": "bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd", "tag": "2b047f63-008f-47b1-9417-8f313dc6c3bc"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:13.031152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0ea8c20-7b2c-49eb-8593-c1c03df8ca75 req-1b48c86a-f467-4b3f-b980-ee1eb4b7e8b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.031612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0ea8c20-7b2c-49eb-8593-c1c03df8ca75 req-1b48c86a-f467-4b3f-b980-ee1eb4b7e8b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.046314 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d0ea8c20-7b2c-49eb-8593-c1c03df8ca75 req-1b48c86a-f467-4b3f-b980-ee1eb4b7e8b8 service nova] Creating event network-changed:a28b17c3-a6e2-4e33-a643-c161b9604200 for instance a4bb5b19-edd9-4351-babc-faf38634044f on nch2-master-1 Apr 30 21:18:13.047411 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d0ea8c20-7b2c-49eb-8593-c1c03df8ca75 req-1b48c86a-f467-4b3f-b980-ee1eb4b7e8b8 service nova] Creating event network-changed:cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:13.048115 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d0ea8c20-7b2c-49eb-8593-c1c03df8ca75 req-1b48c86a-f467-4b3f-b980-ee1eb4b7e8b8 service nova] Creating event network-changed:2b047f63-008f-47b1-9417-8f313dc6c3bc for instance bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd on nch2-master-1 Apr 30 21:18:13.058498 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d0ea8c20-7b2c-49eb-8593-c1c03df8ca75 req-1b48c86a-f467-4b3f-b980-ee1eb4b7e8b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.047730 Apr 30 21:18:13.059260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1087/2127] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:13.065708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:13.066875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:13.079162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.079903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.081198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.082029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.245846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:13.268679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:13.281721 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1930f387-1147-4d86-9cf8-b9b9f017673f tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.220505 Apr 30 21:18:13.282560 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-298e8fa0-b3c2-4dd2-8d84-dd988a170e2b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1319 microversion: 2.1 time: 0.290015 Apr 30 21:18:13.283016 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1088/2128] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:13 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:13.283861 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1041/2129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:12 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:13.288431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-881f12d3-f268-4e09-9b9d-86b2b58f31b3 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Calling method '.version_select at 0x7fdc20cfc3a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:13.292531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:13.293346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:13.300961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.301648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.304220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.304912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.623021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:13.631258 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d045234d-a212-40e0-8f04-ec1468f7a1fc tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1394 microversion: 2.1 time: 0.347002 Apr 30 21:18:13.632770 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1089/2130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:13 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1394 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:13.647846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:13.655522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:13.661765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.662243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:13.663035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:13.663481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:14.707414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:14.719609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:14.721447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:14.723321 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4e74fb94-6b27-451d-8ed3-055501cfa85d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 1.089341 Apr 30 21:18:14.724354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1090/2131] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:13 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:14.731546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:14.733392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:14.740213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:14.740716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:14.741916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:14.742553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:14.940420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:14.955465 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a0a96104-add0-4cee-8151-7dabae238f28 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1275 microversion: 2.1 time: 0.228230 Apr 30 21:18:14.956332 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1091/2132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:14 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:14.972430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:14.979253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:14.981339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:14.982020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:14.983485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:14.984094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.257460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:15.271982 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eab6635e-2b85-4317-833d-ac900a319289 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1331 microversion: 2.1 time: 0.303998 Apr 30 21:18:15.282030 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1092/2133] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:14 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1331 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:15.285621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:15.287074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:15.294058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.294505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.295865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.296317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.640410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:15.658050 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-927818a5-6e9b-46f6-aa42-0e85fe49c5cc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1319 microversion: 2.1 time: 0.379155 Apr 30 21:18:15.658912 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1093/2134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:15 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:15.666045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:15.666926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:15.677749 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-881f12d3-f268-4e09-9b9d-86b2b58f31b3 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/def0dfa9-1853-4fbd-9012-76105f6e9afd" status: 202 len: 0 microversion: 2.1 time: 2.392781 Apr 30 21:18:15.678817 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1042/2135] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:13 2022] DELETE /compute/v2.1/os-floating-ips/def0dfa9-1853-4fbd-9012-76105f6e9afd => generated 0 bytes in 2394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:18:15.679225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.679839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.680906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.681604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.683750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:15.684668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:15.698472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.698954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.702367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.708343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.865146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:15.892881 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70b1505d-20ea-479d-96c3-00ea28d28eeb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.232733 Apr 30 21:18:15.893666 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1094/2136] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:15 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:15.911153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-0dfb9cf8-53b3-4796-97ad-8d4ac9065b56 req-8cd6705c-307c-44a6-81a6-3782b0826ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "3612a02c-d7fa-4f7d-8b59-27351eff0cc5"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:15.919795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0dfb9cf8-53b3-4796-97ad-8d4ac9065b56 req-8cd6705c-307c-44a6-81a6-3782b0826ede service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.920286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0dfb9cf8-53b3-4796-97ad-8d4ac9065b56 req-8cd6705c-307c-44a6-81a6-3782b0826ede service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.930985 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-0dfb9cf8-53b3-4796-97ad-8d4ac9065b56 req-8cd6705c-307c-44a6-81a6-3782b0826ede service nova] Creating event network-changed:3612a02c-d7fa-4f7d-8b59-27351eff0cc5 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:15.936305 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-0dfb9cf8-53b3-4796-97ad-8d4ac9065b56 req-8cd6705c-307c-44a6-81a6-3782b0826ede service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028697 Apr 30 21:18:15.937211 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1095/2137] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:15.944579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4a05d50b-188e-4ab6-a362-c0ea8933af01 req-a03288ab-b26a-4ed5-9cce-ff2d06b7a4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:15.954318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4a05d50b-188e-4ab6-a362-c0ea8933af01 req-a03288ab-b26a-4ed5-9cce-ff2d06b7a4be service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:15.954770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4a05d50b-188e-4ab6-a362-c0ea8933af01 req-a03288ab-b26a-4ed5-9cce-ff2d06b7a4be service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:15.969639 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4a05d50b-188e-4ab6-a362-c0ea8933af01 req-a03288ab-b26a-4ed5-9cce-ff2d06b7a4be service nova] Creating event network-changed:1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:15.973168 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4a05d50b-188e-4ab6-a362-c0ea8933af01 req-a03288ab-b26a-4ed5-9cce-ff2d06b7a4be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034541 Apr 30 21:18:15.974294 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1096/2138] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:15.981541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f891ff92-0bfd-4e12-a1f9-fdb3b9d56fee tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Calling method '.version_select at 0x7fdc203aad30>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:15.988441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:15.997177 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e6b3e864-6199-4ae2-bb56-fe91d8bd83f4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1576 microversion: 2.1 time: 0.317274 Apr 30 21:18:15.997777 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1043/2139] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:15 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1576 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:16.004685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-60174d1f-dde6-4401-8104-65fea10c3d28 req-696bbae5-4662-4bb2-a62f-c9033a7b6027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12866d20-3561-4d1a-a90d-2817908511cd", "name": "network-vif-plugged", "status": "completed", "tag": "1eef8960-f1dd-4d32-8f61-7fd980d9c83e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:16.015617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60174d1f-dde6-4401-8104-65fea10c3d28 req-696bbae5-4662-4bb2-a62f-c9033a7b6027 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:16.016076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60174d1f-dde6-4401-8104-65fea10c3d28 req-696bbae5-4662-4bb2-a62f-c9033a7b6027 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:16.032038 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-60174d1f-dde6-4401-8104-65fea10c3d28 req-696bbae5-4662-4bb2-a62f-c9033a7b6027 service nova] Creating event network-vif-plugged:1eef8960-f1dd-4d32-8f61-7fd980d9c83e for instance 12866d20-3561-4d1a-a90d-2817908511cd on nch2-master-1 Apr 30 21:18:16.037280 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-60174d1f-dde6-4401-8104-65fea10c3d28 req-696bbae5-4662-4bb2-a62f-c9033a7b6027 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037563 Apr 30 21:18:16.038296 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1044/2140] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:16.044588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:16.046011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:16.064093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:16.066866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:16.069955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:16.070431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:16.770835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:16.781556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:16.783395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:16.784757 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c125886-7d57-4683-b86d-f085348c93c7 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.745162 Apr 30 21:18:16.785320 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1045/2141] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:16 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:16.790002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:16.790817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:16.800750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:16.801268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:16.802337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:16.802769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:17.458140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:17.465805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9c87faa-0247-4e9e-98ce-38aa5fc11144 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1317 microversion: 2.1 time: 0.679174 Apr 30 21:18:17.476154 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1046/2142] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:16 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:17.486610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca33fd8a-443e-49da-81b9-23116b66b1e2 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:17.486610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ca33fd8a-443e-49da-81b9-23116b66b1e2 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:17.490081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca33fd8a-443e-49da-81b9-23116b66b1e2 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:17.490765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca33fd8a-443e-49da-81b9-23116b66b1e2 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:17.491758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca33fd8a-443e-49da-81b9-23116b66b1e2 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:17.492366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca33fd8a-443e-49da-81b9-23116b66b1e2 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:17.735165 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca33fd8a-443e-49da-81b9-23116b66b1e2 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.257307 Apr 30 21:18:17.742923 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1047/2143] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:18:17 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41/os-interface => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:17.749630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:17.750737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:17.758806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:17.759289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:17.760287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:17.760908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.146661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:18.164415 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b009610-3b6b-45e3-94c3-b99f0b3a32b7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1331 microversion: 2.1 time: 0.420226 Apr 30 21:18:18.173480 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1048/2144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:17 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1331 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:18.185119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:18.187362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:18.197434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.199190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.203945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.203945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.573650 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f891ff92-0bfd-4e12-a1f9-fdb3b9d56fee tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/e9e2b414-b70e-48ba-a0cc-a132008995cf" status: 202 len: 0 microversion: 2.1 time: 2.597599 Apr 30 21:18:18.577953 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1097/2145] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:15 2022] DELETE /compute/v2.1/os-floating-ips/e9e2b414-b70e-48ba-a0cc-a132008995cf => generated 0 bytes in 2600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:18:18.583984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:18.586012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:18.605000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.607029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.607413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.612583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.641885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:18.654409 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-99bd20cb-1666-41fb-8d65-ea6a81e9cf4d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1319 microversion: 2.1 time: 0.478861 Apr 30 21:18:18.666263 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1049/2146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:18 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:18.675336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:18.677357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:18.698179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.698642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.699440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.700077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.743804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:18.763757 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e49a559-05b9-45ef-a953-24126d11e17d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.188076 Apr 30 21:18:18.765543 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1098/2147] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:18 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:18.770680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3e165e18-5ac2-43d8-a188-4640d420638a req-a232c0ce-5c61-43d2-80b6-c2577232d396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bb5b19-edd9-4351-babc-faf38634044f", "name": "network-vif-plugged", "status": "completed", "tag": "a28b17c3-a6e2-4e33-a643-c161b9604200"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:18.780620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3e165e18-5ac2-43d8-a188-4640d420638a req-a232c0ce-5c61-43d2-80b6-c2577232d396 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.781375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3e165e18-5ac2-43d8-a188-4640d420638a req-a232c0ce-5c61-43d2-80b6-c2577232d396 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.793120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3e165e18-5ac2-43d8-a188-4640d420638a req-a232c0ce-5c61-43d2-80b6-c2577232d396 service nova] Creating event network-vif-plugged:a28b17c3-a6e2-4e33-a643-c161b9604200 for instance a4bb5b19-edd9-4351-babc-faf38634044f on nch2-master-1 Apr 30 21:18:18.798407 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3e165e18-5ac2-43d8-a188-4640d420638a req-a232c0ce-5c61-43d2-80b6-c2577232d396 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031218 Apr 30 21:18:18.804367 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1099/2148] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:18.810645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:18.814441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:18.818993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.819822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:18.820811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:18.821449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:19.060027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:19.070655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:19.072968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:19.074460 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a16311f8-8a59-49b4-b0e0-cca4927bde2d tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.406952 Apr 30 21:18:19.074990 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1050/2149] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:18 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:19.080346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-77d8c352-4c02-479e-84cd-1693f014ea81 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] Calling method '.version_select at 0x7fdc2621d0d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:19.183964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:19.195236 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99146893-016d-4b06-9ca0-3b664fc65c0e tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1317 microversion: 2.1 time: 0.390633 Apr 30 21:18:19.206399 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1100/2150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:18 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:19.214794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:19.214794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:19.221693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:19.222516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:19.223540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:19.224367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:19.527161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:19.540759 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1824f77-130d-411c-a772-e2db09391d32 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1536 microversion: 2.1 time: 0.332906 Apr 30 21:18:19.556669 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1101/2151] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:19 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1536 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:19.562133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e84c6919-fee6-4c2c-9e7b-40aa5d6f55e3 req-de386c85-adc6-4ff1-86ca-278e98c0481c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a29ae768-e8c9-449d-88a7-042239f848c6", "tag": "517c3e72-ce49-4940-a123-3deec175d114"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:19.575483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e84c6919-fee6-4c2c-9e7b-40aa5d6f55e3 req-de386c85-adc6-4ff1-86ca-278e98c0481c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:19.577388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e84c6919-fee6-4c2c-9e7b-40aa5d6f55e3 req-de386c85-adc6-4ff1-86ca-278e98c0481c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:19.590654 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e84c6919-fee6-4c2c-9e7b-40aa5d6f55e3 req-de386c85-adc6-4ff1-86ca-278e98c0481c service nova] Creating event network-changed:517c3e72-ce49-4940-a123-3deec175d114 for instance a29ae768-e8c9-449d-88a7-042239f848c6 on nch1-master-1 Apr 30 21:18:19.599125 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e84c6919-fee6-4c2c-9e7b-40aa5d6f55e3 req-de386c85-adc6-4ff1-86ca-278e98c0481c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040303 Apr 30 21:18:19.600634 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1102/2152] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:19.610397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aea4c2b8-8fe6-46d2-ac83-25375962d86e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'create', calling method: .version_select at 0x7fdc202a0790>, body: {"pool": "24d2363b-44f9-4b0c-a866-84cec16dff58"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:21.034736 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-77d8c352-4c02-479e-84cd-1693f014ea81 tempest-FloatingIPDetailsTestJSON-1693222258 tempest-FloatingIPDetailsTestJSON-1693222258-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/d34a9486-4baf-4fe3-bcfd-8b58e9aa2a64" status: 202 len: 0 microversion: 2.1 time: 1.958316 Apr 30 21:18:21.039174 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1051/2153] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:19 2022] DELETE /compute/v2.1/os-floating-ips/d34a9486-4baf-4fe3-bcfd-8b58e9aa2a64 => generated 0 bytes in 1960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:18:21.040260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:21.040935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:21.048142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.049426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.050627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.051673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.284718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:21.293101 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-695cc4eb-7d31-48ec-9a59-cbd55acf73f1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1319 microversion: 2.1 time: 0.256732 Apr 30 21:18:21.294147 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1052/2154] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:21 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:21.299778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:21.300912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:21.307355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.307823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.308693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.309285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.394122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:21.412913 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2277b62d-d6dc-43f1-87c6-7223ce85d31d tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.117361 Apr 30 21:18:21.413424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1053/2155] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:21 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:21.418138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:21.418893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:21.426229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.426720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.427556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.428002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.648713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:21.656460 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d1a64458-8e88-4bc6-84c9-af8770a69bd3 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1576 microversion: 2.1 time: 0.241904 Apr 30 21:18:21.657053 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1054/2156] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:21 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:21.662288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-df4c70d1-31c6-4c3c-9fb7-fd7af0147849 req-2663f247-32ca-4b46-a5ac-786bfb45a8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82314835-d00b-4591-9555-c35fb57a2d41", "tag": "ce1d8c5d-0c68-4c48-aa37-9fbce01b179e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:21.671521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-df4c70d1-31c6-4c3c-9fb7-fd7af0147849 req-2663f247-32ca-4b46-a5ac-786bfb45a8e1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.672725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-df4c70d1-31c6-4c3c-9fb7-fd7af0147849 req-2663f247-32ca-4b46-a5ac-786bfb45a8e1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.688152 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-df4c70d1-31c6-4c3c-9fb7-fd7af0147849 req-2663f247-32ca-4b46-a5ac-786bfb45a8e1 service nova] Creating event network-changed:ce1d8c5d-0c68-4c48-aa37-9fbce01b179e for instance 82314835-d00b-4591-9555-c35fb57a2d41 on nch1-master-1 Apr 30 21:18:21.693254 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-df4c70d1-31c6-4c3c-9fb7-fd7af0147849 req-2663f247-32ca-4b46-a5ac-786bfb45a8e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034846 Apr 30 21:18:21.693906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1055/2157] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:21.699033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:21.699748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:21.706097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.706573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:21.707761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:21.707891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.012785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:22.023294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:22.027106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:22.027106 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9d9bab5b-6f47-42ae-b699-8765b3eda442 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.331029 Apr 30 21:18:22.027106 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1056/2158] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:21 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:22.031117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:22.031729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:22.037594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.038250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.038841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.039286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.244699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:22.257006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3331478f-811e-4ff8-a108-a35fcfb6ab77 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1317 microversion: 2.1 time: 0.229195 Apr 30 21:18:22.259253 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1057/2159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:22 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:22.266535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-82742a98-c9af-466a-b2e7-38688fc729a6 req-d807fac8-46e1-49f8-8749-58010260b921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd", "name": "network-vif-plugged", "status": "completed", "tag": "2b047f63-008f-47b1-9417-8f313dc6c3bc"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:22.283809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-82742a98-c9af-466a-b2e7-38688fc729a6 req-d807fac8-46e1-49f8-8749-58010260b921 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.284556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-82742a98-c9af-466a-b2e7-38688fc729a6 req-d807fac8-46e1-49f8-8749-58010260b921 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.300112 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-82742a98-c9af-466a-b2e7-38688fc729a6 req-d807fac8-46e1-49f8-8749-58010260b921 service nova] Creating event network-vif-plugged:2b047f63-008f-47b1-9417-8f313dc6c3bc for instance bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd on nch2-master-1 Apr 30 21:18:22.307123 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-82742a98-c9af-466a-b2e7-38688fc729a6 req-d807fac8-46e1-49f8-8749-58010260b921 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044728 Apr 30 21:18:22.307930 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1058/2160] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:22.313617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:22.314584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:22.321211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.321676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.322738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.323011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.617785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aea4c2b8-8fe6-46d2-ac83-25375962d86e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.015962 Apr 30 21:18:22.618522 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1103/2161] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:18:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:22.628043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:22.629008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:22.643996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.644752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.645917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.646607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.676589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:22.690771 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68da4e76-d9f0-4506-89a9-5405d247d494 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1319 microversion: 2.1 time: 0.381422 Apr 30 21:18:22.692214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1059/2162] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:22 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:22.698040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'action', calling method: .version_select at 0x7fdc2325d670>, body: {"addFloatingIp": {"address": "172.35.4.17"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:22.699812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:22.709097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.709590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.710364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:22.711173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:22.785273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Acquired lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:18:22.801188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:22.821266 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01dcc080-21c9-45b3-bdce-cf7663a6c7c7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.201312 Apr 30 21:18:22.822344 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1104/2163] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:22 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:23.045741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:23.046311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:23.053509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:23.054038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:23.054830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:23.055269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:23.463106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:23.473215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:23.474760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:23.476130 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aa5462c4-805e-4cf5-a0de-3d1a54888c94 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.435357 Apr 30 21:18:23.476929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1105/2164] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:23 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:23.481869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:23.483440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:23.489636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:23.490350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:23.491328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:23.491932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.205292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:24.214550 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0b8fe54f-91c4-4cdb-8a99-20a65c9e7958 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1317 microversion: 2.1 time: 0.736345 Apr 30 21:18:24.215851 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1106/2165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:23 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1317 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:24.223139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:24.224131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:24.230723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.232147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.233265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.233963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.395006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:24.402025 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59c6e7e9-e8c6-44e3-901f-ccfe32954e55 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1468 microversion: 2.1 time: 0.184758 Apr 30 21:18:24.402612 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1107/2166] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:24 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:24.407815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:24.408439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:24.426536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.427135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.428141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.428656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.534605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:24.552525 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a79617f-299e-43f0-aafd-8a89b1fe2ac8 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.148877 Apr 30 21:18:24.553143 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1108/2167] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:24 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:24.558072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:24.558872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:24.565543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.566244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.567031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.567668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.758410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:24.767767 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ac70f39-6cdf-486c-87e7-c0ef7c8f63f6 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f" status: 200 len: 1468 microversion: 2.1 time: 0.213307 Apr 30 21:18:24.768673 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1109/2168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:24 2022] GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f => generated 1468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:24.773252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:24.773977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:24.808211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.813345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:24.817477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:24.819985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:25.193684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:25.203596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:25.205645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:25.207795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1797f35-e421-4bf6-b448-2394eaa4fe27 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.438242 Apr 30 21:18:25.220510 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1110/2169] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:24 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:25.225715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:25.237914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:25.238116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Searching by: {'reservation_id': 'r-vqy8o4db', 'deleted': False, 'project_id': '327a580f2f8645c28e9590806928ed91'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:18:25.250214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:25.250911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:25.251955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:25.252575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:25.283161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Building network info cache for instance {{(pid=130670) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:18:25.460039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:18:25.630663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:25.647634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:25.648103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:25.926116 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f42b5dc3-5863-41ab-8dd7-64db690c8388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-vqy8o4db" status: 200 len: 2929 microversion: 2.1 time: 0.704055 Apr 30 21:18:25.926790 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1111/2170] 10.222.0.23 () {58 vars in 1196 bytes} [Sat Apr 30 21:18:25 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vqy8o4db => generated 2929 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:25.932521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:25.933212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:25.944329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:25.944823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:25.945595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:25.946080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.141174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Updating instance_info_cache with network_info: [{"id": "1eef8960-f1dd-4d32-8f61-7fd980d9c83e", "address": "fa:16:3e:03:fe:01", "network": {"id": "31094596-75a5-4a74-a7ff-4154b6b0b753", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1767313633-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "14cb627425b94ce890bd232988d4f051", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1eef8960-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130670) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:18:26.153115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:26.160829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d4afcc9-9cb8-4fd0-a2db-727500cec0f3 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1317 microversion: 2.1 time: 0.232801 Apr 30 21:18:26.161402 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1112/2171] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:25 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:26.174579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c7ae2eec-d689-4868-a839-3e1b5799852c req-669e5724-d540-4273-82c9-f0d380d13a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12866d20-3561-4d1a-a90d-2817908511cd", "tag": "1eef8960-f1dd-4d32-8f61-7fd980d9c83e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:26.183153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c7ae2eec-d689-4868-a839-3e1b5799852c req-669e5724-d540-4273-82c9-f0d380d13a28 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.184498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c7ae2eec-d689-4868-a839-3e1b5799852c req-669e5724-d540-4273-82c9-f0d380d13a28 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.195668 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c7ae2eec-d689-4868-a839-3e1b5799852c req-669e5724-d540-4273-82c9-f0d380d13a28 service nova] Creating event network-changed:1eef8960-f1dd-4d32-8f61-7fd980d9c83e for instance 12866d20-3561-4d1a-a90d-2817908511cd on nch2-master-1 Apr 30 21:18:26.200600 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c7ae2eec-d689-4868-a839-3e1b5799852c req-669e5724-d540-4273-82c9-f0d380d13a28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030290 Apr 30 21:18:26.201776 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1113/2172] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:26.209681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:26.210461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:26.216710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.217673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.218582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.218936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.233610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Releasing lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:18:26.234669 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75b6e7d1-96e6-40da-8717-da3049c79e7d tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action" status: 202 len: 0 microversion: 2.1 time: 3.541198 Apr 30 21:18:26.239527 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1060/2173] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:18:22 2022] POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action => generated 0 bytes in 3546 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:18:26.247504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b1dcdd2a-e083-48a6-8529-8ad585ec05e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:26.284089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.compute.server_groups [None req-b1dcdd2a-e083-48a6-8529-8ad585ec05e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Querying cell a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) for 2 instances {{(pid=130670) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 30 21:18:26.286156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1dcdd2a-e083-48a6-8529-8ad585ec05e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.290567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1dcdd2a-e083-48a6-8529-8ad585ec05e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.330384 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b1dcdd2a-e083-48a6-8529-8ad585ec05e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/8aeb6ac2-9a78-487d-afaf-34842678fb54" status: 200 len: 265 microversion: 2.1 time: 0.089952 Apr 30 21:18:26.330978 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1061/2174] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:26 2022] GET /compute/v2.1/os-server-groups/8aeb6ac2-9a78-487d-afaf-34842678fb54 => generated 265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:26.334215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:26.336071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:26.336711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:26.347107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.347542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.348337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.348782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.365249 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4606f995-7153-44f1-88d0-234c16a9626e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.159474 Apr 30 21:18:26.367545 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1114/2175] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:26 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:26.370853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-948eca61-4700-4246-b943-4d075d02fb4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'create', calling method: .version_select at 0x7fdc202e90d0>, body: {"pool": "24d2363b-44f9-4b0c-a866-84cec16dff58"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:26.765655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:26.775053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:26.776956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:26.778405 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-60bbd742-255c-4ade-ae7a-24cb255e52ef tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.446338 Apr 30 21:18:26.779483 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1062/2176] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:26 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:26.794257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b86987b-136b-4822-8d0c-64e83de5d058 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:26.794257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4b86987b-136b-4822-8d0c-64e83de5d058 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:26.801207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b86987b-136b-4822-8d0c-64e83de5d058 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.801673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b86987b-136b-4822-8d0c-64e83de5d058 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:26.802506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b86987b-136b-4822-8d0c-64e83de5d058 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:26.803190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b86987b-136b-4822-8d0c-64e83de5d058 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:27.332262 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b86987b-136b-4822-8d0c-64e83de5d058 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f" status: 200 len: 1619 microversion: 2.1 time: 0.551383 Apr 30 21:18:27.333178 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1063/2177] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:26 2022] GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f => generated 1619 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:27.342322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:27.342322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:27.354451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:27.355505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:27.356765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:27.358451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:27.670788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:27.679100 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f99da20-204c-4681-b2a1-6fdde06162e4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1317 microversion: 2.1 time: 0.344780 Apr 30 21:18:27.679690 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1064/2178] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:27 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:27.685942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c56c1884-00cb-443d-9c0d-e47b479ab967 req-0f8f328c-7c1f-4dc7-9fd2-83af1b4f0f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29ae768-e8c9-449d-88a7-042239f848c6", "name": "network-vif-plugged", "status": "completed", "tag": "517c3e72-ce49-4940-a123-3deec175d114"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:27.694432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c56c1884-00cb-443d-9c0d-e47b479ab967 req-0f8f328c-7c1f-4dc7-9fd2-83af1b4f0f43 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:27.694844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c56c1884-00cb-443d-9c0d-e47b479ab967 req-0f8f328c-7c1f-4dc7-9fd2-83af1b4f0f43 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:27.709309 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c56c1884-00cb-443d-9c0d-e47b479ab967 req-0f8f328c-7c1f-4dc7-9fd2-83af1b4f0f43 service nova] Creating event network-vif-plugged:517c3e72-ce49-4940-a123-3deec175d114 for instance a29ae768-e8c9-449d-88a7-042239f848c6 on nch1-master-1 Apr 30 21:18:27.715329 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c56c1884-00cb-443d-9c0d-e47b479ab967 req-0f8f328c-7c1f-4dc7-9fd2-83af1b4f0f43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Apr 30 21:18:27.716693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1065/2179] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:27.722612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b1cff78-840f-4943-bbb4-2b75b583ca90 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:27.723324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b1cff78-840f-4943-bbb4-2b75b583ca90 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:27.732284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b1cff78-840f-4943-bbb4-2b75b583ca90 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:27.732987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b1cff78-840f-4943-bbb4-2b75b583ca90 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:27.734130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b1cff78-840f-4943-bbb4-2b75b583ca90 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:27.734747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b1cff78-840f-4943-bbb4-2b75b583ca90 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:27.905961 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b1cff78-840f-4943-bbb4-2b75b583ca90 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 200 len: 1619 microversion: 2.1 time: 0.187297 Apr 30 21:18:27.906881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1066/2180] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:27 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 1619 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:27.911768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:27.912648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:27.927895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:27.928389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:27.929187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:27.930070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:28.034233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:28.068721 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-470ddf27-88c8-40ba-aafe-9f46b937be8c tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.160271 Apr 30 21:18:28.069641 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1067/2181] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:27 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:28.074442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:28.075458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:28.082818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:28.083359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:28.084655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:28.084655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:28.328496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:28.337363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:28.338900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:28.340244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c064f7d-80d4-4845-8f00-3a44c264ff99 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.269758 Apr 30 21:18:28.340815 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1068/2182] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:28 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:28.345250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-541ff9d0-768c-4a3e-b600-3ca3c7bc994c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: .version_select at 0x7fdc2613b4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-25050569", "policies": ["anti-affinity"]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:28.361395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-541ff9d0-768c-4a3e-b600-3ca3c7bc994c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:28.366651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-541ff9d0-768c-4a3e-b600-3ca3c7bc994c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:28.488257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-541ff9d0-768c-4a3e-b600-3ca3c7bc994c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:28.493929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-541ff9d0-768c-4a3e-b600-3ca3c7bc994c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:28.507806 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-541ff9d0-768c-4a3e-b600-3ca3c7bc994c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.165956 Apr 30 21:18:28.508407 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1069/2183] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:18:28 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:28.640508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-732dd9db-5bbc-41f0-9336-be59589d5b98 tempest-AbsoluteLimitsTestJSON-682041739 tempest-AbsoluteLimitsTestJSON-682041739-project] Calling method '.version_select at 0x7fdc2613b670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:28.653440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-732dd9db-5bbc-41f0-9336-be59589d5b98 tempest-AbsoluteLimitsTestJSON-682041739 tempest-AbsoluteLimitsTestJSON-682041739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:28.654911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-732dd9db-5bbc-41f0-9336-be59589d5b98 tempest-AbsoluteLimitsTestJSON-682041739 tempest-AbsoluteLimitsTestJSON-682041739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:28.655939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-732dd9db-5bbc-41f0-9336-be59589d5b98 tempest-AbsoluteLimitsTestJSON-682041739 tempest-AbsoluteLimitsTestJSON-682041739-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:28.656556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-732dd9db-5bbc-41f0-9336-be59589d5b98 tempest-AbsoluteLimitsTestJSON-682041739 tempest-AbsoluteLimitsTestJSON-682041739-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:28.693975 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-732dd9db-5bbc-41f0-9336-be59589d5b98 tempest-AbsoluteLimitsTestJSON-682041739 tempest-AbsoluteLimitsTestJSON-682041739-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.184245 Apr 30 21:18:28.695008 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1070/2184] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:28 2022] GET /compute/v2.1/limits => generated 511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:28.702867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1566635275", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5c58043f-d67d-4e30-b3de-16c5aeb3daff"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:28.758793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:18:29.114777 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-948eca61-4700-4246-b943-4d075d02fb4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.747577 Apr 30 21:18:29.115544 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1115/2185] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:18:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:29.120807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:29.122118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:29.130804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.131291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.132079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.132686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.146738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:18:29.147170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:18:29.147652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:18:29.148069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:18:29.148491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:18:29.166590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.167053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.167871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.168507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.187267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:29.192368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:29.205304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Going to run 2 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:18:29.207733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:18:29.278480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:29.292561 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e41dfc27-d7ce-4f9b-a658-7eb6ac614070 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1507 microversion: 2.1 time: 0.175261 Apr 30 21:18:29.293395 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1116/2186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:29 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:29.299041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:29.299788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:29.305736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.306710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.308196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.308798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.385320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:29.392057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130670) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Apr 30 21:18:29.404012 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4d40be82-c373-4e04-b7df-91b7c9593ab2 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.109353 Apr 30 21:18:29.405833 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1117/2187] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:29 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:29.415819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'action', calling method: .version_select at 0x7fdc2325e670>, body: {"addFloatingIp": {"address": "172.35.4.207"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:29.417053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:29.424393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:29.424821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.425353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.426270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.426776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.430515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:29.505259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Acquired lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:18:29.583765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:29.588938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:29.603380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=34eaeadd-696c-4555-a7a4-2fbcb85aae6f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:18:29.764029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:29.771196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:29.885858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:29.891461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'server_group_members'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:29.906465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.207 (761ef7e5-b225-4481-b86f-0a7c605e7c12) with port 1eef8960-f1dd-4d32-8f61-7fd980d9c83e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 24d2363b-44f9-4b0c-a866-84cec16dff58.", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:18:29.907067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Releasing lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:18:29.907631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.207 (761ef7e5-b225-4481-b86f-0a7c605e7c12) with port 1eef8960-f1dd-4d32-8f61-7fd980d9c83e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 24d2363b-44f9-4b0c-a866-84cec16dff58. Apr 30 21:18:29.907631 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-afc267b4-067f-48dd-a204-5bceaf49c680'] Apr 30 21:18:29.908356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Returning 400 to user: Cannot associate floating IP 172.35.4.207 (761ef7e5-b225-4481-b86f-0a7c605e7c12) with port 1eef8960-f1dd-4d32-8f61-7fd980d9c83e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 24d2363b-44f9-4b0c-a866-84cec16dff58. Apr 30 21:18:29.908356 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-afc267b4-067f-48dd-a204-5bceaf49c680'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:29.909236 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e450c2b-78e1-4a2b-a888-0a8f41dfe9cc tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action" status: 400 len: 382 microversion: 2.1 time: 0.502412 Apr 30 21:18:29.909878 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1118/2188] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:18:29 2022] POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action => generated 382 bytes in 503 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:18:29.921474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:29.921474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:29.923652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.924101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.924885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:29.925326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:29.926907 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc4ca2fb-f61a-44d9-a64b-f018d899cf8d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.230613 Apr 30 21:18:29.927517 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1071/2189] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:18:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 30 21:18:29.933566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a3dcedf-e9ef-44a1-acb7-b86f710fc0e1 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '.version_select at 0x7fdc261c2af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:30.256041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:30.266431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:30.268097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:30.282739 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-566152b3-46bc-449d-8fa5-b102ffefb361 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.371573 Apr 30 21:18:30.284080 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1119/2190] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:29 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:30.303452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:30.307152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:30.307923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Searching by: {'deleted': False, 'project_id': '327a580f2f8645c28e9590806928ed91'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:18:30.324452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:30.324908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:30.325720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:30.326383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:30.442633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:18:30.523118 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a60a0315-4d80-4768-88eb-44f6c50a5811 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.236463 Apr 30 21:18:30.526564 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1120/2191] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:18:30 2022] GET /compute/v2.1/servers => generated 1666 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:30.535080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:30.536059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:30.544722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:30.545416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:30.546526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:30.547275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:30.700077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:30.720311 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e8655c5-a2b0-452d-8cf6-edd4b6aca281 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.190350 Apr 30 21:18:30.720897 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1121/2192] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:30 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:30.725580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6e72ad40-f4bc-4c4b-b1f4-32cda2a625c8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:30.726212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6e72ad40-f4bc-4c4b-b1f4-32cda2a625c8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:30.795920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6e72ad40-f4bc-4c4b-b1f4-32cda2a625c8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:30.802789 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6e72ad40-f4bc-4c4b-b1f4-32cda2a625c8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1219 microversion: 2.1 time: 0.080601 Apr 30 21:18:30.805956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1122/2193] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:30 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:31.178974 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a3dcedf-e9ef-44a1-acb7-b86f710fc0e1 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/761ef7e5-b225-4481-b86f-0a7c605e7c12" status: 202 len: 0 microversion: 2.1 time: 1.250199 Apr 30 21:18:31.179709 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1072/2194] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:29 2022] DELETE /compute/v2.1/os-floating-ips/761ef7e5-b225-4481-b86f-0a7c605e7c12 => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:18:31.189516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'action', calling method: .version_select at 0x7fdc2325e5e0>, body: {"removeFloatingIp": {"address": "172.35.4.17"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:31.304256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:31.305812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:31.317367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.318472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.320815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.321478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.405702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:31.414546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.415150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.416086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.416723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.666822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:31.678205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:31.679978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:31.681155 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7327687b-0a85-4f57-8913-4cd0bcc68b67 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.382880 Apr 30 21:18:31.682027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1073/2195] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:31 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:31.738565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Acquired lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:18:31.741804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:31.742438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:31.749295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.749801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.750584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.751033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.845846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:31.870128 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f0234d13-ad9b-4e34-8145-eea943af516e tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.133126 Apr 30 21:18:31.870832 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1074/2196] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:31 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:31.876295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:31.877123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:31.884307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.884982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.887946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:31.887946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:31.996548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:32.005849 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-06c86b38-e634-4696-ad7f-c9e723ca6b37 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1223 microversion: 2.1 time: 0.133437 Apr 30 21:18:32.011885 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1075/2197] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:31 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:32.370086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5087ffaf-42b2-4c3a-8cbf-0a636593c2ea"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:32.371240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:32.378575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:32.379040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:32.379851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:32.380300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:32.858639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Building network info cache for instance {{(pid=130671) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:18:33.721452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Updating instance_info_cache with network_info: [{"id": "1eef8960-f1dd-4d32-8f61-7fd980d9c83e", "address": "fa:16:3e:03:fe:01", "network": {"id": "31094596-75a5-4a74-a7ff-4154b6b0b753", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1767313633-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "14cb627425b94ce890bd232988d4f051", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1eef8960-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130671) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:18:33.723290 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "POST /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.357068 Apr 30 21:18:33.725154 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1076/2198] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:18:32 2022] POST /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments => generated 194 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:18:33.739467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:33.745481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:33.766798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:33.767300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:33.768445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:33.769368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:33.792767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Releasing lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:18:33.794109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b83fdb4d-4f22-4508-b83c-a42ce788cb4e tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action" status: 202 len: 0 microversion: 2.1 time: 2.608731 Apr 30 21:18:33.794869 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1123/2199] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:18:31 2022] POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action => generated 0 bytes in 2610 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:18:33.800257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-0d141a35-ca38-46a3-b072-99bee0bd5e41 req-2a7b926f-0c55-47e9-9b3b-032f5ae37bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12866d20-3561-4d1a-a90d-2817908511cd", "tag": "1eef8960-f1dd-4d32-8f61-7fd980d9c83e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:33.848700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0d141a35-ca38-46a3-b072-99bee0bd5e41 req-2a7b926f-0c55-47e9-9b3b-032f5ae37bd8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:33.848700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0d141a35-ca38-46a3-b072-99bee0bd5e41 req-2a7b926f-0c55-47e9-9b3b-032f5ae37bd8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:33.878097 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-0d141a35-ca38-46a3-b072-99bee0bd5e41 req-2a7b926f-0c55-47e9-9b3b-032f5ae37bd8 service nova] Creating event network-changed:1eef8960-f1dd-4d32-8f61-7fd980d9c83e for instance 12866d20-3561-4d1a-a90d-2817908511cd on nch2-master-1 Apr 30 21:18:33.896692 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-0d141a35-ca38-46a3-b072-99bee0bd5e41 req-2a7b926f-0c55-47e9-9b3b-032f5ae37bd8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093714 Apr 30 21:18:33.898024 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1124/2200] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:33.907956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:33.913668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:33.934515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:33.935316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:33.937198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:33.939630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:34.098332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:34.132839 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b3ca007-6b22-4d19-ae92-748677c58286 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.232538 Apr 30 21:18:34.134559 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1125/2201] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:33 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:34.146352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:34.154540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:34.156296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:34.163843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:34.164443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:34.166818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:34.167392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:34.171700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:34.173494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:34.174760 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5376df11-d2ad-441f-b7fd-0e14965dec1b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.448165 Apr 30 21:18:34.175336 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1077/2202] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:33 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:34.191116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b4cb97a-ec07-4636-ae5f-886e01d10141 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '.version_select at 0x7fdc26102670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:34.439729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:34.454744 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d800427-aad3-47d5-8adc-15c56ee43fc5 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1279 microversion: 2.1 time: 0.317529 Apr 30 21:18:34.463949 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1126/2203] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:34 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1279 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:34.750129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d7b313f-9686-4bc9-b626-f856d7a98f17 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Calling method '.version_select at 0x7fdc202a0f70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:34.901837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-9d7b313f-9686-4bc9-b626-f856d7a98f17 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66ab83cd-eb3a-4481-af6b-66526d4589a1 does not exist", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:18:34.902656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-9d7b313f-9686-4bc9-b626-f856d7a98f17 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Neutron security group 66ab83cd-eb3a-4481-af6b-66526d4589a1 not found {{(pid=130671) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:18:34.903277 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9d7b313f-9686-4bc9-b626-f856d7a98f17 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] HTTP exception thrown: Security group 66ab83cd-eb3a-4481-af6b-66526d4589a1 does not exist Apr 30 21:18:34.903277 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-952ff695-c86b-42f4-b957-45cd8ce9bd2b'] Apr 30 21:18:34.904144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d7b313f-9686-4bc9-b626-f856d7a98f17 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Returning 404 to user: Security group 66ab83cd-eb3a-4481-af6b-66526d4589a1 does not exist Apr 30 21:18:34.904144 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-952ff695-c86b-42f4-b957-45cd8ce9bd2b'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:34.905314 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d7b313f-9686-4bc9-b626-f856d7a98f17 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/66ab83cd-eb3a-4481-af6b-66526d4589a1" status: 404 len: 194 microversion: 2.1 time: 0.445903 Apr 30 21:18:34.906848 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1127/2204] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:18:34 2022] DELETE /compute/v2.1/os-security-groups/66ab83cd-eb3a-4481-af6b-66526d4589a1 => generated 194 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:18:34.918092 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59d5e581-ea54-4bfc-b210-974653f03112 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005351 Apr 30 21:18:34.922893 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1128/2205] 10.222.0.23 () {58 vars in 1163 bytes} [Sat Apr 30 21:18:34 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 30 21:18:34.933344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2e10a378-8ae8-4970-93b0-569dc22975df tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Calling method '.version_select at 0x7fdc20243790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:35.566363 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2e10a378-8ae8-4970-93b0-569dc22975df tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.638733 Apr 30 21:18:35.568495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1129/2206] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:18:34 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:35.578329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:35.579243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:35.591368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:35.597260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:35.597260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:35.597260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:35.987203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:36.028741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c42a0c6-3242-47a8-8120-650e6ab94c68 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.460454 Apr 30 21:18:36.041476 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1130/2207] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:35 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:36.041476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:36.041476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:36.047966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:36.047966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:36.047966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:36.047966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:36.462682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:36.471831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:36.473316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:36.483262 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f87a81c-8536-482b-ac62-c77af2d62518 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.443127 Apr 30 21:18:36.483262 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1131/2208] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:36 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:36.483262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:36.483262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:36.486374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:36.487029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:36.487833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:36.488257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:36.894746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:36.904547 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b4cb97a-ec07-4636-ae5f-886e01d10141 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/4956bc19-b71f-4b3f-af19-7af2db99869f" status: 202 len: 0 microversion: 2.1 time: 2.727418 Apr 30 21:18:36.905525 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1078/2209] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:34 2022] DELETE /compute/v2.1/os-floating-ips/4956bc19-b71f-4b3f-af19-7af2db99869f => generated 0 bytes in 2730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:18:36.905668 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a96125a3-b516-4e87-868c-2e47973941bd tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.429328 Apr 30 21:18:36.915779 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1132/2210] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:36 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:36.915779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4a091e79-d6d7-49d0-9100-3912329b8ba0 req-4ecf359e-544c-40f3-8ff7-6c4b8b0b5f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34eaeadd-696c-4555-a7a4-2fbcb85aae6f", "tag": "da2ea81e-0c93-4fb7-b6de-96f247b81066"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:36.923910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-620a7974-6995-4298-b5e9-80d010f7c2c1 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Calling method '.version_select at 0x7fdc261570d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:36.927819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4a091e79-d6d7-49d0-9100-3912329b8ba0 req-4ecf359e-544c-40f3-8ff7-6c4b8b0b5f25 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:36.929115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4a091e79-d6d7-49d0-9100-3912329b8ba0 req-4ecf359e-544c-40f3-8ff7-6c4b8b0b5f25 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:36.942493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4a091e79-d6d7-49d0-9100-3912329b8ba0 req-4ecf359e-544c-40f3-8ff7-6c4b8b0b5f25 service nova] Creating event network-changed:da2ea81e-0c93-4fb7-b6de-96f247b81066 for instance 34eaeadd-696c-4555-a7a4-2fbcb85aae6f on nch1-master-1 Apr 30 21:18:36.947925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4a091e79-d6d7-49d0-9100-3912329b8ba0 req-4ecf359e-544c-40f3-8ff7-6c4b8b0b5f25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039916 Apr 30 21:18:36.948753 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1133/2211] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:36.956280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-bd79c5d7-1404-4425-9050-897b0fd63b3f req-055d98f4-281f-47ca-9f66-323aeb85273b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-plugged", "status": "completed", "tag": "bb19e621-b828-4d48-80fb-51c3c27d3aae"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:36.965649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bd79c5d7-1404-4425-9050-897b0fd63b3f req-055d98f4-281f-47ca-9f66-323aeb85273b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:36.966122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bd79c5d7-1404-4425-9050-897b0fd63b3f req-055d98f4-281f-47ca-9f66-323aeb85273b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:36.980471 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-bd79c5d7-1404-4425-9050-897b0fd63b3f req-055d98f4-281f-47ca-9f66-323aeb85273b service nova] Creating event network-vif-plugged:bb19e621-b828-4d48-80fb-51c3c27d3aae for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:36.986188 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-bd79c5d7-1404-4425-9050-897b0fd63b3f req-055d98f4-281f-47ca-9f66-323aeb85273b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036093 Apr 30 21:18:36.995424 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1134/2212] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:36.995424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d983e44-d956-4395-9f7c-f122a09a7a56 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:36.995424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d983e44-d956-4395-9f7c-f122a09a7a56 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:36.995424 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d983e44-d956-4395-9f7c-f122a09a7a56 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action" status: 400 len: 142 microversion: 2.1 time: 0.006381 Apr 30 21:18:36.995424 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1135/2213] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:18:36 2022] POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action => generated 142 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:18:37.004494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:37.005689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:37.012855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.014124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.015116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.015726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.047527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Acquired lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:18:37.226670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-620a7974-6995-4298-b5e9-80d010f7c2c1 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:18:37.228695 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-620a7974-6995-4298-b5e9-80d010f7c2c1 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] HTTP exception thrown: Insufficient rights for removing default security group. Apr 30 21:18:37.228695 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-73c1a522-39f1-46d5-9f61-2a7cca815770'] Apr 30 21:18:37.229318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-620a7974-6995-4298-b5e9-80d010f7c2c1 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Returning 400 to user: Insufficient rights for removing default security group. Apr 30 21:18:37.229318 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-73c1a522-39f1-46d5-9f61-2a7cca815770'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:37.230307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-620a7974-6995-4298-b5e9-80d010f7c2c1 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3bdd063d-f90b-450c-a4b6-46c6edf579ef" status: 400 len: 182 microversion: 2.1 time: 0.310657 Apr 30 21:18:37.238610 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1079/2214] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:18:36 2022] DELETE /compute/v2.1/os-security-groups/3bdd063d-f90b-450c-a4b6-46c6edf579ef => generated 182 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:18:37.243483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:37.244330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Releasing lock "refresh_cache-12866d20-3561-4d1a-a90d-2817908511cd" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:18:37.245102 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] HTTP exception thrown: floating IP not found Apr 30 21:18:37.245930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Returning 404 to user: floating IP not found {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:37.256352 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1692fe2-553c-41f6-beca-7cf078b1e30b tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action" status: 404 len: 67 microversion: 2.1 time: 0.246278 Apr 30 21:18:37.256352 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1136/2215] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:18:36 2022] POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action => generated 67 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:18:37.256616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:37.260816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ccac91f-1827-4ed4-b374-4a9786ae9a57 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Calling method '.version_select at 0x7fdc20281c10>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:37.272919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.279411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.283554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.283554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.344524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-5ccac91f-1827-4ed4-b374-4a9786ae9a57 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e4f4a68a-d189-462e-b5bd-3b43436c2a22 does not exist", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:18:37.346289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-5ccac91f-1827-4ed4-b374-4a9786ae9a57 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Neutron security group e4f4a68a-d189-462e-b5bd-3b43436c2a22 not found {{(pid=130671) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:18:37.346984 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5ccac91f-1827-4ed4-b374-4a9786ae9a57 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] HTTP exception thrown: Security group e4f4a68a-d189-462e-b5bd-3b43436c2a22 does not exist Apr 30 21:18:37.346984 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-bda342a8-9e25-4a19-ad78-ac7b77497cf9'] Apr 30 21:18:37.347642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ccac91f-1827-4ed4-b374-4a9786ae9a57 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Returning 404 to user: Security group e4f4a68a-d189-462e-b5bd-3b43436c2a22 does not exist Apr 30 21:18:37.347642 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-bda342a8-9e25-4a19-ad78-ac7b77497cf9'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:37.354640 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ccac91f-1827-4ed4-b374-4a9786ae9a57 tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/e4f4a68a-d189-462e-b5bd-3b43436c2a22" status: 404 len: 194 microversion: 2.1 time: 0.097765 Apr 30 21:18:37.354640 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1137/2216] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:18:37 2022] GET /compute/v2.1/os-security-groups/e4f4a68a-d189-462e-b5bd-3b43436c2a22 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:18:37.361926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fcaecc42-7947-4b50-93aa-45b5d0fb409f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:37.395464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:37.414325 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c638d31-5277-4372-9a45-688e0acc3a28 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.174283 Apr 30 21:18:37.414998 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1080/2217] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:37 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:37.430906 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-fcaecc42-7947-4b50-93aa-45b5d0fb409f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Apr 30 21:18:37.431891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fcaecc42-7947-4b50-93aa-45b5d0fb409f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:37.433011 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fcaecc42-7947-4b50-93aa-45b5d0fb409f tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action" status: 404 len: 88 microversion: 2.1 time: 0.081448 Apr 30 21:18:37.434042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae7ca9e9-46dd-4847-ac0e-6dc2b03585aa tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Action: 'update', calling method: .version_select at 0x7fdc26115a60>, body: {"security_group": {"name": "tempest-sg-1484228709", "description": "tempest-description-792441085"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:37.434225 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1138/2218] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:18:37 2022] POST /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd/action => generated 88 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:18:37.442307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:37.442961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:37.449593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.453907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.453907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.453907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.481113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:18:37.489532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-ae7ca9e9-46dd-4847-ac0e-6dc2b03585aa tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f902542-dbb2-43df-8a33-a7669d6c8761 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:18:37.490311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-ae7ca9e9-46dd-4847-ac0e-6dc2b03585aa tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Neutron security group 0f902542-dbb2-43df-8a33-a7669d6c8761 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:18:37.490972 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-ae7ca9e9-46dd-4847-ac0e-6dc2b03585aa tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] HTTP exception thrown: Security group 0f902542-dbb2-43df-8a33-a7669d6c8761 does not exist Apr 30 21:18:37.490972 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-9a28b4ef-7149-4103-b490-a1402efec8e3'] Apr 30 21:18:37.491735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae7ca9e9-46dd-4847-ac0e-6dc2b03585aa tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] Returning 404 to user: Security group 0f902542-dbb2-43df-8a33-a7669d6c8761 does not exist Apr 30 21:18:37.491735 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-9a28b4ef-7149-4103-b490-a1402efec8e3'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:37.492962 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae7ca9e9-46dd-4847-ac0e-6dc2b03585aa tempest-SecurityGroupsNegativeTestJSON-1517257354 tempest-SecurityGroupsNegativeTestJSON-1517257354-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/0f902542-dbb2-43df-8a33-a7669d6c8761" status: 404 len: 194 microversion: 2.1 time: 0.070043 Apr 30 21:18:37.494027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1081/2219] 10.222.0.23 () {60 vars in 1289 bytes} [Sat Apr 30 21:18:37 2022] PUT /compute/v2.1/os-security-groups/0f902542-dbb2-43df-8a33-a7669d6c8761 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:18:37.500871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:37.500871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:37.506674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.507428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.508470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.509910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.769093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:37.778143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:37.780282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:37.781445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-adfa898d-6168-4af3-bcd6-094dc69bda41 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.286184 Apr 30 21:18:37.782027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1082/2220] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:37 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:37.819712 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3db8dd0-672b-4f4e-9c8e-3d3d4d755628 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 204 len: 0 microversion: 2.1 time: 0.380427 Apr 30 21:18:37.823307 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1139/2221] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:18:37 2022] DELETE /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:18:37.831775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:37.836658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:37.841998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.842750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.844712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.845988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.928471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:37.928471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:37.943299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.944102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:37.946639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:37.947572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:38.197087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:38.204793 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-01486d7f-5a8b-41e1-8fd5-7621dc3eed8a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1542 microversion: 2.1 time: 0.377695 Apr 30 21:18:38.207276 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1083/2222] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:37 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1542 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:38.261727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:38.270039 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c06c774-f040-481a-b4a0-2140e6761a39 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.349380 Apr 30 21:18:38.270626 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1140/2223] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:37 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:18:38.428068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f156c6c9-0e1b-49a0-8bc2-8502226d9ffe req-513d965d-47f1-4ca2-a58f-7fcae4edb2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3855dbed-3ab0-4ad7-89a7-b2533f8489a5", "tag": "c56ee71c-bad4-4c67-ba8d-174fb8fd7523"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:38.435440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:38.437153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:38.453692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:38.455166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f156c6c9-0e1b-49a0-8bc2-8502226d9ffe req-513d965d-47f1-4ca2-a58f-7fcae4edb2f3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:38.456501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:38.457450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:38.458420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f156c6c9-0e1b-49a0-8bc2-8502226d9ffe req-513d965d-47f1-4ca2-a58f-7fcae4edb2f3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:38.463566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:38.480387 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f156c6c9-0e1b-49a0-8bc2-8502226d9ffe req-513d965d-47f1-4ca2-a58f-7fcae4edb2f3 service nova] Creating event network-changed:c56ee71c-bad4-4c67-ba8d-174fb8fd7523 for instance 3855dbed-3ab0-4ad7-89a7-b2533f8489a5 on nch2-master-1 Apr 30 21:18:38.485247 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f156c6c9-0e1b-49a0-8bc2-8502226d9ffe req-513d965d-47f1-4ca2-a58f-7fcae4edb2f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061138 Apr 30 21:18:38.490336 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1084/2224] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:38.575464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:38.599292 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-589b456e-0228-41af-a334-1820ccb2e011 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.168732 Apr 30 21:18:38.600260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1141/2225] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:38 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:38.803554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:38.812298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:38.828551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:38.829128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:38.830347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:38.830871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.018994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-plugged", "status": "completed", "tag": "1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24"}, {"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-plugged", "status": "completed", "tag": "3612a02c-d7fa-4f7d-8b59-27351eff0cc5"}, {"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-plugged", "status": "completed", "tag": "eeb95bf2-7a04-4881-a1c4-a027f2905abd"}, {"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-plugged", "status": "completed", "tag": "b3fce87b-a558-49fc-83b7-71bd012b7290"}, {"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-plugged", "status": "completed", "tag": "0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:39.028795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.029512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.044906 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Creating event network-vif-plugged:1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:39.046152 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Creating event network-vif-plugged:3612a02c-d7fa-4f7d-8b59-27351eff0cc5 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:39.047018 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Creating event network-vif-plugged:eeb95bf2-7a04-4881-a1c4-a027f2905abd for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:39.048787 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Creating event network-vif-plugged:b3fce87b-a558-49fc-83b7-71bd012b7290 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:39.049502 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] Creating event network-vif-plugged:0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:39.052704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:39.057556 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a08874d0-b1b1-4399-8aab-64d66f73b941 req-4e4ada67-7c1b-4b1c-a937-165ceeac3fa6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.041540 Apr 30 21:18:39.058589 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1142/2226] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:18:39.065593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:39.067148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:39.068319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7cba581c-9593-4ef3-8dd9-f2d68e5d9354 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.270950 Apr 30 21:18:39.068876 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1085/2227] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:38 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:18:39.224383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:39.226614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:39.234367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.235656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.236529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.237557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.295639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:39.296344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:39.303664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.304294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.305226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.305749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.722197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:39.730164 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-85c6f9e3-b8f6-4b19-be17-ba749a8daa4c tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1542 microversion: 2.1 time: 0.510418 Apr 30 21:18:39.731191 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1143/2228] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:39 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1542 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:39.752528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:39.760873 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c0b73827-38e2-4c87-8e84-ee1253e7baf1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.469366 Apr 30 21:18:39.762721 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1086/2229] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:39 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:39.768644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:39.769639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:39.779828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.780785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.782084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.782689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.912393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:39.953858 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e31a960-25e1-49a0-956b-82472c2e2fed tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.185955 Apr 30 21:18:39.959725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "09d1a215-37d9-4f39-9893-10917d702d8b"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:39.961627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:39.970119 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1087/2230] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:39 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:39.972499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.973650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:39.975771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:39.976913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.096049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:40.096698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:40.105022 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] HTTP exception thrown: Volume 09d1a215-37d9-4f39-9893-10917d702d8b could not be found. Apr 30 21:18:40.105022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Returning 400 to user: Volume 09d1a215-37d9-4f39-9893-10917d702d8b could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:40.105022 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b92d5ed1-e29e-46cd-b1ef-22ab687046a3 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments/5087ffaf-42b2-4c3a-8cbf-0a636593c2ea" status: 400 len: 107 microversion: 2.1 time: 0.370480 Apr 30 21:18:40.105022 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1144/2231] 10.222.0.23 () {60 vars in 1432 bytes} [Sat Apr 30 21:18:39 2022] PUT /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments/5087ffaf-42b2-4c3a-8cbf-0a636593c2ea => generated 107 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:18:40.105391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.105892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.107469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.107949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.195475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:40.196034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:40.205928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.206387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.207179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.207670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.318574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lazy-loading 'services' on Instance uuid a29ae768-e8c9-449d-88a7-042239f848c6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:40.552286 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c24372f6-d78b-4fc2-8520-a76c48e5b918 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments/5087ffaf-42b2-4c3a-8cbf-0a636593c2ea" status: 202 len: 0 microversion: 2.1 time: 0.360732 Apr 30 21:18:40.553460 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1145/2232] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:18:40 2022] DELETE /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments/5087ffaf-42b2-4c3a-8cbf-0a636593c2ea => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:18:40.562028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fccfb5d2-cd0a-44c7-a09e-61370ce21c6a tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:40.563136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fccfb5d2-cd0a-44c7-a09e-61370ce21c6a tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:40.572085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fccfb5d2-cd0a-44c7-a09e-61370ce21c6a tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.572551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fccfb5d2-cd0a-44c7-a09e-61370ce21c6a tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.573451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fccfb5d2-cd0a-44c7-a09e-61370ce21c6a tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.573989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fccfb5d2-cd0a-44c7-a09e-61370ce21c6a tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.614618 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fccfb5d2-cd0a-44c7-a09e-61370ce21c6a tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057055 Apr 30 21:18:40.619840 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1146/2233] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:18:40 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:18:40.752215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:40.753005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:40.756801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:40.764115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.764115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.764115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.764115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.773436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:40.778342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:40.783001 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51283d73-5fee-43c4-82f5-497e00a2dec3 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.692517 Apr 30 21:18:40.785021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1088/2234] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:40 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:18:40.797979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:40.798971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:40.807770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.808586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.809722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.810583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:40.949294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:40.969990 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1011c014-9dbf-462b-98f9-325535e343a7 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1500 microversion: 2.1 time: 0.216815 Apr 30 21:18:40.969990 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1147/2235] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:40 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1500 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:18:40.977509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-804dd9d7-eff2-45a3-8d73-611975e3aeee req-1f63e193-6760-4a83-8e72-1fc1450e9041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12866d20-3561-4d1a-a90d-2817908511cd", "name": "network-vif-deleted", "tag": "1eef8960-f1dd-4d32-8f61-7fd980d9c83e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:40.994489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-804dd9d7-eff2-45a3-8d73-611975e3aeee req-1f63e193-6760-4a83-8e72-1fc1450e9041 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:40.995460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-804dd9d7-eff2-45a3-8d73-611975e3aeee req-1f63e193-6760-4a83-8e72-1fc1450e9041 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.009784 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-804dd9d7-eff2-45a3-8d73-611975e3aeee req-1f63e193-6760-4a83-8e72-1fc1450e9041 service nova] Creating event network-vif-deleted:1eef8960-f1dd-4d32-8f61-7fd980d9c83e for instance 12866d20-3561-4d1a-a90d-2817908511cd on nch2-master-1 Apr 30 21:18:41.015666 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-804dd9d7-eff2-45a3-8d73-611975e3aeee req-1f63e193-6760-4a83-8e72-1fc1450e9041 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054108 Apr 30 21:18:41.016722 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1148/2236] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:41.029498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:41.030236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:41.041028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.041028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.041028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.041028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.056536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:41.064276 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9e12ae52-a282-4b24-bfdd-95e5e1b3525b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.277728 Apr 30 21:18:41.064864 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1089/2237] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:40 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:41.081294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e44e637c-da45-4b3d-894d-5c2b3c8b3b62 req-2dd08aa0-aa9b-429e-a894-d014029272d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-plugged", "status": "completed", "tag": "cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:41.089418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e44e637c-da45-4b3d-894d-5c2b3c8b3b62 req-2dd08aa0-aa9b-429e-a894-d014029272d1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.089912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e44e637c-da45-4b3d-894d-5c2b3c8b3b62 req-2dd08aa0-aa9b-429e-a894-d014029272d1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.102334 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e44e637c-da45-4b3d-894d-5c2b3c8b3b62 req-2dd08aa0-aa9b-429e-a894-d014029272d1 service nova] Creating event network-vif-plugged:cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:41.108102 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e44e637c-da45-4b3d-894d-5c2b3c8b3b62 req-2dd08aa0-aa9b-429e-a894-d014029272d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030581 Apr 30 21:18:41.108640 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1090/2238] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:41.127631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:41.144561 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a845727-14cc-44df-bb15-d81c799b4eab tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.120296 Apr 30 21:18:41.145140 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1149/2239] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:41 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:41.628215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fcb555e5-5c56-4225-9766-8e41bc5275ed tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:41.629331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fcb555e5-5c56-4225-9766-8e41bc5275ed tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:41.640198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fcb555e5-5c56-4225-9766-8e41bc5275ed tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.640198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fcb555e5-5c56-4225-9766-8e41bc5275ed tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.640198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fcb555e5-5c56-4225-9766-8e41bc5275ed tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.640198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fcb555e5-5c56-4225-9766-8e41bc5275ed tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.667586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fcb555e5-5c56-4225-9766-8e41bc5275ed tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Apr 30 21:18:41.668457 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1091/2240] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:18:41 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:41.803369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:41.804120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:41.811025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.811506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.812279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.812729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.976442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:41.977810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:41.985634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.988351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:41.988351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:41.988351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:42.030574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:42.041701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:42.045870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:42.045870 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af77b20a-124e-4bef-9616-f51ab6172a10 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.245414 Apr 30 21:18:42.056103 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1150/2241] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:41 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:42.069216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0140b2412e3b455eabd9ce46e39027e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cb627425b94ce890bd232988d4f051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:42.078943 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88d75fe7-a6f4-45cf-b10d-5cb5db2f5eba tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 200 len: 1500 microversion: 2.1 time: 0.106339 Apr 30 21:18:42.080695 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1092/2242] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:41 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 1500 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:18:42.082339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:42.083058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:42.098797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:42.101320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:42.101320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:42.101320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:42.166431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:42.166975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:42.179604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:42.180524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:42.181796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:42.182308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:42.314112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:42.343490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:42.343836 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-28f64059-9b68-4587-8a79-6e08c8f933cb tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.183358 Apr 30 21:18:42.345387 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1093/2243] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:42 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:18:42.352765 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8fb129de-824d-4308-8431-f8baad9c7b30 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.275097 Apr 30 21:18:42.353691 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1151/2244] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:42 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:42.681647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-33ad1012-bbfc-44fc-aa43-657710faf1b4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:42.682697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-33ad1012-bbfc-44fc-aa43-657710faf1b4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:42.691568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33ad1012-bbfc-44fc-aa43-657710faf1b4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:42.692417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33ad1012-bbfc-44fc-aa43-657710faf1b4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:42.693510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33ad1012-bbfc-44fc-aa43-657710faf1b4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:42.694164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33ad1012-bbfc-44fc-aa43-657710faf1b4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:42.728183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-33ad1012-bbfc-44fc-aa43-657710faf1b4 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051583 Apr 30 21:18:42.729263 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1094/2245] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:18:42 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:18:43.069209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:43.069702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:43.076856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.077344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.083029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.083812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.097215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:43.097863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] [instance: 12866d20-3561-4d1a-a90d-2817908511cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:43.104278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.104836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.105616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.106092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.129399 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] HTTP exception thrown: Instance 12866d20-3561-4d1a-a90d-2817908511cd could not be found. Apr 30 21:18:43.130160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] Returning 404 to user: Instance 12866d20-3561-4d1a-a90d-2817908511cd could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:43.131143 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18c0bb1a-1225-4406-af4c-46f642af999a tempest-FloatingIPsAssociationNegativeTestJSON-2019276390 tempest-FloatingIPsAssociationNegativeTestJSON-2019276390-project] 10.222.0.23 "GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd" status: 404 len: 111 microversion: 2.1 time: 0.038065 Apr 30 21:18:43.132031 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1095/2246] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:43 2022] GET /compute/v2.1/servers/12866d20-3561-4d1a-a90d-2817908511cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:18:43.149035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-aa327cf3-ca06-4a59-8f4f-54f720b6a561 req-cc3a3e57-23f5-4a7a-b0fe-b31ae128dd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eaeadd-696c-4555-a7a4-2fbcb85aae6f", "name": "network-vif-plugged", "status": "completed", "tag": "da2ea81e-0c93-4fb7-b6de-96f247b81066"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:43.166527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aa327cf3-ca06-4a59-8f4f-54f720b6a561 req-cc3a3e57-23f5-4a7a-b0fe-b31ae128dd26 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.166983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aa327cf3-ca06-4a59-8f4f-54f720b6a561 req-cc3a3e57-23f5-4a7a-b0fe-b31ae128dd26 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.182531 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-aa327cf3-ca06-4a59-8f4f-54f720b6a561 req-cc3a3e57-23f5-4a7a-b0fe-b31ae128dd26 service nova] Creating event network-vif-plugged:da2ea81e-0c93-4fb7-b6de-96f247b81066 for instance 34eaeadd-696c-4555-a7a4-2fbcb85aae6f on nch1-master-1 Apr 30 21:18:43.188397 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-aa327cf3-ca06-4a59-8f4f-54f720b6a561 req-cc3a3e57-23f5-4a7a-b0fe-b31ae128dd26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055078 Apr 30 21:18:43.189004 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1096/2247] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:43.367382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:43.368678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:43.369130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:43.385089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:43.385322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.386306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.387135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.388387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.389007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:43.390484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89bdd458-b991-4211-b637-b6374266f630 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1870 microversion: 2.32 time: 0.326212 Apr 30 21:18:43.391853 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1152/2248] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:43 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1870 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:43.397001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:43.401224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:43.410766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.411571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.412738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:43.413407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:43.490148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:43.510527 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6107c286-68d1-4d62-865b-ab9c1e385075 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.148427 Apr 30 21:18:43.524177 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1097/2249] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:43 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:43.717522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:43.733743 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90288dc6-8490-4f59-b540-890388c48d52 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.340240 Apr 30 21:18:43.742774 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1153/2250] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:43 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:44.410032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:44.410657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:44.417834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.418517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:44.420039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.420691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:44.537577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:44.538970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:44.561235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.563481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:44.565896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.567291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:44.769070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:44.792911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:44.806647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:44.808161 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5bc115f3-c0aa-4815-b691-3c02d05de989 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1927 microversion: 2.75 time: 0.279521 Apr 30 21:18:44.809192 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1154/2251] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:44 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1927 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:44.815893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:44.816046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:44.816148 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-679d0f14-b6ae-4e0d-8a36-87d22437d324 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2825 microversion: 2.32 time: 0.409588 Apr 30 21:18:44.816460 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1098/2252] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:44 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2825 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:44.816909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:44.823511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.824202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:44.831310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.832263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:44.838594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c0b8165-42f9-4e2f-9352-5d8861fda394 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:44.838911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c0b8165-42f9-4e2f-9352-5d8861fda394 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:44.861967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c0b8165-42f9-4e2f-9352-5d8861fda394 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.862547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c0b8165-42f9-4e2f-9352-5d8861fda394 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:44.863617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c0b8165-42f9-4e2f-9352-5d8861fda394 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:44.864245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c0b8165-42f9-4e2f-9352-5d8861fda394 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:45.168309 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c0b8165-42f9-4e2f-9352-5d8861fda394 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.334574 Apr 30 21:18:45.169802 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1099/2253] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Apr 30 21:18:44 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd/os-interface => generated 1832 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:45.758210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6b508150-9895-4466-a4fe-58faf003f7b2"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:45.759978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:45.777494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:45.778320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:45.779850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:45.780480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:45.877509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:45.889496 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c158626d-1a3e-4f1b-9c35-72eb6bc3e35a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 1.078467 Apr 30 21:18:45.890485 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1155/2254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:44 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:45.897921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] HTTP exception thrown: Volume 38ff381b-8ccc-4977-9a08-cd1e316668bc could not be found. Apr 30 21:18:45.898829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] Returning 404 to user: Volume 38ff381b-8ccc-4977-9a08-cd1e316668bc could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:45.900097 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-338f8d29-c4d4-459e-b4b7-c058ab5f2ee1 tempest-VolumesAdminNegativeTest-2040205407 tempest-VolumesAdminNegativeTest-2040205407-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments/38ff381b-8ccc-4977-9a08-cd1e316668bc" status: 404 len: 109 microversion: 2.1 time: 0.147306 Apr 30 21:18:45.901271 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1100/2255] 10.222.0.23 () {60 vars in 1432 bytes} [Sat Apr 30 21:18:45 2022] PUT /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6/os-volume_attachments/38ff381b-8ccc-4977-9a08-cd1e316668bc => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:18:45.909609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:45.910286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:45.922781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:45.926368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:45.927351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:45.927982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:46.098578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:46.117214 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-65bfdaec-b6e6-4c1a-960c-cbd4ff91e8dc tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1945 microversion: 2.75 time: 0.225654 Apr 30 21:18:46.117864 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1156/2256] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:45 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1945 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:46.848980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-dd51921b-33fa-42eb-afc4-9a313576756d req-b9435d27-9f47-4dcc-80dd-1350b3338c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3855dbed-3ab0-4ad7-89a7-b2533f8489a5", "name": "network-vif-plugged", "status": "completed", "tag": "c56ee71c-bad4-4c67-ba8d-174fb8fd7523"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:46.867671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dd51921b-33fa-42eb-afc4-9a313576756d req-b9435d27-9f47-4dcc-80dd-1350b3338c51 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:46.870540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dd51921b-33fa-42eb-afc4-9a313576756d req-b9435d27-9f47-4dcc-80dd-1350b3338c51 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:46.888399 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-dd51921b-33fa-42eb-afc4-9a313576756d req-b9435d27-9f47-4dcc-80dd-1350b3338c51 service nova] Creating event network-vif-plugged:c56ee71c-bad4-4c67-ba8d-174fb8fd7523 for instance 3855dbed-3ab0-4ad7-89a7-b2533f8489a5 on nch2-master-1 Apr 30 21:18:46.895732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-dd51921b-33fa-42eb-afc4-9a313576756d req-b9435d27-9f47-4dcc-80dd-1350b3338c51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051817 Apr 30 21:18:46.908571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:46.909465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:46.914788 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1101/2257] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:46.917636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:46.918554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:46.921479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:46.922519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:47.145080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:47.145872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:47.164029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:47.166708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:47.167617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:47.168073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:47.470565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:47.482330 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0b171b50-e606-46cb-9f8a-3becc346bbe2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.579719 Apr 30 21:18:47.483251 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1157/2258] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:46 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:47.537399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:47.566957 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-921e21f1-026c-41cc-9155-66d762ba8eef tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1933 microversion: 2.75 time: 0.425994 Apr 30 21:18:47.580497 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1102/2259] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:47 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1933 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:18:48.510556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:48.511183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:48.520550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:48.521444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:48.523051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:48.523724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:48.562658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-68dfa704-f225-4897-b0c3-ecad766226dc req-fc52f414-2b36-4f04-8da7-c96850c1ee2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "tag": "0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:48.579506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-68dfa704-f225-4897-b0c3-ecad766226dc req-fc52f414-2b36-4f04-8da7-c96850c1ee2b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:48.583568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-68dfa704-f225-4897-b0c3-ecad766226dc req-fc52f414-2b36-4f04-8da7-c96850c1ee2b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:48.607790 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-68dfa704-f225-4897-b0c3-ecad766226dc req-fc52f414-2b36-4f04-8da7-c96850c1ee2b service nova] Creating event network-changed:0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:18:48.618043 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-68dfa704-f225-4897-b0c3-ecad766226dc req-fc52f414-2b36-4f04-8da7-c96850c1ee2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056512 Apr 30 21:18:48.619701 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1103/2260] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:48.635656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:48.642207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:48.657473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:48.660993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:48.664169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:48.664731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:48.785023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:48.793917 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce733b94-74da-4cc7-950a-c9988a689016 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1319 microversion: 2.1 time: 0.288265 Apr 30 21:18:48.794692 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1158/2261] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:48 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:48.818685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:48.852132 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ec11bc2-8a2c-4ec3-9579-8d06c2175013 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1933 microversion: 2.75 time: 0.230651 Apr 30 21:18:48.852723 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1104/2262] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:48 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1933 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:49.813574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:49.814947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:49.823739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:49.826083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:49.827157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:49.827619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:49.871783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:49.872959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:49.882146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:49.882662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:49.887118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:49.887118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.034096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] Lazy-loading 'services' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:50.078864 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b665c9a-ea2b-411e-b11e-f76c73850ff7 tempest-ServersAdmin275Test-1691991395 tempest-ServersAdmin275Test-1691991395-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1918 microversion: 2.75 time: 0.208098 Apr 30 21:18:50.087208 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1105/2263] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:49 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1918 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:18:50.116242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:50.116429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:50.116429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:50.118775 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b55bf688-1372-49fe-85b2-bace346f6dab tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1469 microversion: 2.1 time: 0.310805 Apr 30 21:18:50.123236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.128023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.130545 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1159/2264] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:49 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:50.131423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.133615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.139724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:50.139724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:50.154507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.158177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.159327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.161605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.167893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:18:50.446025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:50.463220 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-94692995-09dd-4662-93ea-fdf4a730ecdb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f" status: 200 len: 1468 microversion: 2.1 time: 0.331452 Apr 30 21:18:50.464775 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1160/2265] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:50 2022] GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:50.485204 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8119d854-ed5d-400c-b781-60ae8d3130eb tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 204 len: 0 microversion: 2.75 time: 0.377025 Apr 30 21:18:50.498225 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1106/2266] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:18:50 2022] DELETE /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:18:50.498346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:50.498464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:50.498464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:50.506574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.507307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:50.508347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Searching by: {'reservation_id': 'r-gks4frg3', 'deleted': False, 'project_id': '327a580f2f8645c28e9590806928ed91'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:18:50.509187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.513501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.515043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.524015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.528145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.530031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.532548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:50.652797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:50.669644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:50.671196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:50.712316 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-128b8e98-a9de-45fe-88c4-1e05f7c340d3 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1443 microversion: 2.75 time: 0.216607 Apr 30 21:18:50.713175 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1107/2267] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:50 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1443 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:18:50.797341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:18:50.894660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:50.902252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:50.903022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.058933 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9eac493c-318d-480f-ba08-7bf42262c03f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-gks4frg3" status: 200 len: 2930 microversion: 2.1 time: 0.577446 Apr 30 21:18:51.059893 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1161/2268] 10.222.0.23 () {58 vars in 1196 bytes} [Sat Apr 30 21:18:50 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gks4frg3 => generated 2930 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:18:51.077530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a44986d-a856-4bc5-9c15-21c346170a7f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:51.093122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.compute.server_groups [None req-4a44986d-a856-4bc5-9c15-21c346170a7f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Querying cell a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) for 2 instances {{(pid=130670) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 30 21:18:51.093982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a44986d-a856-4bc5-9c15-21c346170a7f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:51.094438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a44986d-a856-4bc5-9c15-21c346170a7f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.115905 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a44986d-a856-4bc5-9c15-21c346170a7f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/5c58043f-d67d-4e30-b3de-16c5aeb3daff" status: 200 len: 269 microversion: 2.1 time: 0.042690 Apr 30 21:18:51.116403 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1108/2269] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:18:51 2022] GET /compute/v2.1/os-server-groups/5c58043f-d67d-4e30-b3de-16c5aeb3daff => generated 269 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:51.126133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96e35c7d-2af8-49a1-8a2a-908aa137ab93 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:51.126997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96e35c7d-2af8-49a1-8a2a-908aa137ab93 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:51.133345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e35c7d-2af8-49a1-8a2a-908aa137ab93 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:51.133868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e35c7d-2af8-49a1-8a2a-908aa137ab93 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.134666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e35c7d-2af8-49a1-8a2a-908aa137ab93 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:51.135107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e35c7d-2af8-49a1-8a2a-908aa137ab93 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.335498 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96e35c7d-2af8-49a1-8a2a-908aa137ab93 tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f" status: 200 len: 1619 microversion: 2.1 time: 0.213013 Apr 30 21:18:51.344079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1162/2270] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:51 2022] GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f => generated 1619 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:51.359435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64aec917-7bf9-46e8-809a-fbccc240da7d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:51.360070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-64aec917-7bf9-46e8-809a-fbccc240da7d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:51.369071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64aec917-7bf9-46e8-809a-fbccc240da7d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:51.369529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64aec917-7bf9-46e8-809a-fbccc240da7d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.373392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64aec917-7bf9-46e8-809a-fbccc240da7d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:51.374483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64aec917-7bf9-46e8-809a-fbccc240da7d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.570757 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-64aec917-7bf9-46e8-809a-fbccc240da7d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 200 len: 1620 microversion: 2.1 time: 0.221206 Apr 30 21:18:51.578043 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1109/2271] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:51 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 1620 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:51.739047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:51.739681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:51.752883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:51.754506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.755359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:51.759002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:51.826524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3802b858-2b01-4e1b-b161-937a03369376 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Calling method '.version_select at 0x7fdc2030d4c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:51.853289 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3802b858-2b01-4e1b-b161-937a03369376 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] HTTP exception thrown: Image not found. Apr 30 21:18:51.854159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3802b858-2b01-4e1b-b161-937a03369376 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:51.855055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3802b858-2b01-4e1b-b161-937a03369376 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] 10.222.0.23 "DELETE /compute/v2.1/images/f435e7b5-8485-46a9-9a75-db06b9e6a5f2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.304549 Apr 30 21:18:51.856512 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1163/2272] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:18:51 2022] DELETE /compute/v2.1/images/f435e7b5-8485-46a9-9a75-db06b9e6a5f2/metadata/os_distro => generated 62 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:18:51.861494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1964373050", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2190c553-068c-486e-b740-cca74445af33"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:51.875414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:51.889321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:51.894663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:51.908658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e898c1f7-da73-4649-b2de-2fe0cd28df7c tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1443 microversion: 2.75 time: 0.175533 Apr 30 21:18:51.909857 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1110/2273] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:51 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:51.927597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9acf2e40-f3dd-44a1-aaf9-c848571647f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Calling method '.version_select at 0x7fdc200da4c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:51.956879 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-9acf2e40-f3dd-44a1-aaf9-c848571647f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] HTTP exception thrown: Image not found. Apr 30 21:18:51.957702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9acf2e40-f3dd-44a1-aaf9-c848571647f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:51.958650 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9acf2e40-f3dd-44a1-aaf9-c848571647f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] 10.222.0.23 "GET /compute/v2.1/images/7ca08992-f981-4e5e-b83d-68627adbef71/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.047512 Apr 30 21:18:51.960015 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1111/2274] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:18:51 2022] GET /compute/v2.1/images/7ca08992-f981-4e5e-b83d-68627adbef71/metadata/os_version => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:18:51.967349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:18:51.974174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1dfdb12a-d403-40e2-b961-0d83ed45bab8 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Calling method '.version_select at 0x7fdc26102670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:51.999251 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1dfdb12a-d403-40e2-b961-0d83ed45bab8 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] HTTP exception thrown: Image not found. Apr 30 21:18:51.999852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1dfdb12a-d403-40e2-b961-0d83ed45bab8 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:52.000752 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1dfdb12a-d403-40e2-b961-0d83ed45bab8 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] 10.222.0.23 "GET /compute/v2.1/images/89b29779-880e-472c-934c-ce1ede1e77e7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035638 Apr 30 21:18:52.001588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1112/2275] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:18:51 2022] GET /compute/v2.1/images/89b29779-880e-472c-934c-ce1ede1e77e7/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:18:52.026556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68e76ce8-edb1-4870-bab4-dd9e2c1f2220 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Action: 'update_all', calling method: .version_select at 0x7fdc200daaf0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:52.054592 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-68e76ce8-edb1-4870-bab4-dd9e2c1f2220 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] HTTP exception thrown: Image not found. Apr 30 21:18:52.054592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68e76ce8-edb1-4870-bab4-dd9e2c1f2220 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:52.054920 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68e76ce8-edb1-4870-bab4-dd9e2c1f2220 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] 10.222.0.23 "PUT /compute/v2.1/images/8189dc2a-aaf8-47b1-b339-21edd7ac1c0b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047723 Apr 30 21:18:52.055505 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1113/2276] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:18:52 2022] PUT /compute/v2.1/images/8189dc2a-aaf8-47b1-b339-21edd7ac1c0b/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:18:52.067819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf3407c9-e655-47de-ba2f-34aee935f1f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Action: 'update', calling method: .version_select at 0x7fdc26102dc0>, body: {"meta": {"os_distro": "alt"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:52.133073 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-cf3407c9-e655-47de-ba2f-34aee935f1f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] HTTP exception thrown: Image not found. Apr 30 21:18:52.133073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf3407c9-e655-47de-ba2f-34aee935f1f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:52.133073 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf3407c9-e655-47de-ba2f-34aee935f1f2 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] 10.222.0.23 "PUT /compute/v2.1/images/c40f70ff-7b6a-4252-a953-aec9f11ce415/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.063374 Apr 30 21:18:52.133073 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1114/2277] 10.222.0.23 () {60 vars in 1309 bytes} [Sat Apr 30 21:18:52 2022] PUT /compute/v2.1/images/c40f70ff-7b6a-4252-a953-aec9f11ce415/metadata/os_distro => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:18:52.139142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d17b4cb9-6d58-42d5-a9ee-7f9466835408 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Action: 'create', calling method: .version_select at 0x7fdc2613b550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:52.167310 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d17b4cb9-6d58-42d5-a9ee-7f9466835408 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] HTTP exception thrown: Image not found. Apr 30 21:18:52.167948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d17b4cb9-6d58-42d5-a9ee-7f9466835408 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:52.169352 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d17b4cb9-6d58-42d5-a9ee-7f9466835408 tempest-ImagesMetadataNegativeTestJSON-1086129942 tempest-ImagesMetadataNegativeTestJSON-1086129942-project] 10.222.0.23 "POST /compute/v2.1/images/86849cf3-5974-46a2-a412-7fdec38f1929/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034540 Apr 30 21:18:52.169947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1115/2278] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Apr 30 21:18:52 2022] POST /compute/v2.1/images/86849cf3-5974-46a2-a412-7fdec38f1929/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:18:52.318299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:18:52.318796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:18:52.320283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:18:52.320900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:18:52.321525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:18:52.333148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:52.333148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:52.334011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:52.334451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:52.357701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:52.365559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:52.396052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:18:52.398465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:18:52.527119 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bf587bf4-5510-4585-8e5a-719510016ddc tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669419 Apr 30 21:18:52.539277 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1164/2279] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:18:52.544654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-21c029df-b0be-434a-a16d-13dfd278081c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:52.545521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-21c029df-b0be-434a-a16d-13dfd278081c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:52.641883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-21c029df-b0be-434a-a16d-13dfd278081c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:52.650313 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-21c029df-b0be-434a-a16d-13dfd278081c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1217 microversion: 2.1 time: 0.110108 Apr 30 21:18:52.651986 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1116/2280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:52 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:18:52.929597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:52.931755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:52.945350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:52.946139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:52.947140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:52.947753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:53.010026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:53.010729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:53.011091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lazy-loading 'fault' on Instance uuid 2784b72b-7b65-49a5-ac89-9d5c2059b607 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:18:53.138092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:53.158553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:53.163597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a323f0848cb404092fe96f6c4168468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eac2a1411444a6293feba25da6fead3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:53.178624 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4f5bb1e-3b46-4174-9fa5-7bcee3984e18 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 200 len: 1448 microversion: 2.75 time: 0.253223 Apr 30 21:18:53.182300 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1165/2281] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:52 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 1448 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:18:53.669230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32838f72-3f2b-4519-8657-8ce0f63f4d4b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:53.670944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32838f72-3f2b-4519-8657-8ce0f63f4d4b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:53.735896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-32838f72-3f2b-4519-8657-8ce0f63f4d4b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:53.745628 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32838f72-3f2b-4519-8657-8ce0f63f4d4b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1217 microversion: 2.1 time: 0.080826 Apr 30 21:18:53.745628 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1117/2282] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:53 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:54.201525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:54.202151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] [instance: 2784b72b-7b65-49a5-ac89-9d5c2059b607] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:54.209285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:54.209843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:54.210831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:54.211450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:54.229479 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] HTTP exception thrown: Instance 2784b72b-7b65-49a5-ac89-9d5c2059b607 could not be found. Apr 30 21:18:54.230333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] Returning 404 to user: Instance 2784b72b-7b65-49a5-ac89-9d5c2059b607 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:18:54.231451 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d890a738-5ada-4935-8603-07e23c196446 tempest-ServersAdmin275Test-2025510365 tempest-ServersAdmin275Test-2025510365-project] 10.222.0.23 "GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607" status: 404 len: 111 microversion: 2.75 time: 0.034463 Apr 30 21:18:54.232012 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1166/2283] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:18:54 2022] GET /compute/v2.1/servers/2784b72b-7b65-49a5-ac89-9d5c2059b607 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:18:54.275436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:54.282598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:54.284461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Searching by: {'deleted': False, 'project_id': '7c032d189cb14ea297194dffa380eae5'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:18:54.294699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:54.295153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:54.296187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:54.296812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:54.337714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:18:54.376982 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-320e3cce-52e0-4c17-a93a-b251a738ffff tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.111313 Apr 30 21:18:54.378320 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1118/2284] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:18:54 2022] GET /compute/v2.1/servers => generated 334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:54.391981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:54.396709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:54.398172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Searching by: {'deleted': False, 'project_id': '7c032d189cb14ea297194dffa380eae5'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:18:54.408788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:54.409574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:54.410868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:54.411318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:54.448116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2041917528", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "0314ba88-3da6-4b45-afdb-5c5749483484"}, {"uuid": "c6bfe522-35a5-48a5-98ba-c31afc78cb10"}, {"uuid": "0314ba88-3da6-4b45-afdb-5c5749483484"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:54.517916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] validate_networks() for [('0314ba88-3da6-4b45-afdb-5c5749483484', None, None, None, None, None), ('c6bfe522-35a5-48a5-98ba-c31afc78cb10', None, None, None, None, None), ('0314ba88-3da6-4b45-afdb-5c5749483484', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:18:54.566517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:18:54.658514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:54.665478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:54.666219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:55.114230 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8cf8b753-95b9-4581-9eec-46dc1e9bdbc6 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.728348 Apr 30 21:18:55.114858 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1167/2285] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:18:54 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:55.139709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:55.140968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:55.154169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:55.161056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:55.165066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:55.165720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:55.396216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:55.422317 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ae026ab5-a96d-4cea-a83f-94b49d8d8fe9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1269 microversion: 2.1 time: 0.306010 Apr 30 21:18:55.434382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1168/2286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:55 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1269 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:55.447688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-488ec4ae-35fa-4e0e-8fe9-86f9c337622d tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:55.460057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-488ec4ae-35fa-4e0e-8fe9-86f9c337622d tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023774 Apr 30 21:18:55.460945 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1169/2287] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:18:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:55.990272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:18:55.990793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:18:55.991283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:18:55.991705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:18:55.992134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:18:56.013100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.013100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.013100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.017888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.057869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1880737729", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:56.062953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Getting quotas for project 692585b32bd44ddb8ab633a1f1842d5f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:56.078803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Getting quotas for user f3e57c830031491a9d8fd6b3664b4390 and project 692585b32bd44ddb8ab633a1f1842d5f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:56.097130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:18:56.101079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:18:56.123262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:18:56.307485 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e130bb5-43a9-4ca0-9f03-2f7743ef7c07 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868122 Apr 30 21:18:56.308441 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1119/2288] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:18:56.316856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:56.320519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:56.337081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.337822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.341068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.341577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.394732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:18:56.518003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:18:56.519418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:18:56.520104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:18:56.520981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:18:56.521627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:18:56.548059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.548869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.549841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.550343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.584102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Getting quotas for project 65633a0f121948df985e316e3b459970. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:18:56.595519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Getting quotas for user cbaa860b758b49e78d244970875e509d and project 65633a0f121948df985e316e3b459970. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:18:56.615484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:18:56.623709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:18:56.742120 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b62c2e36-59bc-4e13-b222-f7abeeb47f7f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "DELETE /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 204 len: 0 microversion: 2.1 time: 0.432083 Apr 30 21:18:56.742925 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1120/2289] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:18:56 2022] DELETE /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:18:56.749882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-31012022-da6c-4904-ae80-1d10008cbe00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:56.759865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-31012022-da6c-4904-ae80-1d10008cbe00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:56.784492 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a14d75a9-f830-4061-9f2e-58172a4198ec tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949412 Apr 30 21:18:56.789611 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1170/2290] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:18:56.828308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:56.834398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:56.845413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.846293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.847354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.848029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.879219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-31012022-da6c-4904-ae80-1d10008cbe00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:56.891118 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-31012022-da6c-4904-ae80-1d10008cbe00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1213 microversion: 2.1 time: 0.146418 Apr 30 21:18:56.892188 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1121/2291] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:56 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:56.898072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:56.898853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:56.914405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.914735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:56.915894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:56.916206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:57.082683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:57.095516 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-28fc5481-6261-4785-ba48-7477dcf160a3 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1275 microversion: 2.1 time: 0.277500 Apr 30 21:18:57.096477 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1171/2292] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:56 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:57.123037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21e14f46-1c93-4501-b5b8-cce200688d18 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:57.128637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-21e14f46-1c93-4501-b5b8-cce200688d18 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:57.258673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:57.279547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-21e14f46-1c93-4501-b5b8-cce200688d18 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:57.291516 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21e14f46-1c93-4501-b5b8-cce200688d18 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1216 microversion: 2.1 time: 0.183009 Apr 30 21:18:57.292954 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8891e9e1-1080-457f-9d8b-1d37afcca92a tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1700 microversion: 2.1 time: 0.399498 Apr 30 21:18:57.302090 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1172/2293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:57 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1216 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:57.302240 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1122/2294] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:56 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1700 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:57.909782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:57.911328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:57.919966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:57.920798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:57.921962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:57.922629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:58.014683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:58.025016 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fcd86c4c-c1f7-4ba2-b2b9-c2c13b84e086 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1217 microversion: 2.1 time: 0.119494 Apr 30 21:18:58.028831 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1173/2295] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:57 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:58.114415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:58.115373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:58.124855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:58.126061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:58.128232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:58.128925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:58.318573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3e249d7d-5810-4770-a676-9231316f7d79 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:58.320386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3e249d7d-5810-4770-a676-9231316f7d79 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:58.488326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3e249d7d-5810-4770-a676-9231316f7d79 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:58.498976 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3e249d7d-5810-4770-a676-9231316f7d79 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1216 microversion: 2.1 time: 0.190840 Apr 30 21:18:58.500309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1174/2296] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:58 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1216 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:58.515213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:58.516217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:58.524660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:58.525311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:58.526616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:58.527277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:58.748449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:58.760491 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1eeffc86-5a43-4b39-a6ff-e27529ea302f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1317 microversion: 2.1 time: 0.651060 Apr 30 21:18:58.761441 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1123/2297] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:58 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:58.998155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:59.011471 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90316be2-e724-4c15-99a6-ece7ecb6632c tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1700 microversion: 2.1 time: 0.509873 Apr 30 21:18:59.012076 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1175/2298] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:58 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1700 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:59.050547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:59.051734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:59.061852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:59.062961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:59.065214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:59.065923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:59.180987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:59.191670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f64f90a4-e41e-4463-9143-1e4f986b8975 req-1b558202-e0bf-4672-b9f8-edc594fa37c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d77eab37-d34b-4e8c-9959-8d5661bf68fb", "tag": "1635337f-81ee-4aec-a704-cf2d3c4efa24"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:18:59.203757 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f09292e-91d2-441e-baac-ca64d2fe4880 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1265 microversion: 2.1 time: 0.159715 Apr 30 21:18:59.219062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f64f90a4-e41e-4463-9143-1e4f986b8975 req-1b558202-e0bf-4672-b9f8-edc594fa37c8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:59.219062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f64f90a4-e41e-4463-9143-1e4f986b8975 req-1b558202-e0bf-4672-b9f8-edc594fa37c8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:59.219309 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1124/2299] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:59 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:59.236910 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f64f90a4-e41e-4463-9143-1e4f986b8975 req-1b558202-e0bf-4672-b9f8-edc594fa37c8 service nova] Creating event network-changed:1635337f-81ee-4aec-a704-cf2d3c4efa24 for instance d77eab37-d34b-4e8c-9959-8d5661bf68fb on nch1-master-1 Apr 30 21:18:59.242225 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f64f90a4-e41e-4463-9143-1e4f986b8975 req-1b558202-e0bf-4672-b9f8-edc594fa37c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054105 Apr 30 21:18:59.243671 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1176/2300] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:18:59.516930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:59.517558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:59.532676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:59.533226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:59.534153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:59.534541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:59.770921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:18:59.782147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:18:59.782547 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9761d4a-278c-4e17-8ef7-cc4ee3f406cd tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1268 microversion: 2.1 time: 0.269999 Apr 30 21:18:59.783272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:18:59.784594 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1125/2301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:59 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1268 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:18:59.800145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:59.804948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:18:59.807279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:18:59.812383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:00.029344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:00.030606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:00.036970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:00.037697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:00.038746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:00.039286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:00.375683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:00.386684 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67fef072-b683-47b1-8adc-c65453425816 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1317 microversion: 2.1 time: 0.611858 Apr 30 21:19:00.389992 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1177/2302] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:18:59 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:00.406539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:00.412298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:00.423335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:00.426424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:00.428026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:00.428941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:00.569528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:00.581310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:00.585413 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3b5843d-f442-4eb9-b06e-198acc3cdc35 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1271 microversion: 2.1 time: 0.182501 Apr 30 21:19:00.587220 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1178/2303] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:00 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:00.605572 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c3bfad4a-c2b9-428c-894a-6b5d2ffdf911 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1700 microversion: 2.1 time: 0.580753 Apr 30 21:19:00.607536 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1126/2304] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:00 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1700 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:00.806355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:00.808640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:00.822064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:00.823854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:00.829564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:00.830523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.021330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:01.034437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-723599f3-e6da-46f2-9a60-59dc098d0acf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1274 microversion: 2.1 time: 0.234262 Apr 30 21:19:01.035610 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1179/2305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:00 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:01.358950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2b5a1c0a-c34d-414c-b9f8-354e7d9fb18a req-a7e827fd-4103-4d7d-8c44-14b5abe20423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82314835-d00b-4591-9555-c35fb57a2d41", "name": "network-vif-deleted", "tag": "ce1d8c5d-0c68-4c48-aa37-9fbce01b179e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:01.372799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2b5a1c0a-c34d-414c-b9f8-354e7d9fb18a req-a7e827fd-4103-4d7d-8c44-14b5abe20423 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:01.373649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2b5a1c0a-c34d-414c-b9f8-354e7d9fb18a req-a7e827fd-4103-4d7d-8c44-14b5abe20423 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.391562 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2b5a1c0a-c34d-414c-b9f8-354e7d9fb18a req-a7e827fd-4103-4d7d-8c44-14b5abe20423 service nova] Creating event network-vif-deleted:ce1d8c5d-0c68-4c48-aa37-9fbce01b179e for instance 82314835-d00b-4591-9555-c35fb57a2d41 on nch1-master-1 Apr 30 21:19:01.400992 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2b5a1c0a-c34d-414c-b9f8-354e7d9fb18a req-a7e827fd-4103-4d7d-8c44-14b5abe20423 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046263 Apr 30 21:19:01.402976 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1127/2306] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:01.407339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:01.408098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:01.417195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:01.417665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.423397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:01.424280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.604453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:01.605334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:01.618599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:01.618599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.618599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:01.619190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.779994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:01.791635 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7a4c522-81aa-470b-ae6b-68853028d3d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1271 microversion: 2.1 time: 0.191581 Apr 30 21:19:01.801943 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1128/2307] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:01 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:01.807978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:01.808368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:01.813034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:01.818138 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eb847412-6997-4c3d-a92e-95a5bc518b9b tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1317 microversion: 2.1 time: 0.415138 Apr 30 21:19:01.818503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:01.819182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.820172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:01.820781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:01.825684 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1180/2308] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:01 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:02.026047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:02.041301 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11e08f20-3ba5-4100-ab20-574e57db91a4 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1633 microversion: 2.1 time: 0.237688 Apr 30 21:19:02.042053 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1129/2309] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:01 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1633 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:02.057207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:02.057888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:02.070437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:02.070926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:02.076711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:02.077409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:02.551320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:02.561270 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b86beef0-f2a4-4d4d-bddd-6a611bde162a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1316 microversion: 2.1 time: 0.508160 Apr 30 21:19:02.562056 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1181/2310] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:02 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:02.810289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:02.811594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:02.821401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:02.821903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:02.827861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:02.828410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:02.841892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:02.842537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:02.851005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:02.858614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:02.860771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:02.860771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:03.219750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:03.239034 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dabfd2c9-3761-4dcf-84f7-3e3f8c2d8c05 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1317 microversion: 2.1 time: 0.397906 Apr 30 21:19:03.242473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:03.249522 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1182/2311] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:02 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:03.257326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-113aa218-1f8d-409f-90a1-ea9d76e74cc6 req-57ef20cf-aa68-4ed0-b67b-538e236e2f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feabc507-3781-4f59-a795-3d3ccf1028dd", "tag": "6a9ae06d-4914-44f8-98c6-08476b33f8d6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:03.258802 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3909b84c-89d6-480f-bd2a-d3da07b5b91a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1313 microversion: 2.1 time: 0.453880 Apr 30 21:19:03.259277 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1130/2312] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:02 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:03.289251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-113aa218-1f8d-409f-90a1-ea9d76e74cc6 req-57ef20cf-aa68-4ed0-b67b-538e236e2f1d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:03.289698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:03.290272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-113aa218-1f8d-409f-90a1-ea9d76e74cc6 req-57ef20cf-aa68-4ed0-b67b-538e236e2f1d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:03.290401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:03.302080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:03.304460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:03.306340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:03.309722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:03.315774 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-113aa218-1f8d-409f-90a1-ea9d76e74cc6 req-57ef20cf-aa68-4ed0-b67b-538e236e2f1d service nova] Creating event network-changed:6a9ae06d-4914-44f8-98c6-08476b33f8d6 for instance feabc507-3781-4f59-a795-3d3ccf1028dd on nch2-master-1 Apr 30 21:19:03.322617 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-113aa218-1f8d-409f-90a1-ea9d76e74cc6 req-57ef20cf-aa68-4ed0-b67b-538e236e2f1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070827 Apr 30 21:19:03.326264 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1183/2313] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:03.368427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:03.368985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:03.369516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lazy-loading 'fault' on Instance uuid 82314835-d00b-4591-9555-c35fb57a2d41 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:19:03.439356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe17212ef4a49fd954bbf17317ccd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c032d189cb14ea297194dffa380eae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:03.448247 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-396722c3-0fd3-469e-b72a-52415eb67fbf tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 200 len: 1359 microversion: 2.1 time: 0.187931 Apr 30 21:19:03.449019 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1131/2314] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:03 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:03.582818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:03.582818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:03.588885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:03.589364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:03.590245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:03.590695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:03.739364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:03.747936 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-365a8a07-009b-4ed7-86d1-57521d23aa6f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1316 microversion: 2.1 time: 0.173125 Apr 30 21:19:03.748910 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1184/2315] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:03 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:04.263236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:04.264023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:04.275755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.276448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:04.276996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:04.277200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.278838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.279736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.291087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.291828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.292857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.293737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.545956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:04.547608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:04.555482 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-50207190-74b3-426d-86df-7c33282ec0b9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1334 microversion: 2.1 time: 0.282901 Apr 30 21:19:04.556347 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1185/2316] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:04 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1334 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:04.565685 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8a22910-cb6e-471c-b6f3-40b6515fd01f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1317 microversion: 2.1 time: 0.301807 Apr 30 21:19:04.573704 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1132/2317] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:04 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:04.579425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:04.579425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] [instance: 82314835-d00b-4591-9555-c35fb57a2d41] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:04.589865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.592940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.594043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.594848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.611900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] HTTP exception thrown: Instance 82314835-d00b-4591-9555-c35fb57a2d41 could not be found. Apr 30 21:19:04.612746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Returning 404 to user: Instance 82314835-d00b-4591-9555-c35fb57a2d41 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:04.613892 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3da63038-f2dd-4064-a2b6-ebe0b5fa0383 tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41" status: 404 len: 111 microversion: 2.1 time: 0.044916 Apr 30 21:19:04.614863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1186/2318] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:04 2022] GET /compute/v2.1/servers/82314835-d00b-4591-9555-c35fb57a2d41 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:04.623221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3622ad68-cf27-40ed-a3d0-b6b3edaab87f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] Calling method '.version_select at 0x7fdc200da700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:04.726489 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3622ad68-cf27-40ed-a3d0-b6b3edaab87f tempest-ServersTestJSON-1064592018 tempest-ServersTestJSON-1064592018-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410651990" status: 202 len: 0 microversion: 2.1 time: 0.107525 Apr 30 21:19:04.731447 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1133/2319] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410651990 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:19:04.767551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:04.768630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:04.776150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.776585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.778174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.779242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.895378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a1f4ff7f-ca9b-4087-8cef-67b15049fe00 req-253a3fc2-4888-4fd4-b38c-a0ffee50273d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d77eab37-d34b-4e8c-9959-8d5661bf68fb", "name": "network-vif-plugged", "status": "completed", "tag": "1635337f-81ee-4aec-a704-cf2d3c4efa24"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:04.911978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a1f4ff7f-ca9b-4087-8cef-67b15049fe00 req-253a3fc2-4888-4fd4-b38c-a0ffee50273d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:04.912796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a1f4ff7f-ca9b-4087-8cef-67b15049fe00 req-253a3fc2-4888-4fd4-b38c-a0ffee50273d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:04.933264 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a1f4ff7f-ca9b-4087-8cef-67b15049fe00 req-253a3fc2-4888-4fd4-b38c-a0ffee50273d service nova] Creating event network-vif-plugged:1635337f-81ee-4aec-a704-cf2d3c4efa24 for instance d77eab37-d34b-4e8c-9959-8d5661bf68fb on nch1-master-1 Apr 30 21:19:04.950376 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a1f4ff7f-ca9b-4087-8cef-67b15049fe00 req-253a3fc2-4888-4fd4-b38c-a0ffee50273d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054970 Apr 30 21:19:04.950376 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1134/2320] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:05.192383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:05.192936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:05.209065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.209065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:05.209065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.209065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:05.246350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:19:05.394937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:05.420250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3b6a2de-3424-4d1d-a5be-c8713e49b42c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1316 microversion: 2.1 time: 0.656697 Apr 30 21:19:05.426015 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1187/2321] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:04 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:05.573903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:05.573903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:05.587287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.590841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:05.598951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.600952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:05.708369 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-db53808d-8cf1-497f-b13f-8a597ee154fd tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 204 len: 0 microversion: 2.1 time: 0.520920 Apr 30 21:19:05.709031 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1135/2322] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:19:05 2022] DELETE /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:19:05.717415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:05.718201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:05.726060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.727279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:05.731372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.732082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:05.904576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:05.913080 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d90261a-a8c8-44ec-82f3-4e580bcca093 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1334 microversion: 2.1 time: 0.344235 Apr 30 21:19:05.914243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1188/2323] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:05 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1334 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:05.920330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:05.920957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:05.927503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.928006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:05.929049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:05.929505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:06.106693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:06.128816 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0a42149-545e-4129-9f80-717582f80755 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1317 microversion: 2.1 time: 0.414886 Apr 30 21:19:06.148398 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1136/2324] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:05 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:06.202112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:06.213903 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c10a388-7508-4149-a188-065f15ecf116 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1513 microversion: 2.1 time: 0.298179 Apr 30 21:19:06.217107 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1189/2325] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:05 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:06.438935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:06.442703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:06.452960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:06.453225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:06.454217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:06.454823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:06.751085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:06.764620 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ce6b647f-4e88-4b24-a787-a585b8e7e5b4 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1316 microversion: 2.1 time: 0.330307 Apr 30 21:19:06.766424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1137/2326] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:06 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:06.933100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:06.934430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:06.943252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:06.946547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:06.946547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:06.946547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.146652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:07.147579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:07.156580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:07.170597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.171759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:07.172378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.207675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:07.219586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3aac7e47-7ab6-4a5e-80db-e465bdd2ada0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.290860 Apr 30 21:19:07.220487 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1190/2327] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:06 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:07.239921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:07.240864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:07.248772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:07.249470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.250718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:07.251302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.594050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:07.602782 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-017c07d0-e3d0-4d9f-8ba4-3e5bf742f724 tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1513 microversion: 2.1 time: 0.368972 Apr 30 21:19:07.615060 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1191/2328] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:07 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1513 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:07.630397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:07.640790 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d918ecf-f6b4-4dc4-a5cf-5b0a97937576 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1317 microversion: 2.1 time: 0.497675 Apr 30 21:19:07.641708 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1138/2329] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:07 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:07.782781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:07.783956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:07.792059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:07.792515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.793378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:07.793913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.943960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f8b52f69-922c-4d29-8ab7-ec802550728a req-353feb73-d095-41c6-bc48-9de5ccdf85fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "tag": "ea0a3881-d088-4954-b93d-4c3a924c97e3"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:07.958400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f8b52f69-922c-4d29-8ab7-ec802550728a req-353feb73-d095-41c6-bc48-9de5ccdf85fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:07.959330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f8b52f69-922c-4d29-8ab7-ec802550728a req-353feb73-d095-41c6-bc48-9de5ccdf85fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:07.974834 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f8b52f69-922c-4d29-8ab7-ec802550728a req-353feb73-d095-41c6-bc48-9de5ccdf85fe service nova] Creating event network-changed:ea0a3881-d088-4954-b93d-4c3a924c97e3 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:07.985264 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f8b52f69-922c-4d29-8ab7-ec802550728a req-353feb73-d095-41c6-bc48-9de5ccdf85fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046861 Apr 30 21:19:07.987912 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1139/2330] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:19:08.084163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:08.098089 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b0fb14e-ebc9-44b6-8b74-43a85bec61bf tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1316 microversion: 2.1 time: 0.313677 Apr 30 21:19:08.098089 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1192/2331] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:07 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:08.243117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:08.247037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:08.257740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:08.258440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:08.259598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:08.260178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:08.438892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-7f81b10a-73be-4789-9c1c-76225e87c2b1 req-36c9e665-3497-4388-b203-166c89395162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feabc507-3781-4f59-a795-3d3ccf1028dd", "name": "network-vif-plugged", "status": "completed", "tag": "6a9ae06d-4914-44f8-98c6-08476b33f8d6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:08.449177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7f81b10a-73be-4789-9c1c-76225e87c2b1 req-36c9e665-3497-4388-b203-166c89395162 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:08.450443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7f81b10a-73be-4789-9c1c-76225e87c2b1 req-36c9e665-3497-4388-b203-166c89395162 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:08.464215 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-7f81b10a-73be-4789-9c1c-76225e87c2b1 req-36c9e665-3497-4388-b203-166c89395162 service nova] Creating event network-vif-plugged:6a9ae06d-4914-44f8-98c6-08476b33f8d6 for instance feabc507-3781-4f59-a795-3d3ccf1028dd on nch2-master-1 Apr 30 21:19:08.471274 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-7f81b10a-73be-4789-9c1c-76225e87c2b1 req-36c9e665-3497-4388-b203-166c89395162 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045131 Apr 30 21:19:08.472372 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1193/2332] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:19:08.616382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:08.616382 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-be7566e3-e36f-45c2-a832-fcff16f2251d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.378951 Apr 30 21:19:08.616382 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1140/2333] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:08 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:08.621611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:08.622121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:08.629919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:08.630617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:08.631598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:08.632204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:08.659665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:08.660248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:08.674269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:08.679218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:08.679218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:08.679218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:08.954883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:08.967340 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0dcf71df-be5c-4422-9e13-152faf598dce tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1513 microversion: 2.1 time: 0.349822 Apr 30 21:19:08.976585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1194/2334] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:08 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1513 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:09.008953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:09.020954 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d678b5e0-03ab-42fb-835d-0febda1a4c2e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1467 microversion: 2.1 time: 0.365408 Apr 30 21:19:09.035526 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1141/2335] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:08 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1467 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:09.041109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fdc3d2af-f9e0-4135-8ff9-36689e19620c tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:09.041742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fdc3d2af-f9e0-4135-8ff9-36689e19620c tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:09.048890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdc3d2af-f9e0-4135-8ff9-36689e19620c tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:09.049616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdc3d2af-f9e0-4135-8ff9-36689e19620c tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:09.050898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdc3d2af-f9e0-4135-8ff9-36689e19620c tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:09.052046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdc3d2af-f9e0-4135-8ff9-36689e19620c tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:09.119018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:09.120084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:09.127625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:09.128865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:09.129691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:09.130177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:09.381243 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fdc3d2af-f9e0-4135-8ff9-36689e19620c tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1618 microversion: 2.1 time: 0.344254 Apr 30 21:19:09.382256 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1195/2336] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:09 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1618 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:09.442118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-26e6b53e-ef45-4d43-b288-0307c58bc165 req-4367eb0e-9237-4b38-a656-f7a215c432fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29ae768-e8c9-449d-88a7-042239f848c6", "name": "network-vif-deleted", "tag": "517c3e72-ce49-4940-a123-3deec175d114"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:09.466496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-26e6b53e-ef45-4d43-b288-0307c58bc165 req-4367eb0e-9237-4b38-a656-f7a215c432fa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:09.470297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-26e6b53e-ef45-4d43-b288-0307c58bc165 req-4367eb0e-9237-4b38-a656-f7a215c432fa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:09.479430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:09.486077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e54d3f0d-58f2-40b1-b473-3e3e6904a07c tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1316 microversion: 2.1 time: 0.377920 Apr 30 21:19:09.495424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1142/2337] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:09 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:09.503535 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-26e6b53e-ef45-4d43-b288-0307c58bc165 req-4367eb0e-9237-4b38-a656-f7a215c432fa service nova] Creating event network-vif-deleted:517c3e72-ce49-4940-a123-3deec175d114 for instance a29ae768-e8c9-449d-88a7-042239f848c6 on nch1-master-1 Apr 30 21:19:09.512877 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-26e6b53e-ef45-4d43-b288-0307c58bc165 req-4367eb0e-9237-4b38-a656-f7a215c432fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096003 Apr 30 21:19:09.515598 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1196/2338] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:09.554116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-13742144", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2190c553-068c-486e-b740-cca74445af33"]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:09.630555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:09.631289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:09.638842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:19:09.639828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:09.640307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:09.643391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:09.645702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.551373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:19:10.552346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:19:10.553006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:19:10.553609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:19:10.563066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:19:10.585707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.589706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.589706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.589706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.613427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:10.625741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:10.663368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:19:10.663368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:19:10.672507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:10.687562 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a1af09d8-ddb6-47e3-b260-608c0818f9ed tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 1.062319 Apr 30 21:19:10.692154 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1197/2339] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:09 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:10.702454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:10.703784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:10.713709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.716401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.720390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.722342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.800730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.801202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.801676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lazy-loading 'fault' on Instance uuid a29ae768-e8c9-449d-88a7-042239f848c6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:19:10.869844 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-592d7db0-34b7-4389-bbcd-daa8a1e15d34 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319802 Apr 30 21:19:10.870956 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1143/2340] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:19:10.877075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8dbfb86c-b8e6-4d7f-82fc-fc0fa97d06f6 req-a80455de-2873-4751-8a63-35ae0d059bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "tag": "82a0afc9-8d2a-4705-932d-3a178fa07cb5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:10.884731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993cfa563e564a5f924d7e75d118f1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c823086e6504aa0ac38c2b9b86970b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:10.892324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8dbfb86c-b8e6-4d7f-82fc-fc0fa97d06f6 req-a80455de-2873-4751-8a63-35ae0d059bb2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.895757 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-834089b4-50e6-4ac8-9fd9-2d95bfcb959c tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 200 len: 1307 microversion: 2.1 time: 0.202291 Apr 30 21:19:10.896177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8dbfb86c-b8e6-4d7f-82fc-fc0fa97d06f6 req-a80455de-2873-4751-8a63-35ae0d059bb2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.900280 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1198/2341] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:10 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:10.907764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:10.910013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:10.918647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.919865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.922640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:10.923694 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8dbfb86c-b8e6-4d7f-82fc-fc0fa97d06f6 req-a80455de-2873-4751-8a63-35ae0d059bb2 service nova] Creating event network-changed:82a0afc9-8d2a-4705-932d-3a178fa07cb5 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:10.924022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:10.935890 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8dbfb86c-b8e6-4d7f-82fc-fc0fa97d06f6 req-a80455de-2873-4751-8a63-35ae0d059bb2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062973 Apr 30 21:19:10.936487 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1144/2342] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:10.952058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23e908c0-7f37-4ce6-870e-5e8d188dbfba tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:10.954578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23e908c0-7f37-4ce6-870e-5e8d188dbfba tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:11.210883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23e908c0-7f37-4ce6-870e-5e8d188dbfba tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:11.229043 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23e908c0-7f37-4ce6-870e-5e8d188dbfba tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1215 microversion: 2.1 time: 0.289742 Apr 30 21:19:11.230101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1145/2343] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:10 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:11.380972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:11.396895 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb7d339e-8850-4bb2-ba3d-c45e94170896 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1466 microversion: 2.1 time: 0.494523 Apr 30 21:19:11.400041 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1199/2344] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:10 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1466 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:11.417021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:11.417649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:11.434473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:11.436218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:11.438008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:11.439354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:11.495130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:19:11.707132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:11.710846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:11.717004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:11.717809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:11.718863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:11.719497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:11.962744 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88efbf47-85db-45a4-93ab-df2f920f6610 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 204 len: 0 microversion: 2.1 time: 0.549036 Apr 30 21:19:11.968452 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1146/2345] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:19:11 2022] DELETE /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:19:11.978111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:11.979550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] [instance: a29ae768-e8c9-449d-88a7-042239f848c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:11.994131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:11.994602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:11.995719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:11.996380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:12.015324 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] HTTP exception thrown: Instance a29ae768-e8c9-449d-88a7-042239f848c6 could not be found. Apr 30 21:19:12.019387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] Returning 404 to user: Instance a29ae768-e8c9-449d-88a7-042239f848c6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:12.019387 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e0eefb42-ad6b-45e4-84f8-4bf45c9811be tempest-VolumesAdminNegativeTest-2051823524 tempest-VolumesAdminNegativeTest-2051823524-project] 10.222.0.23 "GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6" status: 404 len: 111 microversion: 2.1 time: 0.046962 Apr 30 21:19:12.019387 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1147/2346] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:11 2022] GET /compute/v2.1/servers/a29ae768-e8c9-449d-88a7-042239f848c6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:12.025613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:12.026290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:12.036621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:12.037301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:12.038369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:12.038989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:12.418713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:12.429846 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b29d7054-f2e1-4e8c-945e-da697da8192f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.726008 Apr 30 21:19:12.431815 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1200/2347] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:11 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:12.436999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:12.447359 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96ddcb1f-4e65-4991-8dc1-f03e9cb9b952 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1472 microversion: 2.1 time: 0.428662 Apr 30 21:19:12.447935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1148/2348] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:12 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:12.452452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:12.453094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:12.460377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:12.464543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:12.464543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:12.469714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:12.556107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:12.566076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7e02eeac-e6b5-40f2-9aea-79e38503ca1a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1219 microversion: 2.1 time: 0.123454 Apr 30 21:19:12.567176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1201/2349] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:12 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:12.988568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8105bf24-d19c-4a6a-8b2c-e2ad4010e8be req-41818d99-3335-4fcb-8a4c-100449e9a7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "tag": "3a11409b-ad7c-477a-a07c-22caf611b623"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:13.004019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8105bf24-d19c-4a6a-8b2c-e2ad4010e8be req-41818d99-3335-4fcb-8a4c-100449e9a7dd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:13.004485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8105bf24-d19c-4a6a-8b2c-e2ad4010e8be req-41818d99-3335-4fcb-8a4c-100449e9a7dd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:13.020861 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8105bf24-d19c-4a6a-8b2c-e2ad4010e8be req-41818d99-3335-4fcb-8a4c-100449e9a7dd service nova] Creating event network-changed:3a11409b-ad7c-477a-a07c-22caf611b623 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:13.030701 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8105bf24-d19c-4a6a-8b2c-e2ad4010e8be req-41818d99-3335-4fcb-8a4c-100449e9a7dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044780 Apr 30 21:19:13.033527 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1149/2350] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:13.448007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:13.448743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:13.460928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:13.461399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:13.462231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:13.465355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:13.466184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:13.468742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:13.478194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:13.478761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:13.484701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:13.485449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:13.970937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:13.981427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:13.995831 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e63796cc-4111-4af6-aca6-02a3341d1574 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.552141 Apr 30 21:19:13.996781 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1202/2351] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:13 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:14.001493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:14.008412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:14.012088 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11c3c263-7e4c-4c95-a679-ca542693865a tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1472 microversion: 2.1 time: 0.551105 Apr 30 21:19:14.020805 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1150/2352] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:13 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1472 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:14.024686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:14.025408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:14.026521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:14.027671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:14.120262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:14.142989 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7c79631-304b-4af6-b554-49a2b0ed1a59 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1285 microversion: 2.1 time: 0.144218 Apr 30 21:19:14.144421 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1203/2353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:13 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:15.015390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:15.016734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:15.026017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:15.029324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:15.032684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:15.038730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:15.039211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:15.042085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:15.067165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:15.071348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:15.074688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:15.074688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:15.329384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbaa860b758b49e78d244970875e509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65633a0f121948df985e316e3b459970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:15.352758 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a46de840-e9df-4337-ac0c-3292364f9b29 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 200 len: 1430 microversion: 2.1 time: 0.319628 Apr 30 21:19:15.353399 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1204/2354] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:15 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 1430 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:15.456192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:15.491035 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88811e44-82a8-44e7-bacb-0f560561be9e tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.477932 Apr 30 21:19:15.497747 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1151/2355] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:15 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:15.502229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:15.503200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:15.514078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:15.515444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:15.517708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:15.519053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:15.636232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-946590cd-2a3a-4000-966e-4f982b6a0313 tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] Calling method '.version_select at 0x7fdc21b169d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:15.645189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:15.678548 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-43f81968-ccee-4331-9d74-2cadef4fe2b0 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1273 microversion: 2.1 time: 0.177994 Apr 30 21:19:15.682932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1152/2356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:15 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:15.684797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0662b462-4fc7-4214-9013-c2c77f094526 req-bddd573e-a081-4234-ac90-5b1ce6f413a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feabc507-3781-4f59-a795-3d3ccf1028dd", "name": "network-vif-deleted", "tag": "6a9ae06d-4914-44f8-98c6-08476b33f8d6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:15.714778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0662b462-4fc7-4214-9013-c2c77f094526 req-bddd573e-a081-4234-ac90-5b1ce6f413a6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:15.715311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0662b462-4fc7-4214-9013-c2c77f094526 req-bddd573e-a081-4234-ac90-5b1ce6f413a6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:15.724512 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-946590cd-2a3a-4000-966e-4f982b6a0313 tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.360764 Apr 30 21:19:15.725456 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1205/2357] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:19:15 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:19:15.738036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea610a31-7b74-4a2e-ab01-923387eb7dd6 tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] Action: 'create', calling method: .version_select at 0x7fdc204b68b0>, body: {"pool": "non_exist_pool"} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:15.746864 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0662b462-4fc7-4214-9013-c2c77f094526 req-bddd573e-a081-4234-ac90-5b1ce6f413a6 service nova] Creating event network-vif-deleted:6a9ae06d-4914-44f8-98c6-08476b33f8d6 for instance feabc507-3781-4f59-a795-3d3ccf1028dd on nch2-master-1 Apr 30 21:19:15.753103 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0662b462-4fc7-4214-9013-c2c77f094526 req-bddd573e-a081-4234-ac90-5b1ce6f413a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072670 Apr 30 21:19:15.754547 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1153/2358] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:15.780584 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ea610a31-7b74-4a2e-ab01-923387eb7dd6 tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] HTTP exception thrown: Floating IP pool not found. Apr 30 21:19:15.781257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea610a31-7b74-4a2e-ab01-923387eb7dd6 tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] Returning 404 to user: Floating IP pool not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:15.782140 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea610a31-7b74-4a2e-ab01-923387eb7dd6 tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.048140 Apr 30 21:19:15.783035 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1206/2359] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:19:15 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:19:15.797343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03ef9813-ec30-4611-9083-0e983119f6df tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] Calling method '.version_select at 0x7fdc20148700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:15.849614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-03ef9813-ec30-4611-9083-0e983119f6df tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP da4dc498-59f3-42b8-935d-27e44a18dac0 could not be found", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:19:15.850578 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-03ef9813-ec30-4611-9083-0e983119f6df tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] HTTP exception thrown: Floating IP not found for ID da4dc498-59f3-42b8-935d-27e44a18dac0 Apr 30 21:19:15.854114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03ef9813-ec30-4611-9083-0e983119f6df tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] Returning 404 to user: Floating IP not found for ID da4dc498-59f3-42b8-935d-27e44a18dac0 {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:15.855128 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-03ef9813-ec30-4611-9083-0e983119f6df tempest-FloatingIPsNegativeTestJSON-106226063 tempest-FloatingIPsNegativeTestJSON-106226063-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/da4dc498-59f3-42b8-935d-27e44a18dac0" status: 404 len: 111 microversion: 2.1 time: 0.066494 Apr 30 21:19:15.855974 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1154/2360] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:19:15 2022] DELETE /compute/v2.1/os-floating-ips/da4dc498-59f3-42b8-935d-27e44a18dac0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:16.372031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:16.372689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:16.383100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.383556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.384354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.389440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.434145 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] HTTP exception thrown: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. Apr 30 21:19:16.434874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Returning 404 to user: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:16.437037 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2db8a3ac-37db-4771-842b-62c8b52a075f tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 404 len: 111 microversion: 2.1 time: 0.070804 Apr 30 21:19:16.438775 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1207/2361] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:16 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:16.448575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1305666636", "metadata": {"image_type": "test"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:16.451045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:16.461531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.462262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.463230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.463950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.480993 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] HTTP exception thrown: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. Apr 30 21:19:16.482065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Returning 404 to user: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:16.483327 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c258d27d-0e28-449d-bc7d-89deff23b56d tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "POST /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd/action" status: 404 len: 111 microversion: 2.1 time: 0.039801 Apr 30 21:19:16.484358 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1155/2362] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Apr 30 21:19:16 2022] POST /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:19:16.504016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53bf80df-d779-400b-bebb-2b9c0d9888d1 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-286605529", "metadata": {"image_type": "test"}}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:16.522245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-53bf80df-d779-400b-bebb-2b9c0d9888d1 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Failed to fetch instance by id tempest-invalid-1427568978 {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 30 21:19:16.522245 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-53bf80df-d779-400b-bebb-2b9c0d9888d1 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] HTTP exception thrown: Instance tempest-invalid-1427568978 could not be found. Apr 30 21:19:16.522245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53bf80df-d779-400b-bebb-2b9c0d9888d1 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Returning 404 to user: Instance tempest-invalid-1427568978 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:16.522245 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53bf80df-d779-400b-bebb-2b9c0d9888d1 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-1427568978/action" status: 404 len: 101 microversion: 2.1 time: 0.011652 Apr 30 21:19:16.522245 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1208/2363] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:19:16 2022] POST /compute/v2.1/servers/tempest-invalid-1427568978/action => generated 101 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:16.522868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:16.522868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:16.522868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.522868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.522868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.522868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.533999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f5ddb67f-8e9f-41f1-89be-4f11a9d180ae tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-691330784"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:16.535781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f5ddb67f-8e9f-41f1-89be-4f11a9d180ae tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 30 21:19:16.536514 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f5ddb67f-8e9f-41f1-89be-4f11a9d180ae tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 30 21:19:16.537556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f5ddb67f-8e9f-41f1-89be-4f11a9d180ae tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:16.538615 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f5ddb67f-8e9f-41f1-89be-4f11a9d180ae tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010531 Apr 30 21:19:16.540374 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1209/2364] 10.222.0.23 () {60 vars in 1274 bytes} [Sat Apr 30 21:19:16 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:16.551746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca18b00f-bb03-42bc-80df-d740d4c9fdf3 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1772955011"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:16.556754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ca18b00f-bb03-42bc-80df-d740d4c9fdf3 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 30 21:19:16.557612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ca18b00f-bb03-42bc-80df-d740d4c9fdf3 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 30 21:19:16.557950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca18b00f-bb03-42bc-80df-d740d4c9fdf3 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:16.560351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca18b00f-bb03-42bc-80df-d740d4c9fdf3 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.012688 Apr 30 21:19:16.566286 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1210/2365] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Apr 30 21:19:16 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:16.583693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:16.584745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:16.592352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.593299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.594483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.595738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.617130 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] HTTP exception thrown: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. Apr 30 21:19:16.618553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Returning 404 to user: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:16.619729 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f2f2a35-ac01-467e-bce0-f64572ed362e tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 404 len: 111 microversion: 2.1 time: 0.047646 Apr 30 21:19:16.624892 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1211/2366] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:19:16 2022] DELETE /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:19:16.631572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:16.632808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] [instance: feabc507-3781-4f59-a795-3d3ccf1028dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:16.641915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.645438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.645438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.645438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.672785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] HTTP exception thrown: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. Apr 30 21:19:16.672785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] Returning 404 to user: Instance feabc507-3781-4f59-a795-3d3ccf1028dd could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:16.672785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-539a7ec3-2b5e-4a9a-ba8a-0a5222cced99 tempest-ImagesNegativeTestJSON-858862984 tempest-ImagesNegativeTestJSON-858862984-project] 10.222.0.23 "GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd" status: 404 len: 111 microversion: 2.1 time: 0.046337 Apr 30 21:19:16.673929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1212/2367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:16 2022] GET /compute/v2.1/servers/feabc507-3781-4f59-a795-3d3ccf1028dd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:16.696451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:16.701500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:16.707225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.712313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:16.713527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:16.714269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:17.254512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:17.259912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:17.262271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-124f1c10-0b23-4b80-ae97-f1b0ae90b722 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.568786 Apr 30 21:19:17.263068 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1213/2368] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:16 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:17.272159 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e9f2b8c0-fb42-4973-bf68-e8cf21964e9d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.764675 Apr 30 21:19:17.273196 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1156/2369] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:16 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:18.287907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:18.289217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:18.296082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:18.296633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:18.296807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:18.303194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:18.304298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:18.310976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:18.314570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:18.315491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:18.316482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:18.317088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:19.103962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:19.114155 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc1aeb5b-7e7d-4f99-895b-1c357fbf15e8 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.832943 Apr 30 21:19:19.115226 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1214/2370] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:18 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:19.120305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-46b50589-580d-42f4-bcd5-cd69b817f02b req-48643c09-09bb-4aa8-9ce0-ab55a9ab6567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba12be1-263f-416d-8233-242286a6691d", "tag": "ec488b53-90c5-4824-86a9-6c69bb49fbe8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:19.126558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:19.157437 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7104ca5c-cf57-4023-9e58-1d8091a19057 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.866566 Apr 30 21:19:19.159889 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1157/2371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:18 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:19.172502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-46b50589-580d-42f4-bcd5-cd69b817f02b req-48643c09-09bb-4aa8-9ce0-ab55a9ab6567 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:19.174311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-46b50589-580d-42f4-bcd5-cd69b817f02b req-48643c09-09bb-4aa8-9ce0-ab55a9ab6567 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:19.200834 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-46b50589-580d-42f4-bcd5-cd69b817f02b req-48643c09-09bb-4aa8-9ce0-ab55a9ab6567 service nova] Creating event network-changed:ec488b53-90c5-4824-86a9-6c69bb49fbe8 for instance dba12be1-263f-416d-8233-242286a6691d on nch1-master-1 Apr 30 21:19:19.216179 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-46b50589-580d-42f4-bcd5-cd69b817f02b req-48643c09-09bb-4aa8-9ce0-ab55a9ab6567 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097659 Apr 30 21:19:19.219386 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1215/2372] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:20.135631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:20.138205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:20.162276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:20.163401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:20.164461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:20.165000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:20.177367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:20.178114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:20.192979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:20.195648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:20.196995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:20.199603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:20.535049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:20.543980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:20.546093 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-245a5a7f-6dbd-4e21-a9f9-8a282ef1e615 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.373469 Apr 30 21:19:20.550182 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1216/2373] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:20 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:20.553596 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c3f649cc-31a4-4d69-8525-1032906f19fa tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.424902 Apr 30 21:19:20.556702 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1158/2374] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:20 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:21.377209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b881f75-89bb-4d9f-8e3d-eedae7397fc8 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Action: 'create', calling method: .version_select at 0x7fdc202deee0>, body: {"keypair": {"name": "tempest-keypair-2062193834"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:21.410409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-4b881f75-89bb-4d9f-8e3d-eedae7397fc8 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:21.425697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-4b881f75-89bb-4d9f-8e3d-eedae7397fc8 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:21.569457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:21.571029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:21.584795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:21.585631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:21.586744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:21.587451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:21.701150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-4b881f75-89bb-4d9f-8e3d-eedae7397fc8 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:21.708143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-4b881f75-89bb-4d9f-8e3d-eedae7397fc8 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:21.724385 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b881f75-89bb-4d9f-8e3d-eedae7397fc8 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.742489 Apr 30 21:19:21.725536 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1217/2375] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:20 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:21.731805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:21.732500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:21.739341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:21.739928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:21.740740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:21.741244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:21.868117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:21.897173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2f8700d-534b-4b16-ab92-a6e30d597b6d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.329927 Apr 30 21:19:21.899024 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1159/2376] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:21 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:21.904970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e19a25e1-2707-4f15-8b8a-1304d62c707f tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc261c29d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:21.915769 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e19a25e1-2707-4f15-8b8a-1304d62c707f tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-2062193834" status: 200 len: 692 microversion: 2.1 time: 0.014548 Apr 30 21:19:21.928208 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1160/2377] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:19:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2062193834 => generated 692 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:21.941117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-13d3b4f4-080c-4631-8634-10b6a1ede852 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc2010ee50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:22.057531 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-13d3b4f4-080c-4631-8634-10b6a1ede852 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062193834" status: 202 len: 0 microversion: 2.1 time: 0.121436 Apr 30 21:19:22.059134 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1161/2378] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062193834 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:19:22.067619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:22.069295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f0254d27-1241-4cd7-8b0d-5865a7eae927 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Action: 'create', calling method: .version_select at 0x7fdc200c5e50>, body: {"keypair": {"name": "tempest-keypair-1963028915"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:22.077232 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7c6586c-fd1c-4fdb-b2ed-10e1737119e7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.350245 Apr 30 21:19:22.078640 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1218/2379] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:21 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:22.463345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f0254d27-1241-4cd7-8b0d-5865a7eae927 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:22.468471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f0254d27-1241-4cd7-8b0d-5865a7eae927 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:22.784043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f0254d27-1241-4cd7-8b0d-5865a7eae927 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:22.789464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f0254d27-1241-4cd7-8b0d-5865a7eae927 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:22.805775 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f0254d27-1241-4cd7-8b0d-5865a7eae927 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.740845 Apr 30 21:19:22.806855 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1162/2380] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:22 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:22.816096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13b27da0-7b7f-4402-b900-a688b38e1eb5 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc204b9700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:22.896842 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-13b27da0-7b7f-4402-b900-a688b38e1eb5 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963028915" status: 202 len: 0 microversion: 2.1 time: 0.084582 Apr 30 21:19:22.897657 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1219/2381] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:19:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963028915 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:19:22.908281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14c9eb7e-3d17-493f-9e63-3f08560cbf0c tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Action: 'create', calling method: .version_select at 0x7fdc200b0820>, body: {"keypair": {"name": "tempest-keypair-1337982011", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:22.919587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:22.920660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:22.927761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-14c9eb7e-3d17-493f-9e63-3f08560cbf0c tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:22.952170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-14c9eb7e-3d17-493f-9e63-3f08560cbf0c tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:22.963654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:22.968411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:22.972541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:22.974435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:23.069872 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14c9eb7e-3d17-493f-9e63-3f08560cbf0c tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.165391 Apr 30 21:19:23.072619 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1163/2382] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Apr 30 21:19:22 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:23.081879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ce2976a7-ab14-4270-beb9-fc24bc87fe3a tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc2010ed30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:23.214113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ce2976a7-ab14-4270-beb9-fc24bc87fe3a tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337982011" status: 202 len: 0 microversion: 2.1 time: 0.137219 Apr 30 21:19:23.215183 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1164/2383] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:19:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337982011 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:19:23.222751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:23.223924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:23.231428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:23.231970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:23.232856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:23.233582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:23.235294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:23.243773 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e18c6d6a-b9a5-4896-98bb-bb2ca3e5fbb2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.332069 Apr 30 21:19:23.244729 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1220/2384] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:22 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:23.314086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1293233492", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5c8b504b-43e7-4642-bbf0-dab49293fda8"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:23.374677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] validate_networks() for [('5c8b504b-43e7-4642-bbf0-dab49293fda8', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:19:23.562259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:23.572564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4dcb39e0-c8be-4d8a-b1b8-af01e68bf518 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.356030 Apr 30 21:19:23.575619 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1165/2385] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:23 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:23.580665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7fef356a-5ebb-485c-9cf1-29bcb34b7f51 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Action: 'create', calling method: .version_select at 0x7fdc261185e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2038566838"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:23.611563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7fef356a-5ebb-485c-9cf1-29bcb34b7f51 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:23.619565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7fef356a-5ebb-485c-9cf1-29bcb34b7f51 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:23.940414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:19:23.941797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:19:23.942450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:19:23.942892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:19:23.943474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:19:23.956146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:23.958493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:23.961237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:23.962381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:23.982688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:23.990187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for user 2f5eafa970bd4247bdaef1cda747c3fc and project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:24.005326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:19:24.009154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:19:24.179016 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d157de7-498b-4cd0-8abb-aea2d646b580 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932936 Apr 30 21:19:24.180898 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1221/2386] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:19:24.190934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f0a8651b-bd27-4dbe-99e1-6b8f81f06787 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:24.192900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f0a8651b-bd27-4dbe-99e1-6b8f81f06787 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:24.263744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f0a8651b-bd27-4dbe-99e1-6b8f81f06787 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:24.306092 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f0a8651b-bd27-4dbe-99e1-6b8f81f06787 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1215 microversion: 2.1 time: 0.118143 Apr 30 21:19:24.309439 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1222/2387] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:24 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:24.327161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:24.327861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:24.335921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:24.336842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:24.338828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:24.339329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:24.504750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7fef356a-5ebb-485c-9cf1-29bcb34b7f51 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:24.511825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7fef356a-5ebb-485c-9cf1-29bcb34b7f51 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:24.540203 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7fef356a-5ebb-485c-9cf1-29bcb34b7f51 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.963139 Apr 30 21:19:24.546739 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1166/2388] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:23 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:24.551823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:24.553653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bcda3b57-1b82-411f-8999-ca095a8b4058 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Action: 'create', calling method: .version_select at 0x7fdc2010e1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-847752394"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:24.562795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b91ba509-a506-4719-8144-55f4f8dbb261 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.250993 Apr 30 21:19:24.564538 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1223/2389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:24 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:24.583339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bcda3b57-1b82-411f-8999-ca095a8b4058 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:24.590537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bcda3b57-1b82-411f-8999-ca095a8b4058 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:24.606973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:24.611077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:24.622902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:24.624049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:24.625317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:24.626317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:24.832826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bcda3b57-1b82-411f-8999-ca095a8b4058 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:24.846399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bcda3b57-1b82-411f-8999-ca095a8b4058 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:24.864104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:24.874902 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-00a393f6-0f3c-4f75-869a-376c97604b92 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.285133 Apr 30 21:19:24.874902 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1224/2390] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:24 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:24.880612 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bcda3b57-1b82-411f-8999-ca095a8b4058 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.332601 Apr 30 21:19:24.881382 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1167/2391] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:24 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:24.893040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-253c894d-0400-4b72-aa0c-5b36d55dc252 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Action: 'create', calling method: .version_select at 0x7fdc21b16280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-195205127"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:24.907178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-253c894d-0400-4b72-aa0c-5b36d55dc252 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:24.912534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-253c894d-0400-4b72-aa0c-5b36d55dc252 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:25.251493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-253c894d-0400-4b72-aa0c-5b36d55dc252 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:25.257291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-253c894d-0400-4b72-aa0c-5b36d55dc252 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Getting quotas for user 9fd9d23535c74127a6758a9653515e78 and project 1ccfd8608a3848688dd16c89d054011d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:25.296016 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-253c894d-0400-4b72-aa0c-5b36d55dc252 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.406571 Apr 30 21:19:25.296651 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1225/2392] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:24 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:25.312156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55379b33-93df-46da-b561-f94c6c00944a tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc26118790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:25.316800 ncdv-master-1 devstack@n-api.service[130670]: WARNING oslo_db.sqlalchemy.utils [None req-55379b33-93df-46da-b561-f94c6c00944a tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 30 21:19:25.339813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9fbcb690-6c66-451a-aaf4-a849925c760f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:25.343186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9fbcb690-6c66-451a-aaf4-a849925c760f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:25.347212 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55379b33-93df-46da-b561-f94c6c00944a tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1674 microversion: 2.1 time: 0.044549 Apr 30 21:19:25.347820 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1168/2393] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:19:25 2022] GET /compute/v2.1/os-keypairs => generated 1674 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:25.364835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4ae0490-8f8d-4d11-bd62-bfe46bc92798 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc26121dc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:25.468746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9fbcb690-6c66-451a-aaf4-a849925c760f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:25.478270 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9fbcb690-6c66-451a-aaf4-a849925c760f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1215 microversion: 2.1 time: 0.154630 Apr 30 21:19:25.479270 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1226/2394] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:25 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:25.494262 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4ae0490-8f8d-4d11-bd62-bfe46bc92798 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-195205127" status: 202 len: 0 microversion: 2.1 time: 0.140089 Apr 30 21:19:25.494851 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1169/2395] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-195205127 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:19:25.504653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70d331f1-63a5-4dae-9a6b-806ca305bdc4 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc261219d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:25.662639 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70d331f1-63a5-4dae-9a6b-806ca305bdc4 tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-847752394" status: 202 len: 0 microversion: 2.1 time: 0.162184 Apr 30 21:19:25.665114 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1170/2396] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-847752394 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:19:25.672513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:25.673464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:25.681454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:25.682103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:25.683687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:25.684771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:25.833551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-237a192e-dd50-4a1c-89b2-4f6c6950fd86 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc2112f3a0>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:25.841301 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-237a192e-dd50-4a1c-89b2-4f6c6950fd86 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Apr 30 21:19:25.842194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-237a192e-dd50-4a1c-89b2-4f6c6950fd86 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:25.843231 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-237a192e-dd50-4a1c-89b2-4f6c6950fd86 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.362157 Apr 30 21:19:25.849296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1227/2397] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 369 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:19:25.854555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:25.855823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43055ceb-fbd9-416c-b5e7-626eff0096cc tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] Calling method '.version_select at 0x7fdc204b6310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:25.863182 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f81a4d4-4977-4ac5-9fba-74f1cb7cbace tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.196491 Apr 30 21:19:25.863854 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1171/2398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:25 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:25.875198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-dc80adc3-324c-4564-bdbf-f7b2622d87eb req-d8dc5810-feaa-4f40-a7d5-e593064aad90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-plugged", "status": "completed", "tag": "82a0afc9-8d2a-4705-932d-3a178fa07cb5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:25.884244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dc80adc3-324c-4564-bdbf-f7b2622d87eb req-d8dc5810-feaa-4f40-a7d5-e593064aad90 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:25.884696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dc80adc3-324c-4564-bdbf-f7b2622d87eb req-d8dc5810-feaa-4f40-a7d5-e593064aad90 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:25.897701 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-dc80adc3-324c-4564-bdbf-f7b2622d87eb req-d8dc5810-feaa-4f40-a7d5-e593064aad90 service nova] Creating event network-vif-plugged:82a0afc9-8d2a-4705-932d-3a178fa07cb5 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:25.903660 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-dc80adc3-324c-4564-bdbf-f7b2622d87eb req-d8dc5810-feaa-4f40-a7d5-e593064aad90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038532 Apr 30 21:19:25.904256 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1172/2399] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:25.916372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f59208fe-2e74-4bb7-a65a-bff796e16066 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc26118dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-897197365", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:25.928978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f59208fe-2e74-4bb7-a65a-bff796e16066 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:25.936647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f59208fe-2e74-4bb7-a65a-bff796e16066 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for user e37a7aec6d1c407aa24173ef6edc51f5 and project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:25.957396 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-f59208fe-2e74-4bb7-a65a-bff796e16066 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 30 21:19:25.961654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f59208fe-2e74-4bb7-a65a-bff796e16066 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:25.961830 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43055ceb-fbd9-416c-b5e7-626eff0096cc tempest-KeyPairsV2TestJSON-1967202920 tempest-KeyPairsV2TestJSON-1967202920-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2038566838" status: 202 len: 0 microversion: 2.1 time: 0.108015 Apr 30 21:19:25.961937 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f59208fe-2e74-4bb7-a65a-bff796e16066 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.052808 Apr 30 21:19:25.962027 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1228/2400] 10.222.0.23 () {58 vars in 1277 bytes} [Sat Apr 30 21:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2038566838 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:19:25.962113 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1173/2401] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Apr 30 21:19:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:25.965337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:25.966781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:25.975941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c07cce1b-9398-4bb3-8133-5e9104b91f64 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc26109c10>, body: {"keypair": {"name": "tempest-keypair-1149880332"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:25.981913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:25.982384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:25.983210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:25.983661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:26.004225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c07cce1b-9398-4bb3-8133-5e9104b91f64 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:26.014546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c07cce1b-9398-4bb3-8133-5e9104b91f64 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for user e37a7aec6d1c407aa24173ef6edc51f5 and project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:26.244512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:26.253539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6e8463b-ed2b-4cb0-b4cf-82b2769e099a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.292688 Apr 30 21:19:26.255105 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1229/2402] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:25 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:26.495070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:26.496231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:26.516540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:26.517713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:26.520681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:26.522284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:26.629327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:26.637786 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-609790d3-b17c-4584-befc-11fa5175d559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1267 microversion: 2.1 time: 0.146456 Apr 30 21:19:26.638164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c07cce1b-9398-4bb3-8133-5e9104b91f64 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:26.643932 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1230/2403] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:26 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:26.645355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c07cce1b-9398-4bb3-8133-5e9104b91f64 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for user e37a7aec6d1c407aa24173ef6edc51f5 and project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:26.662332 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c07cce1b-9398-4bb3-8133-5e9104b91f64 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.691097 Apr 30 21:19:26.663538 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1174/2404] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:25 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:26.675397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-475bdc7b-7983-4ebd-bf3f-5cb67eea2004 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc20cfa1f0>, body: {"keypair": {"name": "tempest-keypair-1149880332"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:26.708291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-475bdc7b-7983-4ebd-bf3f-5cb67eea2004 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:26.720390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-475bdc7b-7983-4ebd-bf3f-5cb67eea2004 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for user e37a7aec6d1c407aa24173ef6edc51f5 and project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:26.882211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:26.882972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:26.890455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:26.890928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:26.891730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:26.892387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:26.909153 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-475bdc7b-7983-4ebd-bf3f-5cb67eea2004 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] HTTP exception thrown: Key pair 'tempest-keypair-1149880332' already exists. Apr 30 21:19:26.909819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-475bdc7b-7983-4ebd-bf3f-5cb67eea2004 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 409 to user: Key pair 'tempest-keypair-1149880332' already exists. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:26.910938 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-475bdc7b-7983-4ebd-bf3f-5cb67eea2004 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.240322 Apr 30 21:19:26.911728 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1231/2405] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:26 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 242 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:19:26.921346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cfbc3bf7-4bc4-4e53-a680-8b22864e96b6 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Calling method '.version_select at 0x7fdc2063c790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:27.053083 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cfbc3bf7-4bc4-4e53-a680-8b22864e96b6 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149880332" status: 202 len: 0 microversion: 2.1 time: 0.135031 Apr 30 21:19:27.062045 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1232/2406] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149880332 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:19:27.079399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e0dfcbb5-916e-49fa-af6d-8cbd7c51a7b9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc20cfa0d0>, body: {"keypair": {"name": ""}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:27.080914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e0dfcbb5-916e-49fa-af6d-8cbd7c51a7b9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:27.088174 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e0dfcbb5-916e-49fa-af6d-8cbd7c51a7b9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020937 Apr 30 21:19:27.089340 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1233/2407] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:27 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:19:27.099139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-24ed2314-6de8-45fb-a9d4-c6bb047300ad tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc204b68b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-583328319", "public_key": " "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:27.146424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-24ed2314-6de8-45fb-a9d4-c6bb047300ad tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:27.152442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:27.159203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-24ed2314-6de8-45fb-a9d4-c6bb047300ad tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for user e37a7aec6d1c407aa24173ef6edc51f5 and project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:27.162378 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-73457899-7e17-4abd-bfb9-4d7feb1a01f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.284050 Apr 30 21:19:27.173092 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1175/2408] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:26 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:27.199445 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-24ed2314-6de8-45fb-a9d4-c6bb047300ad tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 30 21:19:27.201398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-24ed2314-6de8-45fb-a9d4-c6bb047300ad tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:27.202494 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-24ed2314-6de8-45fb-a9d4-c6bb047300ad tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.107719 Apr 30 21:19:27.204290 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1234/2409] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:27.216761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e18444a3-62ad-4d35-91dc-10435a2cc078 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc26102f70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:27.218734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e18444a3-62ad-4d35-91dc-10435a2cc078 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:27.220040 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e18444a3-62ad-4d35-91dc-10435a2cc078 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009954 Apr 30 21:19:27.221137 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1176/2410] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Apr 30 21:19:27 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:19:27.232285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c6a6e5a-f801-4b96-8bcb-aed4a27f93f9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Action: 'create', calling method: .version_select at 0x7fdc20e13280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1790144177", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:27.291333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3c6a6e5a-f801-4b96-8bcb-aed4a27f93f9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:27.294173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:27.294803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:27.301720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3c6a6e5a-f801-4b96-8bcb-aed4a27f93f9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Getting quotas for user e37a7aec6d1c407aa24173ef6edc51f5 and project 397b6d767bff4e108a34ab76861ac5e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:27.317490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:27.317962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:27.321568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:27.326967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:27.327683 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3c6a6e5a-f801-4b96-8bcb-aed4a27f93f9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 30 21:19:27.329810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c6a6e5a-f801-4b96-8bcb-aed4a27f93f9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:27.331111 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c6a6e5a-f801-4b96-8bcb-aed4a27f93f9 tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.104305 Apr 30 21:19:27.332410 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1235/2411] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Apr 30 21:19:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:27.365103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eca85edd-7b26-400d-b985-6333557aa75d tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Calling method '.version_select at 0x7fdc2112a3a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:27.385082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-eca85edd-7b26-400d-b985-6333557aa75d tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1387913466 not found for user e37a7aec6d1c407aa24173ef6edc51f5 Apr 30 21:19:27.387020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eca85edd-7b26-400d-b985-6333557aa75d tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1387913466 not found for user e37a7aec6d1c407aa24173ef6edc51f5 {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:27.388945 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eca85edd-7b26-400d-b985-6333557aa75d tempest-KeyPairsNegativeTestJSON-167451646 tempest-KeyPairsNegativeTestJSON-167451646-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1387913466" status: 404 len: 145 microversion: 2.1 time: 0.049984 Apr 30 21:19:27.389787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1236/2412] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1387913466 => generated 145 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:27.641985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:27.656808 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8d9952be-ba8a-40ed-93d2-872fc207a6d9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.373267 Apr 30 21:19:27.662668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:27.663306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:27.667967 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1177/2413] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:27 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:27.673805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:27.674266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:27.675117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:27.675695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:27.768017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:27.776550 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08952d3b-6e83-4817-9767-5810031933ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1273 microversion: 2.1 time: 0.119091 Apr 30 21:19:27.790541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1237/2414] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:27 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:27.946916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b72018d8-27ac-4b82-808e-eda2a7422209 req-ccea9000-da4e-462a-b205-e71ab5b9e439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba12be1-263f-416d-8233-242286a6691d", "name": "network-vif-plugged", "status": "completed", "tag": "ec488b53-90c5-4824-86a9-6c69bb49fbe8"}, {"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-plugged", "status": "completed", "tag": "3a11409b-ad7c-477a-a07c-22caf611b623"}, {"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-plugged", "status": "completed", "tag": "ea0a3881-d088-4954-b93d-4c3a924c97e3"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:27.965493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b72018d8-27ac-4b82-808e-eda2a7422209 req-ccea9000-da4e-462a-b205-e71ab5b9e439 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:27.966432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b72018d8-27ac-4b82-808e-eda2a7422209 req-ccea9000-da4e-462a-b205-e71ab5b9e439 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:27.980969 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b72018d8-27ac-4b82-808e-eda2a7422209 req-ccea9000-da4e-462a-b205-e71ab5b9e439 service nova] Creating event network-vif-plugged:ec488b53-90c5-4824-86a9-6c69bb49fbe8 for instance dba12be1-263f-416d-8233-242286a6691d on nch1-master-1 Apr 30 21:19:27.981570 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b72018d8-27ac-4b82-808e-eda2a7422209 req-ccea9000-da4e-462a-b205-e71ab5b9e439 service nova] Creating event network-vif-plugged:3a11409b-ad7c-477a-a07c-22caf611b623 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:27.982452 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b72018d8-27ac-4b82-808e-eda2a7422209 req-ccea9000-da4e-462a-b205-e71ab5b9e439 service nova] Creating event network-vif-plugged:ea0a3881-d088-4954-b93d-4c3a924c97e3 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:27.991956 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b72018d8-27ac-4b82-808e-eda2a7422209 req-ccea9000-da4e-462a-b205-e71ab5b9e439 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055629 Apr 30 21:19:27.993356 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1178/2415] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:28.183780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:28.195488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:28.195488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:28.195488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:28.195488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:28.195488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:28.427842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:28.445387 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bddd1ae2-d84b-403d-9b09-4666b9ed16ef tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.266437 Apr 30 21:19:28.446633 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1238/2416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:28 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:28.675998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:28.678593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:28.697080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:28.697726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:28.698739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:28.699252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:28.798190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:28.798898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:28.810838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:28.812085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:28.814467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:28.815160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:28.957388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:28.972869 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3370a9a6-ed9b-4341-ad1a-b414eaa3d450 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1315 microversion: 2.1 time: 0.298359 Apr 30 21:19:28.973985 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1179/2417] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:28 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:29.101626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:29.110929 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-81fdb14f-5c71-427d-b973-bbbab9084afd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 0.316856 Apr 30 21:19:29.111761 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1239/2418] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:28 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:29.462745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:29.463387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:29.477512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:29.478006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:29.478891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:29.479351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:29.830632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:29.838292 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ef143ae0-1898-41e8-976e-643ef08eb9e2 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1355 microversion: 2.1 time: 0.379481 Apr 30 21:19:29.851880 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1180/2419] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:29 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1355 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:29.991155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:29.992495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:30.000665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.001453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.006539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.006539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.131191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:30.131823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:30.145646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.147346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.148182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.148645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.312796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:30.326956 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-44bf4a7b-0e8d-452c-bd8e-2b46caa8b7b2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1465 microversion: 2.1 time: 0.337746 Apr 30 21:19:30.343962 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1240/2420] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:29 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1465 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:30.363254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-084c8b74-239d-499e-abf4-a1b8275fb2fb tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:30.364206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-084c8b74-239d-499e-abf4-a1b8275fb2fb tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:30.371979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-084c8b74-239d-499e-abf4-a1b8275fb2fb tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.372650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-084c8b74-239d-499e-abf4-a1b8275fb2fb tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.373627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-084c8b74-239d-499e-abf4-a1b8275fb2fb tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.374274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-084c8b74-239d-499e-abf4-a1b8275fb2fb tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.708705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:30.722699 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f8691200-4c89-4469-8315-11b799381dd2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 0.596533 Apr 30 21:19:30.723674 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1181/2421] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:30 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:30.757309 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-084c8b74-239d-499e-abf4-a1b8275fb2fb tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1616 microversion: 2.1 time: 0.397768 Apr 30 21:19:30.766064 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1241/2422] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:30 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1616 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:30.857474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:30.858209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:30.867344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.871932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.874470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.881152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.900502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d5bb9078-fd2c-42ec-a472-10aa954cda36 req-b227ca2c-75e8-4f9f-8301-8c2bb12e1e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12defef4-f959-4394-a3e1-14296a084329", "tag": "eadb6f33-647b-4991-9dd1-e334e89fcb4c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:30.916705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d5bb9078-fd2c-42ec-a472-10aa954cda36 req-b227ca2c-75e8-4f9f-8301-8c2bb12e1e1c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:30.928792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d5bb9078-fd2c-42ec-a472-10aa954cda36 req-b227ca2c-75e8-4f9f-8301-8c2bb12e1e1c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:30.958847 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d5bb9078-fd2c-42ec-a472-10aa954cda36 req-b227ca2c-75e8-4f9f-8301-8c2bb12e1e1c service nova] Creating event network-changed:eadb6f33-647b-4991-9dd1-e334e89fcb4c for instance 12defef4-f959-4394-a3e1-14296a084329 on nch2-master-1 Apr 30 21:19:30.971523 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d5bb9078-fd2c-42ec-a472-10aa954cda36 req-b227ca2c-75e8-4f9f-8301-8c2bb12e1e1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075175 Apr 30 21:19:30.973167 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1242/2423] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:30.990558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1058384514", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2190c553-068c-486e-b740-cca74445af33"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:31.059806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:19:31.423550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:31.436774 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96c64138-491f-4d23-aeb5-9c12516f0bc0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1806 microversion: 2.1 time: 0.583590 Apr 30 21:19:31.450021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1182/2424] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:30 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1806 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:31.455544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-003a7d5a-6e13-44ea-9bc0-092ec1b78eff tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:31.456078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-003a7d5a-6e13-44ea-9bc0-092ec1b78eff tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:31.463908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-003a7d5a-6e13-44ea-9bc0-092ec1b78eff tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:31.468936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-003a7d5a-6e13-44ea-9bc0-092ec1b78eff tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:31.468936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-003a7d5a-6e13-44ea-9bc0-092ec1b78eff tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:31.468936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-003a7d5a-6e13-44ea-9bc0-092ec1b78eff tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:31.503903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-003a7d5a-6e13-44ea-9bc0-092ec1b78eff tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab/ips" status: 200 len: 219 microversion: 2.1 time: 0.052320 Apr 30 21:19:31.510153 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1183/2425] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:19:31 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab/ips => generated 219 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:31.516166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:31.517141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:31.525310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:31.525310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:31.525310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:31.525825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:31.556409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:19:31.935792 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b34b8a84-574d-4da9-8c13-1e08e58ffd28 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 204 len: 0 microversion: 2.1 time: 0.423999 Apr 30 21:19:31.936479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1184/2426] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:19:31 2022] DELETE /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:19:31.942008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:31.942861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:31.949717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:31.950617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:31.951704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:31.952259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:32.073079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:19:32.074616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:19:32.075211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:19:32.075730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:19:32.076251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:19:32.099774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:32.101099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:32.101731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:32.102297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:32.137682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:32.148233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Getting quotas for user 1961bb1779214710bc073d188262f1fb and project 327a580f2f8645c28e9590806928ed91. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:32.149094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:32.162921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c491de56-11a8-4b67-9c47-5fe12eb31166 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 0.224694 Apr 30 21:19:32.172174 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1185/2427] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:31 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:32.182934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:19:32.185973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:19:32.332968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-477648627", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "98b1dbd8-5abb-448b-9acd-f922dee70a3d"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:32.398665 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dae92245-c2c2-41c6-b2cd-604f8051302c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422652 Apr 30 21:19:32.406273 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1243/2428] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:19:32.420739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:32.421594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:32.425124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] validate_networks() for [('98b1dbd8-5abb-448b-9acd-f922dee70a3d', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:19:32.434951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:32.434951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:32.435773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:32.436393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:32.881926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:32.893616 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-07737302-1d9c-4920-9f57-f95dab2f58d8 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1812 microversion: 2.1 time: 0.485535 Apr 30 21:19:32.896331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1244/2429] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:32 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1812 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:32.912721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90dc1c17-0596-4a7f-9c22-bb7f9da11242 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:32.914664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90dc1c17-0596-4a7f-9c22-bb7f9da11242 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:33.007312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90dc1c17-0596-4a7f-9c22-bb7f9da11242 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:33.020843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90dc1c17-0596-4a7f-9c22-bb7f9da11242 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1217 microversion: 2.1 time: 0.122964 Apr 30 21:19:33.038426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1245/2430] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:32 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:33.180368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:33.192724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:33.194426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:33.196594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:33.197734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:33.206256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:33.598831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:19:33.599378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:19:33.599747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:19:33.600169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:19:33.600600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:19:33.616777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:33.617515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:33.618557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:33.619186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:33.648868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Getting quotas for project 6cebc4a4f75349b09fd03f67d0207875. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:33.654863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Getting quotas for user a75959d37cbf4c9b8482e480a0888246 and project 6cebc4a4f75349b09fd03f67d0207875. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:33.668610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:19:33.671324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:19:33.694800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:33.705499 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dfbb7c26-42a7-4601-bdb4-0d99d28be15e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 0.529226 Apr 30 21:19:33.707215 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1246/2431] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:33 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:33.851515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3dd8f584-e986-45f1-8bdc-ffd1980d57ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686638 Apr 30 21:19:33.852651 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1186/2432] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:19:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:19:33.862883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cff881d0-bfaf-4bba-a154-115243e26348 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:33.864055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cff881d0-bfaf-4bba-a154-115243e26348 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:33.914680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:33.915309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:33.938288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:33.939017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:33.941303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:33.946446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:34.084491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cff881d0-bfaf-4bba-a154-115243e26348 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:34.095809 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cff881d0-bfaf-4bba-a154-115243e26348 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1223 microversion: 2.1 time: 0.236785 Apr 30 21:19:34.110651 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1247/2433] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:33 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1223 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:34.117129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:34.118000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:34.127764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:34.128508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:34.129926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:34.130554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:34.312489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:34.322904 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18cde0a8-1390-4c1a-a73a-9c731a393f94 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1221 microversion: 2.1 time: 0.210676 Apr 30 21:19:34.333042 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1248/2434] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:34 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:34.407042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:34.416492 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96d885ae-ab20-414e-b7dc-9b300fffb767 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1812 microversion: 2.1 time: 0.506172 Apr 30 21:19:34.417973 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1187/2435] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:33 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1812 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:34.725295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:34.726332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:34.738566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:34.739357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:34.740356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:34.740974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:35.119031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-118f026b-2149-43e5-9794-76a66a2a934d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:35.119643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-118f026b-2149-43e5-9794-76a66a2a934d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:35.294493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-118f026b-2149-43e5-9794-76a66a2a934d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:35.303532 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-118f026b-2149-43e5-9794-76a66a2a934d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1223 microversion: 2.1 time: 0.190611 Apr 30 21:19:35.305393 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1188/2436] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:35 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1223 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:35.341301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:35.343067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:35.350730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:35.353645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:35.353645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:35.353645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:35.669243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:35.713264 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aa64089d-25e8-4c5a-9c4f-901670d2f62f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1269 microversion: 2.1 time: 0.368625 Apr 30 21:19:35.713264 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1189/2437] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:35 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1269 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:35.730810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:35.738131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:35.747371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:35.748800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:35.750076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:35.750763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:35.888676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:35.898529 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9ecaa594-846f-4eb6-a690-70a4191ce2f6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 1.177189 Apr 30 21:19:35.900040 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1249/2438] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:34 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:36.290751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:36.306918 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a7945ae-c6a6-45d1-9013-a5a2e781a7ec tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1812 microversion: 2.1 time: 0.596289 Apr 30 21:19:36.307572 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1190/2439] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:35 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1812 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:36.322447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:36.323669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:36.334288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:36.335177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:36.340039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:36.340039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:36.532458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:36.542437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-933d4e30-49b0-4194-b432-5dfb04045f1e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1219 microversion: 2.1 time: 0.224060 Apr 30 21:19:36.544598 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1250/2440] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:36 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1219 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:36.725609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:36.726380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:36.739186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:36.758091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:36.758091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:36.758091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:36.918480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:36.919714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:36.938798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:36.940129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:36.941290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:36.942055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:37.037486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:37.054265 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-52426c50-aa3a-4523-a9e5-3f8627f31eee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1275 microversion: 2.1 time: 0.332710 Apr 30 21:19:37.069542 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1191/2441] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:36 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:37.154402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0c90e8bc-ad93-4e5d-86c7-c8145d4a02de req-599968cb-547b-4b1a-89fe-4c50b87110fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-deleted", "tag": "3a11409b-ad7c-477a-a07c-22caf611b623"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:37.164657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0c90e8bc-ad93-4e5d-86c7-c8145d4a02de req-599968cb-547b-4b1a-89fe-4c50b87110fb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:37.171376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0c90e8bc-ad93-4e5d-86c7-c8145d4a02de req-599968cb-547b-4b1a-89fe-4c50b87110fb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:37.193416 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0c90e8bc-ad93-4e5d-86c7-c8145d4a02de req-599968cb-547b-4b1a-89fe-4c50b87110fb service nova] Creating event network-vif-deleted:3a11409b-ad7c-477a-a07c-22caf611b623 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:37.203617 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0c90e8bc-ad93-4e5d-86c7-c8145d4a02de req-599968cb-547b-4b1a-89fe-4c50b87110fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057669 Apr 30 21:19:37.205802 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1192/2442] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:19:37.326069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:37.327564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:37.337817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:37.338285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:37.345237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:37.346013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:37.968068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:37.978907 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b70adfc4-6c4f-48a1-8dfa-a4c938ee491f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 1.065785 Apr 30 21:19:37.981564 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1251/2443] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:36 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:38.009936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:38.011306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:38.021672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:38.022468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:38.027314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:38.027975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:38.091301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:38.157880 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0fcbec70-4937-48a9-9d5a-a3d778d5be4c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1676 microversion: 2.1 time: 0.830499 Apr 30 21:19:38.159895 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1193/2444] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:37 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1676 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:38.173996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-dcc2ba02-d3c8-4a31-994b-a892deab85fc req-570ced24-4f8e-41dd-9e32-9ce6938e6e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-unplugged", "status": "completed", "tag": "82a0afc9-8d2a-4705-932d-3a178fa07cb5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:38.195112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dcc2ba02-d3c8-4a31-994b-a892deab85fc req-570ced24-4f8e-41dd-9e32-9ce6938e6e8c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:38.196016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dcc2ba02-d3c8-4a31-994b-a892deab85fc req-570ced24-4f8e-41dd-9e32-9ce6938e6e8c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:38.210212 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-dcc2ba02-d3c8-4a31-994b-a892deab85fc req-570ced24-4f8e-41dd-9e32-9ce6938e6e8c service nova] Creating event network-vif-unplugged:82a0afc9-8d2a-4705-932d-3a178fa07cb5 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:38.217199 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-dcc2ba02-d3c8-4a31-994b-a892deab85fc req-570ced24-4f8e-41dd-9e32-9ce6938e6e8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055596 Apr 30 21:19:38.218126 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1194/2445] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:38.223726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:38.224678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:38.233125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:38.233797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:38.234794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:38.235554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:38.384682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:38.393033 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6aff0a76-dd80-4dac-8f55-49b24cff9669 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1275 microversion: 2.1 time: 0.173509 Apr 30 21:19:38.394003 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1195/2446] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:38 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:38.429164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:38.459201 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d64a97c-0d33-41d4-b76f-d610297da2fe tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1281 microversion: 2.1 time: 0.464917 Apr 30 21:19:38.462111 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1252/2447] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:37 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1281 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:38.998848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:39.000026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:39.018283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:39.019132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:39.020202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:39.025179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:39.176017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:39.177350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:39.185745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:39.186558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:39.187625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:39.188329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:40.203493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:40.217424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:40.225869 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-469b6005-eda8-49b0-9957-37984e900176 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1655 microversion: 2.1 time: 1.046527 Apr 30 21:19:40.227618 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1253/2448] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:39 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1655 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:40.239821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:40.240784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:40.246719 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-040fc9c8-e2bb-47ca-886b-1a847ebbe6c4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 1.252675 Apr 30 21:19:40.247941 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1196/2449] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:38 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:40.249611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:40.250352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:40.251568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:40.252921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:40.257351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:40.259464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:40.295734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:40.299684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:40.299684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:40.299684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:40.722998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:40.750967 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4d2c0d1e-a456-477e-974d-ccc758395547 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.495424 Apr 30 21:19:40.752275 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1197/2450] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:40 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:40.764086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0435b70e-c2f7-4827-92d5-ed8d6dbcea9f req-218a9e1a-4241-4c82-9849-8da5ed3ba4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-deleted", "tag": "82a0afc9-8d2a-4705-932d-3a178fa07cb5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:40.785193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0435b70e-c2f7-4827-92d5-ed8d6dbcea9f req-218a9e1a-4241-4c82-9849-8da5ed3ba4af service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:40.787178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0435b70e-c2f7-4827-92d5-ed8d6dbcea9f req-218a9e1a-4241-4c82-9849-8da5ed3ba4af service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:40.816136 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0435b70e-c2f7-4827-92d5-ed8d6dbcea9f req-218a9e1a-4241-4c82-9849-8da5ed3ba4af service nova] Creating event network-vif-deleted:82a0afc9-8d2a-4705-932d-3a178fa07cb5 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:40.827840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0435b70e-c2f7-4827-92d5-ed8d6dbcea9f req-218a9e1a-4241-4c82-9849-8da5ed3ba4af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073388 Apr 30 21:19:40.829570 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1198/2451] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:40.845767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e071ed4b-1e8b-4b53-8d3d-6f81b46ed1ba req-7ecb1ac5-fd24-4161-89f0-ed53a6808b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-unplugged", "status": "completed", "tag": "ea0a3881-d088-4954-b93d-4c3a924c97e3"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:40.866110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e071ed4b-1e8b-4b53-8d3d-6f81b46ed1ba req-7ecb1ac5-fd24-4161-89f0-ed53a6808b2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:40.868094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e071ed4b-1e8b-4b53-8d3d-6f81b46ed1ba req-7ecb1ac5-fd24-4161-89f0-ed53a6808b2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:40.909242 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e071ed4b-1e8b-4b53-8d3d-6f81b46ed1ba req-7ecb1ac5-fd24-4161-89f0-ed53a6808b2f service nova] Creating event network-vif-unplugged:ea0a3881-d088-4954-b93d-4c3a924c97e3 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:40.917700 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e071ed4b-1e8b-4b53-8d3d-6f81b46ed1ba req-7ecb1ac5-fd24-4161-89f0-ed53a6808b2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084466 Apr 30 21:19:40.920034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1199/2452] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:40.996880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:41.018151 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-691c6265-a5ce-4ad4-bfd8-69ac4bf53d6a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.784747 Apr 30 21:19:41.020174 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1254/2453] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:40 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:41.257518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:41.263898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:41.264793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:41.266503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:41.296700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:41.297209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:41.298008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:41.298360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:41.299332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:41.299982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:41.300301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:41.301705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:41.403305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:41.403793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:41.404282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lazy-loading 'fault' on Instance uuid a4eb62c4-aebc-4598-95f5-85b5e40329ab {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:19:41.581452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:41.596185 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f09e3ea6-e393-4d9d-940a-591a437fa5c1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 200 len: 1303 microversion: 2.1 time: 0.355717 Apr 30 21:19:41.604832 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1200/2454] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:41 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 1303 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:41.692527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:41.705535 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01f3dbbb-a423-430f-bd2a-8a022e7520e2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 0.443390 Apr 30 21:19:41.709600 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1255/2455] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:41 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:41.769523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:41.770648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:41.782590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:41.785502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:41.787856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:41.791870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.037480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:42.038132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:42.051324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:42.051853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.052697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:42.053144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.123475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:42.143808 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8ba0fc4b-5390-436d-b756-6d08c1d4d04c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.367295 Apr 30 21:19:42.145502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1201/2456] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:41 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:42.357238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:42.367208 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da21f40f-d02f-4939-a5b3-a1c11048750d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.334266 Apr 30 21:19:42.377485 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1256/2457] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:42 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:42.465960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cbd9f4dd-8a19-4593-ab38-1ede3a751eb1 req-ff3b2ae8-f789-4874-9cf9-8435ed9b8aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f5ae75-f8f7-4c52-b569-73aeb5df14bb", "tag": "1ab74d47-a77c-473c-aede-16dbff2beee9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:42.505000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cbd9f4dd-8a19-4593-ab38-1ede3a751eb1 req-ff3b2ae8-f789-4874-9cf9-8435ed9b8aa6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:42.506426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cbd9f4dd-8a19-4593-ab38-1ede3a751eb1 req-ff3b2ae8-f789-4874-9cf9-8435ed9b8aa6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.546283 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cbd9f4dd-8a19-4593-ab38-1ede3a751eb1 req-ff3b2ae8-f789-4874-9cf9-8435ed9b8aa6 service nova] Creating event network-changed:1ab74d47-a77c-473c-aede-16dbff2beee9 for instance d9f5ae75-f8f7-4c52-b569-73aeb5df14bb on nch2-master-1 Apr 30 21:19:42.566363 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cbd9f4dd-8a19-4593-ab38-1ede3a751eb1 req-ff3b2ae8-f789-4874-9cf9-8435ed9b8aa6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104475 Apr 30 21:19:42.567685 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1202/2458] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:42.623535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:42.624914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:42.641014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:42.641476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.645989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:42.650281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.695551 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] HTTP exception thrown: Instance a4eb62c4-aebc-4598-95f5-85b5e40329ab could not be found. Apr 30 21:19:42.695551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Returning 404 to user: Instance a4eb62c4-aebc-4598-95f5-85b5e40329ab could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:42.695551 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f898d20d-6e97-4afd-824e-9d565f37e05d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 404 len: 111 microversion: 2.1 time: 0.078001 Apr 30 21:19:42.701532 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1257/2459] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:42 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:42.731036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:42.732458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:42.746027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:42.749279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.750475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:42.751157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:42.988079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-06ce6930-0c10-4447-847a-231a99ced6ed req-bec5c283-1c8d-48f3-881a-4deb1459e4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4eb62c4-aebc-4598-95f5-85b5e40329ab", "name": "network-vif-deleted", "tag": "ea0a3881-d088-4954-b93d-4c3a924c97e3"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:43.007605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-06ce6930-0c10-4447-847a-231a99ced6ed req-bec5c283-1c8d-48f3-881a-4deb1459e4b3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:43.008073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-06ce6930-0c10-4447-847a-231a99ced6ed req-bec5c283-1c8d-48f3-881a-4deb1459e4b3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:43.026803 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-06ce6930-0c10-4447-847a-231a99ced6ed req-bec5c283-1c8d-48f3-881a-4deb1459e4b3 service nova] Creating event network-vif-deleted:ea0a3881-d088-4954-b93d-4c3a924c97e3 for instance a4eb62c4-aebc-4598-95f5-85b5e40329ab on nch2-master-1 Apr 30 21:19:43.033250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-06ce6930-0c10-4447-847a-231a99ced6ed req-bec5c283-1c8d-48f3-881a-4deb1459e4b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052057 Apr 30 21:19:43.034380 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1258/2460] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:43.042806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3f276167-c151-4734-a09d-4840d924105e req-f1fa6706-89bf-42cf-878e-0f6a72647669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12defef4-f959-4394-a3e1-14296a084329", "name": "network-vif-plugged", "status": "completed", "tag": "eadb6f33-647b-4991-9dd1-e334e89fcb4c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:43.057716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3f276167-c151-4734-a09d-4840d924105e req-f1fa6706-89bf-42cf-878e-0f6a72647669 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:43.058200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3f276167-c151-4734-a09d-4840d924105e req-f1fa6706-89bf-42cf-878e-0f6a72647669 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:43.070198 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3f276167-c151-4734-a09d-4840d924105e req-f1fa6706-89bf-42cf-878e-0f6a72647669 service nova] Creating event network-vif-plugged:eadb6f33-647b-4991-9dd1-e334e89fcb4c for instance 12defef4-f959-4394-a3e1-14296a084329 on nch2-master-1 Apr 30 21:19:43.076278 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3f276167-c151-4734-a09d-4840d924105e req-f1fa6706-89bf-42cf-878e-0f6a72647669 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039989 Apr 30 21:19:43.077468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1259/2461] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:43.091086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:43.099175 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2557db64-f694-43a2-bacb-cc4507fbbd5f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 0.375709 Apr 30 21:19:43.100363 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1203/2462] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:42 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:43.169719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:43.169719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:43.180306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:43.180771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:43.184588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:43.185370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:43.386561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:43.387117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:43.396086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:43.396603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:43.397424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:43.397894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:43.605875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:43.616948 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-98945949-1e66-4b54-82d3-ebbac71ee9e9 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.457622 Apr 30 21:19:43.617561 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1260/2463] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:43 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:43.870290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:43.880266 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b1b33eed-b786-42f4-9a87-dcc4ed0d75ed tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.498109 Apr 30 21:19:43.898328 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1204/2464] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:43 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:44.121048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:44.121801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:44.131910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:44.132614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:44.134068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:44.134381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:44.401651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-91a31571-c765-4c65-b966-030fc67a3a23 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Action: 'create', calling method: .version_select at 0x7fdc2613b040>, body: {"keypair": {"name": "tempest-keypair-502635805"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:44.419974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-91a31571-c765-4c65-b966-030fc67a3a23 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for project c91284d0547c4c8a9d99f57d0a43f98b. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:44.426976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-91a31571-c765-4c65-b966-030fc67a3a23 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for user 0a426fa7ed504002881521b1e820e359 and project c91284d0547c4c8a9d99f57d0a43f98b. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:45.013306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:45.022028 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-223d510c-f4be-4180-90cd-473065b1cecc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1315 microversion: 2.1 time: 0.907019 Apr 30 21:19:45.026461 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1261/2465] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:44 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:45.031465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-31aff451-859c-43ab-a75e-7fdd03d8a365 req-d2e5d569-a901-45a7-83da-219e31428f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8236137e-cfde-45ba-964c-d277d70c97d4", "tag": "85c0da70-e0eb-430c-af77-63aac46b8dc4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:45.056585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-31aff451-859c-43ab-a75e-7fdd03d8a365 req-d2e5d569-a901-45a7-83da-219e31428f22 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:45.057493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-31aff451-859c-43ab-a75e-7fdd03d8a365 req-d2e5d569-a901-45a7-83da-219e31428f22 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:45.081858 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-31aff451-859c-43ab-a75e-7fdd03d8a365 req-d2e5d569-a901-45a7-83da-219e31428f22 service nova] Creating event network-changed:85c0da70-e0eb-430c-af77-63aac46b8dc4 for instance 8236137e-cfde-45ba-964c-d277d70c97d4 on nch1-master-1 Apr 30 21:19:45.084983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-91a31571-c765-4c65-b966-030fc67a3a23 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for project c91284d0547c4c8a9d99f57d0a43f98b. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:45.085977 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-31aff451-859c-43ab-a75e-7fdd03d8a365 req-d2e5d569-a901-45a7-83da-219e31428f22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057160 Apr 30 21:19:45.087588 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1262/2466] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:45.095923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:45.097851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:45.108014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:45.108494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-91a31571-c765-4c65-b966-030fc67a3a23 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for user 0a426fa7ed504002881521b1e820e359 and project c91284d0547c4c8a9d99f57d0a43f98b. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:45.109826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:45.112172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:45.118033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:45.157335 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-91a31571-c765-4c65-b966-030fc67a3a23 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.858271 Apr 30 21:19:45.161230 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1205/2467] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:19:44 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:45.172206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:45.173085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:45.180729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:45.184795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:45.186007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:45.186709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:45.437737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:45.449843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a24ca55-0c9a-4c56-9f59-26a45cc0c28b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.357900 Apr 30 21:19:45.451708 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1263/2468] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:45 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:45.458029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:45.473116 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1209d28b-24af-440e-836e-b9b7d2982306 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.305400 Apr 30 21:19:45.479499 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1206/2469] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:45 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:46.045153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:46.046755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:46.068741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.069208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:46.070313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.070828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:46.376013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:46.392383 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f62cd78-1a3d-48cd-b010-91940442f4ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1502 microversion: 2.1 time: 0.352221 Apr 30 21:19:46.394836 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1264/2470] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:46 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1502 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:46.412733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:46.413262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:46.427221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.427692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:46.428518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.428972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:46.470972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:46.471598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:46.484058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.484522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:46.485342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.492097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:46.531384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:19:46.909140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:46.928843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ed64a6b-91b8-4f82-92dd-bd369d0be453 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.463041 Apr 30 21:19:46.932601 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1265/2471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:46 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:46.946161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:46.947102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:46.956308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.959228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:46.959228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:46.959228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:47.008606 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc895c85-a073-4893-a2ca-3dde8ff1329e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 204 len: 0 microversion: 2.1 time: 0.599774 Apr 30 21:19:47.009231 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1207/2472] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:19:46 2022] DELETE /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:19:47.018778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:47.022256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:47.029200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:47.029915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:47.030997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:47.031606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:47.372154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:47.381278 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d388ca9-754c-4907-b993-e9ef31c9f176 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.449291 Apr 30 21:19:47.381890 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1266/2473] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:46 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:47.485428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:47.496907 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5194f26-f3f3-4833-b5a5-43b2ce16a958 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1508 microversion: 2.1 time: 0.482627 Apr 30 21:19:47.508952 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1208/2474] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:47 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1508 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:47.947978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:47.948618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:47.968061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:47.968061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:47.968061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:47.968437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:48.397742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:48.398737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:48.413496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:48.417486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:48.425548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:48.426565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:48.539292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:48.554342 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca1a3305-375e-41dd-97ee-11cd14c6b77b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.610003 Apr 30 21:19:48.556611 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1267/2475] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:47 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:48.572717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:48.576910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:48.596723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:48.597012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:48.597884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:48.607435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:48.938846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:48.968633 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-842354ca-180c-4ace-b928-ba2de7eeb0ce tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.573933 Apr 30 21:19:48.986442 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1209/2476] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:48 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:48.990474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:49.002395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4d06e85-d2bf-4c23-b18b-82fb45cf2947 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1508 microversion: 2.1 time: 0.436774 Apr 30 21:19:49.003050 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1268/2477] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:48 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:49.574425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:49.576139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:49.592820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:49.593955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:49.594996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:49.595461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:49.990874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:49.991520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:49.996502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:50.005656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae473936-4ba3-4e3d-97df-8fa7661b56b0 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.437944 Apr 30 21:19:50.005961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:50.007491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:50.010731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:50.016500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:50.021194 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1210/2478] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:49 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:50.034772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:50.037567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:50.059563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:50.061454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:50.062424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:50.062994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:50.226078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:50.234057 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-99cad0e0-62d7-4494-8cce-6b3474c7be08 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 200 len: 1466 microversion: 2.1 time: 0.211823 Apr 30 21:19:50.241113 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1211/2479] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:50 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 1466 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:50.313535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-47a4713e-9960-4571-8e59-a6e448e5a8ba req-3610d301-158b-4066-9107-9908e899b1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12defef4-f959-4394-a3e1-14296a084329", "name": "network-vif-deleted", "tag": "eadb6f33-647b-4991-9dd1-e334e89fcb4c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:50.331275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-47a4713e-9960-4571-8e59-a6e448e5a8ba req-3610d301-158b-4066-9107-9908e899b1ef service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:50.332607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-47a4713e-9960-4571-8e59-a6e448e5a8ba req-3610d301-158b-4066-9107-9908e899b1ef service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:50.399562 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-47a4713e-9960-4571-8e59-a6e448e5a8ba req-3610d301-158b-4066-9107-9908e899b1ef service nova] Creating event network-vif-deleted:eadb6f33-647b-4991-9dd1-e334e89fcb4c for instance 12defef4-f959-4394-a3e1-14296a084329 on nch2-master-1 Apr 30 21:19:50.425658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-47a4713e-9960-4571-8e59-a6e448e5a8ba req-3610d301-158b-4066-9107-9908e899b1ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115677 Apr 30 21:19:50.426681 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1212/2480] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:19:50.499032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:50.507830 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bbaec9d0-e47e-4bf3-81e3-3962a50b5787 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.522026 Apr 30 21:19:50.509402 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1269/2481] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:49 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:50.969405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1976742036", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b64257ec-4b95-4265-9c51-aad2fb5f6475"}], "security_groups": [{"name": "tempest-securitygroup--609560345"}], "key_name": "tempest-keypair-502635805", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:51.028767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:51.028767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:51.033506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:51.034482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:51.035551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:51.036262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:51.185631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] validate_networks() for [('b64257ec-4b95-4265-9c51-aad2fb5f6475', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:19:51.737076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:51.754132 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4db94c82-b1bb-420b-beef-265beb707729 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.731951 Apr 30 21:19:51.756950 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1270/2482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:51 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:51.771858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:51.774511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:51.787360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:51.788719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:51.790525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:51.791772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:51.813639 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 12defef4-f959-4394-a3e1-14296a084329 could not be found. Apr 30 21:19:51.827807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 12defef4-f959-4394-a3e1-14296a084329 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:19:51.828927 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c85b306-3a68-41c1-83b3-1063bc9cf8c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 404 len: 111 microversion: 2.1 time: 0.070149 Apr 30 21:19:51.830253 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1271/2483] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:51 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:19:51.837094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:51.838068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:51.849258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:51.849957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:51.852201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:51.852675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:52.406876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:52.416939 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-702b35d2-b10f-4ddf-ab61-ffa5aa0f6159 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.585305 Apr 30 21:19:52.418637 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1272/2484] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:51 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:52.432597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-948772146", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5c8b504b-43e7-4642-bbf0-dab49293fda8"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:52.460094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for project c91284d0547c4c8a9d99f57d0a43f98b. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:52.475674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for user 0a426fa7ed504002881521b1e820e359 and project c91284d0547c4c8a9d99f57d0a43f98b. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:52.509293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:19:52.509469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] validate_networks() for [('5c8b504b-43e7-4642-bbf0-dab49293fda8', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:19:52.509742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:19:52.510271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:19:52.510976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:19:52.511412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:19:52.521840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:52.525282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:52.525282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:52.525282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:52.547446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for project c91284d0547c4c8a9d99f57d0a43f98b. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:52.554155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Getting quotas for user 0a426fa7ed504002881521b1e820e359 and project c91284d0547c4c8a9d99f57d0a43f98b. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:52.571561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:19:52.575030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:19:52.748384 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e8c1da6-972e-4eb9-982b-a8a679cfeee2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.783665 Apr 30 21:19:52.754501 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1213/2485] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:19:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:19:52.760469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-bd0fe219-ffc2-4bf0-9877-45518edc32a6 req-86e0ec4b-e8dd-47aa-b2a8-a43d9f75c9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8236137e-cfde-45ba-964c-d277d70c97d4", "name": "network-vif-plugged", "status": "completed", "tag": "85c0da70-e0eb-430c-af77-63aac46b8dc4"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:52.773331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-bd0fe219-ffc2-4bf0-9877-45518edc32a6 req-86e0ec4b-e8dd-47aa-b2a8-a43d9f75c9fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:52.774183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-bd0fe219-ffc2-4bf0-9877-45518edc32a6 req-86e0ec4b-e8dd-47aa-b2a8-a43d9f75c9fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:52.822862 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-bd0fe219-ffc2-4bf0-9877-45518edc32a6 req-86e0ec4b-e8dd-47aa-b2a8-a43d9f75c9fe service nova] Creating event network-vif-plugged:85c0da70-e0eb-430c-af77-63aac46b8dc4 for instance 8236137e-cfde-45ba-964c-d277d70c97d4 on nch1-master-1 Apr 30 21:19:52.839208 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-bd0fe219-ffc2-4bf0-9877-45518edc32a6 req-86e0ec4b-e8dd-47aa-b2a8-a43d9f75c9fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083015 Apr 30 21:19:52.842492 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1214/2486] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:52.852289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0dbe758d-152b-4654-910d-013621db7a05 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:52.856547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0dbe758d-152b-4654-910d-013621db7a05 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:52.999429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0dbe758d-152b-4654-910d-013621db7a05 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:53.012077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0dbe758d-152b-4654-910d-013621db7a05 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1277 microversion: 2.1 time: 0.168021 Apr 30 21:19:53.017601 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1215/2487] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:52 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:53.034870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:53.040203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:53.075668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:53.075668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:53.075668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:53.075668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:53.401633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:53.415405 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-959986ac-3241-4b1b-84d2-9fca343f6570 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1323 microversion: 2.1 time: 0.395650 Apr 30 21:19:53.422215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:19:53.422903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:19:53.424775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:19:53.425939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:19:53.426684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:19:53.444018 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1216/2488] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:53 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:53.444290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1342087078", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "8a42b8f1-3795-4419-a0fb-32d2333d769d"}, {"uuid": "a5f36e2a-1d9b-4a37-8420-54ceae320947"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:53.445888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:53.446534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:53.448127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:53.448781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:53.508419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:53.515567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] validate_networks() for [('8a42b8f1-3795-4419-a0fb-32d2333d769d', None, None, None, None, None), ('a5f36e2a-1d9b-4a37-8420-54ceae320947', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:19:53.524159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for user 2f5eafa970bd4247bdaef1cda747c3fc and project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:53.541567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:19:53.543875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:19:53.778395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7222a7a-24e8-4781-8553-6b5013d5b3ae tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358308 Apr 30 21:19:53.782173 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1273/2489] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:19:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:19:53.819978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:53.840369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:53.871510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:53.871983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:53.877121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:53.878505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:54.501894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:54.514513 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9ce06185-953a-4f68-8a80-4aab0fd17b8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.729100 Apr 30 21:19:54.530586 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1274/2490] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:53 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:54.536352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-649798cf-124b-4ebc-91bd-850a107e5734 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:54.536986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-649798cf-124b-4ebc-91bd-850a107e5734 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:54.556116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:19:54.559297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:19:54.559297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:19:54.559297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:19:54.559297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:19:54.588015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:54.591129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:54.592396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:54.592849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:54.645115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Getting quotas for project 692585b32bd44ddb8ab633a1f1842d5f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:19:54.668908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Getting quotas for user f3e57c830031491a9d8fd6b3664b4390 and project 692585b32bd44ddb8ab633a1f1842d5f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:19:54.692261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-649798cf-124b-4ebc-91bd-850a107e5734 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:54.705479 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-649798cf-124b-4ebc-91bd-850a107e5734 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1214 microversion: 2.1 time: 0.174647 Apr 30 21:19:54.705479 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1275/2491] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:54 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:54.706192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:19:54.714957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:19:54.718565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:54.721503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:54.737970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:54.738448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:54.739258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:54.739701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:54.878778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:54.910603 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f136f24d-50d6-47c3-b50f-ae05748f620e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1281 microversion: 2.1 time: 0.205095 Apr 30 21:19:54.911312 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1276/2492] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:54 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:54.945072 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-723a09ba-37af-448c-9ea1-9ed224d4beb9 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501404 Apr 30 21:19:54.952564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:54.952564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:54.953517 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1217/2493] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:19:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:19:54.968584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cbd8e8be-a315-486a-a13e-5bb2e0345074 req-774d8685-3d26-4b60-b55e-654d23e47add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f5ae75-f8f7-4c52-b569-73aeb5df14bb", "name": "network-vif-plugged", "status": "completed", "tag": "1ab74d47-a77c-473c-aede-16dbff2beee9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:54.968709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:54.968709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:54.968709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:54.969089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:54.990639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cbd8e8be-a315-486a-a13e-5bb2e0345074 req-774d8685-3d26-4b60-b55e-654d23e47add service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:54.998780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cbd8e8be-a315-486a-a13e-5bb2e0345074 req-774d8685-3d26-4b60-b55e-654d23e47add service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:55.006515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cbd8e8be-a315-486a-a13e-5bb2e0345074 req-774d8685-3d26-4b60-b55e-654d23e47add service nova] Creating event network-vif-plugged:1ab74d47-a77c-473c-aede-16dbff2beee9 for instance d9f5ae75-f8f7-4c52-b569-73aeb5df14bb on nch2-master-1 Apr 30 21:19:55.013167 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cbd8e8be-a315-486a-a13e-5bb2e0345074 req-774d8685-3d26-4b60-b55e-654d23e47add service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057956 Apr 30 21:19:55.015262 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1218/2494] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:55.025322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0c9510ef-c1d0-4ebd-8daf-680b87045baa tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:55.027070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0c9510ef-c1d0-4ebd-8daf-680b87045baa tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:55.154711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0c9510ef-c1d0-4ebd-8daf-680b87045baa tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:55.168915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0c9510ef-c1d0-4ebd-8daf-680b87045baa tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1213 microversion: 2.1 time: 0.151919 Apr 30 21:19:55.171321 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1219/2495] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:55 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:55.313875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:55.319157 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c681d3c1-dd45-40cb-84e4-ce9a56a63198 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1519 microversion: 2.1 time: 0.406314 Apr 30 21:19:55.319738 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1277/2496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:54 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1519 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:55.336475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dda83afb-87b9-4de9-8ad6-69328f3af2b1 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'create', calling method: .version_select at 0x7fdc261219d0>, body: {"pool": null} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:19:55.533625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:55.538346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:55.564728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:55.565198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:55.570882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:55.571440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:55.930408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:55.941614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41df4d90-16e8-4236-b89e-702667145a04 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1317 microversion: 2.1 time: 0.412879 Apr 30 21:19:55.942627 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1278/2497] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:55 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:55.948295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:55.949229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:55.956483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:55.957191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:55.958394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:55.959008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:56.072971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:56.085552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-25702023-fdaf-49ec-9bd0-aa4b1230a293 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1218 microversion: 2.1 time: 0.140989 Apr 30 21:19:56.091364 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1279/2498] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:55 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:56.098730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:56.100523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:56.107432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:56.107956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:56.108811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:56.109218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:56.180134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:56.190977 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19f2715c-73da-4732-ad96-62ee68efeb13 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1329 microversion: 2.1 time: 0.097994 Apr 30 21:19:56.191919 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1280/2499] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:56 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1329 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:56.200331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35302a14-ffc2-4086-b015-19cd10d70852 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:56.201959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35302a14-ffc2-4086-b015-19cd10d70852 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:56.262944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-35302a14-ffc2-4086-b015-19cd10d70852 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:56.271545 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35302a14-ffc2-4086-b015-19cd10d70852 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1213 microversion: 2.1 time: 0.077225 Apr 30 21:19:56.271545 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1281/2500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:56 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:56.981258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:56.986994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:57.027731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.031709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:57.036436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.041847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:57.335498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:57.344526 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-736423a3-25fc-4d98-b1a3-cfa29bcc0e3f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1467 microversion: 2.1 time: 0.384962 Apr 30 21:19:57.348380 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1282/2501] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:56 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1467 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:19:57.357510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:57.360592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:57.375446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.377912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:57.380867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.381666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:57.495405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:57.508043 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18e38917-d363-4ac0-b937-7496bc1c9071 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1266 microversion: 2.1 time: 0.153775 Apr 30 21:19:57.519506 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1283/2502] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:57 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:57.536288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:57.537357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:57.560455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.561329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:57.564263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.565244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:57.744156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:57.753104 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7c879551-69ce-43cb-967b-e89370d1e566 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1335 microversion: 2.1 time: 0.227124 Apr 30 21:19:57.756847 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1284/2503] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:57 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1335 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:57.766542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:57.770884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:57.783648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.785316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:57.789134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:57.790096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:58.003842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:58.015796 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-657cba2a-977a-41bb-870e-c1f3d05d7711 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1265 microversion: 2.1 time: 0.255300 Apr 30 21:19:58.016763 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1285/2504] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:57 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:58.021644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c80e2d8a-22cc-4249-a84c-62cf83b4e00d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:58.022609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c80e2d8a-22cc-4249-a84c-62cf83b4e00d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:58.030185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c80e2d8a-22cc-4249-a84c-62cf83b4e00d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:58.031043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c80e2d8a-22cc-4249-a84c-62cf83b4e00d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:58.032094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c80e2d8a-22cc-4249-a84c-62cf83b4e00d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:58.032795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c80e2d8a-22cc-4249-a84c-62cf83b4e00d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:59.071159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c80e2d8a-22cc-4249-a84c-62cf83b4e00d tempest-ServersOnMultiNodesTest-401983236 tempest-ServersOnMultiNodesTest-401983236-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1618 microversion: 2.1 time: 1.053074 Apr 30 21:19:59.077151 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1286/2505] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:58 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1618 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:59.086768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:59.087712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:59.106861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:59.107540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:59.108538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:59.109382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:59.444837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:19:59.454350 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-544822bb-2e04-484c-b490-7172ed29a11a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1272 microversion: 2.1 time: 0.375712 Apr 30 21:19:59.459674 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1287/2506] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:59 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:19:59.465668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:59.466570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:59.474216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:59.474928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:59.479807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:59.479807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:59.718508 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dda83afb-87b9-4de9-8ad6-69328f3af2b1 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.386151 Apr 30 21:19:59.719803 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1220/2507] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:19:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:19:59.724747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:19:59.734866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:19:59.769276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:59.770096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:59.772033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:19:59.773334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:19:59.986024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:00.002842 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9bbff7f9-171a-4feb-869e-a2be4984f633 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1271 microversion: 2.1 time: 0.281793 Apr 30 21:20:00.007632 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1221/2508] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:59 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:00.016719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:00.018143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:00.032106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:00.032655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:00.033712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:00.034333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:00.098596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:00.219248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:00.234631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-28d7ebf8-4309-410c-b0fa-8aede8d84753 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 0.773604 Apr 30 21:20:00.244884 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1288/2509] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:19:59 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:00.248970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1504407446", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "98b1dbd8-5abb-448b-9acd-f922dee70a3d"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:00.390773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] validate_networks() for [('98b1dbd8-5abb-448b-9acd-f922dee70a3d', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:20:00.453449 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a87eafeb-6eb8-4f97-9932-913b3497a9e9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 204 len: 0 microversion: 2.1 time: 0.444092 Apr 30 21:20:00.454779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1222/2510] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:00 2022] DELETE /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:00.465274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:00.466050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:00.477113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:00.477579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:00.483414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:00.484700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:00.831545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:00.841401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aed22574-8bcb-4516-9608-2b02f50caa8f tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1473 microversion: 2.1 time: 0.382093 Apr 30 21:20:00.853353 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1223/2511] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:00 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:00.859234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:00.859876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:00.866516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:00.868758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:00.868758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:00.868758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:00.975551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:00.997556 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c4f7cb0d-0871-4dea-8e16-70b0a6891f46 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1272 microversion: 2.1 time: 0.142161 Apr 30 21:20:01.002673 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1224/2512] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:00 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:01.024550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:01.028547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:01.039939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.040656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.042474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.043258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.149870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:01.162280 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-42da8972-3692-4029-a37f-92061ae15c8c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1271 microversion: 2.1 time: 0.141408 Apr 30 21:20:01.163542 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1225/2513] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:01 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:01.259240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:01.262615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:01.270166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.270892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.271891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.272495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.660233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:20:01.661314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:20:01.662075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:20:01.662845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:20:01.663581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:20:01.683049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.683833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.684958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.685665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.719052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:01.732944 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cfd10563-69fb-44e5-ab3a-5a9d771f923e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 0.478426 Apr 30 21:20:01.734842 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1226/2514] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:01 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:01.751012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-32c1d34b-f732-42cc-b131-678c2db1134d req-f70dee28-6762-4150-82ee-5d52a2660724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96657a8f-3ac7-4f4b-a90a-0b487d135e52", "tag": "51b3842d-35b9-4bef-ad94-2041501dcf33"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:01.756245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Getting quotas for project 6cebc4a4f75349b09fd03f67d0207875. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:01.779597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-32c1d34b-f732-42cc-b131-678c2db1134d req-f70dee28-6762-4150-82ee-5d52a2660724 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.784696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Getting quotas for user a75959d37cbf4c9b8482e480a0888246 and project 6cebc4a4f75349b09fd03f67d0207875. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:01.786440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-32c1d34b-f732-42cc-b131-678c2db1134d req-f70dee28-6762-4150-82ee-5d52a2660724 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.828134 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-32c1d34b-f732-42cc-b131-678c2db1134d req-f70dee28-6762-4150-82ee-5d52a2660724 service nova] Creating event network-changed:51b3842d-35b9-4bef-ad94-2041501dcf33 for instance 96657a8f-3ac7-4f4b-a90a-0b487d135e52 on nch2-master-1 Apr 30 21:20:01.831638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:20:01.836324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:20:01.847694 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-32c1d34b-f732-42cc-b131-678c2db1134d req-f70dee28-6762-4150-82ee-5d52a2660724 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111291 Apr 30 21:20:01.853047 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1227/2515] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:01.862253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:01.863793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:01.876806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.877712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:01.879153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:01.880293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:02.014906 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18fd5de1-cde0-481f-8f5e-4d397e4cd92c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.777940 Apr 30 21:20:02.024195 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1289/2516] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:20:02.038767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:02.040846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:02.102634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:02.103748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:02.104641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:02.106217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:02.539024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:02.547468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f094ae6-397f-4830-8231-d4c3d2ffd5ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 0.526508 Apr 30 21:20:02.548667 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1290/2517] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:02 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:02.571104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-24968b82-b609-4eda-8aa6-4d22247423d1 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:02.572956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-24968b82-b609-4eda-8aa6-4d22247423d1 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:02.663944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-24968b82-b609-4eda-8aa6-4d22247423d1 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:02.680657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:02.695295 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94f33082-554e-45d0-a60e-9557f274f661 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1473 microversion: 2.1 time: 0.840277 Apr 30 21:20:02.696544 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1228/2518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:01 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1473 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:02.703947 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-24968b82-b609-4eda-8aa6-4d22247423d1 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1224 microversion: 2.1 time: 0.125894 Apr 30 21:20:02.706039 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1291/2519] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:02 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1224 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:02.711433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:02.714549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:02.737929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:02.747394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:02.747394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:02.747394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:02.752979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:02.753636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:02.768003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:02.768470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:02.769290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:02.769744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.099515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:04.115175 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3313fc3a-a82b-4dfa-9449-b92ae79fcf30 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 1.368708 Apr 30 21:20:04.128185 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1292/2520] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:02 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:04.137957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:04.139513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:04.154161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.158211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:04.167156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.169419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.170958 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6f9496c5-27ab-4511-9192-bc9f83d6242c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1313 microversion: 2.1 time: 1.472507 Apr 30 21:20:04.173687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.178838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1229/2521] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:02 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1313 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:04.197005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:04.200190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:04.232218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.232695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.233517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.238703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.331728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.332685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.333615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lazy-loading 'fault' on Instance uuid d9f5ae75-f8f7-4c52-b569-73aeb5df14bb {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:20:04.530170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:04.542481 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ff4c8d9-54a5-42be-bd42-5eeb74715431 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 200 len: 1307 microversion: 2.1 time: 0.361723 Apr 30 21:20:04.543703 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1230/2522] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:04 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:04.550148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:04.551734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:04.561929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.562803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.563912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.564561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.865414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:04.876982 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-54e2a46f-ca9c-48ef-a4a8-f789eeef9167 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1276 microversion: 2.1 time: 0.328977 Apr 30 21:20:04.876982 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1231/2523] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:04 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:04.882048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a391b1d6-05c4-4b45-866f-9ed115c301be req-319cdab6-b055-4ca2-9f82-b2983ee45e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f5ae75-f8f7-4c52-b569-73aeb5df14bb", "name": "network-vif-deleted", "tag": "1ab74d47-a77c-473c-aede-16dbff2beee9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:04.893816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a391b1d6-05c4-4b45-866f-9ed115c301be req-319cdab6-b055-4ca2-9f82-b2983ee45e6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:04.894282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a391b1d6-05c4-4b45-866f-9ed115c301be req-319cdab6-b055-4ca2-9f82-b2983ee45e6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:04.909048 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a391b1d6-05c4-4b45-866f-9ed115c301be req-319cdab6-b055-4ca2-9f82-b2983ee45e6a service nova] Creating event network-vif-deleted:1ab74d47-a77c-473c-aede-16dbff2beee9 for instance d9f5ae75-f8f7-4c52-b569-73aeb5df14bb on nch2-master-1 Apr 30 21:20:04.915190 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a391b1d6-05c4-4b45-866f-9ed115c301be req-319cdab6-b055-4ca2-9f82-b2983ee45e6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038844 Apr 30 21:20:04.918424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1232/2524] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:05.062655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:05.073406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c2a22af-7de9-454f-aedd-c4d9174d8c99 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 0.941910 Apr 30 21:20:05.074349 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1293/2525] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:04 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:05.148625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:05.159073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:05.159073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.159073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.160039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.160039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.196174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:05.199256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:05.211986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.212742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.213709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.214414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.690674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:05.695872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:05.697011 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4d06e7eb-83d6-4eef-b50f-55997febef62 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 0.555395 Apr 30 21:20:05.709256 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1233/2526] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:05 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:05.717209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:05.719235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d9f5ae75-f8f7-4c52-b569-73aeb5df14bb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:05.725984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.730912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.730912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.730912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.747561 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96350658-1e2c-47ec-b82a-89175f9a13f5 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1313 microversion: 2.1 time: 0.556285 Apr 30 21:20:05.747813 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance d9f5ae75-f8f7-4c52-b569-73aeb5df14bb could not be found. Apr 30 21:20:05.753945 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1294/2527] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:05 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:05.757253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance d9f5ae75-f8f7-4c52-b569-73aeb5df14bb could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:05.758285 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2c621ee-7e09-45d0-8068-b902d969cd76 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb" status: 404 len: 111 microversion: 2.1 time: 0.047322 Apr 30 21:20:05.758939 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1234/2528] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:05 2022] GET /compute/v2.1/servers/d9f5ae75-f8f7-4c52-b569-73aeb5df14bb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:05.774284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:05.774284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:05.791762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.796334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.797079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.798490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.841510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:05.893877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:05.895171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:05.903991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.909204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:05.909204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:05.909204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:06.130663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:06.143333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ad2f3af-c3bb-454a-8e72-f0ba60054f50 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1282 microversion: 2.1 time: 0.254314 Apr 30 21:20:06.159325 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1235/2529] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:05 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1282 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:06.160159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-171af9b9-bf3c-424e-91e3-948e3c88d18a tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 204 len: 0 microversion: 2.1 time: 0.394479 Apr 30 21:20:06.162403 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1295/2530] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:05 2022] DELETE /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:06.178357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:06.182385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:06.182528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ce08430a-8295-4460-afa5-caac4f5f4e0c req-c0f9a1b9-1440-4534-86e4-b59159abe1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a99313-2234-43cf-92e0-80ad0262a063", "tag": "411cb9bf-ba86-4506-a5f1-be9d564d6e55"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:06.189560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:06.190675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:06.193341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:06.198385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:06.249806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ce08430a-8295-4460-afa5-caac4f5f4e0c req-c0f9a1b9-1440-4534-86e4-b59159abe1b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:06.253953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ce08430a-8295-4460-afa5-caac4f5f4e0c req-c0f9a1b9-1440-4534-86e4-b59159abe1b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:06.288987 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ce08430a-8295-4460-afa5-caac4f5f4e0c req-c0f9a1b9-1440-4534-86e4-b59159abe1b8 service nova] Creating event network-changed:411cb9bf-ba86-4506-a5f1-be9d564d6e55 for instance 91a99313-2234-43cf-92e0-80ad0262a063 on nch2-master-1 Apr 30 21:20:06.302293 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ce08430a-8295-4460-afa5-caac4f5f4e0c req-c0f9a1b9-1440-4534-86e4-b59159abe1b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137819 Apr 30 21:20:06.304638 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1296/2531] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:06.314568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:06.315982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:06.325279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:06.325279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:06.325279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:06.325279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:07.167516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:07.175348 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7a884108-1717-4598-9532-c9d007b46c80 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 1.018954 Apr 30 21:20:07.175944 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1236/2532] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:06 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:07.181812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:07.182911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:07.190058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:07.190671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:07.191483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:07.191938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:07.210557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:07.220276 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f368bc47-b9a8-41fa-8aa6-39815d6d3d81 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1471 microversion: 2.1 time: 0.914372 Apr 30 21:20:07.220994 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1297/2533] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:06 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1471 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:07.225854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:07.226921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:07.233832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:07.234285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:07.235056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:07.235496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:07.779935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:07.788069 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f591f03-a318-4d79-90c9-554c98ddac99 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 0.610744 Apr 30 21:20:07.788576 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1237/2534] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:07 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:07.794696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:07.795589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:07.803507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:07.805157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:07.807340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:07.813110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:07.829952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:07.839167 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d4771b7-fb95-43ed-878e-a41506589f36 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.616777 Apr 30 21:20:07.851867 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1298/2535] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:07 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:08.200921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:08.202353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:08.211533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:08.213224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:08.214346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:08.215055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:08.455825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:08.464304 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d009568b-6084-4fdd-957d-8d41e3a6f0c5 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.674450 Apr 30 21:20:08.465066 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1238/2536] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:07 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:08.470083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:08.470991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:08.478609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:08.480096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:08.481150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:08.481819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:08.548457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:08.560598 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bcc003a5-190e-493b-beab-584c8ffed25a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 0.370639 Apr 30 21:20:08.561188 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1299/2537] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:08 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:08.806811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:08.807439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:08.814136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:08.814509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:08.815419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:08.815737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:08.985788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:09.007904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1695068d-380c-45df-8053-da3fb77f0ab1 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 200 len: 1471 microversion: 2.1 time: 0.532629 Apr 30 21:20:09.008627 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1239/2538] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:08 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 1471 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:09.016957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-06a564e8-df4b-4b0e-b6a3-8b79f6b32835 req-5703e560-f5c8-4843-aa79-bf92000383c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba12be1-263f-416d-8233-242286a6691d", "name": "network-vif-deleted", "tag": "ec488b53-90c5-4824-86a9-6c69bb49fbe8"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:09.043258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-06a564e8-df4b-4b0e-b6a3-8b79f6b32835 req-5703e560-f5c8-4843-aa79-bf92000383c4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.043744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-06a564e8-df4b-4b0e-b6a3-8b79f6b32835 req-5703e560-f5c8-4843-aa79-bf92000383c4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:09.065825 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-06a564e8-df4b-4b0e-b6a3-8b79f6b32835 req-5703e560-f5c8-4843-aa79-bf92000383c4 service nova] Creating event network-vif-deleted:ec488b53-90c5-4824-86a9-6c69bb49fbe8 for instance dba12be1-263f-416d-8233-242286a6691d on nch1-master-1 Apr 30 21:20:09.079712 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-06a564e8-df4b-4b0e-b6a3-8b79f6b32835 req-5703e560-f5c8-4843-aa79-bf92000383c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068923 Apr 30 21:20:09.081190 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1240/2539] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:09.087064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:09.088686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:09.105783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.106746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:09.107719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.108792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:09.122394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:09.134897 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0fe04e1-34bb-4952-91a1-4bd4f7ca1158 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 0.330960 Apr 30 21:20:09.136599 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1300/2540] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:08 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:09.466193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:09.474904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c1ee1be2-58ad-4f19-a84d-8874ecacf6d3 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.392327 Apr 30 21:20:09.476577 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1241/2541] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:09 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:09.482067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:09.482680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:09.489832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.490287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:09.491067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.491511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:09.525700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2427177b-d385-4f38-8361-ed613625d23f req-6d51a2c1-0fd9-4d2f-9836-a537fc7adbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48b9d33-108e-4c2b-a7f1-91869f9b4fe8", "tag": "938b3124-c295-4ecf-b6a7-1c1b548c7665"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:09.542537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2427177b-d385-4f38-8361-ed613625d23f req-6d51a2c1-0fd9-4d2f-9836-a537fc7adbc7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.543096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2427177b-d385-4f38-8361-ed613625d23f req-6d51a2c1-0fd9-4d2f-9836-a537fc7adbc7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:09.565776 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2427177b-d385-4f38-8361-ed613625d23f req-6d51a2c1-0fd9-4d2f-9836-a537fc7adbc7 service nova] Creating event network-changed:938b3124-c295-4ecf-b6a7-1c1b548c7665 for instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 on nch2-master-1 Apr 30 21:20:09.572419 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2427177b-d385-4f38-8361-ed613625d23f req-6d51a2c1-0fd9-4d2f-9836-a537fc7adbc7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050972 Apr 30 21:20:09.574760 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1242/2542] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:09.580071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:09.580989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:09.590597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.602816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:09.604559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:09.605728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:10.456222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:10.468536 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0228fb24-bd25-4e92-acaf-074590e260ac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.990758 Apr 30 21:20:10.469135 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1301/2543] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:09 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:10.481389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:10.482550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: dba12be1-263f-416d-8233-242286a6691d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:10.496380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:10.496843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:10.497946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:10.498590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:10.519635 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance dba12be1-263f-416d-8233-242286a6691d could not be found. Apr 30 21:20:10.520261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance dba12be1-263f-416d-8233-242286a6691d could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:10.521127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d873280-2aed-4dea-ad9b-0425552c9e91 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d" status: 404 len: 111 microversion: 2.1 time: 0.050665 Apr 30 21:20:10.521700 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1302/2544] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:10 2022] GET /compute/v2.1/servers/dba12be1-263f-416d-8233-242286a6691d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:10.530768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:10.533295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:10.544033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:10.547243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:10.547243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:10.547243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:10.663216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:10.671129 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e19cb5ac-8894-4d8f-ad0f-1b6730edc9a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 1.095587 Apr 30 21:20:10.671612 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1243/2545] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:09 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:10.676299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:10.681896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:10.684433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:10.684892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:10.685736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:10.686199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.116923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:11.126429 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b8fe687-91d4-46d8-a8f8-100b500cfa2c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 0.603379 Apr 30 21:20:11.127152 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1303/2546] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:10 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:11.132052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:11.133231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:11.140285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.140773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.141568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.142580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.190386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:11.209026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:11.217509 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e30f3adf-912e-4070-94be-cdd8bbe92f73 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.544829 Apr 30 21:20:11.218368 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1244/2547] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:10 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:11.223088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ada27960-ca2b-4e62-bf0e-fb51fdf33fd5 req-17a40bd8-e53f-4a4b-9648-710aed5a1c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96657a8f-3ac7-4f4b-a90a-0b487d135e52", "name": "network-vif-plugged", "status": "completed", "tag": "51b3842d-35b9-4bef-ad94-2041501dcf33"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:11.232182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ada27960-ca2b-4e62-bf0e-fb51fdf33fd5 req-17a40bd8-e53f-4a4b-9648-710aed5a1c78 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.232825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ada27960-ca2b-4e62-bf0e-fb51fdf33fd5 req-17a40bd8-e53f-4a4b-9648-710aed5a1c78 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.248106 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ada27960-ca2b-4e62-bf0e-fb51fdf33fd5 req-17a40bd8-e53f-4a4b-9648-710aed5a1c78 service nova] Creating event network-vif-plugged:51b3842d-35b9-4bef-ad94-2041501dcf33 for instance 96657a8f-3ac7-4f4b-a90a-0b487d135e52 on nch2-master-1 Apr 30 21:20:11.253984 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ada27960-ca2b-4e62-bf0e-fb51fdf33fd5 req-17a40bd8-e53f-4a4b-9648-710aed5a1c78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034170 Apr 30 21:20:11.256095 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1245/2548] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:11.488205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:11.488205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:11.493365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.494480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.495558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.495974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.630410 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0be303ec-6dd8-41f1-8589-8f4e1d109018 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 204 len: 0 microversion: 2.1 time: 0.501919 Apr 30 21:20:11.632717 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1304/2549] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:11 2022] DELETE /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:11.640421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b9ec2e75-664a-4036-ba68-d4390c28cd04 req-6dd84e60-fa49-442a-8d30-7ff765de89f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce71b4fd-70d3-4703-8ca7-c1b569060a9f", "tag": "ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:11.649352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b9ec2e75-664a-4036-ba68-d4390c28cd04 req-6dd84e60-fa49-442a-8d30-7ff765de89f0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.650573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b9ec2e75-664a-4036-ba68-d4390c28cd04 req-6dd84e60-fa49-442a-8d30-7ff765de89f0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.661882 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b9ec2e75-664a-4036-ba68-d4390c28cd04 req-6dd84e60-fa49-442a-8d30-7ff765de89f0 service nova] Creating event network-changed:ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd for instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f on nch1-master-1 Apr 30 21:20:11.666984 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b9ec2e75-664a-4036-ba68-d4390c28cd04 req-6dd84e60-fa49-442a-8d30-7ff765de89f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032681 Apr 30 21:20:11.668092 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1305/2550] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:11.673060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:11.673793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:11.681366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.682627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.683015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.683603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.704649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:11.719229 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd16888f-49e6-426e-b0ac-b0ca03b45cef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.236773 Apr 30 21:20:11.720488 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1246/2551] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:11 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:11.725489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:11.726282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:11.739796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.739796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.739796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:11.739796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:11.989196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:11.993044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:11.997940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a1d0cd9-e689-4d5f-a5fa-d0440735a6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1473 microversion: 2.1 time: 0.328746 Apr 30 21:20:11.998528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1306/2552] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:11 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:12.002105 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3bc0c983-d756-4798-8276-d9f2822eddd0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 0.280350 Apr 30 21:20:12.003211 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1247/2553] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:11 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:12.143161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:12.143773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:12.150519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:12.150987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:12.151779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:12.152215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:12.235460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:12.236416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:12.243849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:12.244412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:12.245409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:12.245962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:12.380852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:12.397374 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2a0a71b-057c-405f-9a31-65e0f3d9ee7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1402 microversion: 2.1 time: 0.258038 Apr 30 21:20:12.398602 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1307/2554] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:12 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1402 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:12.450883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:12.463206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2502d24-e513-4977-93ad-3fd9c5d50909 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.228223 Apr 30 21:20:12.463206 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1248/2555] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:12 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:12.736569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:12.737177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:12.744502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:12.744960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:12.745736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:12.746208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.019910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:13.021587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:13.036283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.037011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.039582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.043670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.357958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:13.365978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5fbbc4e5-9ef4-4473-a169-2c44666c158b tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.633265 Apr 30 21:20:13.376260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1308/2556] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:12 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:13.376260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:13.376260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:13.379604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.380190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.381083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.381628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.609747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:13.626026 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae303fbb-629b-47d2-8411-83d14e9ce6fb tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1473 microversion: 2.1 time: 0.613414 Apr 30 21:20:13.636798 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1249/2557] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:13 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1473 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:13.642834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:13.643637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:13.658041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.658517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.659326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.659933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.802660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:13.813411 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-49010113-aac9-42b6-99a1-1546bb7ad65f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 0.445227 Apr 30 21:20:13.814094 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1309/2558] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:13 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:13.834248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:13.834883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:13.853711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.855912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:13.861255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:13.861255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.020285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:14.034716 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d05970bb-ca5c-4b60-9bc1-77ccae6b1dce tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1589 microversion: 2.1 time: 0.396462 Apr 30 21:20:14.035662 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1250/2559] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:13 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1589 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:14.043257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-13f13586-0df8-4f88-a0d5-f1f11b58f088 req-0e9874a7-d681-4329-a310-1a036493f086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48b9d33-108e-4c2b-a7f1-91869f9b4fe8", "tag": "f2566869-85df-44a5-8e76-dd5804ef8cdb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:14.053394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13f13586-0df8-4f88-a0d5-f1f11b58f088 req-0e9874a7-d681-4329-a310-1a036493f086 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.055037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13f13586-0df8-4f88-a0d5-f1f11b58f088 req-0e9874a7-d681-4329-a310-1a036493f086 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.069360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-13f13586-0df8-4f88-a0d5-f1f11b58f088 req-0e9874a7-d681-4329-a310-1a036493f086 service nova] Creating event network-changed:f2566869-85df-44a5-8e76-dd5804ef8cdb for instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 on nch2-master-1 Apr 30 21:20:14.075808 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-13f13586-0df8-4f88-a0d5-f1f11b58f088 req-0e9874a7-d681-4329-a310-1a036493f086 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036012 Apr 30 21:20:14.076429 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1251/2560] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:14.084612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a293e0ad-610c-41ee-8988-444542599c1f req-a6f1a9b2-0989-4faf-b342-fd5ab5942da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d77eab37-d34b-4e8c-9959-8d5661bf68fb", "name": "network-vif-deleted", "tag": "1635337f-81ee-4aec-a704-cf2d3c4efa24"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:14.095292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a293e0ad-610c-41ee-8988-444542599c1f req-a6f1a9b2-0989-4faf-b342-fd5ab5942da1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.095992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a293e0ad-610c-41ee-8988-444542599c1f req-a6f1a9b2-0989-4faf-b342-fd5ab5942da1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.111702 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a293e0ad-610c-41ee-8988-444542599c1f req-a6f1a9b2-0989-4faf-b342-fd5ab5942da1 service nova] Creating event network-vif-deleted:1635337f-81ee-4aec-a704-cf2d3c4efa24 for instance d77eab37-d34b-4e8c-9959-8d5661bf68fb on nch1-master-1 Apr 30 21:20:14.120150 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a293e0ad-610c-41ee-8988-444542599c1f req-a6f1a9b2-0989-4faf-b342-fd5ab5942da1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041042 Apr 30 21:20:14.122735 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1252/2561] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:14.131320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df129981-62a5-46b4-801a-fe298a8ca5ca tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:14.132350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df129981-62a5-46b4-801a-fe298a8ca5ca tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:14.144069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df129981-62a5-46b4-801a-fe298a8ca5ca tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.145498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df129981-62a5-46b4-801a-fe298a8ca5ca tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.147006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df129981-62a5-46b4-801a-fe298a8ca5ca tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.147653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df129981-62a5-46b4-801a-fe298a8ca5ca tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.210370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:14.218581 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-449e901e-b48c-486a-a727-b6665036351c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.388148 Apr 30 21:20:14.219691 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1310/2562] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:13 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:14.323316 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df129981-62a5-46b4-801a-fe298a8ca5ca tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.199041 Apr 30 21:20:14.323933 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1253/2563] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:20:14 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:14.384260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:14.384865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:14.394037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.394512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.398435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.399131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.602495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:14.610880 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0e0cf3ca-2e83-4fd4-ab43-a7648841a611 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.230483 Apr 30 21:20:14.612050 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1311/2564] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:14 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:14.644678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:14.645578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:14.654368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.654836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.655646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.656091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.692578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.693134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.693688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lazy-loading 'fault' on Instance uuid d77eab37-d34b-4e8c-9959-8d5661bf68fb {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:20:14.740767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:14.748444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1372641c-0a18-4850-954f-7b718ce6009d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1307 microversion: 2.1 time: 0.108889 Apr 30 21:20:14.749224 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1254/2565] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:14 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:14.771619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-07269d0c-1bcb-4bb5-95ca-6bc2c85b734f req-891a9164-5942-41bb-b300-e3bea76860f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a99313-2234-43cf-92e0-80ad0262a063", "name": "network-vif-plugged", "status": "completed", "tag": "411cb9bf-ba86-4506-a5f1-be9d564d6e55"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:14.783271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-07269d0c-1bcb-4bb5-95ca-6bc2c85b734f req-891a9164-5942-41bb-b300-e3bea76860f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.783937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-07269d0c-1bcb-4bb5-95ca-6bc2c85b734f req-891a9164-5942-41bb-b300-e3bea76860f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.795836 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-07269d0c-1bcb-4bb5-95ca-6bc2c85b734f req-891a9164-5942-41bb-b300-e3bea76860f6 service nova] Creating event network-vif-plugged:411cb9bf-ba86-4506-a5f1-be9d564d6e55 for instance 91a99313-2234-43cf-92e0-80ad0262a063 on nch2-master-1 Apr 30 21:20:14.800775 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-07269d0c-1bcb-4bb5-95ca-6bc2c85b734f req-891a9164-5942-41bb-b300-e3bea76860f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033433 Apr 30 21:20:14.801367 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1312/2566] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:20:14.830641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:14.831269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:14.837667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.838162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.838948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:14.839393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:14.982407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:14.990633 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a906ddab-9996-403f-9b97-d5442098f38e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 0.163841 Apr 30 21:20:14.991201 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1255/2567] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:14 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:15.237063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:15.238042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:15.244437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:15.244989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:15.246406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:15.246953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:15.489411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:15.504125 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5eb7f7b8-d604-4359-9818-8935fba75951 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.271218 Apr 30 21:20:15.506245 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1313/2568] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:15 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:15.628321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:15.628951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:15.636358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:15.637177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:15.638123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:15.638799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:15.775812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:15.784204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:15.794697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:15.795504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:15.796569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:15.797995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:15.842982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:15.843552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:15.844083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lazy-loading 'fault' on Instance uuid d77eab37-d34b-4e8c-9959-8d5661bf68fb {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:20:15.984950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:15.994603 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de04bc0c-556f-4f12-af9c-03dc04404ae7 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 200 len: 1307 microversion: 2.1 time: 0.233482 Apr 30 21:20:15.995357 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1314/2569] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:15 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:16.003660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:16.008655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:16.012434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:16.013013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:16.013933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:16.014507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:16.267167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:16.276064 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ede6943c-bfd1-44f2-aaea-d4de7a53b53d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.651596 Apr 30 21:20:16.277281 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1256/2570] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:15 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:16.283136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:16.284142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:16.292237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:16.293617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:16.295193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:16.295850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:16.611817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:16.622991 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d01a18c1-916e-43fc-8ae5-550cf53e4cd1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1589 microversion: 2.1 time: 0.625707 Apr 30 21:20:16.633474 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1315/2571] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:15 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1589 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:16.633474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-cd53fa79-8734-4f71-97b5-cc739242bf81 req-d0d03513-4ea0-4f94-a924-4ff1499e4026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96657a8f-3ac7-4f4b-a90a-0b487d135e52", "tag": "51b3842d-35b9-4bef-ad94-2041501dcf33"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:16.648481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cd53fa79-8734-4f71-97b5-cc739242bf81 req-d0d03513-4ea0-4f94-a924-4ff1499e4026 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:16.648481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cd53fa79-8734-4f71-97b5-cc739242bf81 req-d0d03513-4ea0-4f94-a924-4ff1499e4026 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:16.666023 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-cd53fa79-8734-4f71-97b5-cc739242bf81 req-d0d03513-4ea0-4f94-a924-4ff1499e4026 service nova] Creating event network-changed:51b3842d-35b9-4bef-ad94-2041501dcf33 for instance 96657a8f-3ac7-4f4b-a90a-0b487d135e52 on nch2-master-1 Apr 30 21:20:16.671661 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-cd53fa79-8734-4f71-97b5-cc739242bf81 req-d0d03513-4ea0-4f94-a924-4ff1499e4026 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046125 Apr 30 21:20:16.672399 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1316/2572] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:16.683518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:16.684346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:16.691927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:16.692464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:16.693367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:16.693951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:16.748224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:16.756731 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-105502f6-f88b-4c66-ad74-394c4e1a88d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1314 microversion: 2.1 time: 0.477993 Apr 30 21:20:16.757315 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1257/2573] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:16 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:16.922094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:16.931419 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1379c5e6-d8c7-4027-a74c-6198ce385c2a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.253417 Apr 30 21:20:16.939167 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1317/2574] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:16 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:17.014934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:17.015776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: d77eab37-d34b-4e8c-9959-8d5661bf68fb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:17.025605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.034185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.037425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.038304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.059073 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance d77eab37-d34b-4e8c-9959-8d5661bf68fb could not be found. Apr 30 21:20:17.059914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance d77eab37-d34b-4e8c-9959-8d5661bf68fb could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:17.060931 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a934a6e4-92a4-4ca1-b4a4-f5dcd7d7bbee tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb" status: 404 len: 111 microversion: 2.1 time: 0.050360 Apr 30 21:20:17.061875 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1258/2575] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:17 2022] GET /compute/v2.1/servers/d77eab37-d34b-4e8c-9959-8d5661bf68fb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:17.072309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:17.072940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:17.081228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.081878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.083170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.083711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.115482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:17.293496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:17.295843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:17.317188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.321185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.323975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.325514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.552588 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b3b69f7-779a-4802-a223-30d80ff46309 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f" status: 204 len: 0 microversion: 2.1 time: 0.484842 Apr 30 21:20:17.557619 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1318/2576] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:17 2022] DELETE /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:17.575128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:17.575891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:17.583803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.584380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.586313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:17.586796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:17.650275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:18.088791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1697c310-b95e-4fa4-8764-7fa10a7dc1f9 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 204 len: 0 microversion: 2.1 time: 0.528846 Apr 30 21:20:18.090412 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1319/2577] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:17 2022] DELETE /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:18.100049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:18.102040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:18.111388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:18.112385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:18.114155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:18.114930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:18.191796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:18.204874 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-69fec226-f246-4fec-a970-6a73b414a24a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.915968 Apr 30 21:20:18.206113 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1259/2578] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:17 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:18.213562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:18.213562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:18.220174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:18.220941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:18.223031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:18.223649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:18.439219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:18.449525 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-10b24a22-0d9e-4f07-a304-271f238aa2d6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1501 microversion: 2.1 time: 0.357665 Apr 30 21:20:18.450446 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1320/2579] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:18 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1501 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:18.456873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:18.457776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:18.477373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:18.479885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:18.481873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:18.485081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:18.743597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:18.752016 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-92499e40-b9c4-4aae-89a8-d17efecb753c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.544569 Apr 30 21:20:18.752604 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1260/2580] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:18 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:18.824779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:18.832861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ebab75ca-804d-4d7c-856c-91ea30973a64 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f" status: 200 len: 1474 microversion: 2.1 time: 0.381042 Apr 30 21:20:18.842079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1321/2581] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:18 2022] GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:19.222820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:19.224237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:19.231736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:19.240138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:19.241532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:19.250698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:19.775815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:19.777840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:19.788587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:19.789423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:19.790717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:19.792413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:19.916853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:19.946792 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0698c535-36d7-4331-814c-0b915d36a4ef tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.727875 Apr 30 21:20:19.947391 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1261/2582] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:19 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:19.952304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:19.953131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:19.960579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:19.961241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:19.962298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:19.962756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:20.424912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:20.437147 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2286b00d-21b4-43f5-a708-86224e535443 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.669268 Apr 30 21:20:20.437942 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1322/2583] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:19 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:20.448130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:20.467086 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd90a99a-e9e1-4477-aae2-4403675f197e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f" status: 200 len: 1474 microversion: 2.1 time: 0.516779 Apr 30 21:20:20.468668 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1262/2584] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:19 2022] GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:20.655624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-65236a5a-99ff-423e-8b87-3412ad8664fa req-0507abb5-0dc8-4879-aa7b-8a4206019b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eaeadd-696c-4555-a7a4-2fbcb85aae6f", "name": "network-vif-deleted", "tag": "da2ea81e-0c93-4fb7-b6de-96f247b81066"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:20.670396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-65236a5a-99ff-423e-8b87-3412ad8664fa req-0507abb5-0dc8-4879-aa7b-8a4206019b94 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:20.670944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-65236a5a-99ff-423e-8b87-3412ad8664fa req-0507abb5-0dc8-4879-aa7b-8a4206019b94 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:20.683626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-65236a5a-99ff-423e-8b87-3412ad8664fa req-0507abb5-0dc8-4879-aa7b-8a4206019b94 service nova] Creating event network-vif-deleted:da2ea81e-0c93-4fb7-b6de-96f247b81066 for instance 34eaeadd-696c-4555-a7a4-2fbcb85aae6f on nch1-master-1 Apr 30 21:20:20.689387 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-65236a5a-99ff-423e-8b87-3412ad8664fa req-0507abb5-0dc8-4879-aa7b-8a4206019b94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037482 Apr 30 21:20:20.690063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1323/2585] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:20.816146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5be18289-65a8-48dc-827d-bcac3b1db104 req-8a72b6a0-76c8-468b-8664-edd54e683019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce71b4fd-70d3-4703-8ca7-c1b569060a9f", "name": "network-vif-plugged", "status": "completed", "tag": "ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:20.834932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5be18289-65a8-48dc-827d-bcac3b1db104 req-8a72b6a0-76c8-468b-8664-edd54e683019 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:20.835410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5be18289-65a8-48dc-827d-bcac3b1db104 req-8a72b6a0-76c8-468b-8664-edd54e683019 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:20.848273 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5be18289-65a8-48dc-827d-bcac3b1db104 req-8a72b6a0-76c8-468b-8664-edd54e683019 service nova] Creating event network-vif-plugged:ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd for instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f on nch1-master-1 Apr 30 21:20:20.861086 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5be18289-65a8-48dc-827d-bcac3b1db104 req-8a72b6a0-76c8-468b-8664-edd54e683019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043873 Apr 30 21:20:20.861086 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1263/2586] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:20.965785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:20.966762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:20.984328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:20.994653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:20.995954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:20.997112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.192078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab9775d9-6c2c-4698-b34d-781ae5119763 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Action: 'create', calling method: .version_select at 0x7fdc261c2ee0>, body: {"keypair": {"name": "tempest-keypair-1375931719"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:21.221126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab9775d9-6c2c-4698-b34d-781ae5119763 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Getting quotas for project b81eb3fcf4664f479119191dbc28bf07. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:21.234823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab9775d9-6c2c-4698-b34d-781ae5119763 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Getting quotas for user af1585cd61ba445eba82fb0b5c74a460 and project b81eb3fcf4664f479119191dbc28bf07. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:21.511839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab9775d9-6c2c-4698-b34d-781ae5119763 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Getting quotas for project b81eb3fcf4664f479119191dbc28bf07. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:21.525085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab9775d9-6c2c-4698-b34d-781ae5119763 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Getting quotas for user af1585cd61ba445eba82fb0b5c74a460 and project b81eb3fcf4664f479119191dbc28bf07. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:21.550208 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab9775d9-6c2c-4698-b34d-781ae5119763 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.42 time: 0.362597 Apr 30 21:20:21.551320 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1264/2587] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Apr 30 21:20:21 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 365 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:20:21.558327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:21.559699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:21.567553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:21.568229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.569257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:21.570136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.626043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:21.635141 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9f56dea4-e10b-4fd8-abea-860c8a381ae6 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.674484 Apr 30 21:20:21.635789 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1324/2588] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:20 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:21.643131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:21.643983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:21.656741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:21.657131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.658033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:21.658482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.697506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:21.697998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.698468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lazy-loading 'fault' on Instance uuid 34eaeadd-696c-4555-a7a4-2fbcb85aae6f {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:20:21.811431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:21.822182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:21.823888 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a8cd9d0-8d73-4f57-a958-8b54572c0d60 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f" status: 200 len: 1309 microversion: 2.1 time: 0.185924 Apr 30 21:20:21.828050 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1325/2589] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:21 2022] GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:21.837886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55606186-0ef2-4dbd-836a-c0fefeb400d2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea469c91-90fa-49e9-98c2-38c22ad83db0"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:21.842041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55606186-0ef2-4dbd-836a-c0fefeb400d2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:21.849341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55606186-0ef2-4dbd-836a-c0fefeb400d2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:21.850082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55606186-0ef2-4dbd-836a-c0fefeb400d2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.850876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55606186-0ef2-4dbd-836a-c0fefeb400d2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:21.851319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55606186-0ef2-4dbd-836a-c0fefeb400d2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:21.873920 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c8e83d1a-e5f4-41bd-9d73-24d63a7eaa00 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.314424 Apr 30 21:20:21.887403 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1265/2590] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:21 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:22.653215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:22.654904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:22.661633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.662208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.663216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.663667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.744824 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55606186-0ef2-4dbd-836a-c0fefeb400d2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915314 Apr 30 21:20:22.745872 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1326/2591] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:20:21 2022] POST /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:22.756172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a1c88680-81c9-4436-a823-7961823787d1 req-276c7bb8-664d-49f9-a49f-4144587a2aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3855dbed-3ab0-4ad7-89a7-b2533f8489a5", "name": "network-vif-deleted", "tag": "c56ee71c-bad4-4c67-ba8d-174fb8fd7523"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:22.783023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a1c88680-81c9-4436-a823-7961823787d1 req-276c7bb8-664d-49f9-a49f-4144587a2aeb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.788344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a1c88680-81c9-4436-a823-7961823787d1 req-276c7bb8-664d-49f9-a49f-4144587a2aeb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.808123 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a1c88680-81c9-4436-a823-7961823787d1 req-276c7bb8-664d-49f9-a49f-4144587a2aeb service nova] Creating event network-vif-deleted:c56ee71c-bad4-4c67-ba8d-174fb8fd7523 for instance 3855dbed-3ab0-4ad7-89a7-b2533f8489a5 on nch2-master-1 Apr 30 21:20:22.823660 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a1c88680-81c9-4436-a823-7961823787d1 req-276c7bb8-664d-49f9-a49f-4144587a2aeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075990 Apr 30 21:20:22.824498 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1327/2592] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:22.848927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:22.849657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 34eaeadd-696c-4555-a7a4-2fbcb85aae6f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:22.857535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.858207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.859022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.859483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.863814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:22.873167 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4db74858-95cf-4067-86fa-d326350e914a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1324 microversion: 2.1 time: 0.224284 Apr 30 21:20:22.874451 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1266/2593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:22 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1324 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:22.885791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-bef201ea-52a0-4462-9985-b2464db6d36f req-384aeefd-9dd2-474d-8f68-1d6f109fe5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48b9d33-108e-4c2b-a7f1-91869f9b4fe8", "name": "network-vif-plugged", "status": "completed", "tag": "f2566869-85df-44a5-8e76-dd5804ef8cdb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:22.886653 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance 34eaeadd-696c-4555-a7a4-2fbcb85aae6f could not be found. Apr 30 21:20:22.890943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance 34eaeadd-696c-4555-a7a4-2fbcb85aae6f could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:22.892135 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0f7f4dc-5859-4a85-8949-5bd2b53bd216 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f" status: 404 len: 111 microversion: 2.1 time: 0.047711 Apr 30 21:20:22.893568 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1328/2594] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:22 2022] GET /compute/v2.1/servers/34eaeadd-696c-4555-a7a4-2fbcb85aae6f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:20:22.898704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-bef201ea-52a0-4462-9985-b2464db6d36f req-384aeefd-9dd2-474d-8f68-1d6f109fe5bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.899297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-bef201ea-52a0-4462-9985-b2464db6d36f req-384aeefd-9dd2-474d-8f68-1d6f109fe5bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.900680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:22.901430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:22.920150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.920493 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-bef201ea-52a0-4462-9985-b2464db6d36f req-384aeefd-9dd2-474d-8f68-1d6f109fe5bf service nova] Creating event network-vif-plugged:f2566869-85df-44a5-8e76-dd5804ef8cdb for instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 on nch2-master-1 Apr 30 21:20:22.921039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.922385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.924263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.928146 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-bef201ea-52a0-4462-9985-b2464db6d36f req-384aeefd-9dd2-474d-8f68-1d6f109fe5bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046850 Apr 30 21:20:22.929967 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1267/2595] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:22.935843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:22.937202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 3855dbed-3ab0-4ad7-89a7-b2533f8489a5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:22.960746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.962848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.965555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:22.972019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:22.991168 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance 3855dbed-3ab0-4ad7-89a7-b2533f8489a5 could not be found. Apr 30 21:20:22.993729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance 3855dbed-3ab0-4ad7-89a7-b2533f8489a5 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:22.993729 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-161ad71b-619a-4926-8582-8344035c3f75 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5" status: 404 len: 111 microversion: 2.1 time: 0.061404 Apr 30 21:20:22.994101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1268/2596] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:22 2022] GET /compute/v2.1/servers/3855dbed-3ab0-4ad7-89a7-b2533f8489a5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:23.001688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ca7c33f-b7ba-4828-81c4-fffe94cf4376 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:23.100452 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ca7c33f-b7ba-4828-81c4-fffe94cf4376 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/5c58043f-d67d-4e30-b3de-16c5aeb3daff" status: 204 len: 0 microversion: 2.1 time: 0.102522 Apr 30 21:20:23.101050 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1269/2597] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:20:22 2022] DELETE /compute/v2.1/os-server-groups/5c58043f-d67d-4e30-b3de-16c5aeb3daff => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:20:23.109840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:23.110365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:23.126015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.127058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:23.127967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.128541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:23.163834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:23.170201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:23.180535 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e52c98d0-4dc1-4844-91a1-6bcdfbb8092b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.284499 Apr 30 21:20:23.182540 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1329/2598] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:22 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:23.567837 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8ef861aa-e576-406c-b025-7db95f7ad133 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f" status: 204 len: 0 microversion: 2.1 time: 0.461626 Apr 30 21:20:23.568433 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1270/2599] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:23 2022] DELETE /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:20:23.576830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:23.577343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:23.583684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.584213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:23.585054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.585563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:23.611868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:23.893271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:23.894054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:23.908702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.909101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:23.909934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.910531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:23.956593 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef4ddf77-d65c-4261-8cae-d1d9465fb388 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 204 len: 0 microversion: 2.1 time: 0.383346 Apr 30 21:20:23.957347 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1330/2600] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:23 2022] DELETE /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:23.967566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:23.971509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:23.980744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.981710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:23.983435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:23.984081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:24.549481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:24.557425 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-01fb6114-032e-4494-98a2-e5dd790259d7 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 200 len: 1521 microversion: 2.1 time: 0.670303 Apr 30 21:20:24.558095 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1271/2601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:23 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:24.561769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:24.569788 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-763247ab-42ff-49da-9078-250cf5a7560d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f" status: 200 len: 1474 microversion: 2.1 time: 0.607455 Apr 30 21:20:24.570450 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1331/2602] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:23 2022] GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f => generated 1474 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:24.573220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:24.573873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:24.575398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.86"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:24.576714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:24.580024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:24.580494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:24.581279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:24.581907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:24.582790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:24.583240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:24.584013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:24.592463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:24.617485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Acquired lock "refresh_cache-8236137e-cfde-45ba-964c-d277d70c97d4" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:20:24.971263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:24.979214 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b84b4c0-8cc9-475c-9ba4-a8898c547e69 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.409811 Apr 30 21:20:24.979801 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1272/2603] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:24 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:24.984425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f73704c4-4c72-41b6-81a2-7a66fa4dd3bf req-19583925-cf5b-4238-bf5a-bc9c27bc280a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48b9d33-108e-4c2b-a7f1-91869f9b4fe8", "name": "network-vif-plugged", "status": "completed", "tag": "938b3124-c295-4ecf-b6a7-1c1b548c7665"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:24.994325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f73704c4-4c72-41b6-81a2-7a66fa4dd3bf req-19583925-cf5b-4238-bf5a-bc9c27bc280a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:24.994785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f73704c4-4c72-41b6-81a2-7a66fa4dd3bf req-19583925-cf5b-4238-bf5a-bc9c27bc280a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:25.006946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f73704c4-4c72-41b6-81a2-7a66fa4dd3bf req-19583925-cf5b-4238-bf5a-bc9c27bc280a service nova] Creating event network-vif-plugged:938b3124-c295-4ecf-b6a7-1c1b548c7665 for instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 on nch2-master-1 Apr 30 21:20:25.012847 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f73704c4-4c72-41b6-81a2-7a66fa4dd3bf req-19583925-cf5b-4238-bf5a-bc9c27bc280a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Apr 30 21:20:25.013449 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1273/2604] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:25.150965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2017104655", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0f28b49f-01d7-4c9d-82d6-265d3558ca5b"}, {"port": "83b262c0-f5b8-4175-b9b8-1163fa513cc0", "tag": "port-1"}, {"port": "68951237-c8b8-42a1-8ab3-47a4e01c2f51", "tag": "port-2"}, {"uuid": "2398732c-111b-435b-a08f-1b346cc08b51", "tag": "net-1"}, {"uuid": "2398732c-111b-435b-a08f-1b346cc08b51"}, {"uuid": "b8d11e40-b37d-4318-bdf2-7339b1b28107", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b8d11e40-b37d-4318-bdf2-7339b1b28107", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "36930a8a-00bb-4076-b396-25ba68392b9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "27b24866-27ef-457f-bbcc-0152de7c242b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "04049fb4-d6f1-4d01-83c2-db5981be2487", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--982000583"}], "key_name": "tempest-keypair-1375931719", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:25.330820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] validate_networks() for [('0f28b49f-01d7-4c9d-82d6-265d3558ca5b', None, None, None, None, None), (None, None, '83b262c0-f5b8-4175-b9b8-1163fa513cc0', None, None, None), (None, None, '68951237-c8b8-42a1-8ab3-47a4e01c2f51', None, None, None), ('2398732c-111b-435b-a08f-1b346cc08b51', None, None, None, None, None), ('2398732c-111b-435b-a08f-1b346cc08b51', None, None, None, None, None), ('b8d11e40-b37d-4318-bdf2-7339b1b28107', '10.2.2.100', None, None, None, None), ('b8d11e40-b37d-4318-bdf2-7339b1b28107', '10.2.2.200', None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:20:26.929686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Building network info cache for instance {{(pid=130671) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:20:28.192903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Updating instance_info_cache with network_info: [{"id": "85c0da70-e0eb-430c-af77-63aac46b8dc4", "address": "fa:16:3e:fb:a3:5a", "network": {"id": "98b1dbd8-5abb-448b-9acd-f922dee70a3d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1807871381-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6cebc4a4f75349b09fd03f67d0207875", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap85c0da70-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130671) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:20:28.276085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Releasing lock "refresh_cache-8236137e-cfde-45ba-964c-d277d70c97d4" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:20:28.278013 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a277c15d-b55c-482c-8f56-6c399e28110e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action" status: 202 len: 0 microversion: 2.1 time: 3.706167 Apr 30 21:20:28.284794 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1332/2605] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:20:24 2022] POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action => generated 0 bytes in 3707 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:20:28.286574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:28.287245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:28.295004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:28.295651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:28.296546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:28.297214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:28.418707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:28.426252 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4595a663-90a7-4d8b-bc04-ed864f1f0b17 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f" status: 200 len: 1304 microversion: 2.1 time: 0.146602 Apr 30 21:20:28.426833 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1333/2606] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:28 2022] GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:28.431917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:28.432539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:28.439034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:28.439793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:28.440890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:28.441347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:28.739104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:28.747043 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e73feff1-2b27-4e71-8d55-11c9d0b1e601 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1334 microversion: 2.1 time: 0.319216 Apr 30 21:20:28.747608 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1334/2607] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:28 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1334 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:28.752075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ae801b7f-c0a7-4ed5-9c5e-87181bbfeda4 req-b8afbeab-49bd-486f-9568-646ac84fb10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8236137e-cfde-45ba-964c-d277d70c97d4", "tag": "85c0da70-e0eb-430c-af77-63aac46b8dc4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:28.761415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ae801b7f-c0a7-4ed5-9c5e-87181bbfeda4 req-b8afbeab-49bd-486f-9568-646ac84fb10e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:28.761902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ae801b7f-c0a7-4ed5-9c5e-87181bbfeda4 req-b8afbeab-49bd-486f-9568-646ac84fb10e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:28.773357 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ae801b7f-c0a7-4ed5-9c5e-87181bbfeda4 req-b8afbeab-49bd-486f-9568-646ac84fb10e service nova] Creating event network-changed:85c0da70-e0eb-430c-af77-63aac46b8dc4 for instance 8236137e-cfde-45ba-964c-d277d70c97d4 on nch1-master-1 Apr 30 21:20:28.778452 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ae801b7f-c0a7-4ed5-9c5e-87181bbfeda4 req-b8afbeab-49bd-486f-9568-646ac84fb10e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029601 Apr 30 21:20:28.779150 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1335/2608] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:28.784226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.86"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:28.785377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:28.791984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:28.792124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:28.793006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:28.794186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:28.822715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Acquired lock "refresh_cache-ce71b4fd-70d3-4703-8ca7-c1b569060a9f" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:20:30.489877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:20:30.490334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:20:30.491262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:20:30.491683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:20:30.492103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:20:30.502649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:30.503137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:30.503964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:30.504611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:30.521931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Getting quotas for project b81eb3fcf4664f479119191dbc28bf07. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:30.527832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Getting quotas for user af1585cd61ba445eba82fb0b5c74a460 and project b81eb3fcf4664f479119191dbc28bf07. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:30.683898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:20:30.685259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='36930a8a-00bb-4076-b396-25ba68392b9d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='27b24866-27ef-457f-bbcc-0152de7c242b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04049fb4-d6f1-4d01-83c2-db5981be2487',volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:20:31.571542 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.network.neutron [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] re-assign floating IP 172.35.4.86 from instance 8236137e-cfde-45ba-964c-d277d70c97d4 Apr 30 21:20:31.615768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Building network info cache for instance {{(pid=130671) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:20:31.627696 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.480811 Apr 30 21:20:31.634886 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1274/2609] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Apr 30 21:20:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 6489 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:20:31.640348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:31.641086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:31.648400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:31.649707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:31.650729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:31.651331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:31.684094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:32.013498 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c902e5d3-070d-4044-9313-394ff9e0b91c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 204 len: 0 microversion: 2.1 time: 0.376825 Apr 30 21:20:32.014161 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1275/2610] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:31 2022] DELETE /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:32.021812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:32.023018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: a4bb5b19-edd9-4351-babc-faf38634044f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:32.030856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.031768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.032755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.033437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.050152 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance a4bb5b19-edd9-4351-babc-faf38634044f could not be found. Apr 30 21:20:32.051311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance a4bb5b19-edd9-4351-babc-faf38634044f could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:32.052347 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78d050ef-65e7-4d08-86ec-7ec7aabd1c54 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f" status: 404 len: 111 microversion: 2.1 time: 0.036896 Apr 30 21:20:32.054319 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1276/2611] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:32 2022] GET /compute/v2.1/servers/a4bb5b19-edd9-4351-babc-faf38634044f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:32.061517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:32.066435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:32.074110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.074949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.075888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.076485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.224646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Updating instance_info_cache with network_info: [{"id": "85c0da70-e0eb-430c-af77-63aac46b8dc4", "address": "fa:16:3e:fb:a3:5a", "network": {"id": "98b1dbd8-5abb-448b-9acd-f922dee70a3d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1807871381-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6cebc4a4f75349b09fd03f67d0207875", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap85c0da70-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130671) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:20:32.263422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:32.271627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1aca082a-41f2-462f-9f5d-2ba304bf202d tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1671 microversion: 2.1 time: 0.216184 Apr 30 21:20:32.272477 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1277/2612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:32 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1671 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:32.277028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f8d671ca-d4d2-4fcd-b294-09139856fbdb req-06002c7a-ba4a-4e99-a7e3-132fa8f91f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bb5b19-edd9-4351-babc-faf38634044f", "name": "network-vif-deleted", "tag": "a28b17c3-a6e2-4e33-a643-c161b9604200"}, {"server_uuid": "bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd", "name": "network-vif-deleted", "tag": "2b047f63-008f-47b1-9417-8f313dc6c3bc"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:32.290705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f8d671ca-d4d2-4fcd-b294-09139856fbdb req-06002c7a-ba4a-4e99-a7e3-132fa8f91f5f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.292193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f8d671ca-d4d2-4fcd-b294-09139856fbdb req-06002c7a-ba4a-4e99-a7e3-132fa8f91f5f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.306930 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f8d671ca-d4d2-4fcd-b294-09139856fbdb req-06002c7a-ba4a-4e99-a7e3-132fa8f91f5f service nova] Creating event network-vif-deleted:a28b17c3-a6e2-4e33-a643-c161b9604200 for instance a4bb5b19-edd9-4351-babc-faf38634044f on nch2-master-1 Apr 30 21:20:32.307543 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f8d671ca-d4d2-4fcd-b294-09139856fbdb req-06002c7a-ba4a-4e99-a7e3-132fa8f91f5f service nova] Creating event network-vif-deleted:2b047f63-008f-47b1-9417-8f313dc6c3bc for instance bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd on nch2-master-1 Apr 30 21:20:32.309642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Building network info cache for instance {{(pid=130671) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:20:32.314649 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f8d671ca-d4d2-4fcd-b294-09139856fbdb req-06002c7a-ba4a-4e99-a7e3-132fa8f91f5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040835 Apr 30 21:20:32.316222 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1278/2613] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:32.324496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5658b285-33b9-4cf1-add6-326d4f3b1957 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:32.325415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5658b285-33b9-4cf1-add6-326d4f3b1957 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:32.384683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5658b285-33b9-4cf1-add6-326d4f3b1957 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:32.395548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5658b285-33b9-4cf1-add6-326d4f3b1957 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:32.397270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5658b285-33b9-4cf1-add6-326d4f3b1957 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:32.398731 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5658b285-33b9-4cf1-add6-326d4f3b1957 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1286 microversion: 2.42 time: 0.080932 Apr 30 21:20:32.404424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1279/2614] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:32 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:32.409040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:32.409671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:32.416212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.416706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.417503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.417979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.914161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:32.923808 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4a5d40b-a754-439c-8a1b-8c6d0011ccec tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1553 microversion: 2.1 time: 0.518445 Apr 30 21:20:32.925644 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1280/2615] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:32 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1553 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:32.935791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:32.941378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:32.948371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.948835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.949648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.950189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.966623 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd could not be found. Apr 30 21:20:32.967238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:32.968093 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4070cfd-ab95-463e-bf2d-e2296760f749 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd" status: 404 len: 111 microversion: 2.1 time: 0.041327 Apr 30 21:20:32.968661 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1281/2616] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:32 2022] GET /compute/v2.1/servers/bc3f689b-e59d-4ba7-bff2-0d6e7b56f0cd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:32.973819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ae018a9-a432-44e6-b949-8d334c38034a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:32.974554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ae018a9-a432-44e6-b949-8d334c38034a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:32.987648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ae018a9-a432-44e6-b949-8d334c38034a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.987648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ae018a9-a432-44e6-b949-8d334c38034a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:32.987648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ae018a9-a432-44e6-b949-8d334c38034a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:32.987648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ae018a9-a432-44e6-b949-8d334c38034a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.010234 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ae018a9-a432-44e6-b949-8d334c38034a tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8/ips" status: 200 len: 181 microversion: 2.1 time: 0.040314 Apr 30 21:20:33.010836 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1282/2617] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:20:32 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8/ips => generated 181 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:33.017566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fdf2155d-6e31-400e-a09f-f377481a4ddf tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:33.146273 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fdf2155d-6e31-400e-a09f-f377481a4ddf tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/8aeb6ac2-9a78-487d-afaf-34842678fb54" status: 204 len: 0 microversion: 2.1 time: 0.134181 Apr 30 21:20:33.146877 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1283/2618] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:20:33 2022] DELETE /compute/v2.1/os-server-groups/8aeb6ac2-9a78-487d-afaf-34842678fb54 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:33.151476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:33.151993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:33.158518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.160978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.160978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.160978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.193264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:33.249891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Updating instance_info_cache with network_info: [{"id": "ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd", "address": "fa:16:3e:89:59:ba", "network": {"id": "98b1dbd8-5abb-448b-9acd-f922dee70a3d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1807871381-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6cebc4a4f75349b09fd03f67d0207875", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapffd1a6c9-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130671) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:20:33.314648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Releasing lock "refresh_cache-ce71b4fd-70d3-4703-8ca7-c1b569060a9f" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:20:33.315906 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-74ee0d3b-3d92-43a9-8083-7ade2a9460ab tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f/action" status: 202 len: 0 microversion: 2.1 time: 4.535672 Apr 30 21:20:33.316959 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1336/2619] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:20:28 2022] POST /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f/action => generated 0 bytes in 4537 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:20:33.322734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:33.323430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:33.329625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.330508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.331260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.331711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.360201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:33.470024 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-089366ea-bbc8-4eaf-ae3b-c3b0684b0851 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 204 len: 0 microversion: 2.1 time: 0.321806 Apr 30 21:20:33.470704 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1284/2620] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:33 2022] DELETE /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:33.476437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'action', calling method: .version_select at 0x7fdc2325d5e0>, body: {"removeFloatingIp": {"address": "172.35.4.86"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:33.621301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:33.627816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.628305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.629093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.629538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.678684 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-03e98284-07f1-4b2f-b642-bb155dec4587 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 204 len: 0 microversion: 2.1 time: 0.359876 Apr 30 21:20:33.679494 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1337/2621] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:33 2022] DELETE /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:33.685936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:33.686464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:33.692554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.693016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.693870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.694319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.766968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:33.776343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:33.777935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:33.779097 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56524d50-0a7d-4098-9299-96f3431efb2f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1528 microversion: 2.42 time: 0.097659 Apr 30 21:20:33.779662 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1338/2622] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:33 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1528 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:33.784782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:33.785563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:33.793271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.793738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.794632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.795082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.953852 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] HTTP exception thrown: Floating IP 172.35.4.86 is not associated with instance 8236137e-cfde-45ba-964c-d277d70c97d4. Apr 30 21:20:33.954576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Returning 409 to user: Floating IP 172.35.4.86 is not associated with instance 8236137e-cfde-45ba-964c-d277d70c97d4. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:33.955770 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0300617f-4b58-4969-ac10-f9be345430e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action" status: 409 len: 145 microversion: 2.1 time: 0.483752 Apr 30 21:20:33.956964 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1285/2623] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:20:33 2022] POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action => generated 145 bytes in 486 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:20:33.964486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:33.964486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:33.969876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.970350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.971152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:33.971603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:33.993574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:34.000470 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f68ffc8-ac7f-4718-b1b1-e4fd1a15ad52 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1677 microversion: 2.1 time: 0.219797 Apr 30 21:20:34.001048 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1339/2624] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:33 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:34.005786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:34.006593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:34.012665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:34.015881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:34.015881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:34.015881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:34.149516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:34.159329 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-527c5898-8ade-43dd-a26d-4fd05d0913d4 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1472 microversion: 2.1 time: 0.201127 Apr 30 21:20:34.160208 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1286/2625] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:33 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:34.167874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.86"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:34.181106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:34.191349 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3df43ec5-d294-44f1-9a5d-79abb9c501cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1553 microversion: 2.1 time: 0.189041 Apr 30 21:20:34.194022 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1340/2626] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:34 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:34.299683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:34.306890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:34.307438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:34.308190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:34.308642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:34.330515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c66527bd-3231-49fd-ac47-f07ba3e0ee1c req-0af00c1d-f438-4d5b-b91d-db402b1e2c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8236137e-cfde-45ba-964c-d277d70c97d4", "tag": "85c0da70-e0eb-430c-af77-63aac46b8dc4"}, {"name": "network-changed", "server_uuid": "ce71b4fd-70d3-4703-8ca7-c1b569060a9f", "tag": "ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:34.342519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c66527bd-3231-49fd-ac47-f07ba3e0ee1c req-0af00c1d-f438-4d5b-b91d-db402b1e2c1a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:34.343241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c66527bd-3231-49fd-ac47-f07ba3e0ee1c req-0af00c1d-f438-4d5b-b91d-db402b1e2c1a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:34.357665 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c66527bd-3231-49fd-ac47-f07ba3e0ee1c req-0af00c1d-f438-4d5b-b91d-db402b1e2c1a service nova] Creating event network-changed:85c0da70-e0eb-430c-af77-63aac46b8dc4 for instance 8236137e-cfde-45ba-964c-d277d70c97d4 on nch1-master-1 Apr 30 21:20:34.358223 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c66527bd-3231-49fd-ac47-f07ba3e0ee1c req-0af00c1d-f438-4d5b-b91d-db402b1e2c1a service nova] Creating event network-changed:ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd for instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f on nch1-master-1 Apr 30 21:20:34.364798 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c66527bd-3231-49fd-ac47-f07ba3e0ee1c req-0af00c1d-f438-4d5b-b91d-db402b1e2c1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038373 Apr 30 21:20:34.365585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1341/2627] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:20:34.616906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Acquired lock "refresh_cache-ce71b4fd-70d3-4703-8ca7-c1b569060a9f" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:20:34.801215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:34.801955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:34.815644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:34.820519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:34.822898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:34.823554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:34.990912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:35.007503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:35.010035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:35.011536 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-adbe6429-9169-4e44-91a0-5852c50ee6bc tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1584 microversion: 2.42 time: 0.215063 Apr 30 21:20:35.012687 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1342/2628] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:34 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1584 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:20:35.018120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:35.019164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:35.027438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:35.028227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:35.029241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:35.030070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:35.404131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:35.416771 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-78059060-91cf-47f2-afb6-c1f83b4701b0 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1677 microversion: 2.1 time: 0.402798 Apr 30 21:20:35.417559 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1343/2629] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:35 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1677 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:35.422243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:35.423151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:35.432991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:35.447214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:35.448186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:35.450024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:35.772501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:35.781514 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ba71bb8-4249-454b-9e46-78fd75d875e2 tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1472 microversion: 2.1 time: 0.362766 Apr 30 21:20:35.782305 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1344/2630] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:35 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:35.787396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:35.788217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:35.797705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:35.798187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:35.799663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:35.800552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:37.080625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:37.091021 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e6432a6d-7dc7-457c-a5fb-b539b2644c6b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1553 microversion: 2.1 time: 1.307371 Apr 30 21:20:37.092614 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1345/2631] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:35 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1553 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:37.098265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:37.099106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:37.107589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:37.108272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:37.109247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:37.109909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:37.287718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Building network info cache for instance {{(pid=130670) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:20:37.704203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:37.715209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:37.721214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:37.721214 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2a398463-0e47-459a-a6c9-6348b28b26e2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1707 microversion: 2.42 time: 0.624100 Apr 30 21:20:37.749590 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1346/2632] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:37 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1707 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:37.754921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:37.770386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:37.784031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:37.790374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:37.791311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:37.791768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:38.298379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:38.314621 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b87df80-30b7-499c-a424-af574c17e86c tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1677 microversion: 2.1 time: 0.563395 Apr 30 21:20:38.315381 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1347/2633] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:37 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1677 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:38.320501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:38.321327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:38.328019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:38.328796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:38.329977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:38.331298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:38.736189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:38.745886 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7633eab9-9fbf-4cb5-bab5-4660adcbbb4e tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1472 microversion: 2.1 time: 0.429144 Apr 30 21:20:38.746707 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1348/2634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:38 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:38.752050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d0c43bb6-28bb-4968-b6b3-5509234737e7 req-dfdacd4d-9508-4c93-81fc-cc64d38e533a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce71b4fd-70d3-4703-8ca7-c1b569060a9f", "tag": "ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:38.761459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0c43bb6-28bb-4968-b6b3-5509234737e7 req-dfdacd4d-9508-4c93-81fc-cc64d38e533a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:38.762144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0c43bb6-28bb-4968-b6b3-5509234737e7 req-dfdacd4d-9508-4c93-81fc-cc64d38e533a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:38.777520 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d0c43bb6-28bb-4968-b6b3-5509234737e7 req-dfdacd4d-9508-4c93-81fc-cc64d38e533a service nova] Creating event network-changed:ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd for instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f on nch1-master-1 Apr 30 21:20:38.783463 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d0c43bb6-28bb-4968-b6b3-5509234737e7 req-dfdacd4d-9508-4c93-81fc-cc64d38e533a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034623 Apr 30 21:20:38.784490 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1349/2635] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:38.796948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f6d4385d-81ae-4aab-8a29-89eeb1a69830 req-a9f0eb7b-becc-441f-ba44-0b4075cf9490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a99313-2234-43cf-92e0-80ad0262a063", "name": "network-vif-unplugged", "status": "completed", "tag": "411cb9bf-ba86-4506-a5f1-be9d564d6e55"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:38.813273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f6d4385d-81ae-4aab-8a29-89eeb1a69830 req-a9f0eb7b-becc-441f-ba44-0b4075cf9490 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:38.813924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f6d4385d-81ae-4aab-8a29-89eeb1a69830 req-a9f0eb7b-becc-441f-ba44-0b4075cf9490 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:38.829264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f6d4385d-81ae-4aab-8a29-89eeb1a69830 req-a9f0eb7b-becc-441f-ba44-0b4075cf9490 service nova] Creating event network-vif-unplugged:411cb9bf-ba86-4506-a5f1-be9d564d6e55 for instance 91a99313-2234-43cf-92e0-80ad0262a063 on nch2-master-1 Apr 30 21:20:38.848546 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f6d4385d-81ae-4aab-8a29-89eeb1a69830 req-a9f0eb7b-becc-441f-ba44-0b4075cf9490 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060085 Apr 30 21:20:38.848546 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1350/2636] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:38.857195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:38.861999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:38.869750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:38.870839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:38.872339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:38.872935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.199011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:39.210514 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ef05bfe-1d7d-4b14-996f-2276f1fae600 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1511 microversion: 2.1 time: 0.359344 Apr 30 21:20:39.211374 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1351/2637] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:38 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:39.220853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:39.222385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:39.229395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.229885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.230687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.231126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.351244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Updating instance_info_cache with network_info: [{"id": "ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd", "address": "fa:16:3e:89:59:ba", "network": {"id": "98b1dbd8-5abb-448b-9acd-f922dee70a3d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1807871381-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6cebc4a4f75349b09fd03f67d0207875", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapffd1a6c9-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130670) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:20:39.368094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Releasing lock "refresh_cache-ce71b4fd-70d3-4703-8ca7-c1b569060a9f" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:20:39.369266 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc99b13c-f6cc-44d8-a90a-222fff0ac915 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f/action" status: 202 len: 0 microversion: 2.1 time: 5.207818 Apr 30 21:20:39.370318 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1287/2638] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:20:34 2022] POST /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f/action => generated 0 bytes in 5209 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:20:39.375881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:39.376950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:39.384648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.385272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.386254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.387084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.727867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:39.744756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:39.749946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:39.754164 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e06d0361-8785-4fc7-8552-59eca2ec30f4 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1799 microversion: 2.42 time: 0.535922 Apr 30 21:20:39.755944 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1352/2639] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:39 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1799 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:39.778247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:39.778247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:39.792081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.792629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.797630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.798353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.877573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:39.880375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:39.891395 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75c6e8d5-b83e-4a5d-8363-ef95c55f9f0f tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1656 microversion: 2.1 time: 0.519820 Apr 30 21:20:39.901359 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1288/2640] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:39 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1656 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:39.901359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:39.901359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:39.915154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.915611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.917738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.918298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.963528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:39.964056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:39.964729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lazy-loading 'fault' on Instance uuid 2190c553-068c-486e-b740-cca74445af33 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:20:40.306554 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a030349-8d3c-44e7-8a50-ca1b5ae65e3a tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 204 len: 0 microversion: 2.1 time: 0.547595 Apr 30 21:20:40.315093 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1353/2641] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:39 2022] DELETE /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:40.322442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:40.323514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:40.333014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:40.333735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:40.337515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:40.338456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:40.382810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:40.384091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:40.384388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1961bb1779214710bc073d188262f1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a580f2f8645c28e9590806928ed91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:40.385208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lazy-loading 'fault' on Instance uuid 91a99313-2234-43cf-92e0-80ad0262a063 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:20:40.393967 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-024f6994-a528-4cc1-86e5-b0d828aa318d tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 200 len: 1307 microversion: 2.1 time: 0.500265 Apr 30 21:20:40.395152 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1289/2642] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:39 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 1307 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:40.419818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.86"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:40.421025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:40.427529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:40.428702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:40.429719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:40.430202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:40.462234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Acquired lock "refresh_cache-8236137e-cfde-45ba-964c-d277d70c97d4" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:20:40.472851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:40.487178 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d948602f-8bf5-4ae5-8c6b-66af645b831f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 200 len: 1350 microversion: 2.1 time: 0.165357 Apr 30 21:20:40.487178 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1354/2643] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:40 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:40.778519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:40.779239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:40.790068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:40.791866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:40.792758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:40.793265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.088277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:41.097514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:41.099079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:41.100252 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b7bb4b25-3697-4c10-bfd7-461c9535c3a2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1845 microversion: 2.42 time: 0.326505 Apr 30 21:20:41.100825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1355/2644] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:40 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1845 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:20:41.116379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-11cd7556-3663-4808-9f4b-32b78907d970 req-b567aa80-6539-45af-96c9-cfe1b7bbfccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2190c553-068c-486e-b740-cca74445af33", "name": "network-vif-deleted", "tag": "3bf656ae-1f28-4b83-93e5-60f173aa4d0f"}, {"server_uuid": "d48b9d33-108e-4c2b-a7f1-91869f9b4fe8", "name": "network-vif-deleted", "tag": "938b3124-c295-4ecf-b6a7-1c1b548c7665"}, {"server_uuid": "91a99313-2234-43cf-92e0-80ad0262a063", "name": "network-vif-deleted", "tag": "411cb9bf-ba86-4506-a5f1-be9d564d6e55"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:41.126555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-11cd7556-3663-4808-9f4b-32b78907d970 req-b567aa80-6539-45af-96c9-cfe1b7bbfccb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.127011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-11cd7556-3663-4808-9f4b-32b78907d970 req-b567aa80-6539-45af-96c9-cfe1b7bbfccb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.142192 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-11cd7556-3663-4808-9f4b-32b78907d970 req-b567aa80-6539-45af-96c9-cfe1b7bbfccb service nova] Creating event network-vif-deleted:3bf656ae-1f28-4b83-93e5-60f173aa4d0f for instance 2190c553-068c-486e-b740-cca74445af33 on nch2-master-1 Apr 30 21:20:41.142752 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-11cd7556-3663-4808-9f4b-32b78907d970 req-b567aa80-6539-45af-96c9-cfe1b7bbfccb service nova] Creating event network-vif-deleted:938b3124-c295-4ecf-b6a7-1c1b548c7665 for instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 on nch2-master-1 Apr 30 21:20:41.143271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-11cd7556-3663-4808-9f4b-32b78907d970 req-b567aa80-6539-45af-96c9-cfe1b7bbfccb service nova] Creating event network-vif-deleted:411cb9bf-ba86-4506-a5f1-be9d564d6e55 for instance 91a99313-2234-43cf-92e0-80ad0262a063 on nch2-master-1 Apr 30 21:20:41.152436 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-11cd7556-3663-4808-9f4b-32b78907d970 req-b567aa80-6539-45af-96c9-cfe1b7bbfccb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039566 Apr 30 21:20:41.153058 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1356/2645] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:41.158237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8547c5cb-d6c1-45fa-9538-d2d7d441faa9 req-31e773d9-7ffd-483a-b8ef-e1182e6e5f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48b9d33-108e-4c2b-a7f1-91869f9b4fe8", "name": "network-vif-unplugged", "status": "completed", "tag": "f2566869-85df-44a5-8e76-dd5804ef8cdb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:41.167225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8547c5cb-d6c1-45fa-9538-d2d7d441faa9 req-31e773d9-7ffd-483a-b8ef-e1182e6e5f60 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.167694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8547c5cb-d6c1-45fa-9538-d2d7d441faa9 req-31e773d9-7ffd-483a-b8ef-e1182e6e5f60 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.179104 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8547c5cb-d6c1-45fa-9538-d2d7d441faa9 req-31e773d9-7ffd-483a-b8ef-e1182e6e5f60 service nova] Creating event network-vif-unplugged:f2566869-85df-44a5-8e76-dd5804ef8cdb for instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 on nch2-master-1 Apr 30 21:20:41.183795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8547c5cb-d6c1-45fa-9538-d2d7d441faa9 req-31e773d9-7ffd-483a-b8ef-e1182e6e5f60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029253 Apr 30 21:20:41.184387 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1357/2646] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:41.189472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:41.190209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:41.196845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.197309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.198121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.198574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.279000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e57c830031491a9d8fd6b3664b4390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692585b32bd44ddb8ab633a1f1842d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:41.286890 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc76962b-78c8-42ca-bcdb-822c412beb30 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 200 len: 1298 microversion: 2.1 time: 0.101352 Apr 30 21:20:41.287474 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1358/2647] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:41 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:41.411941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:41.412589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] [instance: 2190c553-068c-486e-b740-cca74445af33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:41.419515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.420037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.420820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.421263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.436902 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] HTTP exception thrown: Instance 2190c553-068c-486e-b740-cca74445af33 could not be found. Apr 30 21:20:41.437328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] Returning 404 to user: Instance 2190c553-068c-486e-b740-cca74445af33 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:41.438181 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-155e6bf8-be2d-47b2-9bde-d7edfb22707c tempest-ServersOnMultiNodesTest-1527225414 tempest-ServersOnMultiNodesTest-1527225414-project] 10.222.0.23 "GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33" status: 404 len: 111 microversion: 2.1 time: 0.030217 Apr 30 21:20:41.439264 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1359/2648] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:41 2022] GET /compute/v2.1/servers/2190c553-068c-486e-b740-cca74445af33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:20:41.501731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:41.503572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:41.516269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.517600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.519262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.520676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.573419 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. Apr 30 21:20:41.575163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:41.576238 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0bf0c5c-aa9b-4045-bd4b-ffc5a3e386a1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 404 len: 111 microversion: 2.1 time: 0.080720 Apr 30 21:20:41.578992 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1360/2649] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:41 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:20:41.710740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:41.711814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:41.719076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.719765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.720724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:41.721329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:41.735622 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. Apr 30 21:20:41.736257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:41.737106 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ca6f1c0-1a40-4c35-8b1c-fb5548b84559 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032641 Apr 30 21:20:41.740989 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1361/2650] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:20:41 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:41.862052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-245565812", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5c8b504b-43e7-4642-bbf0-dab49293fda8"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:41.931782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] validate_networks() for [('5c8b504b-43e7-4642-bbf0-dab49293fda8', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:20:42.578439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Building network info cache for instance {{(pid=130670) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:20:43.282900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:20:43.283449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:20:43.283791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:20:43.284200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:20:43.284761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:20:43.300883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:43.301342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:43.302263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:43.303273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:43.336910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:43.344963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for user 2f5eafa970bd4247bdaef1cda747c3fc and project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:43.360801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:20:43.363990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:20:43.516698 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bb15e185-e66c-4e8d-9ccc-8f9731274ec1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659351 Apr 30 21:20:43.517350 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1362/2651] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:20:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:20:43.536866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:43.541918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:43.571133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:43.571592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:43.581702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:43.582108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:44.054070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:44.069356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:44.077317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:44.078885 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d384c58c-dfea-4357-9d16-ce79c939b359 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1854 microversion: 2.42 time: 0.555693 Apr 30 21:20:44.084223 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1363/2652] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:43 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1854 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:44.097590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:44.104250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:44.118891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:44.119625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:44.120613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:44.127978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:44.154380 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] HTTP exception thrown: Instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 could not be found. Apr 30 21:20:44.154380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Returning 404 to user: Instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:44.155346 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a42e4790-dbfc-48b3-a30b-e66269320e7b tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 404 len: 111 microversion: 2.1 time: 0.069788 Apr 30 21:20:44.155910 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1364/2653] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:44 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:44.172478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-30dd047a-3d3d-47ed-911e-8012d0a082da req-ff43d166-5196-44ae-8b2f-cd30eea85ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "b222076d-c1a2-4c03-8c2a-48a53d5a9274"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:44.191312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-30dd047a-3d3d-47ed-911e-8012d0a082da req-ff43d166-5196-44ae-8b2f-cd30eea85ef4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:44.191779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-30dd047a-3d3d-47ed-911e-8012d0a082da req-ff43d166-5196-44ae-8b2f-cd30eea85ef4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:44.220075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-30dd047a-3d3d-47ed-911e-8012d0a082da req-ff43d166-5196-44ae-8b2f-cd30eea85ef4 service nova] Creating event network-changed:b222076d-c1a2-4c03-8c2a-48a53d5a9274 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:20:44.232771 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-30dd047a-3d3d-47ed-911e-8012d0a082da req-ff43d166-5196-44ae-8b2f-cd30eea85ef4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064791 Apr 30 21:20:44.233785 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1365/2654] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:44.242662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-210af2de-f6df-456c-a4f2-196653475dd2 req-9a4e71fd-290b-44f8-b3a1-404cf2b550b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48b9d33-108e-4c2b-a7f1-91869f9b4fe8", "name": "network-vif-deleted", "tag": "f2566869-85df-44a5-8e76-dd5804ef8cdb"}, {"name": "network-changed", "server_uuid": "8236137e-cfde-45ba-964c-d277d70c97d4", "tag": "85c0da70-e0eb-430c-af77-63aac46b8dc4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:44.281198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-210af2de-f6df-456c-a4f2-196653475dd2 req-9a4e71fd-290b-44f8-b3a1-404cf2b550b6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:44.281737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-210af2de-f6df-456c-a4f2-196653475dd2 req-9a4e71fd-290b-44f8-b3a1-404cf2b550b6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:44.308072 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-210af2de-f6df-456c-a4f2-196653475dd2 req-9a4e71fd-290b-44f8-b3a1-404cf2b550b6 service nova] Creating event network-vif-deleted:f2566869-85df-44a5-8e76-dd5804ef8cdb for instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 on nch2-master-1 Apr 30 21:20:44.311184 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-210af2de-f6df-456c-a4f2-196653475dd2 req-9a4e71fd-290b-44f8-b3a1-404cf2b550b6 service nova] Creating event network-changed:85c0da70-e0eb-430c-af77-63aac46b8dc4 for instance 8236137e-cfde-45ba-964c-d277d70c97d4 on nch1-master-1 Apr 30 21:20:44.325212 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-210af2de-f6df-456c-a4f2-196653475dd2 req-9a4e71fd-290b-44f8-b3a1-404cf2b550b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.088899 Apr 30 21:20:44.326479 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1366/2655] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:44.336844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8015c42c-c4b1-4225-b788-200704522520 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:44.337574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8015c42c-c4b1-4225-b788-200704522520 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:44.425526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Updating instance_info_cache with network_info: [{"id": "85c0da70-e0eb-430c-af77-63aac46b8dc4", "address": "fa:16:3e:fb:a3:5a", "network": {"id": "98b1dbd8-5abb-448b-9acd-f922dee70a3d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1807871381-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6cebc4a4f75349b09fd03f67d0207875", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap85c0da70-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130670) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:20:44.434077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8015c42c-c4b1-4225-b788-200704522520 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:44.449239 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8015c42c-c4b1-4225-b788-200704522520 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5" status: 200 len: 1214 microversion: 2.1 time: 0.121187 Apr 30 21:20:44.449966 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1367/2656] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:44 2022] GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:44.465270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f4e1b8bc-2cd9-4059-b80b-3aae2d8c2acb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:44.465813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f4e1b8bc-2cd9-4059-b80b-3aae2d8c2acb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:44.484402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f4e1b8bc-2cd9-4059-b80b-3aae2d8c2acb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:44.566064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Releasing lock "refresh_cache-8236137e-cfde-45ba-964c-d277d70c97d4" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:20:44.571083 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68d8164b-d967-4b02-ad52-aab44e9464f2 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action" status: 202 len: 0 microversion: 2.1 time: 4.170543 Apr 30 21:20:44.571679 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1290/2657] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:20:40 2022] POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action => generated 0 bytes in 4175 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:20:44.576964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-57dac260-438a-480b-b899-0c6cff176148 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '.version_select at 0x7fdc209cfca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:44.953588 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-57dac260-438a-480b-b899-0c6cff176148 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/79343313-14bf-4c47-9183-087da35513f0" status: 200 len: 183 microversion: 2.1 time: 0.380522 Apr 30 21:20:44.960367 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1291/2658] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:20:44 2022] GET /compute/v2.1/os-floating-ips/79343313-14bf-4c47-9183-087da35513f0 => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:44.966117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.86"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:45.264804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:45.281036 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.scheduler.client.report [None req-f4e1b8bc-2cd9-4059-b80b-3aae2d8c2acb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Deleted allocations for instance 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 Apr 30 21:20:45.281129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:45.281129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:45.281129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:45.281129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:45.454917 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f4e1b8bc-2cd9-4059-b80b-3aae2d8c2acb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5" status: 204 len: 0 microversion: 2.1 time: 0.993161 Apr 30 21:20:45.455634 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1368/2659] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:44 2022] DELETE /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:20:45.462273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:45.462990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:45.483819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:45.484589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:45.485784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:45.486471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:45.572362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Acquired lock "refresh_cache-8236137e-cfde-45ba-964c-d277d70c97d4" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:20:45.827832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:45.872905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:45.874495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:45.875710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4bc65ef1-8247-4c86-a2cd-814e6c1555d8 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.418706 Apr 30 21:20:45.877461 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1369/2660] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:45 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:45.893207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:45.894152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:45.900503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:45.901208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:45.902257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:45.902912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:45.986495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:45.998436 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fec081a2-453a-4fc1-8d80-3d45850e8767 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5" status: 200 len: 1218 microversion: 2.1 time: 0.112463 Apr 30 21:20:46.000267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1370/2661] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:45 2022] GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:46.272696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-44831a8e-e9c0-4397-b2f2-c9421c848d9a req-37b24489-97c8-45d4-91d7-225416418845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "83b262c0-f5b8-4175-b9b8-1163fa513cc0"}, {"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "68951237-c8b8-42a1-8ab3-47a4e01c2f51"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:46.287208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-44831a8e-e9c0-4397-b2f2-c9421c848d9a req-37b24489-97c8-45d4-91d7-225416418845 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:46.288662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-44831a8e-e9c0-4397-b2f2-c9421c848d9a req-37b24489-97c8-45d4-91d7-225416418845 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:46.322444 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-44831a8e-e9c0-4397-b2f2-c9421c848d9a req-37b24489-97c8-45d4-91d7-225416418845 service nova] Creating event network-changed:83b262c0-f5b8-4175-b9b8-1163fa513cc0 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:20:46.323339 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-44831a8e-e9c0-4397-b2f2-c9421c848d9a req-37b24489-97c8-45d4-91d7-225416418845 service nova] Creating event network-changed:68951237-c8b8-42a1-8ab3-47a4e01c2f51 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:20:46.330938 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-44831a8e-e9c0-4397-b2f2-c9421c848d9a req-37b24489-97c8-45d4-91d7-225416418845 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062718 Apr 30 21:20:46.340511 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1371/2662] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:46.371338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d9491400-1d10-4b05-890c-ab2831cd91be req-6922f7fe-b7bb-416b-9b98-06bc5221493f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce71b4fd-70d3-4703-8ca7-c1b569060a9f", "name": "network-vif-deleted", "tag": "ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:46.383317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d9491400-1d10-4b05-890c-ab2831cd91be req-6922f7fe-b7bb-416b-9b98-06bc5221493f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:46.383777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d9491400-1d10-4b05-890c-ab2831cd91be req-6922f7fe-b7bb-416b-9b98-06bc5221493f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:46.401750 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d9491400-1d10-4b05-890c-ab2831cd91be req-6922f7fe-b7bb-416b-9b98-06bc5221493f service nova] Creating event network-vif-deleted:ffd1a6c9-ead3-4e0b-89e6-56d10432c2dd for instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f on nch1-master-1 Apr 30 21:20:46.407307 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d9491400-1d10-4b05-890c-ab2831cd91be req-6922f7fe-b7bb-416b-9b98-06bc5221493f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050721 Apr 30 21:20:46.408277 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1372/2663] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:46.711711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Building network info cache for instance {{(pid=130670) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:20:46.899028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:46.900307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:46.910472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:46.910472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:46.910837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:46.912653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:47.352406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:47.368630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:47.374841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:47.377609 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-195bfc2a-bc4a-4b8f-9f73-a37e09e970c5 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.482984 Apr 30 21:20:47.380179 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1373/2664] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:46 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:47.389638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:47.391502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:47.403428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:47.405348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:47.407715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:47.408382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:47.433980 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 could not be found. Apr 30 21:20:47.435884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:47.438388 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b390517-feeb-46db-9d03-1bdef444747c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5" status: 404 len: 111 microversion: 2.1 time: 0.055260 Apr 30 21:20:47.441136 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1374/2665] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:47 2022] GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:47.462653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7084d92-ef74-406d-bad7-d34ebb4ccf33 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc20640430>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:47.531998 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7084d92-ef74-406d-bad7-d34ebb4ccf33 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd" status: 200 len: 636 microversion: 2.1 time: 0.088382 Apr 30 21:20:47.532887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1375/2666] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:20:47 2022] GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd => generated 636 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:47.545737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d1e0288-976d-408f-a674-ace62edc0239 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:47.546732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8d1e0288-976d-408f-a674-ace62edc0239 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:47.571517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d1e0288-976d-408f-a674-ace62edc0239 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:47.571984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d1e0288-976d-408f-a674-ace62edc0239 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:47.572785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d1e0288-976d-408f-a674-ace62edc0239 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:47.577784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d1e0288-976d-408f-a674-ace62edc0239 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:47.652418 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d1e0288-976d-408f-a674-ace62edc0239 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "POST /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df/action" status: 200 len: 24562 microversion: 2.1 time: 0.118199 Apr 30 21:20:47.655392 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1376/2667] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:20:47 2022] POST /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df/action => generated 24562 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:20:47.671161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c2e906a-e453-491a-9ba3-5fb8695147cc tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update_all', calling method: .version_select at 0x7fdc261fb0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:47.696635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Updating instance_info_cache with network_info: [{"id": "85c0da70-e0eb-430c-af77-63aac46b8dc4", "address": "fa:16:3e:fb:a3:5a", "network": {"id": "98b1dbd8-5abb-448b-9acd-f922dee70a3d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1807871381-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6cebc4a4f75349b09fd03f67d0207875", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap85c0da70-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130670) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:20:47.732445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6c2e906a-e453-491a-9ba3-5fb8695147cc tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:47.738440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6c2e906a-e453-491a-9ba3-5fb8695147cc tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:47.795392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Releasing lock "refresh_cache-8236137e-cfde-45ba-964c-d277d70c97d4" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:20:47.796924 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-48209648-0752-4388-89a5-1653477c00ea tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action" status: 202 len: 0 microversion: 2.1 time: 2.835148 Apr 30 21:20:47.802465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1292/2668] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:20:44 2022] POST /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4/action => generated 0 bytes in 2841 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:20:47.808904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1572112124", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5c8b504b-43e7-4642-bbf0-dab49293fda8"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:47.921141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] validate_networks() for [('5c8b504b-43e7-4642-bbf0-dab49293fda8', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:20:48.448694 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c2e906a-e453-491a-9ba3-5fb8695147cc tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.791715 Apr 30 21:20:48.450912 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1377/2669] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:20:47 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 61 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:48.457341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:48.469950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:48.471088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Searching by: {'deleted': False, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:20:48.479140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.480012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.480988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.481590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.562984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:20:48.598199 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-034c5d01-8972-43e2-9948-4faf3480bc91 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.144922 Apr 30 21:20:48.606263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1378/2670] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:20:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:48.610976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:48.611611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:48.618115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.618586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.619391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.619841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.641612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] HTTP exception thrown: Instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f could not be found. Apr 30 21:20:48.642256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Returning 404 to user: Instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:48.643318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f974d87-7bf2-49e6-8f10-b3ec6d39f67c tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 404 len: 111 microversion: 2.1 time: 0.036062 Apr 30 21:20:48.643983 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1379/2671] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:48 2022] DELETE /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:48.645624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:20:48.646154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:20:48.647057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:20:48.647613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:20:48.649206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:48.649933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:48.653417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:20:48.663416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.664431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.670227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.670346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.670346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.670549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.670636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:48.670636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:48.694675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:48.712899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for user 2f5eafa970bd4247bdaef1cda747c3fc and project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:48.723890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:20:48.727231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:20:48.869196 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1cfb8e9f-36a2-4515-b189-f6646987a550 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064421 Apr 30 21:20:48.870948 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1293/2672] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:20:49.047630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-524822e5-d9be-4b3a-a925-181153e4c7d2 req-880d1ed0-495c-4393-869b-557b61628c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8236137e-cfde-45ba-964c-d277d70c97d4", "tag": "85c0da70-e0eb-430c-af77-63aac46b8dc4"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:49.059646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-524822e5-d9be-4b3a-a925-181153e4c7d2 req-880d1ed0-495c-4393-869b-557b61628c06 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.060093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-524822e5-d9be-4b3a-a925-181153e4c7d2 req-880d1ed0-495c-4393-869b-557b61628c06 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.085245 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-524822e5-d9be-4b3a-a925-181153e4c7d2 req-880d1ed0-495c-4393-869b-557b61628c06 service nova] Creating event network-changed:85c0da70-e0eb-430c-af77-63aac46b8dc4 for instance 8236137e-cfde-45ba-964c-d277d70c97d4 on nch1-master-1 Apr 30 21:20:49.091781 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-524822e5-d9be-4b3a-a925-181153e4c7d2 req-880d1ed0-495c-4393-869b-557b61628c06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219001 Apr 30 21:20:49.093014 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1294/2673] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:49.100145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d24f143-ac8b-46cb-810f-848dfad49f32 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc20708ca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:49.123606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:49.133274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:49.134801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:49.135975 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2a9de830-a197-4ec3-b32a-d51a75336111 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.491045 Apr 30 21:20:49.136511 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1380/2674] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:48 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:49.155911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-16499955-c990-47ed-8ab3-9fd71974ed6d req-16ac1e95-4f97-4f94-a0bf-3f3ab8f85470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "b7b29b71-981b-4ddd-b8fa-c4dc14de585e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:49.175049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-16499955-c990-47ed-8ab3-9fd71974ed6d req-16ac1e95-4f97-4f94-a0bf-3f3ab8f85470 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.175049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-16499955-c990-47ed-8ab3-9fd71974ed6d req-16ac1e95-4f97-4f94-a0bf-3f3ab8f85470 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.189240 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-16499955-c990-47ed-8ab3-9fd71974ed6d req-16ac1e95-4f97-4f94-a0bf-3f3ab8f85470 service nova] Creating event network-changed:b7b29b71-981b-4ddd-b8fa-c4dc14de585e for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:20:49.202711 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-16499955-c990-47ed-8ab3-9fd71974ed6d req-16ac1e95-4f97-4f94-a0bf-3f3ab8f85470 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059165 Apr 30 21:20:49.204141 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1381/2675] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:49.214462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:49.221363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:49.222666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Searching by: {'deleted': False, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:20:49.230290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.230757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.232141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.233572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.282719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:20:49.341328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:49.348510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.351204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.692237 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d24f143-ac8b-46cb-810f-848dfad49f32 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "DELETE /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.597528 Apr 30 21:20:49.700582 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1295/2676] 10.222.0.23 () {58 vars in 1295 bytes} [Sat Apr 30 21:20:49 2022] DELETE /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata/os_version => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:49.702847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:49.704374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: ce71b4fd-70d3-4703-8ca7-c1b569060a9f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:49.713437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.714250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.715231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.716024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.741164 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] HTTP exception thrown: Instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f could not be found. Apr 30 21:20:49.742442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Returning 404 to user: Instance ce71b4fd-70d3-4703-8ca7-c1b569060a9f could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:49.743453 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-41dbae32-0584-49dd-b072-38f92004ae9e tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f" status: 404 len: 111 microversion: 2.1 time: 0.048938 Apr 30 21:20:49.744269 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1296/2677] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:49 2022] GET /compute/v2.1/servers/ce71b4fd-70d3-4703-8ca7-c1b569060a9f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:49.762559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-72fef78c-c9e2-4b2d-a100-9d0136093614 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:49.763186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-72fef78c-c9e2-4b2d-a100-9d0136093614 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:49.884085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-72fef78c-c9e2-4b2d-a100-9d0136093614 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:49.896158 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-72fef78c-c9e2-4b2d-a100-9d0136093614 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1215 microversion: 2.1 time: 0.149817 Apr 30 21:20:49.897888 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1297/2678] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:49 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:49.908062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fec4283-a355-4c3c-9d6c-fd022b969a6e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc2103ff70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:49.972796 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8b4158f8-e542-4d8c-ba79-4f6503edb970 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.767269 Apr 30 21:20:49.973387 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1382/2679] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:20:49 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:49.978590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:49.978826 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fec4283-a355-4c3c-9d6c-fd022b969a6e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 37 microversion: 2.1 time: 0.078821 Apr 30 21:20:49.979206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:49.979410 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1298/2680] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:20:49 2022] GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 37 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:49.986028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-86999209-43a4-4eec-b7f3-7b7e8a73ec9d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '.version_select at 0x7fdc20beb310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:49.990000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.991806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:49.992850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:49.993302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:50.010524 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] HTTP exception thrown: Instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 could not be found. Apr 30 21:20:50.011485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Returning 404 to user: Instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:50.012399 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a8523b84-4783-49b6-abec-82e16b794333 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 404 len: 111 microversion: 2.1 time: 0.038042 Apr 30 21:20:50.013145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1383/2681] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:49 2022] DELETE /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:50.019764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e0d2d02-4687-49ca-8fca-ebbb5c8c4eae tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:50.028821 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e0d2d02-4687-49ca-8fca-ebbb5c8c4eae tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014220 Apr 30 21:20:50.029646 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1384/2682] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:20:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:50.039384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b98df03-7efa-49c9-b97f-e5519c198d0f tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update_all', calling method: .version_select at 0x7fdc261bc5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:50.101869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-8b98df03-7efa-49c9-b97f-e5519c198d0f tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:50.111739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-8b98df03-7efa-49c9-b97f-e5519c198d0f tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:50.586900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8b98df03-7efa-49c9-b97f-e5519c198d0f tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.555747 Apr 30 21:20:50.594115 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1385/2683] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:20:50 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 61 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:50.594115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:50.594115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: d48b9d33-108e-4c2b-a7f1-91869f9b4fe8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:50.599056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:50.599509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:50.600354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:50.600823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:50.614316 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] HTTP exception thrown: Instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 could not be found. Apr 30 21:20:50.614958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Returning 404 to user: Instance d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:50.615901 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1dada869-106d-4611-bae9-3787bcec82d1 tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8" status: 404 len: 111 microversion: 2.1 time: 0.027622 Apr 30 21:20:50.623482 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1386/2684] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:50 2022] GET /compute/v2.1/servers/d48b9d33-108e-4c2b-a7f1-91869f9b4fe8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:50.623482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:50.623482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:50.628375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:50.628860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:50.629637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:50.630107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.018022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:51.027240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:51.029009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:51.030210 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90530ee8-fc7b-4922-bd93-9dbdc61ea739 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.412328 Apr 30 21:20:51.030848 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1387/2685] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:50 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:51.035669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-39c8e4c4-c1b1-4c79-a095-e4216729861d tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc2062d0d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:51.081329 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-39c8e4c4-c1b1-4c79-a095-e4216729861d tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.049286 Apr 30 21:20:51.082107 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1388/2686] 10.222.0.23 () {58 vars in 1289 bytes} [Sat Apr 30 21:20:51 2022] GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata/os_distro => generated 33 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:51.087561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:51.088282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:51.094422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.095016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.095798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.096238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.110597 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] HTTP exception thrown: Instance a4eb62c4-aebc-4598-95f5-85b5e40329ab could not be found. Apr 30 21:20:51.111197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Returning 404 to user: Instance a4eb62c4-aebc-4598-95f5-85b5e40329ab could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:51.112043 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7c60c691-252b-432f-9645-acd8955e0bde tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 404 len: 111 microversion: 2.1 time: 0.028889 Apr 30 21:20:51.112575 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1389/2687] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:51 2022] DELETE /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:51.119925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:51.120537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:51.126498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.126949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.127723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.128179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.265032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:51.274165 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eef5b232-24a3-4b76-ba06-3b123d8f0c30 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1275 microversion: 2.1 time: 0.160456 Apr 30 21:20:51.298699 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1390/2688] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:51 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:51.298699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80ae820a-9e95-491e-9145-2a185700c1a1 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update_all', calling method: .version_select at 0x7fdc261fb8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:51.340891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-80ae820a-9e95-491e-9145-2a185700c1a1 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:51.346084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-80ae820a-9e95-491e-9145-2a185700c1a1 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:51.599347 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-86999209-43a4-4eec-b7f3-7b7e8a73ec9d tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/79343313-14bf-4c47-9183-087da35513f0" status: 202 len: 0 microversion: 2.1 time: 1.618849 Apr 30 21:20:51.600993 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1299/2689] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:20:49 2022] DELETE /compute/v2.1/os-floating-ips/79343313-14bf-4c47-9183-087da35513f0 => generated 0 bytes in 1621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:20:51.607448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:51.608301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] [instance: a4eb62c4-aebc-4598-95f5-85b5e40329ab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:51.613039 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80ae820a-9e95-491e-9145-2a185700c1a1 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.325640 Apr 30 21:20:51.613811 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1391/2690] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:20:51 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 61 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:51.627684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.627684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.627684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.627684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.630036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1ec5058b-45a9-49d4-9129-795d31c50fdf req-b746f1c8-b773-45ac-8ae3-6c996786f6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "c4baf2f0-f599-4e18-a1c9-15315a90ac2d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:51.639341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1ec5058b-45a9-49d4-9129-795d31c50fdf req-b746f1c8-b773-45ac-8ae3-6c996786f6d8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.639795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1ec5058b-45a9-49d4-9129-795d31c50fdf req-b746f1c8-b773-45ac-8ae3-6c996786f6d8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.640861 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] HTTP exception thrown: Instance a4eb62c4-aebc-4598-95f5-85b5e40329ab could not be found. Apr 30 21:20:51.641489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] Returning 404 to user: Instance a4eb62c4-aebc-4598-95f5-85b5e40329ab could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:51.642541 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-41110631-0294-463c-92f4-5a8856761bfd tempest-ServersTestMultiNic-689988957 tempest-ServersTestMultiNic-689988957-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab" status: 404 len: 111 microversion: 2.1 time: 0.039444 Apr 30 21:20:51.643109 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1300/2691] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:51 2022] GET /compute/v2.1/servers/a4eb62c4-aebc-4598-95f5-85b5e40329ab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:51.648610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:51.649471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:51.652617 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1ec5058b-45a9-49d4-9129-795d31c50fdf req-b746f1c8-b773-45ac-8ae3-6c996786f6d8 service nova] Creating event network-changed:c4baf2f0-f599-4e18-a1c9-15315a90ac2d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:20:51.656912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.657585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.657940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1ec5058b-45a9-49d4-9129-795d31c50fdf req-b746f1c8-b773-45ac-8ae3-6c996786f6d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037760 Apr 30 21:20:51.658786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:51.658909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1392/2692] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:51.659486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:51.665220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-559d5c06-c2ae-4e21-92f7-30ee813ba6e8 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc2062d1f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:51.692009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:51.715660 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-559d5c06-c2ae-4e21-92f7-30ee813ba6e8 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.055362 Apr 30 21:20:51.717228 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1393/2693] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:20:51 2022] GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 61 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:51.728553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de1d5e93-08c1-43e2-97c1-5aca8dffae7e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update_all', calling method: .version_select at 0x7fdc261fb670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:51.805575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-de1d5e93-08c1-43e2-97c1-5aca8dffae7e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:51.813845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-de1d5e93-08c1-43e2-97c1-5aca8dffae7e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:52.086328 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de1d5e93-08c1-43e2-97c1-5aca8dffae7e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.362099 Apr 30 21:20:52.087166 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1394/2694] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:20:51 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 61 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:52.091624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:52.092756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:52.099771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:52.100571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:52.102550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:52.103230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:52.105676 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-af964715-312b-4ce1-bad1-ebcbf22789c3 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 204 len: 0 microversion: 2.1 time: 0.460774 Apr 30 21:20:52.107023 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1301/2695] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:51 2022] DELETE /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:52.114926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c80e823c-941f-4de4-9f95-621f0b5874a1 req-2fa04d74-9d63-4178-9b0f-f3bf18de9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "cdb35a6b-139d-435e-9c32-4c2cc700c91d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:52.139588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c80e823c-941f-4de4-9f95-621f0b5874a1 req-2fa04d74-9d63-4178-9b0f-f3bf18de9bc6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:52.140052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c80e823c-941f-4de4-9f95-621f0b5874a1 req-2fa04d74-9d63-4178-9b0f-f3bf18de9bc6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:52.163414 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c80e823c-941f-4de4-9f95-621f0b5874a1 req-2fa04d74-9d63-4178-9b0f-f3bf18de9bc6 service nova] Creating event network-changed:cdb35a6b-139d-435e-9c32-4c2cc700c91d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:20:52.170059 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c80e823c-941f-4de4-9f95-621f0b5874a1 req-2fa04d74-9d63-4178-9b0f-f3bf18de9bc6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060890 Apr 30 21:20:52.170894 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1302/2696] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:52.178146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c16cef9-aa62-4472-bacd-33d921487afd tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update_all', calling method: .version_select at 0x7fdc21028940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:52.242237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6c16cef9-aa62-4472-bacd-33d921487afd tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:52.252576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6c16cef9-aa62-4472-bacd-33d921487afd tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:52.375020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:52.387437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:52.389201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:52.390487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-614954be-5a86-401f-9d8d-c7e664f4f2af tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.302625 Apr 30 21:20:52.391225 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1395/2697] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:52 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:52.397362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:52.398558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:52.405449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:52.405948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:52.406727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:52.407176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:52.660449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:52.669628 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7514b406-0ecc-4b74-b19a-3c96ca06eeac tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1525 microversion: 2.1 time: 0.277225 Apr 30 21:20:52.670484 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1396/2698] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:52 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1525 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:52.675183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:52.675848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:52.683288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:52.683824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:52.684717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:52.685291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:52.688450 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c16cef9-aa62-4472-bacd-33d921487afd tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.516101 Apr 30 21:20:52.693769 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1303/2699] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:20:52 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 64 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:52.703092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f8e631d0-9f5e-4a99-b0be-1c2f354de073 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc20cfc550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:52.750954 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f8e631d0-9f5e-4a99-b0be-1c2f354de073 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.055906 Apr 30 21:20:52.751549 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1304/2700] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:20:52 2022] GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 64 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:52.762691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f3a82ca0-f1f5-4e72-89d0-27f18cbca05e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update_all', calling method: .version_select at 0x7fdc262b5280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:52.821399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f3a82ca0-f1f5-4e72-89d0-27f18cbca05e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:52.827857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f3a82ca0-f1f5-4e72-89d0-27f18cbca05e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:52.847846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:52.859950 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-822afb47-f579-46c6-a1ce-9fad0c238449 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.188388 Apr 30 21:20:52.860852 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1397/2701] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:52 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:53.318551 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f3a82ca0-f1f5-4e72-89d0-27f18cbca05e tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.560551 Apr 30 21:20:53.319158 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1305/2702] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:20:52 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 61 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:53.328613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3542917e-0fb3-4116-b6ac-b08c2a796be2 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update', calling method: .version_select at 0x7fdc21170ee0>, body: {"meta": {"os_version": "alt"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:53.387346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3542917e-0fb3-4116-b6ac-b08c2a796be2 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:53.399058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3542917e-0fb3-4116-b6ac-b08c2a796be2 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:53.412895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:53.414234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:53.426980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.427718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:53.431257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.431257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:53.867020 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3542917e-0fb3-4116-b6ac-b08c2a796be2 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.542265 Apr 30 21:20:53.867957 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1398/2703] 10.222.0.23 () {60 vars in 1312 bytes} [Sat Apr 30 21:20:53 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata/os_version => generated 31 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:53.872745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:53.876524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:53.877391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Searching by: {'deleted': False, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:20:53.883545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.884305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:53.885185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.885694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:53.914218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:20:53.916439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:53.935565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:53.937971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:53.940617 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aeecf8a2-014b-4dcd-b723-84655b4912a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.533262 Apr 30 21:20:53.943394 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1306/2704] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:53 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:53.950650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:53.951541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:53.960207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.961568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:53.962940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.963067 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e86a6cc-cdd1-4392-9f83-d9e56b04996b tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.093167 Apr 30 21:20:53.963731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:53.963914 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1399/2705] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:20:53 2022] GET /compute/v2.1/servers => generated 340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:53.970817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:53.971892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:53.980767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.981236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:53.982086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:53.982565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:54.663043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:54.668549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:54.676395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01512b72-330b-4901-b937-6a64792d4ce1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.710717 Apr 30 21:20:54.677646 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1400/2706] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:53 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:54.695576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58ae989d-25cb-425a-ba6b-de3446a03267 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc261fb4c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:54.712579 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2a6d8de-4531-420e-a2ed-e24a0dd5f4d8 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1525 microversion: 2.1 time: 0.762422 Apr 30 21:20:54.719017 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1307/2707] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:53 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1525 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:54.747304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:54.759677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:54.760959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Searching by: {'deleted': False, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:20:54.763187 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58ae989d-25cb-425a-ba6b-de3446a03267 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 58 microversion: 2.1 time: 0.084046 Apr 30 21:20:54.765265 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1401/2708] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:20:54 2022] GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 58 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:54.769886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:54.770650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:54.774027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:54.775254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-04d94f2a-197a-47a4-87dc-9b4e1cf1875b req-c87d4647-a615-4a1a-991b-7dc1e74086f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535d878c-5289-4a05-abdb-c65a639e113d", "tag": "10b7463f-64be-41ee-8517-759ef5b7f0ef"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:54.776112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:54.802432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-04d94f2a-197a-47a4-87dc-9b4e1cf1875b req-c87d4647-a615-4a1a-991b-7dc1e74086f9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:54.803141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-04d94f2a-197a-47a4-87dc-9b4e1cf1875b req-c87d4647-a615-4a1a-991b-7dc1e74086f9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:54.828797 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-04d94f2a-197a-47a4-87dc-9b4e1cf1875b req-c87d4647-a615-4a1a-991b-7dc1e74086f9 service nova] Creating event network-changed:10b7463f-64be-41ee-8517-759ef5b7f0ef for instance 535d878c-5289-4a05-abdb-c65a639e113d on nch2-master-1 Apr 30 21:20:54.839040 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-04d94f2a-197a-47a4-87dc-9b4e1cf1875b req-c87d4647-a615-4a1a-991b-7dc1e74086f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072381 Apr 30 21:20:54.842046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:20:54.842280 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1402/2709] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:54.854095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-977e819b-1ac2-4935-a061-eca785e68d78 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'update_all', calling method: .version_select at 0x7fdc205171f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:54.951391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:54.962807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:54.963280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:54.970551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-977e819b-1ac2-4935-a061-eca785e68d78 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:54.977703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-977e819b-1ac2-4935-a061-eca785e68d78 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:55.377401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56ec8bfc-b198-4852-9e31-727b2aaadd7e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.659785 Apr 30 21:20:55.380253 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1308/2710] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:20:54 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:55.389361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:55.390424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:55.399965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:55.400583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:55.401541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:55.402123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:55.424908 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-977e819b-1ac2-4935-a061-eca785e68d78 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.581327 Apr 30 21:20:55.430702 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1403/2711] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:20:54 2022] PUT /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 61 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:55.431859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4d29e7bc-f956-434a-b41c-2ad8a474ac09 req-ebf76db8-30e1-4bc4-b019-c3ddca887b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8236137e-cfde-45ba-964c-d277d70c97d4", "name": "network-vif-deleted", "tag": "85c0da70-e0eb-430c-af77-63aac46b8dc4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:55.460741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d29e7bc-f956-434a-b41c-2ad8a474ac09 req-ebf76db8-30e1-4bc4-b019-c3ddca887b53 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:55.461198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d29e7bc-f956-434a-b41c-2ad8a474ac09 req-ebf76db8-30e1-4bc4-b019-c3ddca887b53 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:55.473495 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4d29e7bc-f956-434a-b41c-2ad8a474ac09 req-ebf76db8-30e1-4bc4-b019-c3ddca887b53 service nova] Creating event network-vif-deleted:85c0da70-e0eb-430c-af77-63aac46b8dc4 for instance 8236137e-cfde-45ba-964c-d277d70c97d4 on nch1-master-1 Apr 30 21:20:55.486441 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4d29e7bc-f956-434a-b41c-2ad8a474ac09 req-ebf76db8-30e1-4bc4-b019-c3ddca887b53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057093 Apr 30 21:20:55.487013 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1404/2712] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:55.499393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c6f8a24-b7d7-428d-833f-a42b445c2e4d tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:55.512156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c6f8a24-b7d7-428d-833f-a42b445c2e4d tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020237 Apr 30 21:20:55.513639 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1405/2713] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:20:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:55.520332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70ce77fc-e3d1-4c6f-a369-d620854ae90d tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Action: 'create', calling method: .version_select at 0x7fdc261fb670>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:55.616115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-70ce77fc-e3d1-4c6f-a369-d620854ae90d tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:20:55.629962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-70ce77fc-e3d1-4c6f-a369-d620854ae90d tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Getting quotas for user f17c7aaa6e5d4aefa1f1f508e2b9b4e9 and project 72deb8cb9e6e401f82ec1a3ff894a1a7. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:20:56.086435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:56.095549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:56.097072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:56.098292 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-84c4ce3c-4aa5-4671-ba13-d4721026359b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.716541 Apr 30 21:20:56.098883 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1309/2714] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:55 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:56.103969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:56.104588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:56.110945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.111407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.112216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.112658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.213998 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70ce77fc-e3d1-4c6f-a369-d620854ae90d tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "POST /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.698726 Apr 30 21:20:56.215235 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1406/2715] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Apr 30 21:20:55 2022] POST /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 85 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:56.220823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:56.221562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:56.229133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.237174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.238142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.238772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.298957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.299477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.300082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lazy-loading 'fault' on Instance uuid 8236137e-cfde-45ba-964c-d277d70c97d4 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:20:56.389140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75959d37cbf4c9b8482e480a0888246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebc4a4f75349b09fd03f67d0207875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:56.396045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:56.397944 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-255860fd-8a5b-4c88-8551-bb18d5bf90e4 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 200 len: 1313 microversion: 2.1 time: 0.181251 Apr 30 21:20:56.406038 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a25d2651-d44a-4e51-921a-539ab3217549 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.306073 Apr 30 21:20:56.406937 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1310/2716] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:56 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:56.410554 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1407/2717] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:56 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:56.415116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:56.415924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:56.417515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c48e8d4b-8d4d-4093-96d4-c98acc355a15 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] Calling method '.version_select at 0x7fdc205401f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:56.422523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.423225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.424231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.424968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.457031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:20:56.479023 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c48e8d4b-8d4d-4093-96d4-c98acc355a15 tempest-ImagesMetadataTestJSON-546024493 tempest-ImagesMetadataTestJSON-546024493-project] 10.222.0.23 "GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.067278 Apr 30 21:20:56.479616 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1408/2718] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:20:56 2022] GET /compute/v2.1/images/9f76c81c-8401-48fa-89f5-aa96c2557cfd/metadata => generated 85 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:20:56.778940 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7a7c1043-4328-44ba-b390-7a09baad593e tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 204 len: 0 microversion: 2.1 time: 0.370362 Apr 30 21:20:56.780280 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1311/2719] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:20:56 2022] DELETE /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:20:56.788422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:56.790282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:56.797166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.797975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.799041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.799704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.901505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7c8659e1-692f-48fd-a83a-be49a3a1dddb req-0de600be-9aa7-4d01-8261-810ec2286602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "ee2823b4-cb37-40e4-9569-718e828d60c1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:20:56.931529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7c8659e1-692f-48fd-a83a-be49a3a1dddb req-0de600be-9aa7-4d01-8261-810ec2286602 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:56.933864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7c8659e1-692f-48fd-a83a-be49a3a1dddb req-0de600be-9aa7-4d01-8261-810ec2286602 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:56.943174 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7c8659e1-692f-48fd-a83a-be49a3a1dddb req-0de600be-9aa7-4d01-8261-810ec2286602 service nova] Creating event network-changed:ee2823b4-cb37-40e4-9569-718e828d60c1 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:20:56.960064 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7c8659e1-692f-48fd-a83a-be49a3a1dddb req-0de600be-9aa7-4d01-8261-810ec2286602 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068197 Apr 30 21:20:56.961660 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1312/2720] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:20:57.117781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:57.119238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:57.126749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:57.127432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:57.128487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:57.129148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:57.155066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:57.167109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f30e1341-df30-48c2-88a9-5c85bd5022b2 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1713 microversion: 2.1 time: 0.382601 Apr 30 21:20:57.175992 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1409/2721] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:56 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1713 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:20:57.417386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:57.418030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] [instance: 8236137e-cfde-45ba-964c-d277d70c97d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:57.430916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:57.432224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:57.437324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:57.438154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:57.461795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] HTTP exception thrown: Instance 8236137e-cfde-45ba-964c-d277d70c97d4 could not be found. Apr 30 21:20:57.462420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] Returning 404 to user: Instance 8236137e-cfde-45ba-964c-d277d70c97d4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:20:57.463656 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c5eeeb67-a6f5-4ce2-9ea3-1e2609197637 tempest-FloatingIPsAssociationTestJSON-68500166 tempest-FloatingIPsAssociationTestJSON-68500166-project] 10.222.0.23 "GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4" status: 404 len: 111 microversion: 2.1 time: 0.050774 Apr 30 21:20:57.466290 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1410/2722] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:57 2022] GET /compute/v2.1/servers/8236137e-cfde-45ba-964c-d277d70c97d4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:20:57.478842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:57.479518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:57.489337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:57.489975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:57.490775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:57.491227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:57.498948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:57.512393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:57.515419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:57.517580 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae8c003d-7d96-4f35-85d0-85b0c5992d7a tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.404369 Apr 30 21:20:57.519572 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1313/2723] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:57 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:20:57.664600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:57.675193 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b4a19f13-d1f8-48b4-bb78-8916fd945956 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.207450 Apr 30 21:20:57.687169 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1411/2724] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:57 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:58.192588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:58.193641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:58.202003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:58.202612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:58.203563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:58.204175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:58.537402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:58.538778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:58.555614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:58.556080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:58.556875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:58.557321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:58.766178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:58.780793 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1d92b291-a596-40b1-afb3-24d70fdefad6 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1713 microversion: 2.1 time: 0.592104 Apr 30 21:20:58.795449 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1314/2725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:58 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1713 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:58.807696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:58.813344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:58.829940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:58.830416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:58.833009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:58.833432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:59.489627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:59.525011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:59.527307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:59.530133 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db67a6bf-caa9-4ffd-a0f4-0afcda16f5d3 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.996761 Apr 30 21:20:59.531324 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1412/2726] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:20:58 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:20:59.653635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:20:59.665538 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7dc17dc-b58b-4c9c-87a9-f77b518c13a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.868589 Apr 30 21:20:59.666616 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1315/2727] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:58 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:20:59.806461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:20:59.810828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:20:59.840560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:59.841708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:20:59.845607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:20:59.846551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:00.178774 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2c4ca6c6-8037-4f1b-9527-80870da58960 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.218848 Apr 30 21:21:00.180688 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1316/2728] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:20:59 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 30 21:21:00.192668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48fc0d48-bd14-47f2-840c-35196b7af2de tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Calling method '.version_select at 0x7fdc21028c10>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:00.235990 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-48fc0d48-bd14-47f2-840c-35196b7af2de tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] HTTP exception thrown: Image not found. Apr 30 21:21:00.236836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48fc0d48-bd14-47f2-840c-35196b7af2de tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:00.238039 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-48fc0d48-bd14-47f2-840c-35196b7af2de tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.050045 Apr 30 21:21:00.239407 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1317/2729] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:21:00 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:21:00.259670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2568940-4e9f-42ec-8334-b0bdd7264c27 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Calling method '.version_select at 0x7fdc2104faf0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:00.293076 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d2568940-4e9f-42ec-8334-b0bdd7264c27 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] HTTP exception thrown: Image not found. Apr 30 21:21:00.295022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2568940-4e9f-42ec-8334-b0bdd7264c27 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:00.295947 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2568940-4e9f-42ec-8334-b0bdd7264c27 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] 10.222.0.23 "DELETE /compute/v2.1/images/49b5851f-7790-42dc-89d3-766e5331de7j" status: 404 len: 62 microversion: 2.1 time: 0.045893 Apr 30 21:21:00.302191 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1318/2730] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:00 2022] DELETE /compute/v2.1/images/49b5851f-7790-42dc-89d3-766e5331de7j => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:21:00.309577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6727d1d0-6f95-46f1-ab00-a3f67239a991 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Calling method '.version_select at 0x7fdc2627caf0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:00.330552 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-6727d1d0-6f95-46f1-ab00-a3f67239a991 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] HTTP exception thrown: Image not found. Apr 30 21:21:00.331171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6727d1d0-6f95-46f1-ab00-a3f67239a991 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:00.332051 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6727d1d0-6f95-46f1-ab00-a3f67239a991 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] 10.222.0.23 "DELETE /compute/v2.1/images/575c791f-491a-4466-8c20-1e4445d1cdc51" status: 404 len: 62 microversion: 2.1 time: 0.026640 Apr 30 21:21:00.332912 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1319/2731] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:21:00 2022] DELETE /compute/v2.1/images/575c791f-491a-4466-8c20-1e4445d1cdc51 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:21:00.345081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1a6c8b79-b9ec-4d0d-bbbc-17d2a99e3147 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Calling method '.version_select at 0x7fdc21221a60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:00.378449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:00.379760 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1a6c8b79-b9ec-4d0d-bbbc-17d2a99e3147 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] HTTP exception thrown: Image not found. Apr 30 21:21:00.381492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1a6c8b79-b9ec-4d0d-bbbc-17d2a99e3147 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:00.381492 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1a6c8b79-b9ec-4d0d-bbbc-17d2a99e3147 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-1363197934" status: 404 len: 62 microversion: 2.1 time: 0.040800 Apr 30 21:21:00.381864 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1320/2732] 10.222.0.23 () {58 vars in 1205 bytes} [Sat Apr 30 21:21:00 2022] DELETE /compute/v2.1/images/tempest-invalid-1363197934 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:21:00.392200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-20ba63a3-32c5-4b96-94cc-af2f9f5de366 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Calling method '.version_select at 0x7fdc2074eaf0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:00.392396 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a83a1eb5-e6bb-40ce-971b-67ede624c100 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1713 microversion: 2.1 time: 0.595587 Apr 30 21:21:00.405023 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1413/2733] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:20:59 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1713 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:00.417194 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-20ba63a3-32c5-4b96-94cc-af2f9f5de366 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] HTTP exception thrown: Image not found. Apr 30 21:21:00.417865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-20ba63a3-32c5-4b96-94cc-af2f9f5de366 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] Returning 404 to user: Image not found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:00.418751 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-20ba63a3-32c5-4b96-94cc-af2f9f5de366 tempest-ImagesDeleteNegativeTestJSON-507183465 tempest-ImagesDeleteNegativeTestJSON-507183465-project] 10.222.0.23 "DELETE /compute/v2.1/images/7d5de3b9-8675-4d11-95ec-cfccd74e1061" status: 404 len: 62 microversion: 2.1 time: 0.030620 Apr 30 21:21:00.419313 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1321/2734] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:00 2022] DELETE /compute/v2.1/images/7d5de3b9-8675-4d11-95ec-cfccd74e1061 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:21:00.549074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:00.550221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:00.559951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:00.560182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:00.560994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:00.563391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:00.684808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:00.685446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:00.705965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:00.708879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:00.709991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:00.712852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:01.230970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:01.247757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:01.250294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:01.252115 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b2783637-d6fc-45a4-81e8-31d62c2c7fea tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.707164 Apr 30 21:21:01.253994 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1414/2735] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:00 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:01.304706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:01.320075 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5cd18f8-c492-4f81-bbf6-c1d5157c66c3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.639723 Apr 30 21:21:01.320767 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1322/2736] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:00 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:01.420557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:01.421193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:01.436737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:01.440838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:01.440838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:01.440838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:01.542216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a426fa7ed504002881521b1e820e359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91284d0547c4c8a9d99f57d0a43f98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:01.551427 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-60eb9ed3-c32d-41a0-9fa7-9ac8c775b1e8 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 200 len: 1646 microversion: 2.1 time: 0.134495 Apr 30 21:21:01.553059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1415/2737] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:01 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 1646 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:01.759163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-102b34c4-7fb7-4fb3-aadd-cd71fe06328c req-0d6d869a-b4de-403e-859f-d1bea2224d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96657a8f-3ac7-4f4b-a90a-0b487d135e52", "name": "network-vif-deleted", "tag": "51b3842d-35b9-4bef-ad94-2041501dcf33"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:01.770447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-102b34c4-7fb7-4fb3-aadd-cd71fe06328c req-0d6d869a-b4de-403e-859f-d1bea2224d7e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:01.775476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-102b34c4-7fb7-4fb3-aadd-cd71fe06328c req-0d6d869a-b4de-403e-859f-d1bea2224d7e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:01.809420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-102b34c4-7fb7-4fb3-aadd-cd71fe06328c req-0d6d869a-b4de-403e-859f-d1bea2224d7e service nova] Creating event network-vif-deleted:51b3842d-35b9-4bef-ad94-2041501dcf33 for instance 96657a8f-3ac7-4f4b-a90a-0b487d135e52 on nch2-master-1 Apr 30 21:21:01.827934 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-102b34c4-7fb7-4fb3-aadd-cd71fe06328c req-0d6d869a-b4de-403e-859f-d1bea2224d7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074135 Apr 30 21:21:01.833923 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1323/2738] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:02.277484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:02.279547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:02.292180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:02.292642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:02.293446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:02.298870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:02.339919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:02.340982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:02.360554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:02.361455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:02.363534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:02.363534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:03.017193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:03.017751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:03.027970 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e9e3d963-4048-4e70-b7ab-336e4c7a2b7a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.694955 Apr 30 21:21:03.028603 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1324/2739] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:02 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:03.034115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:03.035753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:03.038182 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da92c473-ddf0-4cd1-b394-6e75b32a45f7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.767226 Apr 30 21:21:03.039587 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1416/2740] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:02 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:03.044975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:03.045890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] [instance: 96657a8f-3ac7-4f4b-a90a-0b487d135e52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:03.054216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:03.054955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:03.055908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:03.056779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:03.075260 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] HTTP exception thrown: Instance 96657a8f-3ac7-4f4b-a90a-0b487d135e52 could not be found. Apr 30 21:21:03.077010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Returning 404 to user: Instance 96657a8f-3ac7-4f4b-a90a-0b487d135e52 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:03.078372 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-087d2731-1365-4d13-8434-c812964aec5c tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52" status: 404 len: 111 microversion: 2.1 time: 0.037291 Apr 30 21:21:03.079097 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1417/2741] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:03 2022] GET /compute/v2.1/servers/96657a8f-3ac7-4f4b-a90a-0b487d135e52 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:21:03.089691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31aa2287-5345-44d6-b4f0-4ec6632a28b1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] Calling method '.version_select at 0x7fdc20640160>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:03.219413 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31aa2287-5345-44d6-b4f0-4ec6632a28b1 tempest-ServersTestManualDisk-1097669359 tempest-ServersTestManualDisk-1097669359-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502635805" status: 202 len: 0 microversion: 2.1 time: 0.135459 Apr 30 21:21:03.220373 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1418/2742] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502635805 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:03.241099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3efa5295-c056-4c06-967c-7c8564d8c6e1 req-005803c6-f2a2-402b-9e50-96268b52b624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535d878c-5289-4a05-abdb-c65a639e113d", "name": "network-vif-plugged", "status": "completed", "tag": "10b7463f-64be-41ee-8517-759ef5b7f0ef"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:03.262972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3efa5295-c056-4c06-967c-7c8564d8c6e1 req-005803c6-f2a2-402b-9e50-96268b52b624 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:03.265974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3efa5295-c056-4c06-967c-7c8564d8c6e1 req-005803c6-f2a2-402b-9e50-96268b52b624 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:03.299648 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3efa5295-c056-4c06-967c-7c8564d8c6e1 req-005803c6-f2a2-402b-9e50-96268b52b624 service nova] Creating event network-vif-plugged:10b7463f-64be-41ee-8517-759ef5b7f0ef for instance 535d878c-5289-4a05-abdb-c65a639e113d on nch2-master-1 Apr 30 21:21:03.307931 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3efa5295-c056-4c06-967c-7c8564d8c6e1 req-005803c6-f2a2-402b-9e50-96268b52b624 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277868 Apr 30 21:21:03.308805 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1325/2743] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:03.699502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1db700e-ccb4-4956-853d-2646b1bc4656 tempest-ListImageFiltersNegativeTestJSON-271114642 tempest-ListImageFiltersNegativeTestJSON-271114642-project] Calling method '.version_select at 0x7fdc20517dc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:03.724660 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d1db700e-ccb4-4956-853d-2646b1bc4656 tempest-ListImageFiltersNegativeTestJSON-271114642 tempest-ListImageFiltersNegativeTestJSON-271114642-project] HTTP exception thrown: Image not found. Apr 30 21:21:03.725477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1db700e-ccb4-4956-853d-2646b1bc4656 tempest-ListImageFiltersNegativeTestJSON-271114642 tempest-ListImageFiltersNegativeTestJSON-271114642-project] Returning 404 to user: Image not found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:03.728366 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1db700e-ccb4-4956-853d-2646b1bc4656 tempest-ListImageFiltersNegativeTestJSON-271114642 tempest-ListImageFiltersNegativeTestJSON-271114642-project] 10.222.0.23 "GET /compute/v2.1/images/02da8dd8-8bd2-406b-9778-f2e977be039d" status: 404 len: 62 microversion: 2.1 time: 0.181530 Apr 30 21:21:03.729418 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1419/2744] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:03 2022] GET /compute/v2.1/images/02da8dd8-8bd2-406b-9778-f2e977be039d => generated 62 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:21:04.046145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:04.046871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:04.059784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:04.060618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:04.063582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:04.066419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:04.067597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:04.070081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:04.070764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:04.073553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:04.074574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:04.078303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:04.615770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:04.646466 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f722032d-f1e6-4497-9cce-232f3b1eb8ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1315 microversion: 2.1 time: 0.605531 Apr 30 21:21:04.664304 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1326/2745] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:04 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:04.681351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:04.701437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:04.713560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:04.720172 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-74a7ad81-0a28-4f05-a2b6-73dd79563dd7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.664235 Apr 30 21:21:04.721390 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1420/2746] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:04 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:05.669252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:05.670222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:05.677237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:05.678271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:05.679078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:05.681857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:05.739152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:05.742117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:05.764936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:05.765679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:05.767371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:05.768158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:06.353145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:06.381672 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-462c044b-e9b0-43e5-a5dd-189427e758ac tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1502 microversion: 2.1 time: 0.710661 Apr 30 21:21:06.383110 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1327/2747] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:05 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1502 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:06.401966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97975659-b97b-408f-90d9-2ea59223c99f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:06.408535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97975659-b97b-408f-90d9-2ea59223c99f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:06.419342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97975659-b97b-408f-90d9-2ea59223c99f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:06.420560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97975659-b97b-408f-90d9-2ea59223c99f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:06.422554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97975659-b97b-408f-90d9-2ea59223c99f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:06.425164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97975659-b97b-408f-90d9-2ea59223c99f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:06.457974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:06.481804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:06.498244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:06.499487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ac5504a-721d-4ae3-b20a-63f01abb9791 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.764430 Apr 30 21:21:06.510558 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1421/2748] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:05 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:21:06.763245 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97975659-b97b-408f-90d9-2ea59223c99f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d/action" status: 202 len: 0 microversion: 2.1 time: 0.366991 Apr 30 21:21:06.764573 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1328/2749] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:21:06 2022] POST /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:21:06.774797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:06.781086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:06.803028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:06.806159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:06.809018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:06.810804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:07.130926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:07.154539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8fb29b44-ddbf-4adc-808f-c386d704c6ea tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1507 microversion: 2.1 time: 0.383468 Apr 30 21:21:07.156795 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1422/2750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:06 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:07.430437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f59fef6-1304-4d96-9998-31d606a7a6e3 tempest-ListImagesTestJSON-1740338515 tempest-ListImagesTestJSON-1740338515-project] Calling method '.version_select at 0x7fdc20bc14c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:07.483353 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f59fef6-1304-4d96-9998-31d606a7a6e3 tempest-ListImagesTestJSON-1740338515 tempest-ListImagesTestJSON-1740338515-project] 10.222.0.23 "GET /compute/v2.1/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d" status: 200 len: 784 microversion: 2.1 time: 0.231108 Apr 30 21:21:07.484317 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1329/2751] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:07 2022] GET /compute/v2.1/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d => generated 784 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:07.499372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-973295f5-bedf-4460-8099-8b13f2ae9c01 tempest-ListImagesTestJSON-1740338515 tempest-ListImagesTestJSON-1740338515-project] Calling method '.version_select at 0x7fdc13d98280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:07.528843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:07.533884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:07.563883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:07.565139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:07.570258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:07.570736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:07.574320 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-973295f5-bedf-4460-8099-8b13f2ae9c01 tempest-ListImagesTestJSON-1740338515 tempest-ListImagesTestJSON-1740338515-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.079381 Apr 30 21:21:07.575093 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1423/2752] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:07 2022] GET /compute/v2.1/images => generated 445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:07.589155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-09519c1a-4ab6-4303-93d8-2fa22855f484 tempest-ListImagesTestJSON-1740338515 tempest-ListImagesTestJSON-1740338515-project] Calling method '.version_select at 0x7fdc13d989d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:07.690160 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-09519c1a-4ab6-4303-93d8-2fa22855f484 tempest-ListImagesTestJSON-1740338515 tempest-ListImagesTestJSON-1740338515-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.105515 Apr 30 21:21:07.691425 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1424/2753] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:21:07 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:21:08.191255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:08.202446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:08.206002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:08.237793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:08.239846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:08.240306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:08.248635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:08.251541 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e55ace9e-9238-4f45-9c93-3441bca15523 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.734030 Apr 30 21:21:08.253363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:08.256324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:08.258667 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1330/2754] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:07 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:08.609090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:08.635024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-914f6e0b-a6f2-48f8-a435-0aee8040ffca tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1487 microversion: 2.1 time: 0.440331 Apr 30 21:21:08.636993 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1425/2755] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:08 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1487 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:08.655914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:08.656669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:08.664400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:08.665171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:08.667754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:08.669489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:08.702056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:21:09.113007 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02e70282-c172-4d08-b775-03460add7b9d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 204 len: 0 microversion: 2.1 time: 0.463221 Apr 30 21:21:09.114212 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1331/2756] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:21:08 2022] DELETE /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:21:09.124592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:09.125787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:09.135826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:09.141570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:09.141570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:09.141570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:09.271515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:09.273358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:09.291398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:09.292149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:09.293776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:09.294435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:10.006527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:10.023262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:10.041195 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6d065021-08c4-4be7-b843-65f2d1bbc484 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1493 microversion: 2.1 time: 0.922018 Apr 30 21:21:10.045797 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1426/2757] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:09 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1493 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:10.048288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:10.051901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:10.053840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-637e2860-4618-4a5e-9627-339127138ec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.786640 Apr 30 21:21:10.057288 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1332/2758] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:09 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:10.736468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21dbb322-11e9-4a8f-8f34-0e523eb501f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'create', calling method: .version_select at 0x7fdc26267820>, body: {"keypair": {"name": "tempest-keypair-1798288353"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:10.775557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-21dbb322-11e9-4a8f-8f34-0e523eb501f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:10.791124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-21dbb322-11e9-4a8f-8f34-0e523eb501f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for user 65bedbcb4d094160a9a9fc3b6ba6f603 and project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:11.064358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:11.064932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:11.088109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:11.088565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:11.090629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:11.091732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:11.223637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-21dbb322-11e9-4a8f-8f34-0e523eb501f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:11.234344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-21dbb322-11e9-4a8f-8f34-0e523eb501f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for user 65bedbcb4d094160a9a9fc3b6ba6f603 and project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:11.261456 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21dbb322-11e9-4a8f-8f34-0e523eb501f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.729868 Apr 30 21:21:11.262762 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1427/2759] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Apr 30 21:21:10 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 737 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:21:11.290956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:11.291676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:11.303199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:11.304468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:11.306466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:11.307148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:11.814503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:11.833064 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9febc022-9601-4ede-9ee4-be1e24a00159 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1493 microversion: 2.1 time: 0.770672 Apr 30 21:21:11.834519 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1333/2760] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:11 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1493 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:11.970325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:11.980019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:11.986434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:11.996820 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e5c34384-67f4-4091-9edf-3153799d907f tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.731354 Apr 30 21:21:11.998197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1428/2761] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:11 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:12.135635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96fee8ef-949f-4846-9dbd-fed75c98f1bc tempest-AZV2TestJSON-699336715 tempest-AZV2TestJSON-699336715-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:12.137427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96fee8ef-949f-4846-9dbd-fed75c98f1bc tempest-AZV2TestJSON-699336715 tempest-AZV2TestJSON-699336715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:12.137993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96fee8ef-949f-4846-9dbd-fed75c98f1bc tempest-AZV2TestJSON-699336715 tempest-AZV2TestJSON-699336715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:12.138847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96fee8ef-949f-4846-9dbd-fed75c98f1bc tempest-AZV2TestJSON-699336715 tempest-AZV2TestJSON-699336715-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:12.146900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96fee8ef-949f-4846-9dbd-fed75c98f1bc tempest-AZV2TestJSON-699336715 tempest-AZV2TestJSON-699336715-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:12.183274 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96fee8ef-949f-4846-9dbd-fed75c98f1bc tempest-AZV2TestJSON-699336715 tempest-AZV2TestJSON-699336715-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.346130 Apr 30 21:21:12.184121 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1334/2762] 10.222.0.23 () {58 vars in 1163 bytes} [Sat Apr 30 21:21:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:21:12.352692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-20349ecc-9001-4dce-9410-32da3f73a2f7 req-17f819df-2c34-4518-99b7-64dac4754d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535d878c-5289-4a05-abdb-c65a639e113d", "name": "network-vif-deleted", "tag": "10b7463f-64be-41ee-8517-759ef5b7f0ef"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:12.370394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-20349ecc-9001-4dce-9410-32da3f73a2f7 req-17f819df-2c34-4518-99b7-64dac4754d20 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:12.370982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-20349ecc-9001-4dce-9410-32da3f73a2f7 req-17f819df-2c34-4518-99b7-64dac4754d20 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:12.389921 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-20349ecc-9001-4dce-9410-32da3f73a2f7 req-17f819df-2c34-4518-99b7-64dac4754d20 service nova] Creating event network-vif-deleted:10b7463f-64be-41ee-8517-759ef5b7f0ef for instance 535d878c-5289-4a05-abdb-c65a639e113d on nch2-master-1 Apr 30 21:21:12.410275 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-20349ecc-9001-4dce-9410-32da3f73a2f7 req-17f819df-2c34-4518-99b7-64dac4754d20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064796 Apr 30 21:21:12.414006 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1429/2763] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:12.576637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5416e682-e41e-48a5-b471-e61e8627180b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc2098cb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-376712282", "description": "tempest-description-289969475"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:12.861994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:12.862959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:12.876961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:12.877427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:12.885311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:12.887170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:12.954370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:12.955350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:12.956022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lazy-loading 'fault' on Instance uuid 535d878c-5289-4a05-abdb-c65a639e113d {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:21:13.051286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:13.071605 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ba17161-b468-4e71-818d-f05203c00d32 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 200 len: 1305 microversion: 2.1 time: 0.224491 Apr 30 21:21:13.075091 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1430/2764] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:12 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 1305 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:13.102282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:13.103559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:13.113895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:13.113895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:13.113895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:13.113895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:13.144314 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5416e682-e41e-48a5-b471-e61e8627180b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.655056 Apr 30 21:21:13.152470 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1335/2765] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:12 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:13.158860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0109ab5-0d6c-4219-bf9c-6e3214532645 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc20bfe550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-294086249", "description": "tempest-description-1910836625"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:13.601456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:13.614943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:13.620134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:13.625863 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-428f591a-0489-4554-9df1-df87d9b384dd tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.548920 Apr 30 21:21:13.628996 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1431/2766] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:13 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:13.884261 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0109ab5-0d6c-4219-bf9c-6e3214532645 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.730418 Apr 30 21:21:13.898644 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1336/2767] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:14.065263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-762439966", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "7b3c83f5-11ee-4bcf-b36d-922b070bfdae"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:14.094002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:14.094641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:14.118931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:14.119406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:14.120211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:14.125924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:14.140750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] validate_networks() for [('7b3c83f5-11ee-4bcf-b36d-922b070bfdae', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:21:14.142685 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 535d878c-5289-4a05-abdb-c65a639e113d could not be found. Apr 30 21:21:14.145644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 535d878c-5289-4a05-abdb-c65a639e113d could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:14.145644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-578519f7-b7de-4de7-832f-e15a073d6690 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 404 len: 111 microversion: 2.1 time: 0.054889 Apr 30 21:21:14.145644 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1337/2768] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:14 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:21:14.329227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1910413896", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5c8b504b-43e7-4642-bbf0-dab49293fda8"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:14.439775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] validate_networks() for [('5c8b504b-43e7-4642-bbf0-dab49293fda8', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:21:15.202747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:15.203225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:15.203714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:15.209610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:15.209610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:15.218061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:15.218756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:15.219591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:15.220034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:15.270143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Getting quotas for project 8b8ae5530f6847478106f78f50e7314d. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:15.281342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Getting quotas for user 02b78cd5fee5448b9e42dbb212f0de19 and project 8b8ae5530f6847478106f78f50e7314d. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:15.339619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:21:15.348002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:21:15.443133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:15.443644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:15.444975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:15.445480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:15.446023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:15.455679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:15.456274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:15.457212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:15.457808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:15.476331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:15.483427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for user 2f5eafa970bd4247bdaef1cda747c3fc and project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:15.502548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:21:15.505186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:21:15.569993 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3df6d334-cc2d-415b-8453-1ac6d5457f36 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511593 Apr 30 21:21:15.570925 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1432/2769] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:21:15.576387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:15.577019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:15.584809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:15.585507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:15.587304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:15.587304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:15.682050 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7093a7a9-13f2-411e-92b5-77bd8c1eca92 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362664 Apr 30 21:21:15.682726 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1338/2770] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:21:15.693828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4246c927-a1f3-44b4-9a28-1b7a9aa2028a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:15.700081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4246c927-a1f3-44b4-9a28-1b7a9aa2028a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:15.897641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4246c927-a1f3-44b4-9a28-1b7a9aa2028a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:15.906112 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4246c927-a1f3-44b4-9a28-1b7a9aa2028a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1215 microversion: 2.1 time: 0.222172 Apr 30 21:21:15.907283 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1339/2771] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:15 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:15.913109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-254240213", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1ba9505-d2cf-4c5a-934a-6a1e685fc411"}], "security_groups": [{"name": "tempest-securitygroup--836253890"}], "key_name": "tempest-keypair-1798288353", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:16.068469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:16.082799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:16.085143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:16.086400 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c9078c32-76d1-47a6-8c7c-59cd8ca99b41 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.514146 Apr 30 21:21:16.088672 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1433/2772] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:15 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:16.103803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-400d4190-ccf3-49d2-84c1-f9358cd2fc6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:16.104434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-400d4190-ccf3-49d2-84c1-f9358cd2fc6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:16.130368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] validate_networks() for [('b1ba9505-d2cf-4c5a-934a-6a1e685fc411', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:21:16.226356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-400d4190-ccf3-49d2-84c1-f9358cd2fc6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:16.234127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-400d4190-ccf3-49d2-84c1-f9358cd2fc6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1215 microversion: 2.1 time: 0.144161 Apr 30 21:21:16.234710 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1434/2773] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:16 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:16.588602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:16.589103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:16.589508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:16.589958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:16.590378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:16.598962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:16.599509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:16.600246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:16.600664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:16.619960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:16.625913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for user 65bedbcb4d094160a9a9fc3b6ba6f603 and project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:16.648257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:21:16.651002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:21:16.820576 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-76387134-6e5c-4c95-bbb0-6a19ee5e4f0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.911530 Apr 30 21:21:16.821250 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1340/2774] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:21:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:21:16.831484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab4b1b5c-e3cb-4384-bee3-7f130c87f69e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:16.832743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab4b1b5c-e3cb-4384-bee3-7f130c87f69e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:16.906044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab4b1b5c-e3cb-4384-bee3-7f130c87f69e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:16.917874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab4b1b5c-e3cb-4384-bee3-7f130c87f69e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:16.919880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab4b1b5c-e3cb-4384-bee3-7f130c87f69e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:16.921861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab4b1b5c-e3cb-4384-bee3-7f130c87f69e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1281 microversion: 2.20 time: 0.093825 Apr 30 21:21:16.922972 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1435/2775] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:16 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:21:16.923654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:16.924290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:16.934491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:16.935492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:16.936579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:16.938043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:17.024117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:17.036708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0723f60-4453-48ce-a748-fa8792af9ec9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1219 microversion: 2.1 time: 0.116884 Apr 30 21:21:17.038948 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1341/2776] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:16 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:17.106078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:17.107141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:17.115277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:17.120765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:17.120765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:17.120765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:17.251242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:17.251877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:17.260508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:17.264313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:17.264313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:17.264313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:17.354588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:17.373094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:17.374932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:17.376602 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1127f1d1-b402-44a7-9f25-3efff0c4253e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.275349 Apr 30 21:21:17.389309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1436/2777] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:17 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:17.400373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:17.406772 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d197116c-f4ab-40cd-b9b6-86acd1ceab5d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1219 microversion: 2.1 time: 0.160486 Apr 30 21:21:17.407742 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1342/2778] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:17 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:17.940482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01b77285-4e12-4134-88f9-8cc7b17d54a9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:17.941090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01b77285-4e12-4134-88f9-8cc7b17d54a9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:18.013054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01b77285-4e12-4134-88f9-8cc7b17d54a9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.020998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01b77285-4e12-4134-88f9-8cc7b17d54a9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.023124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01b77285-4e12-4134-88f9-8cc7b17d54a9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.024269 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01b77285-4e12-4134-88f9-8cc7b17d54a9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1281 microversion: 2.20 time: 0.087680 Apr 30 21:21:18.024840 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1437/2779] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:17 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:18.056095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:18.056735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:18.066335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:18.066798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:18.067674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:18.068125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:18.133834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.141226 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ece4f7b-bc31-4236-8625-f4b63f4e46f1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1267 microversion: 2.1 time: 0.089968 Apr 30 21:21:18.141828 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1343/2780] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:18 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:18.398741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:18.399375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:18.415945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:18.417185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:18.418975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:18.418975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:18.429636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:18.430973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:18.445514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:18.447617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:18.450258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:18.450976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:18.662110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.676841 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47937095-ab2d-456c-8528-71ba35a075af tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1275 microversion: 2.1 time: 0.255563 Apr 30 21:21:18.677724 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1344/2781] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:18 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:18.883877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-220174730", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "4aa3c30a-e2d6-4ad0-98a6-6121283b1ac0"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:18.938431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.952890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.953978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] validate_networks() for [('4aa3c30a-e2d6-4ad0-98a6-6121283b1ac0', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:21:18.954467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:18.955785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-69c31757-c36c-49ca-872e-f3bd0641e479 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.564601 Apr 30 21:21:18.956651 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1438/2782] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:18 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:21:19.025832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-19101406", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "4e174604-3d00-4575-a608-2f7eb012a46b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:19.080911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] validate_networks() for [('4e174604-3d00-4575-a608-2f7eb012a46b', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:21:20.484305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:20.484771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:20.485248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:20.485670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:20.486128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:20.496961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.497647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.498779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.499404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.518812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Getting quotas for project 06b329e61e254c7c9c722e9afd8160ea. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:20.524686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Getting quotas for user 833f17bf2a0a4f89a95214e4e19c153a and project 06b329e61e254c7c9c722e9afd8160ea. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:20.538004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:21:20.540350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:21:20.589320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:20.589820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:20.590280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:20.590984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:20.591406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:20.601668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.602165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.603228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.603675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.621150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Getting quotas for project 3e12f061321b434e92c0f85031c54ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:20.626404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Getting quotas for user a42c6a51b78b408f85cbacb545f06707 and project 3e12f061321b434e92c0f85031c54ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:20.646615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:21:20.649386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:21:20.758346 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45c798ff-bf18-4ad9-a6db-98c31253e2ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.025569 Apr 30 21:21:20.759000 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1345/2783] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:21:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:21:20.764076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:20.764488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:20.770917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.774695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.774695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.774695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.820358 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6ad24e51-7e43-47fe-851c-003dc551770a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862617 Apr 30 21:21:20.821382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1439/2784] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:21:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:21:20.827654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:20.828465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:20.851042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.851793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.852321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.853353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.902679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:20.911614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:20.915695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:20.916713 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3eb49fb4-0b1d-4960-a823-24081f60368d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1339 microversion: 2.20 time: 0.156772 Apr 30 21:21:20.917302 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1346/2785] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:20 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:20.923902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:20.924539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:20.933169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.934133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:20.935102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:20.935680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:21.014583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:21.023077 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2c66580-2d4f-4df9-8ab1-c475d543538c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1273 microversion: 2.1 time: 0.199423 Apr 30 21:21:21.023670 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1440/2786] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:20 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:21.029868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:21.030763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:21.038377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:21.042642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:21.042642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:21.042642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:21.438326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:21.446360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f9048570-90dd-4ad3-8902-dc3736a8cb51 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.527839 Apr 30 21:21:21.446941 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1347/2787] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:20 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:21.451950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-775c39f3-d5da-462d-87a8-92b8c628ca5a tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:21.452973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-775c39f3-d5da-462d-87a8-92b8c628ca5a tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:21.561042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:21.572208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:21.574396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:21.575874 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ecb656a1-417c-4fd7-833b-a4c8afbd398e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.550319 Apr 30 21:21:21.582849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-775c39f3-d5da-462d-87a8-92b8c628ca5a tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:21.586516 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1441/2788] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:21 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:21.592821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90effae1-2ea5-4cdc-9b53-e529121bf965 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:21.593568 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-775c39f3-d5da-462d-87a8-92b8c628ca5a tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1216 microversion: 2.1 time: 0.144209 Apr 30 21:21:21.594208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90effae1-2ea5-4cdc-9b53-e529121bf965 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:21.594434 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1348/2789] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:21 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:21.729030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90effae1-2ea5-4cdc-9b53-e529121bf965 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:21.736066 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90effae1-2ea5-4cdc-9b53-e529121bf965 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1216 microversion: 2.1 time: 0.147075 Apr 30 21:21:21.736633 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1442/2790] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:21 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:21.934847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:21.935467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:21.941827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:21.942296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:21.943087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:21.944080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:22.041319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:22.041923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:22.050493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:22.054103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:22.054103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:22.054103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:22.387322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:22.397347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:22.399733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:22.401058 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8dd461a4-743f-4794-9137-3b780fcb6691 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1339 microversion: 2.20 time: 0.470323 Apr 30 21:21:22.412855 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1349/2791] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:21 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1339 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:22.464106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:22.465141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:22.471946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:22.472601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:22.473547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:22.474180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:22.710634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:22.720476 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c10a6d91-5458-4ff8-b949-ae7de4a2ff4e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.683821 Apr 30 21:21:22.732426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1443/2792] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:22 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:22.738913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:22.739744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:22.748871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:22.751722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:22.751722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:22.751722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:22.993818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:23.001742 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-73cf4735-8bad-47d5-ae18-e417e5523dff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.542037 Apr 30 21:21:23.002449 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1350/2793] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:22 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:23.009002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:23.009860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:23.016167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.016756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:23.017786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.018321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:23.112775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:23.120946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-368c62b6-a189-40b4-a94a-245cb8f89d9b tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1268 microversion: 2.1 time: 0.116711 Apr 30 21:21:23.121655 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1351/2794] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:23 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1268 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:23.126541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:23.127279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:23.133730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.134264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:23.135109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.135561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:23.228050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:23.237025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:23.238621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:23.239792 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-353f9cf5-61f5-4348-8e43-96d96d90dd00 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.506054 Apr 30 21:21:23.240360 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1444/2795] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:22 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:23.290571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:23.299319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9b37f09e-a44e-43bc-848e-708730a84157 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1268 microversion: 2.1 time: 0.176378 Apr 30 21:21:23.300301 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1352/2796] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:23 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:23.420670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:23.421272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:23.428885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.429329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:23.430179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.430618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:23.740170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:23.741736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:23.750122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.750735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:23.751751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:23.752419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.039554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:24.049946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:24.051797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:24.053400 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de5c7cdc-fe5b-4142-89d1-8f513e1f5bf5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.637869 Apr 30 21:21:24.054765 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1445/2797] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:23 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:24.058545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:24.059368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:24.067747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.068995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.070647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.071386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.228272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:24.237080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4b85b20-3244-42c8-bc14-8e691b6e73bf tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.502291 Apr 30 21:21:24.237689 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1353/2798] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:23 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:24.251571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:24.252184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:24.259098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.259600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.260400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.260854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.425728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:24.435948 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d4f3b8a-5608-45d8-a91d-7b6cd76c8677 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1274 microversion: 2.1 time: 0.188083 Apr 30 21:21:24.436545 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1354/2799] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:24 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:24.445458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:24.446907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:24.454080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.454559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.455414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.455873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.549472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:24.560636 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6cc6a443-ec06-49a6-9081-eb4b3d9ce433 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.503834 Apr 30 21:21:24.573909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1446/2800] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:24 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:24.580010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:24.580774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:24.593747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.595223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:24.596305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:24.596974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:25.467092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:25.478581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:25.480189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:25.480671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:25.481805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-73db802b-2e78-41bd-a954-1d8699b39404 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 1.044119 Apr 30 21:21:25.493703 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1355/2801] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:24 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:25.493703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5edfa087-dbc5-4ed9-83d6-025661c9a723 req-0b162aad-a26b-4567-aab9-c3a865305252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3443c916-dda1-43d3-b094-442c866c9184", "tag": "5337eefd-6282-4815-8142-ab29768bf85b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:25.502811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5edfa087-dbc5-4ed9-83d6-025661c9a723 req-0b162aad-a26b-4567-aab9-c3a865305252 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:25.506757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5edfa087-dbc5-4ed9-83d6-025661c9a723 req-0b162aad-a26b-4567-aab9-c3a865305252 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:25.525499 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-98d5e20e-4bda-4d5e-a1c2-3bb0a570344f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1316 microversion: 2.1 time: 0.944938 Apr 30 21:21:25.526257 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1447/2802] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:24 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1316 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:25.537783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c12f0002-233d-4b25-bb24-7d320fc3918c req-3880e4f5-80a1-4354-ae69-84b631ed4e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-plugged", "status": "completed", "tag": "b222076d-c1a2-4c03-8c2a-48a53d5a9274"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:25.540145 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5edfa087-dbc5-4ed9-83d6-025661c9a723 req-0b162aad-a26b-4567-aab9-c3a865305252 service nova] Creating event network-changed:5337eefd-6282-4815-8142-ab29768bf85b for instance 3443c916-dda1-43d3-b094-442c866c9184 on nch2-master-1 Apr 30 21:21:25.547534 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5edfa087-dbc5-4ed9-83d6-025661c9a723 req-0b162aad-a26b-4567-aab9-c3a865305252 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063347 Apr 30 21:21:25.548157 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1356/2803] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:25.557372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:25.558121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:25.565584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:25.566164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:25.567069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:25.567589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:25.582195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c12f0002-233d-4b25-bb24-7d320fc3918c req-3880e4f5-80a1-4354-ae69-84b631ed4e79 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:25.582195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c12f0002-233d-4b25-bb24-7d320fc3918c req-3880e4f5-80a1-4354-ae69-84b631ed4e79 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:25.612046 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c12f0002-233d-4b25-bb24-7d320fc3918c req-3880e4f5-80a1-4354-ae69-84b631ed4e79 service nova] Creating event network-vif-plugged:b222076d-c1a2-4c03-8c2a-48a53d5a9274 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:25.619672 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c12f0002-233d-4b25-bb24-7d320fc3918c req-3880e4f5-80a1-4354-ae69-84b631ed4e79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091394 Apr 30 21:21:25.624088 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1448/2804] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:25.629988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:25.630979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:25.641719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:25.642469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:25.645011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:25.645989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.120930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.138620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.140172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.142116 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8cbd4a18-619b-467d-93ed-58c016fba2d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.592613 Apr 30 21:21:26.142729 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1357/2805] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:25 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:26.207352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-96d3157a-6038-4275-a7d0-fbcf83c4fb8d req-c9a5550e-0975-41cb-8568-e2dbfba0f338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284", "tag": "03bbeaca-a3de-45e7-975b-56c33a1d9bff"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:26.215875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-96d3157a-6038-4275-a7d0-fbcf83c4fb8d req-c9a5550e-0975-41cb-8568-e2dbfba0f338 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.216289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-96d3157a-6038-4275-a7d0-fbcf83c4fb8d req-c9a5550e-0975-41cb-8568-e2dbfba0f338 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.217278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.226039 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-94c59ef6-c933-4871-bed5-eba1e5d93fe6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.600284 Apr 30 21:21:26.230601 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-96d3157a-6038-4275-a7d0-fbcf83c4fb8d req-c9a5550e-0975-41cb-8568-e2dbfba0f338 service nova] Creating event network-changed:03bbeaca-a3de-45e7-975b-56c33a1d9bff for instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 on nch1-master-1 Apr 30 21:21:26.230691 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1449/2806] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:25 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:26.242331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:26.242991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:26.247047 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-96d3157a-6038-4275-a7d0-fbcf83c4fb8d req-c9a5550e-0975-41cb-8568-e2dbfba0f338 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103022 Apr 30 21:21:26.248671 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1358/2807] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:26.257410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:26.258319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:26.259394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.262338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.265207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.265988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.266930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.282709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.283827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.284486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.689600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.697172 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-231e5438-8661-4d10-9bc4-f742e82aa584 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.447062 Apr 30 21:21:26.697561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.698008 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1359/2808] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:26 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:26.702627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:26.703234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:26.706449 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f395108-526c-43c5-a909-c29381644e79 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.474765 Apr 30 21:21:26.707029 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1450/2809] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:26 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:26.710596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.711098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.711899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.712130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:26.712349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.712912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:26.718863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.719339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.720112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:26.720550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:26.955049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.962629 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-baad5949-0469-47fb-a3b1-3496ca24ece6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1316 microversion: 2.1 time: 0.254611 Apr 30 21:21:26.963906 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1451/2810] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:26 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:26.970519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.980341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.982062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:26.983355 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b8a3ae4-ab87-49a2-96c1-7a93729f5d85 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.284549 Apr 30 21:21:26.984418 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1360/2811] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:26 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:27.160545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:27.161158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:27.167220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:27.167676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:27.168456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:27.169247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:27.248702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:27.249912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:27.257812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:27.258284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:27.259080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:27.259528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.067952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:28.076945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:28.078694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:28.079883 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e45d6528-7802-44c5-be09-cf65323ac16a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.923373 Apr 30 21:21:28.080449 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1452/2812] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:27 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:28.090586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-plugged", "status": "completed", "tag": "83b262c0-f5b8-4175-b9b8-1163fa513cc0"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-plugged", "status": "completed", "tag": "b7b29b71-981b-4ddd-b8fa-c4dc14de585e"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-plugged", "status": "completed", "tag": "cdb35a6b-139d-435e-9c32-4c2cc700c91d"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-plugged", "status": "completed", "tag": "68951237-c8b8-42a1-8ab3-47a4e01c2f51"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-plugged", "status": "completed", "tag": "c4baf2f0-f599-4e18-a1c9-15315a90ac2d"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-plugged", "status": "completed", "tag": "ee2823b4-cb37-40e4-9569-718e828d60c1"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:28.094257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.095759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.110171 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Creating event network-vif-plugged:83b262c0-f5b8-4175-b9b8-1163fa513cc0 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:28.110690 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Creating event network-vif-plugged:b7b29b71-981b-4ddd-b8fa-c4dc14de585e for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:28.111198 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Creating event network-vif-plugged:cdb35a6b-139d-435e-9c32-4c2cc700c91d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:28.111712 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Creating event network-vif-plugged:68951237-c8b8-42a1-8ab3-47a4e01c2f51 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:28.112238 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Creating event network-vif-plugged:c4baf2f0-f599-4e18-a1c9-15315a90ac2d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:28.112713 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] Creating event network-vif-plugged:ee2823b4-cb37-40e4-9569-718e828d60c1 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:28.114908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:28.119449 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-de97460a-b87a-433a-a65c-d7752fd28a39 req-842c498b-81b5-4383-8664-1985dba8d431 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.037759 Apr 30 21:21:28.120056 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1453/2813] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:28.135482 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-73bfadcf-9fcc-4b98-b532-0b65ce03c114 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.880001 Apr 30 21:21:28.135482 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1361/2814] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:27 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:28.135482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:28.135482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:28.137233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:28.137997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:28.138269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.138737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.139522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.140160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.144556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.145618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.148323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.148323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.504772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:28.511060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:28.532663 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4e07ac8-a4b2-444e-a6f5-4da01c330a47 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.405633 Apr 30 21:21:28.539980 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1362/2815] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:28 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:28.542251 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-82600e5e-a653-4888-b511-7500f5acdf9f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.420723 Apr 30 21:21:28.543047 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1454/2816] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:28 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:28.547484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5685c8a4-6a59-46ed-a884-97195f09d451 req-0dbde530-1577-49ff-b1dd-5e03f1812021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37", "tag": "7e51ce70-02d6-4e28-b92b-1abce8dc8c21"}, {"name": "network-changed", "server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:28.552752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:28.559599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:28.567197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5685c8a4-6a59-46ed-a884-97195f09d451 req-0dbde530-1577-49ff-b1dd-5e03f1812021 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.569103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5685c8a4-6a59-46ed-a884-97195f09d451 req-0dbde530-1577-49ff-b1dd-5e03f1812021 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.576675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.577160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.585924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.586723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.607097 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5685c8a4-6a59-46ed-a884-97195f09d451 req-0dbde530-1577-49ff-b1dd-5e03f1812021 service nova] Creating event network-changed:7e51ce70-02d6-4e28-b92b-1abce8dc8c21 for instance c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 on nch2-master-1 Apr 30 21:21:28.613480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5685c8a4-6a59-46ed-a884-97195f09d451 req-0dbde530-1577-49ff-b1dd-5e03f1812021 service nova] Creating event network-changed:25241eca-3984-4407-9196-eb00543c2900 for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 on nch2-master-1 Apr 30 21:21:28.625290 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5685c8a4-6a59-46ed-a884-97195f09d451 req-0dbde530-1577-49ff-b1dd-5e03f1812021 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083763 Apr 30 21:21:28.626365 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1363/2817] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:28.633708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:28.634744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:28.641006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.643191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.643191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:28.643191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:28.883468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:28.891341 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5910960c-2354-4023-baf3-15a866199b54 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1316 microversion: 2.1 time: 0.342534 Apr 30 21:21:28.891928 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1455/2818] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:28 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:29.095408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.098548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:29.099159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:29.105888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.106117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.106730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.107538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.107647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.107985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.109185 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c9be9aa-8a3f-4f31-91ad-bd9a5a74651e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.481536 Apr 30 21:21:29.110130 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1364/2819] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:28 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:29.144027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:29.152678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:29.159394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.159924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.160826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.161281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.576502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.585235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.587067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.588192 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-635c0a67-5e3e-420d-b80d-d116f3a7612a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.493728 Apr 30 21:21:29.588754 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1456/2820] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:29 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:29.593486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:29.594327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:29.600542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.600988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.603053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.603053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.611215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.620945 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-95922457-3912-437b-9961-a8d739b0084f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.481203 Apr 30 21:21:29.622290 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1365/2821] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:29 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:29.627377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:29.628202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:29.634779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.635244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.636031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.636481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.894125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.901346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:29.909180 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c82ec398-a515-4c5d-9519-3887bf57263a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.285325 Apr 30 21:21:29.909794 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1366/2822] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:29 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:29.918221 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef943eeb-3859-43bf-9654-fca9298dd6ac tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.328255 Apr 30 21:21:29.919326 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1457/2823] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:29 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:29.920223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:29.921093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:29.929114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.929852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:29.930661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:29.931109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:30.128501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:30.129244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:30.132497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:30.135974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:30.136432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:30.137212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:30.137646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:30.140654 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98305f7e-b01b-4450-9e91-d4e17f110170 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1316 microversion: 2.1 time: 0.229860 Apr 30 21:21:30.141499 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1367/2824] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:29 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:30.600322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:30.607779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:30.609357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:30.612920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:30.614943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:30.620981 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c66e678c-ba97-43ee-878a-7bb415a254ef tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.493062 Apr 30 21:21:30.620981 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1458/2825] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:30 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:30.629384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:30.629917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:30.631679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:30.632351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:30.641888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:30.642578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:30.651366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:30.651837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:30.652643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:30.653095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.198606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:31.206492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:31.208010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:31.209133 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23269cea-6de2-40ff-a0db-548b6b2f6ebe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.606747 Apr 30 21:21:31.209790 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1368/2826] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:30 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:31.214589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-94870d30-5dda-426b-9221-fbebdf39caf1 req-e8340f6f-5a0b-40f4-a5e1-a126c7fd4616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284", "name": "network-vif-plugged", "status": "completed", "tag": "03bbeaca-a3de-45e7-975b-56c33a1d9bff"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:31.220355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:31.228083 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c6ca815e-a478-4867-a20c-c5bbf9815b02 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.593503 Apr 30 21:21:31.230974 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1459/2827] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:30 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:31.231098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-94870d30-5dda-426b-9221-fbebdf39caf1 req-e8340f6f-5a0b-40f4-a5e1-a126c7fd4616 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.231098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-94870d30-5dda-426b-9221-fbebdf39caf1 req-e8340f6f-5a0b-40f4-a5e1-a126c7fd4616 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.235546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:31.236900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:31.241840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-94870d30-5dda-426b-9221-fbebdf39caf1 req-e8340f6f-5a0b-40f4-a5e1-a126c7fd4616 service nova] Creating event network-vif-plugged:03bbeaca-a3de-45e7-975b-56c33a1d9bff for instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 on nch1-master-1 Apr 30 21:21:31.245111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.245581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.246402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.246893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.247000 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-94870d30-5dda-426b-9221-fbebdf39caf1 req-e8340f6f-5a0b-40f4-a5e1-a126c7fd4616 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Apr 30 21:21:31.247729 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1369/2828] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:31.252802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:31.253516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:31.260823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.261279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.262094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.262572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.569509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:31.577066 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-215324c6-839c-4a4c-92ad-85d45ddbd3b0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.347122 Apr 30 21:21:31.587186 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1460/2829] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:31 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:31.594489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:31.594585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-51f5720c-3e09-4e4c-ae32-266d5e3c0be2 req-a59efd06-53be-4b83-ba80-955cfaafb4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14900c0e-ec78-49e5-ae69-942a76d77fc1", "tag": "dd9e8d91-9874-4104-8556-90f37ddf0af6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:31.594666 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0dc29e05-b452-40cd-9e31-f0c331994d03 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.338513 Apr 30 21:21:31.594666 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1370/2830] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:31 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:31.594666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:31.595733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-51f5720c-3e09-4e4c-ae32-266d5e3c0be2 req-a59efd06-53be-4b83-ba80-955cfaafb4f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.596192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-51f5720c-3e09-4e4c-ae32-266d5e3c0be2 req-a59efd06-53be-4b83-ba80-955cfaafb4f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.602748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:31.607753 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-51f5720c-3e09-4e4c-ae32-266d5e3c0be2 req-a59efd06-53be-4b83-ba80-955cfaafb4f6 service nova] Creating event network-changed:dd9e8d91-9874-4104-8556-90f37ddf0af6 for instance 14900c0e-ec78-49e5-ae69-942a76d77fc1 on nch1-master-1 Apr 30 21:21:31.608947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.609513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.611109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.611639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.613167 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-51f5720c-3e09-4e4c-ae32-266d5e3c0be2 req-a59efd06-53be-4b83-ba80-955cfaafb4f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033876 Apr 30 21:21:31.614188 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1461/2831] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:31.636736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:31.637742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:31.644248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.644782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:31.645630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:31.646169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.000057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.009586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cc03e8f8-1442-4c3d-8919-206b0a91f19d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1316 microversion: 2.1 time: 0.418996 Apr 30 21:21:32.014200 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1371/2832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:31 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:32.081031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.093118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.095359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.097250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-016cbb4b-c8ae-4ed2-b1c8-1c1313e355a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1875 microversion: 2.42 time: 0.465423 Apr 30 21:21:32.108916 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1462/2833] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:31 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1875 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:21:32.228047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:32.228907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:32.235334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.235792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.236578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.237017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.248013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:32.249577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:32.258496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.259111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.261035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.261654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.534994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.541856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.543962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.545504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.546700 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a9c72f9f-37da-4635-9c08-1e448bb007a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.323286 Apr 30 21:21:32.547280 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1372/2834] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:32 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:32.549564 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-260a36fb-78cb-4aee-bddd-7c28bf5189ec tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.308193 Apr 30 21:21:32.550300 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1463/2835] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:32 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:32.594545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:32.595190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:32.601961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.603432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.604342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.604941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.609178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:32.609920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:32.616710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.617174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.617999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:32.618452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:32.803398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.809622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:32.818609 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ba8b475-a49d-471a-9ba9-ee2f47bd5003 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.227413 Apr 30 21:21:32.819210 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1373/2836] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:32 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:32.829566 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f07fe9bd-f203-4089-a06d-56c16662819f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.224353 Apr 30 21:21:32.831336 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1464/2837] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:32 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:33.031333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:33.032224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:33.038955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.039449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.043433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.043433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.118417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:33.118417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:33.126547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.128233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.128233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.128551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.228336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.236474 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9bec8ce8-b380-4a58-aa78-60c4b6a67cc6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1316 microversion: 2.1 time: 0.209227 Apr 30 21:21:33.237170 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1374/2838] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:33 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:33.264143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6eaa6599-d48f-4396-b395-4d4e28a5f9e5 req-e2ea3e09-6d24-4572-b12c-29dff5c820fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3443c916-dda1-43d3-b094-442c866c9184", "name": "network-vif-plugged", "status": "completed", "tag": "5337eefd-6282-4815-8142-ab29768bf85b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:33.275181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6eaa6599-d48f-4396-b395-4d4e28a5f9e5 req-e2ea3e09-6d24-4572-b12c-29dff5c820fa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.275778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6eaa6599-d48f-4396-b395-4d4e28a5f9e5 req-e2ea3e09-6d24-4572-b12c-29dff5c820fa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.290236 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6eaa6599-d48f-4396-b395-4d4e28a5f9e5 req-e2ea3e09-6d24-4572-b12c-29dff5c820fa service nova] Creating event network-vif-plugged:5337eefd-6282-4815-8142-ab29768bf85b for instance 3443c916-dda1-43d3-b094-442c866c9184 on nch2-master-1 Apr 30 21:21:33.295679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6eaa6599-d48f-4396-b395-4d4e28a5f9e5 req-e2ea3e09-6d24-4572-b12c-29dff5c820fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035772 Apr 30 21:21:33.299973 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1375/2839] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:21:33.335439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.344563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.346087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.347357 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-29d87bd8-a4e3-4262-b9ff-827546a85338 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2833 microversion: 2.42 time: 0.235008 Apr 30 21:21:33.347914 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1465/2840] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:33 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2833 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:33.367947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-92385afe-89e0-4935-97aa-d7d1839ef47e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:33.368619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-92385afe-89e0-4935-97aa-d7d1839ef47e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:33.375739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92385afe-89e0-4935-97aa-d7d1839ef47e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.377097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92385afe-89e0-4935-97aa-d7d1839ef47e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.377335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92385afe-89e0-4935-97aa-d7d1839ef47e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.377912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92385afe-89e0-4935-97aa-d7d1839ef47e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.518222 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-92385afe-89e0-4935-97aa-d7d1839ef47e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.154670 Apr 30 21:21:33.518991 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1376/2841] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Apr 30 21:21:33 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f/os-interface => generated 1831 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:21:33.566095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:33.567187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:33.567408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:33.568644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:33.573686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.574183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.574994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.575462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.577972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.579409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.580644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.581159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.904666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.914765 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f35b4a9e-4326-47ab-a72a-96b21dce9168 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.351096 Apr 30 21:21:33.916586 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1377/2842] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:33 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:33.923216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:33.923996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:33.926535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.930976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.931654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.936333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.936333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.936889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.938476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:33.939636 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-94c8f447-4aba-402e-8032-fd5dcf9f9f80 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.379032 Apr 30 21:21:33.950947 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1466/2843] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:33 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:33.956665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:33.957400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:33.963975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.964532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:33.965408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:33.966008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:34.294579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:34.302277 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d1d5df8d-ff49-4e2f-807c-13ff69f60507 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1315 microversion: 2.1 time: 0.384130 Apr 30 21:21:34.303388 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1378/2844] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:33 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:34.307937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:34.308560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:34.311713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:34.314757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:34.315163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:34.315941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:34.316386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:34.319401 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af469de8-4dca-4580-b918-4efa102d3003 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.366811 Apr 30 21:21:34.320152 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1467/2845] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:33 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:34.457571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:34.467091 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fe9b665d-806f-4185-934c-d44d160c13b6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1507 microversion: 2.1 time: 0.162666 Apr 30 21:21:34.467903 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1379/2846] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:34 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:34.488915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:34.490840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:34.496660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:34.497125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:34.497964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:34.498415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:34.933360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:34.934155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:34.941715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:34.942194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:34.943607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:34.944065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.087668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:35.095352 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18f5a88f-fc66-4247-b869-a1bf50d85873 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1507 microversion: 2.1 time: 0.610357 Apr 30 21:21:35.096154 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1468/2847] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:34 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:35.111651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:35.112270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:35.118971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.119429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.120220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.120670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.232928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:35.242392 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d56aa3e6-2781-4057-a48b-16d3212f0cb4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.313130 Apr 30 21:21:35.244052 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1380/2848] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:34 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:35.247958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:35.249923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:35.257977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.258504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.259357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.260019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.347910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:35.351956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:35.351956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:35.351956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:35.351956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:35.351956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:35.356615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:35.358172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:35.359487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-284d0512-9fd9-4929-81a3-9246dbb84857 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.251544 Apr 30 21:21:35.369931 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1469/2849] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:35 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:35.369931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c158f29d-85e1-4cf8-ad5b-4312d01aaab9 req-e781a85a-fcd2-44b4-b6c5-64165098c6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37", "name": "network-vif-plugged", "status": "completed", "tag": "7e51ce70-02d6-4e28-b92b-1abce8dc8c21"}, {"server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "name": "network-vif-plugged", "status": "completed", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:35.379335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c158f29d-85e1-4cf8-ad5b-4312d01aaab9 req-e781a85a-fcd2-44b4-b6c5-64165098c6f0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.379826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c158f29d-85e1-4cf8-ad5b-4312d01aaab9 req-e781a85a-fcd2-44b4-b6c5-64165098c6f0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.392801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c158f29d-85e1-4cf8-ad5b-4312d01aaab9 req-e781a85a-fcd2-44b4-b6c5-64165098c6f0 service nova] Creating event network-vif-plugged:7e51ce70-02d6-4e28-b92b-1abce8dc8c21 for instance c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 on nch2-master-1 Apr 30 21:21:35.393292 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c158f29d-85e1-4cf8-ad5b-4312d01aaab9 req-e781a85a-fcd2-44b4-b6c5-64165098c6f0 service nova] Creating event network-vif-plugged:25241eca-3984-4407-9196-eb00543c2900 for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 on nch2-master-1 Apr 30 21:21:35.399858 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c158f29d-85e1-4cf8-ad5b-4312d01aaab9 req-e781a85a-fcd2-44b4-b6c5-64165098c6f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037063 Apr 30 21:21:35.400649 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1470/2850] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:35.406915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:35.407613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:35.414737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.420687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.420687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.420687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.546510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:35.554546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.554546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.555461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.556194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.587739 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e0bf894-5744-4833-b63c-206a54dceacb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "POST /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284/action" status: 202 len: 1109 microversion: 2.1 time: 0.343553 Apr 30 21:21:35.591026 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1381/2851] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:21:35 2022] POST /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284/action => generated 1109 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 30 21:21:35.594777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:35.595629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:35.602106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.604154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.604342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.604926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.784571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:35.795820 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd257584-bb48-48cf-9096-d20a2121eee7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1503 microversion: 2.1 time: 0.392761 Apr 30 21:21:35.805469 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1471/2852] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:35 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:35.805469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:35.805469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:35.811370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.812207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.813872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.814848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.857179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:35.866950 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7ff0a3c6-3887-407f-9b36-6c99473b9966 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.275864 Apr 30 21:21:35.867675 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1382/2853] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:35 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:35.873411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-263777a7-c2a9-4cdb-b3d0-8c03000fd30c req-1a9c5f73-8805-44bd-8064-b6a35106dda0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "tag": "b222076d-c1a2-4c03-8c2a-48a53d5a9274"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:35.883325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-263777a7-c2a9-4cdb-b3d0-8c03000fd30c req-1a9c5f73-8805-44bd-8064-b6a35106dda0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.883861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-263777a7-c2a9-4cdb-b3d0-8c03000fd30c req-1a9c5f73-8805-44bd-8064-b6a35106dda0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.897981 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-263777a7-c2a9-4cdb-b3d0-8c03000fd30c req-1a9c5f73-8805-44bd-8064-b6a35106dda0 service nova] Creating event network-changed:b222076d-c1a2-4c03-8c2a-48a53d5a9274 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:21:35.903542 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-263777a7-c2a9-4cdb-b3d0-8c03000fd30c req-1a9c5f73-8805-44bd-8064-b6a35106dda0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034419 Apr 30 21:21:35.904336 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1383/2854] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:35.909484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:35.910329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:35.918437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.918937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.919743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:35.920197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:35.946595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lazy-loading 'flavor' on Instance uuid 3443c916-dda1-43d3-b094-442c866c9184 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:21:36.017119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:36.026011 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-422fae99-7873-4811-8bd9-6b0694213cbb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.227826 Apr 30 21:21:36.026589 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1472/2855] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:35 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:36.260485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:36.261134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:36.271481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.271481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:36.271481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.271481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:36.490833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:36.499845 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a3d966a-b50c-432d-be51-1fe9f262da27 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1315 microversion: 2.1 time: 0.244103 Apr 30 21:21:36.500632 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1473/2856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:36 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:36.507578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:36.508389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:36.516818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.516818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:36.516818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.517068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:36.698471 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-54fd6281-c025-4b3b-b5cb-a4cae3d24a2b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184/action" status: 202 len: 0 microversion: 2.1 time: 0.792720 Apr 30 21:21:36.702002 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1384/2857] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:21:35 2022] POST /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:36.708458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:36.710299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:36.717408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.717967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:36.718757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.719200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:36.727590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:36.737365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:36.739331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:36.740908 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-003c15ca-1c5f-4a53-8b0d-4da334b9449e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1406 microversion: 2.20 time: 0.239109 Apr 30 21:21:36.752548 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1474/2858] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:36 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:21:36.869940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:36.878014 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f074d41b-cecb-4458-8cef-e28e2b85b64d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.173637 Apr 30 21:21:36.882207 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1385/2859] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:36 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:36.888491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:36.888491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:36.894583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.895038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:36.895846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:36.896883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.034607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:37.042788 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ca18e83-8e32-4836-a99c-f65253fc81aa tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.163418 Apr 30 21:21:37.043902 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1475/2860] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:36 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:37.044313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:37.046251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:37.054263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.054754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.055542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.055988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.192412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:37.200014 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-436e4174-0824-44df-a1fb-f947b6d76ace tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.159917 Apr 30 21:21:37.200587 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1386/2861] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:37 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:37.415278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c7894171-645a-4dbb-87dc-2d4228e0163d req-cc563950-5fcd-45fd-978e-9b67830c165d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14900c0e-ec78-49e5-ae69-942a76d77fc1", "name": "network-vif-plugged", "status": "completed", "tag": "dd9e8d91-9874-4104-8556-90f37ddf0af6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:37.425534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c7894171-645a-4dbb-87dc-2d4228e0163d req-cc563950-5fcd-45fd-978e-9b67830c165d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.426068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c7894171-645a-4dbb-87dc-2d4228e0163d req-cc563950-5fcd-45fd-978e-9b67830c165d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.438982 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c7894171-645a-4dbb-87dc-2d4228e0163d req-cc563950-5fcd-45fd-978e-9b67830c165d service nova] Creating event network-vif-plugged:dd9e8d91-9874-4104-8556-90f37ddf0af6 for instance 14900c0e-ec78-49e5-ae69-942a76d77fc1 on nch1-master-1 Apr 30 21:21:37.444451 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c7894171-645a-4dbb-87dc-2d4228e0163d req-cc563950-5fcd-45fd-978e-9b67830c165d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032925 Apr 30 21:21:37.445047 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1476/2862] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:37.518021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:37.518535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:37.525240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.525701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.526531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.526976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.683952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:37.691376 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d58d5c2d-59f8-4f5e-90b8-a347c2599d72 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1503 microversion: 2.1 time: 0.177556 Apr 30 21:21:37.691965 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1387/2863] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:37 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:37.711060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-376712282"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:37.711722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:37.718446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.718623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.719361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.723999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.759630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:37.760254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:37.766509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.766969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.767842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:37.768408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:37.877368 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.network.security_group_api [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Adding security group f7ef8d53-d162-4fc5-aa9a-1e25d138b59a to port 7e51ce70-02d6-4e28-b92b-1abce8dc8c21 Apr 30 21:21:37.995900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:38.004077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:38.006271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:38.007447 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b29e951f-134e-4b61-8cb5-a0c088d8c13a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1597 microversion: 2.20 time: 0.252360 Apr 30 21:21:38.008015 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1388/2864] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:21:37 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1597 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:21:38.012539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:38.013106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:38.019723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.020470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.021844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.022293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.233544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:38.240989 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c5e8750-3c72-4b13-a7b3-eeb1738c9ca6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.232003 Apr 30 21:21:38.241564 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1389/2865] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:38 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:38.246351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c3788fe7-21c8-4325-90eb-817bcc6ca15c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:38.246797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c3788fe7-21c8-4325-90eb-817bcc6ca15c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:38.252474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3788fe7-21c8-4325-90eb-817bcc6ca15c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.252934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3788fe7-21c8-4325-90eb-817bcc6ca15c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.253726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3788fe7-21c8-4325-90eb-817bcc6ca15c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.254196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3788fe7-21c8-4325-90eb-817bcc6ca15c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.344500 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c3788fe7-21c8-4325-90eb-817bcc6ca15c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101754 Apr 30 21:21:38.345105 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1390/2866] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Apr 30 21:21:38 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:21:38.350857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:38.351552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:38.357496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.360450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.360450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.360450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.515165 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01c62755-7931-4827-838d-22dcb260a04d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37/action" status: 202 len: 0 microversion: 2.1 time: 0.810059 Apr 30 21:21:38.519568 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1477/2867] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:21:37 2022] POST /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:38.527634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:38.528587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:38.536023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.537324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.538536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.539181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.788116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:38.796576 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d52b120b-3f0f-40b5-b976-cf4da5552d31 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1316 microversion: 2.1 time: 0.450413 Apr 30 21:21:38.806577 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1391/2868] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:38 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:38.806577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-294086249"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:38.806577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:38.810043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.810507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:38.811377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:38.811818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:39.178533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:39.186336 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71e1533d-7a34-4003-83e5-c9a2c3a96a93 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.664262 Apr 30 21:21:39.186917 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1478/2869] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:38 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:39.191469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8a04499a-d8c9-4bb6-adf2-648d9a711b84 req-e1d2c3d3-59bc-42ac-98bf-b216ea06269c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37", "tag": "7e51ce70-02d6-4e28-b92b-1abce8dc8c21"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:39.199933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8a04499a-d8c9-4bb6-adf2-648d9a711b84 req-e1d2c3d3-59bc-42ac-98bf-b216ea06269c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:39.200376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8a04499a-d8c9-4bb6-adf2-648d9a711b84 req-e1d2c3d3-59bc-42ac-98bf-b216ea06269c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:39.212357 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8a04499a-d8c9-4bb6-adf2-648d9a711b84 req-e1d2c3d3-59bc-42ac-98bf-b216ea06269c service nova] Creating event network-changed:7e51ce70-02d6-4e28-b92b-1abce8dc8c21 for instance c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 on nch2-master-1 Apr 30 21:21:39.218311 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8a04499a-d8c9-4bb6-adf2-648d9a711b84 req-e1d2c3d3-59bc-42ac-98bf-b216ea06269c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030042 Apr 30 21:21:39.219325 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1479/2870] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:39.260005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:39.260722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:39.267072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:39.267534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:39.268338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:39.268867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:39.424442 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.network.security_group_api [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Adding security group 3acd7fa0-ff34-4d41-9777-37c9353e5067 to port 7e51ce70-02d6-4e28-b92b-1abce8dc8c21 Apr 30 21:21:39.733049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:39.750731 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f359ae2-999d-4c63-a26e-7d56a0347bbe tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.495461 Apr 30 21:21:39.751497 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1480/2871] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:39 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:39.814443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:39.815059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:39.821676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:39.822159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:39.822930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:39.823367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.299800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:40.307541 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8b1d77c-f3de-48ad-8fcc-12b0c93e6524 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1504 microversion: 2.1 time: 0.497083 Apr 30 21:21:40.308117 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1481/2872] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:39 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1504 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:40.312751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:40.313363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:40.319948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.320402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.321216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.321677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.662065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:40.671081 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-317142de-7de9-43d8-8809-dbcb149a3f7a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.361255 Apr 30 21:21:40.681798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1482/2873] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:40 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:40.687015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:40.687683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:40.694756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.695318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.696199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.696758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.734052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:40.734573 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-030daab6-7570-474e-a1a6-afdb8e438262 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1/os-instance-actions/req-45c798ff-bf18-4ad9-a6db-98c31253e2ac" status: 200 len: 313 microversion: 2.1 time: 0.051133 Apr 30 21:21:40.737603 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1483/2874] 10.222.0.23 () {58 vars in 1418 bytes} [Sat Apr 30 21:21:40 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1/os-instance-actions/req-45c798ff-bf18-4ad9-a6db-98c31253e2ac => generated 313 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:40.749874 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1cbca20d-1d3b-4e7a-b296-b7961ec76841 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37/action" status: 202 len: 0 microversion: 2.1 time: 1.951451 Apr 30 21:21:40.752153 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1392/2875] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:21:38 2022] POST /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37/action => generated 0 bytes in 1954 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:40.753402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db59922e-fe57-4f1e-94a5-3a22f147e481 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:40.754944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db59922e-fe57-4f1e-94a5-3a22f147e481 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:40.761036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1c73f29c-5c19-4334-8fc1-34c77ae2cc0c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:40.761736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c73f29c-5c19-4334-8fc1-34c77ae2cc0c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:40.771764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db59922e-fe57-4f1e-94a5-3a22f147e481 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.773610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c73f29c-5c19-4334-8fc1-34c77ae2cc0c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.773723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db59922e-fe57-4f1e-94a5-3a22f147e481 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.773868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c73f29c-5c19-4334-8fc1-34c77ae2cc0c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.774245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c73f29c-5c19-4334-8fc1-34c77ae2cc0c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.775792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c73f29c-5c19-4334-8fc1-34c77ae2cc0c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:40.778073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db59922e-fe57-4f1e-94a5-3a22f147e481 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:40.778779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db59922e-fe57-4f1e-94a5-3a22f147e481 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:41.010792 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db59922e-fe57-4f1e-94a5-3a22f147e481 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "POST /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1/action" status: 202 len: 0 microversion: 2.1 time: 0.262894 Apr 30 21:21:41.015128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1484/2876] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:21:40 2022] POST /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:21:41.022567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:41.023431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:41.031724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:41.032796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:41.033820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:41.034466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:41.058618 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1c73f29c-5c19-4334-8fc1-34c77ae2cc0c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.301764 Apr 30 21:21:41.059224 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1393/2877] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:21:40 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37/os-security-groups => generated 1156 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:41.068696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:41.069410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:41.077548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:41.078274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:41.079351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:41.079963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:41.278497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:41.286288 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aebb2629-1403-4171-a7fd-79e5ae66c497 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.269696 Apr 30 21:21:41.287429 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1485/2878] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:41 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:41.292061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8bc20238-ae52-445e-bef4-d67b612c37bb tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc13d58a60>, body: {"security_group": {"name": " tempest-securitygroup -1670172599 ", "description": "tempest-description-1602535885"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:41.352721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:41.361067 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f7ff1db0-5359-4fc3-aa49-685925a81c87 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1506 microversion: 2.1 time: 0.300406 Apr 30 21:21:41.362027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1394/2879] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:41 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:41.367580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-dd0f6c82-d2de-4d65-b2ef-714038720ec2 req-031372c9-e6c6-4c80-b10a-84cd8468b104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37", "tag": "7e51ce70-02d6-4e28-b92b-1abce8dc8c21"}, {"name": "network-changed", "server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:41.377095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dd0f6c82-d2de-4d65-b2ef-714038720ec2 req-031372c9-e6c6-4c80-b10a-84cd8468b104 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:41.377582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dd0f6c82-d2de-4d65-b2ef-714038720ec2 req-031372c9-e6c6-4c80-b10a-84cd8468b104 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:41.392178 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-dd0f6c82-d2de-4d65-b2ef-714038720ec2 req-031372c9-e6c6-4c80-b10a-84cd8468b104 service nova] Creating event network-changed:7e51ce70-02d6-4e28-b92b-1abce8dc8c21 for instance c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 on nch2-master-1 Apr 30 21:21:41.392710 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-dd0f6c82-d2de-4d65-b2ef-714038720ec2 req-031372c9-e6c6-4c80-b10a-84cd8468b104 service nova] Creating event network-changed:25241eca-3984-4407-9196-eb00543c2900 for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 on nch2-master-1 Apr 30 21:21:41.400428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-dd0f6c82-d2de-4d65-b2ef-714038720ec2 req-031372c9-e6c6-4c80-b10a-84cd8468b104 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036853 Apr 30 21:21:41.401549 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1395/2880] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:41.689437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:41.690230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:41.697144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:41.697604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:41.698428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:41.698869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:42.078916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:42.093105 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d16316ff-9f48-47c3-b70a-d2e9313a12bb tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.408149 Apr 30 21:21:42.094436 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1396/2881] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:41 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:42.291068 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8bc20238-ae52-445e-bef4-d67b612c37bb tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.002536 Apr 30 21:21:42.292355 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1486/2882] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:41 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:42.307789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:42.308485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:42.309686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-adededa1-04b4-427b-bb55-a18e97a6ff78 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc261908b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:42.316263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:42.317069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:42.318105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:42.318736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:42.514474 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-adededa1-04b4-427b-bb55-a18e97a6ff78 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717" status: 200 len: 224 microversion: 2.1 time: 0.212205 Apr 30 21:21:42.521623 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1487/2883] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:21:42 2022] GET /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717 => generated 224 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:42.526564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:42.527380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:42.535084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:42.535558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:42.536363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:42.537377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:42.731967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:42.740838 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4c947569-2bb1-4f77-a52e-e30f1b95a9ff tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.440393 Apr 30 21:21:42.741455 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1397/2884] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:42 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:42.746242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-42aef774-de28-4345-84d6-0450fdfb6716 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc20836160>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:42.854140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:42.862693 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42a2ef63-effb-4ef3-88cc-6217169c77c4 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1506 microversion: 2.1 time: 0.339807 Apr 30 21:21:42.863542 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1488/2885] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:42 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:43.110514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:43.111141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:43.118291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:43.118754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:43.119674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:43.120128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:43.213006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-42aef774-de28-4345-84d6-0450fdfb6716 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717" status: 202 len: 0 microversion: 2.1 time: 0.470126 Apr 30 21:21:43.213643 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1398/2886] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:21:42 2022] DELETE /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:43.224765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e14cbfb-aece-4ee7-8232-d9ffc726a8de tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc208364c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-8e14cbfb-aece-4ee7-8232-d9ffc726a8de tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-8e14cbfb-aece-4ee7-8232-d9ffc726a8de tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-8e14cbfb-aece-4ee7-8232-d9ffc726a8de tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 does not exist Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-1c75d5bd-ac6e-4978-a15a-ddcafccee97c'] Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e14cbfb-aece-4ee7-8232-d9ffc726a8de tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 does not exist Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-1c75d5bd-ac6e-4978-a15a-ddcafccee97c'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8e14cbfb-aece-4ee7-8232-d9ffc726a8de tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717" status: 404 len: 194 microversion: 2.1 time: 0.086513 Apr 30 21:21:43.308026 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1399/2887] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:21:43 2022] GET /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:21:43.316305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07617c04-1deb-40b2-a081-8a6dbfc2a50c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc207e80d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1694576627", "description": "tempest-description-1249017619"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:43.393355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:43.404137 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6adf1a99-b486-4aae-b7e5-02435fad147e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.297437 Apr 30 21:21:43.405088 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1489/2888] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:43 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:43.757976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:43.758597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:43.765531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:43.767393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:43.767393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:43.767393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:43.854244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-07617c04-1deb-40b2-a081-8a6dbfc2a50c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.542730 Apr 30 21:21:43.854843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1400/2889] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:21:43.865426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6316f4c1-d8b9-43a3-bc50-e6a3e43bc715 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc20836e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1517533938", "description": "tempest-description-608171839"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:43.921676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:43.930335 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff497b89-cac5-409a-9933-3646b4bcd103 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.176263 Apr 30 21:21:43.930934 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1490/2890] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:43 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:43.941358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:43.942010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:43.948205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:43.948661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:43.949438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:43.949910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.121358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:44.130281 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7a5352ef-19ba-4105-bd38-baa31a6a6ffd tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1504 microversion: 2.1 time: 0.198356 Apr 30 21:21:44.143058 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1491/2891] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:43 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:44.146356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ae4c5acc-2ff3-4487-b1eb-22e9a44ecb35 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '.version_select at 0x7fdc13d06af0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:44.147412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae4c5acc-2ff3-4487-b1eb-22e9a44ecb35 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:44.153088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4c5acc-2ff3-4487-b1eb-22e9a44ecb35 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.153533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4c5acc-2ff3-4487-b1eb-22e9a44ecb35 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.154324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4c5acc-2ff3-4487-b1eb-22e9a44ecb35 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.154760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae4c5acc-2ff3-4487-b1eb-22e9a44ecb35 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.185858 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ae4c5acc-2ff3-4487-b1eb-22e9a44ecb35 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.043017 Apr 30 21:21:44.186412 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1492/2892] 10.222.0.23 () {58 vars in 1295 bytes} [Sat Apr 30 21:21:44 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1/os-instance-actions => generated 611 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:21:44.196602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:44.197109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:44.203340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.203799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.204588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.205029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.234840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:21:44.283990 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6316f4c1-d8b9-43a3-bc50-e6a3e43bc715 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.422239 Apr 30 21:21:44.284596 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1401/2893] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:43 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:44.295540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d592d6f-82fd-4890-8e17-e8fe68fc9639 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc207e8940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1448070160", "description": "tempest-description-1657905800"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:44.496813 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c3d1df5-1a72-434d-9fcb-74e639c1d29d tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "DELETE /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 204 len: 0 microversion: 2.1 time: 0.303297 Apr 30 21:21:44.497350 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1493/2894] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:21:44 2022] DELETE /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:21:44.502452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:44.503178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:44.509666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.510141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.510911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.511462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.619629 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5d592d6f-82fd-4890-8e17-e8fe68fc9639 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.327577 Apr 30 21:21:44.620300 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1402/2895] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:21:44.625484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:44.626628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:44.633330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.633820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.635105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.635797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.658522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:44.666213 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4887d78-2e8d-4f99-8c78-def2e5ca9406 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.167620 Apr 30 21:21:44.667191 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1494/2896] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:44 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:44.671963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f052ae4-ad27-43bb-95d3-3e9d6752ad97 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc261bc820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:44.816613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:44.824775 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c3371115-9104-4f23-a089-1f778de205c7 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1510 microversion: 2.1 time: 0.203284 Apr 30 21:21:44.825361 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1403/2897] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:44 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:44.932002 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7f052ae4-ad27-43bb-95d3-3e9d6752ad97 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.263610 Apr 30 21:21:44.932596 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1495/2898] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:21:44 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:44.944792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09b55cfc-122f-4fb5-8bf4-db2a659572ae tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc207e8700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:44.951259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:44.951259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:44.954875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.955334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:44.956115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:44.956558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:45.147568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:45.155122 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c819186-5738-4ca0-a968-35656ec729a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.211928 Apr 30 21:21:45.155782 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1496/2899] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:44 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:45.232561 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-09b55cfc-122f-4fb5-8bf4-db2a659572ae tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/22a28b49-9aa7-4a27-8872-ae42cb7445ca" status: 202 len: 0 microversion: 2.1 time: 0.292111 Apr 30 21:21:45.233280 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1404/2900] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:21:44 2022] DELETE /compute/v2.1/os-security-groups/22a28b49-9aa7-4a27-8872-ae42cb7445ca => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:45.242709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-226ecf31-a9ff-486c-8ca3-ae2abe58aafe tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc13d580d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:45.265523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-226ecf31-a9ff-486c-8ca3-ae2abe58aafe tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca does not exist", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:21:45.266174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-226ecf31-a9ff-486c-8ca3-ae2abe58aafe tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca not found {{(pid=130671) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:21:45.266796 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-226ecf31-a9ff-486c-8ca3-ae2abe58aafe tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca does not exist Apr 30 21:21:45.266796 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-1c649273-9412-4c80-abb9-0f27243f28fe'] Apr 30 21:21:45.267397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-226ecf31-a9ff-486c-8ca3-ae2abe58aafe tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca does not exist Apr 30 21:21:45.267397 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-1c649273-9412-4c80-abb9-0f27243f28fe'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:45.268276 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-226ecf31-a9ff-486c-8ca3-ae2abe58aafe tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/22a28b49-9aa7-4a27-8872-ae42cb7445ca" status: 404 len: 194 microversion: 2.1 time: 0.030858 Apr 30 21:21:45.268843 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1497/2901] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:21:45 2022] GET /compute/v2.1/os-security-groups/22a28b49-9aa7-4a27-8872-ae42cb7445ca => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:21:45.276828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3de726fa-46bb-48d7-8028-a377105579f6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc20836ca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:45.575892 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3de726fa-46bb-48d7-8028-a377105579f6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/db752416-2acb-42fa-9e08-aac4aed4c913" status: 202 len: 0 microversion: 2.1 time: 0.302686 Apr 30 21:21:45.576777 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1405/2902] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:21:45 2022] DELETE /compute/v2.1/os-security-groups/db752416-2acb-42fa-9e08-aac4aed4c913 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:45.586121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d79d8124-852f-4716-a87c-af4d5747ef2c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc13d06820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:45.609043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-d79d8124-852f-4716-a87c-af4d5747ef2c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group db752416-2acb-42fa-9e08-aac4aed4c913 does not exist", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:21:45.609736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-d79d8124-852f-4716-a87c-af4d5747ef2c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group db752416-2acb-42fa-9e08-aac4aed4c913 not found {{(pid=130671) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:21:45.610286 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d79d8124-852f-4716-a87c-af4d5747ef2c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group db752416-2acb-42fa-9e08-aac4aed4c913 does not exist Apr 30 21:21:45.610286 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-3aad2462-5395-4be7-bd03-47f429b3ff85'] Apr 30 21:21:45.610902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d79d8124-852f-4716-a87c-af4d5747ef2c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group db752416-2acb-42fa-9e08-aac4aed4c913 does not exist Apr 30 21:21:45.610902 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-3aad2462-5395-4be7-bd03-47f429b3ff85'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:45.612606 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d79d8124-852f-4716-a87c-af4d5747ef2c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/db752416-2acb-42fa-9e08-aac4aed4c913" status: 404 len: 194 microversion: 2.1 time: 0.030807 Apr 30 21:21:45.613177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1498/2903] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:21:45 2022] GET /compute/v2.1/os-security-groups/db752416-2acb-42fa-9e08-aac4aed4c913 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:21:45.621885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4c810d8a-788a-49c9-ae38-a4696ad904f9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc2084c1f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:45.684007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:45.684961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:45.693616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:45.694653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:45.695469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:45.695916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:45.864357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:45.872768 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc2fbdaf-02e3-4ceb-b157-fa9b2e055a9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.192847 Apr 30 21:21:45.873391 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1499/2904] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:45 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:45.877862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:45.878477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:45.884708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:45.885167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:45.885986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:45.886434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:45.923973 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4c810d8a-788a-49c9-ae38-a4696ad904f9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/2572a270-49b7-46ba-a411-000d6d75f164" status: 202 len: 0 microversion: 2.1 time: 0.305797 Apr 30 21:21:45.924555 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1406/2905] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:21:45 2022] DELETE /compute/v2.1/os-security-groups/2572a270-49b7-46ba-a411-000d6d75f164 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:21:45.933686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-256d7860-db73-4950-85a3-d5a8d53e89c0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc206cc9d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:45.982402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-256d7860-db73-4950-85a3-d5a8d53e89c0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2572a270-49b7-46ba-a411-000d6d75f164 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:21:45.983307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-256d7860-db73-4950-85a3-d5a8d53e89c0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group 2572a270-49b7-46ba-a411-000d6d75f164 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:21:45.983943 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-256d7860-db73-4950-85a3-d5a8d53e89c0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group 2572a270-49b7-46ba-a411-000d6d75f164 does not exist Apr 30 21:21:45.983943 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-b3a42eff-86b9-4ef4-85ee-9665953e7b32'] Apr 30 21:21:45.984520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-256d7860-db73-4950-85a3-d5a8d53e89c0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group 2572a270-49b7-46ba-a411-000d6d75f164 does not exist Apr 30 21:21:45.984520 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-b3a42eff-86b9-4ef4-85ee-9665953e7b32'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:45.985534 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-256d7860-db73-4950-85a3-d5a8d53e89c0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/2572a270-49b7-46ba-a411-000d6d75f164" status: 404 len: 194 microversion: 2.1 time: 0.055614 Apr 30 21:21:45.986192 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1407/2906] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:21:45 2022] GET /compute/v2.1/os-security-groups/2572a270-49b7-46ba-a411-000d6d75f164 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:21:45.995513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9fb7b624-11aa-4a21-829d-84778a237255 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc207e8280>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:46.092769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:46.100922 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37a2df41-3369-4232-b77c-9e00bc78bc5f tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1510 microversion: 2.1 time: 0.226519 Apr 30 21:21:46.101495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1500/2907] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:45 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:46.172606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:46.173228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:46.180307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:46.180763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:46.181546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:46.182019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:46.358411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9fb7b624-11aa-4a21-829d-84778a237255 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.367365 Apr 30 21:21:46.358932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1408/2908] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:21:45 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:46.372897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-928a4d3b-a03a-4495-812b-af36f867892f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc206ccb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2070493505", "description": "tempest-description-1255180394"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:46.453378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:46.461488 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bf92cfdf-8249-4cf6-a0c5-3f0197fc54ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.292776 Apr 30 21:21:46.462110 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1501/2909] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:46 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:46.846127 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-928a4d3b-a03a-4495-812b-af36f867892f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.477048 Apr 30 21:21:46.846940 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1409/2910] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:46 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:21:46.857765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-576372f8-2d6c-4537-8fee-fd75b9d24182 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc26267d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-526780883", "description": "tempest-description-978256777"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:46.879643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b573d87a-ef65-4f8e-a627-3c7143484b92 req-578076d0-1148-46f8-b389-da102e24a696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14900c0e-ec78-49e5-ae69-942a76d77fc1", "name": "network-vif-deleted", "tag": "dd9e8d91-9874-4104-8556-90f37ddf0af6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:46.890268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b573d87a-ef65-4f8e-a627-3c7143484b92 req-578076d0-1148-46f8-b389-da102e24a696 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:46.890721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b573d87a-ef65-4f8e-a627-3c7143484b92 req-578076d0-1148-46f8-b389-da102e24a696 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:46.902577 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b573d87a-ef65-4f8e-a627-3c7143484b92 req-578076d0-1148-46f8-b389-da102e24a696 service nova] Creating event network-vif-deleted:dd9e8d91-9874-4104-8556-90f37ddf0af6 for instance 14900c0e-ec78-49e5-ae69-942a76d77fc1 on nch1-master-1 Apr 30 21:21:46.907687 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b573d87a-ef65-4f8e-a627-3c7143484b92 req-578076d0-1148-46f8-b389-da102e24a696 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Apr 30 21:21:46.908240 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1410/2911] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:21:46.913251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:46.914020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:46.920264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:46.920722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:46.921536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:46.922035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:47.095959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:47.103535 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c8370804-1e68-4433-a177-fcd121436035 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.194168 Apr 30 21:21:47.104120 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1411/2912] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:46 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:47.118141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:47.118787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:47.124731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:47.125191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:47.126018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:47.126453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:47.189188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833f17bf2a0a4f89a95214e4e19c153a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b329e61e254c7c9c722e9afd8160ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:47.198920 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-65d4cc89-5dd6-4135-b840-a2e212b63ca5 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 200 len: 1301 microversion: 2.1 time: 0.085218 Apr 30 21:21:47.200361 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1412/2913] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:47 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:47.289592 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-576372f8-2d6c-4537-8fee-fd75b9d24182 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.435494 Apr 30 21:21:47.290283 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1502/2914] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:21:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:47.386616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1055611188", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "7b3c83f5-11ee-4bcf-b36d-922b070bfdae"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:47.437729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] validate_networks() for [('7b3c83f5-11ee-4bcf-b36d-922b070bfdae', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:21:47.478413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:47.478945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:47.485204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:47.485670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:47.486489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:47.486939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:47.676962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:47.685485 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0be2254c-a51e-4248-9c00-2186210d6360 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.211472 Apr 30 21:21:47.686100 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1503/2915] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:47 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:47.860248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:47.860709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:47.861196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:47.861608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:47.862116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:47.872292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:47.874870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:47.874870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:47.874870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:47.892446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Getting quotas for project 8b8ae5530f6847478106f78f50e7314d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:47.899292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Getting quotas for user 02b78cd5fee5448b9e42dbb212f0de19 and project 8b8ae5530f6847478106f78f50e7314d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:47.912648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:21:47.915139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:21:48.041568 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f7321031-d8f3-485c-83b1-9867f245be39 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658842 Apr 30 21:21:48.042204 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1413/2916] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:21:48.052603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d14aa4f-c06a-4ce9-b850-52053f90dff5 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:48.070060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d14aa4f-c06a-4ce9-b850-52053f90dff5 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:48.116015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d14aa4f-c06a-4ce9-b850-52053f90dff5 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:48.119802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:48.120431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:48.125970 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d14aa4f-c06a-4ce9-b850-52053f90dff5 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1216 microversion: 2.1 time: 0.077549 Apr 30 21:21:48.126995 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1504/2917] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:48 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:48.128286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:48.128755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:48.129562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:48.130211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:48.216021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:48.216652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] [instance: 14900c0e-ec78-49e5-ae69-942a76d77fc1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:48.226570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:48.227122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:48.227922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:48.228370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:48.253959 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] HTTP exception thrown: Instance 14900c0e-ec78-49e5-ae69-942a76d77fc1 could not be found. Apr 30 21:21:48.255097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] Returning 404 to user: Instance 14900c0e-ec78-49e5-ae69-942a76d77fc1 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:21:48.257428 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7272a5e4-48f7-4eff-b59c-a9b89458b700 tempest-InstanceActionsTestJSON-975144923 tempest-InstanceActionsTestJSON-975144923-project] 10.222.0.23 "GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1" status: 404 len: 111 microversion: 2.1 time: 0.044837 Apr 30 21:21:48.258931 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1505/2918] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:48 2022] GET /compute/v2.1/servers/14900c0e-ec78-49e5-ae69-942a76d77fc1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:21:48.265523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:48.279982 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8468cfaa-9509-4cc0-a956-bfe2b995c0b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.163733 Apr 30 21:21:48.281342 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1414/2919] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:48 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:48.703861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:48.704690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:48.712297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:48.712759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:48.713542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:48.714078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:48.876242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:48.884626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-807ac088-15fc-4289-90db-0e5e864f56be tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.184707 Apr 30 21:21:48.885194 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1506/2920] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:48 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:49.142726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:49.143460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:49.150539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:49.151097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:49.151963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:49.152485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:49.220396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:49.228209 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a9694bd8-6be7-4317-b28f-2ca49374b9f2 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1220 microversion: 2.1 time: 0.089543 Apr 30 21:21:49.229078 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1415/2921] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:49 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:49.296908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:49.297632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:49.305082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:49.305594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:49.306559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:49.307071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:49.439125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:49.446957 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d2e7d6d0-f8e5-4f35-b1a2-3cb710259aa1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.153964 Apr 30 21:21:49.447540 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1507/2922] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:49 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:49.902670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:49.903306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:49.909584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:49.910429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:49.911028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:49.911483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:50.057342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:50.064759 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bb25a7ed-574d-4767-9d55-60bfee6677a2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.166781 Apr 30 21:21:50.065326 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1416/2923] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:49 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:50.245013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:50.245833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:50.252901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:50.253708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:50.260064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:50.260820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:50.344257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:50.353861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d5b1c1e1-a57e-40bc-a027-0658918dd551 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1276 microversion: 2.1 time: 0.113234 Apr 30 21:21:50.354442 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1508/2924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:50 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:50.464887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:50.465616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:50.473672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:50.474627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:50.476235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:50.476830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:50.679053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:50.686958 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9fb9989b-5afc-4ceb-a6e8-9d1a3c4d1e9a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.226551 Apr 30 21:21:50.687848 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1417/2925] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:50 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:51.082506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:51.083162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:51.090077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:51.091363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:51.092219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:51.092661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:51.329686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:51.337871 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-480990f5-923d-4abd-a2e3-2dfdbdce2406 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.260224 Apr 30 21:21:51.338444 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1509/2926] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:51 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:51.373528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:51.374497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:51.381293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:51.381781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:51.382616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:51.383064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:51.620163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:51.631915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-920a8239-1eb2-4245-b739-52ef5d21ecd3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.259966 Apr 30 21:21:51.631915 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1418/2927] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:51 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:51.704483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:51.705242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:51.712458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:51.712928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:51.713721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:51.714194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:51.958444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:51.968051 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da5f3830-ec21-4028-97e9-81a436ab29e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.267392 Apr 30 21:21:51.969751 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1510/2928] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:51 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:52.181226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9f701160-0dad-460c-9651-916b11fbc0d6 req-96ff27a8-5afd-4b8d-baa0-a0feeaa09bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703208f7-1534-4904-bd47-2912f134e612", "tag": "7fed5ec0-2e20-45e9-adca-fbfa5aac5d72"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:52.195619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9f701160-0dad-460c-9651-916b11fbc0d6 req-96ff27a8-5afd-4b8d-baa0-a0feeaa09bcc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:52.196419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9f701160-0dad-460c-9651-916b11fbc0d6 req-96ff27a8-5afd-4b8d-baa0-a0feeaa09bcc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:52.211005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9f701160-0dad-460c-9651-916b11fbc0d6 req-96ff27a8-5afd-4b8d-baa0-a0feeaa09bcc service nova] Creating event network-changed:7fed5ec0-2e20-45e9-adca-fbfa5aac5d72 for instance 703208f7-1534-4904-bd47-2912f134e612 on nch1-master-1 Apr 30 21:21:52.218457 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9f701160-0dad-460c-9651-916b11fbc0d6 req-96ff27a8-5afd-4b8d-baa0-a0feeaa09bcc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040608 Apr 30 21:21:52.220217 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1419/2929] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:52.355757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:52.356377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:52.363222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:52.363880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:52.364663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:52.365108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:52.575599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:52.583196 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ef834e1-9a21-4bc1-8297-3b5e9fd0c0cc tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.231215 Apr 30 21:21:52.584974 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1511/2930] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:52 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:52.647005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:52.648411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:52.655655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:52.656211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:52.657110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:52.657630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:52.791891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1545262441", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "33316c41-54f6-4e10-894d-0bdc761056d7"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:52.849440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] validate_networks() for [('33316c41-54f6-4e10-894d-0bdc761056d7', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:21:52.983973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:52.992827 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74b1bb9f-e855-4a42-8ec0-1e70e983b525 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.351281 Apr 30 21:21:52.994093 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1420/2931] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:52 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:53.000525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:53.001154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:53.008150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:53.008741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:53.009796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:53.010209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:53.269931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:53.278006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-187a32c0-0daf-42f6-b570-6a1666b3e16e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.282465 Apr 30 21:21:53.278993 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1421/2932] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:52 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:53.488871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:21:53.489488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:21:53.490175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:21:53.491390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:21:53.491808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:21:53.502412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:53.502861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:53.503664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:53.504103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:53.528225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Getting quotas for project 5dc17b1f657d4f6caefcd0aae175053d. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:21:53.534015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Getting quotas for user 8d214c299b614208912789b9e3d7daae and project 5dc17b1f657d4f6caefcd0aae175053d. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:21:53.548006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:21:53.550360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:21:53.600406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:53.601067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:53.607223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:53.607688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:53.608495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:53.608943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:53.647782 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02cc58f8-9f7f-4ebe-85c6-bce6222cfb91 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981320 Apr 30 21:21:53.648606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1512/2933] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:21:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:21:53.658164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-382b295b-1c33-4244-b903-0b2222ce4fd0 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:53.658797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-382b295b-1c33-4244-b903-0b2222ce4fd0 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:53.726235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-382b295b-1c33-4244-b903-0b2222ce4fd0 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:53.733838 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-382b295b-1c33-4244-b903-0b2222ce4fd0 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1225 microversion: 2.1 time: 0.079417 Apr 30 21:21:53.734412 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1513/2934] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:53 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:53.785320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:53.793610 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45d12631-876d-43e4-a71c-f77dab328286 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.197134 Apr 30 21:21:53.794218 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1422/2935] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:53 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:54.011071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:54.011596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:54.018783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.019310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.020063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.020520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.149685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:54.157414 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19181b8d-05d3-4c92-8b5f-8aa737bea1ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.151159 Apr 30 21:21:54.158025 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1514/2936] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:54 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:54.295824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:54.296457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:54.303458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.303927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.304709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.305201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.440859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:54.449176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4f5d84a5-57d4-4164-be0d-a8cf6690a740 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.157342 Apr 30 21:21:54.449770 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1423/2937] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:54 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:54.751846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:54.752545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:54.760929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.761386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.762537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.762989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.810625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:54.811261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:54.818175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.818639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.819551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:54.820001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:54.828740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:54.836953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-40a2af1c-dfe9-4d3f-be55-ead750dd631f tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1229 microversion: 2.1 time: 0.089718 Apr 30 21:21:54.837535 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1515/2938] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:54 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:54.955411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:54.963533 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35400029-130d-4c56-a1cf-2d163e56a6e8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.156945 Apr 30 21:21:54.964102 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1424/2939] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:54 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:55.174420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:55.175041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:55.182425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.182874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:55.183676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.184150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:55.323315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:55.330970 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-528f8d45-0b42-42a1-9d8a-7bb434236aa6 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.160606 Apr 30 21:21:55.331548 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1516/2940] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:55 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:55.466292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:55.466978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:55.473135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.473624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:55.474435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.474881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:55.616544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:55.624296 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c8c719d6-603f-40fd-9914-a3ad8841c615 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.162030 Apr 30 21:21:55.624896 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1425/2941] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:55 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:55.854521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:55.855163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:55.862621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.872470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:55.872470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.872470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:55.937771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:55.947639 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b891602-072c-42e6-89b3-3185220cf32d tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1285 microversion: 2.1 time: 0.097676 Apr 30 21:21:55.956825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1517/2942] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:55 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:55.980977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:55.981597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:55.988556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.989018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:55.989818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:55.990916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:56.144485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:56.156708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d80c828b-14dc-49d4-9a15-ac817512b877 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.179530 Apr 30 21:21:56.157300 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1426/2943] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:55 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:56.348864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:56.350241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:56.356620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:56.357274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:56.358204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:56.358642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:56.540538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:56.548143 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73df4df1-06c7-4756-889f-8a06ddc4b4c9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.203688 Apr 30 21:21:56.548743 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1518/2944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:56 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:56.643140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:56.643861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:56.652405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:56.653215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:56.654507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:56.654828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:56.816127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:56.824125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8609ce63-6235-4771-a1e4-a7c77bdf9a17 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.185435 Apr 30 21:21:56.824693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1427/2945] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:56 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:56.964654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:56.965270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:56.978760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:56.979305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:56.980148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:56.980600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:57.175281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:57.175932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:57.184023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:57.184487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:57.186226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:57.186226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:57.548548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:57.557915 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-05e5eee4-3c84-452f-ac06-3661559bebad tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.597135 Apr 30 21:21:57.558506 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1519/2946] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:56 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:57.571002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:57.571756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:57.579016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:57.579509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:57.580689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:57.581016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:57.661526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:57.670156 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10d3dfa3-738f-4c84-a0af-fec1093ed058 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.499707 Apr 30 21:21:57.670784 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1428/2947] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:57 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:57.748627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:57.756119 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1722969-1bb6-4cf4-93b9-e675d0a46e24 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.194729 Apr 30 21:21:57.756736 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1520/2948] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:57 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:57.842582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:57.843336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:57.850377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:57.851017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:57.851820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:57.852286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.042253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:58.049932 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ef2e186-1fef-449a-a0b8-52630f7f103b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.211441 Apr 30 21:21:58.050451 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1429/2949] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:57 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:58.213948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-04459328-ca67-42a4-bb1f-28aca6e05a5e req-3d6ed93f-5d49-437b-b050-6e0060de3fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cff1b97-a0f9-40ae-95b5-54d8cbf64720", "tag": "782e899c-e697-463d-a2f3-2518f28f1d5b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:58.222704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-04459328-ca67-42a4-bb1f-28aca6e05a5e req-3d6ed93f-5d49-437b-b050-6e0060de3fb6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.224942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-04459328-ca67-42a4-bb1f-28aca6e05a5e req-3d6ed93f-5d49-437b-b050-6e0060de3fb6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.235324 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-04459328-ca67-42a4-bb1f-28aca6e05a5e req-3d6ed93f-5d49-437b-b050-6e0060de3fb6 service nova] Creating event network-changed:782e899c-e697-463d-a2f3-2518f28f1d5b for instance 7cff1b97-a0f9-40ae-95b5-54d8cbf64720 on nch2-master-1 Apr 30 21:21:58.241375 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-04459328-ca67-42a4-bb1f-28aca6e05a5e req-3d6ed93f-5d49-437b-b050-6e0060de3fb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031304 Apr 30 21:21:58.242040 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1521/2950] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:58.575851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:58.576622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:58.590449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.595182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.595182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.595182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.688700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:58.689408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:58.695734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.697026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.698008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.698585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.908600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:58.918326 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-61b30a07-6737-4a27-b153-6dd246a6bd19 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.346550 Apr 30 21:21:58.919548 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1430/2951] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:58 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:58.930113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:58.930873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:58.949136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.949643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.950504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.950956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.963068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:58.972805 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-355a83b6-fff0-4ca1-b484-7267a2c0c023 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.288251 Apr 30 21:21:58.973296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1522/2952] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:58 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:58.981598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ef8bd613-268e-4b75-afb3-43c8367281b9 req-5056098a-5f5a-45c7-a06e-f191f1d603b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703208f7-1534-4904-bd47-2912f134e612", "name": "network-vif-plugged", "status": "completed", "tag": "7fed5ec0-2e20-45e9-adca-fbfa5aac5d72"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:21:58.987622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ef8bd613-268e-4b75-afb3-43c8367281b9 req-5056098a-5f5a-45c7-a06e-f191f1d603b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:58.988071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ef8bd613-268e-4b75-afb3-43c8367281b9 req-5056098a-5f5a-45c7-a06e-f191f1d603b7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:58.999372 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ef8bd613-268e-4b75-afb3-43c8367281b9 req-5056098a-5f5a-45c7-a06e-f191f1d603b7 service nova] Creating event network-vif-plugged:7fed5ec0-2e20-45e9-adca-fbfa5aac5d72 for instance 703208f7-1534-4904-bd47-2912f134e612 on nch1-master-1 Apr 30 21:21:59.004319 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ef8bd613-268e-4b75-afb3-43c8367281b9 req-5056098a-5f5a-45c7-a06e-f191f1d603b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029770 Apr 30 21:21:59.004915 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1523/2953] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:21:59.068000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:59.068495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:59.075360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:59.075823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:59.076628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:59.077075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:59.270855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:59.278829 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-968a87d4-67cf-4152-b1b4-400fc0cbc89c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.358053 Apr 30 21:21:59.279597 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1431/2954] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:58 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:21:59.312450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:21:59.320724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-11463d0f-9936-4c16-a89e-a7e4005909ad tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.257287 Apr 30 21:21:59.321296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1524/2955] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:59 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:21:59.935458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:59.936077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:59.942924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:59.943379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:59.944152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:59.944593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:59.989216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:21:59.989978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:21:59.996001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:59.996465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:21:59.997253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:21:59.997701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:00.127317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:00.135017 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-293afe97-c135-4a62-bd71-f9f0ab7fa32c tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.203517 Apr 30 21:22:00.135695 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1432/2956] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:59 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:00.157660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:00.165690 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-23b5ba92-209f-4aab-bc70-e55759387db0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.180322 Apr 30 21:22:00.166282 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1525/2957] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:21:59 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:00.296636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:00.297257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:00.303613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:00.306505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:00.306505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:00.306505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:00.338496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:00.339025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:00.347106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:00.347535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:00.363175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:00.363175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:00.484446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:00.492601 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-58d94291-1655-4907-93d3-787e744142a3 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1316 microversion: 2.1 time: 0.200239 Apr 30 21:22:00.493263 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1433/2958] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:00 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:00.514277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:00.522193 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-826794f0-75b2-4e24-b10b-35ead4d51e8d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.188129 Apr 30 21:22:00.522773 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1526/2959] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:00 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:01.155785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:01.156403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:01.163157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.163612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.164387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.164828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.183412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:01.184116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:01.197081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.197542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.198380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.198830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.349217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:01.357288 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a6f427d-0488-42db-bd91-fadf31e77fd3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.205372 Apr 30 21:22:01.357815 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1434/2960] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:01 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:01.376789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:01.384925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2bc61bf0-2b7d-43ba-a30d-aa4f3d377da6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.205852 Apr 30 21:22:01.385492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1527/2961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:01 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:01.509099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:01.509723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:01.516125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.517270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.518079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.518527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.539102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:01.539868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:01.545965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.546429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.547216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.547660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.714592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:01.723011 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aac8a7a6-8e62-4359-b060-3d9fe96d9358 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1504 microversion: 2.1 time: 0.218370 Apr 30 21:22:01.723592 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1435/2962] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:01 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:01.731465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:01.739775 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee6259ef-c271-4932-acfb-ba3b55b0b1f6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.204144 Apr 30 21:22:01.739959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2070493505"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:01.740351 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1528/2963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:01 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:01.740483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:01.747895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.748426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.749395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:01.749873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:01.878333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.network.security_group_api [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Adding security group 48bf3612-bf9b-470a-96a8-0ba6432dc15a to port 7fed5ec0-2e20-45e9-adca-fbfa5aac5d72 Apr 30 21:22:02.295176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4c82a751-200c-4d28-8003-4599097c4c85 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612/action" status: 202 len: 0 microversion: 2.1 time: 0.559121 Apr 30 21:22:02.299288 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1436/2964] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:22:01 2022] POST /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:22:02.311429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b2306bbf-a162-4fc4-b6ee-96f0142569cc req-d1195a6e-6ed7-4c60-8ebb-9ffb90b0052c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703208f7-1534-4904-bd47-2912f134e612", "tag": "7fed5ec0-2e20-45e9-adca-fbfa5aac5d72"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:02.313980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af5d4515-e326-45ca-a4f7-b5ca5c44fc63 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc13d7dee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:02.331236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b2306bbf-a162-4fc4-b6ee-96f0142569cc req-d1195a6e-6ed7-4c60-8ebb-9ffb90b0052c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.331924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b2306bbf-a162-4fc4-b6ee-96f0142569cc req-d1195a6e-6ed7-4c60-8ebb-9ffb90b0052c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.345367 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b2306bbf-a162-4fc4-b6ee-96f0142569cc req-d1195a6e-6ed7-4c60-8ebb-9ffb90b0052c service nova] Creating event network-changed:7fed5ec0-2e20-45e9-adca-fbfa5aac5d72 for instance 703208f7-1534-4904-bd47-2912f134e612 on nch1-master-1 Apr 30 21:22:02.351032 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b2306bbf-a162-4fc4-b6ee-96f0142569cc req-d1195a6e-6ed7-4c60-8ebb-9ffb90b0052c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045979 Apr 30 21:22:02.352192 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1437/2965] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:02.378746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:02.379925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:02.387687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.388345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.388971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.389412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.569276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG neutronclient.v2_0.client [None req-af5d4515-e326-45ca-a4f7-b5ca5c44fc63 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 48bf3612-bf9b-470a-96a8-0ba6432dc15a in use.", "detail": ""}} {{(pid=130671) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:02.570456 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-af5d4515-e326-45ca-a4f7-b5ca5c44fc63 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security Group 48bf3612-bf9b-470a-96a8-0ba6432dc15a in use. Apr 30 21:22:02.570456 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-afb58972-5aff-47ea-bdb0-b4a1aad2e8ce'] Apr 30 21:22:02.571249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af5d4515-e326-45ca-a4f7-b5ca5c44fc63 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 400 to user: Security Group 48bf3612-bf9b-470a-96a8-0ba6432dc15a in use. Apr 30 21:22:02.571249 ncdv-master-1 devstack@n-api.service[130671]: Neutron server returns request_ids: ['req-afb58972-5aff-47ea-bdb0-b4a1aad2e8ce'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:02.572220 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af5d4515-e326-45ca-a4f7-b5ca5c44fc63 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/48bf3612-bf9b-470a-96a8-0ba6432dc15a" status: 400 len: 185 microversion: 2.1 time: 0.271485 Apr 30 21:22:02.572792 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1529/2966] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:02 2022] DELETE /compute/v2.1/os-security-groups/48bf3612-bf9b-470a-96a8-0ba6432dc15a => generated 185 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:22:02.583005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:02.583672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:02.592755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.593694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.595021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.595632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.715269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:02.725429 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-034c34b7-1e03-4418-9b90-c9d5c3befbbc tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.353404 Apr 30 21:22:02.727842 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1438/2967] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:02 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:02.734249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81e40a60-5fdf-4049-9692-3273ef1d86f8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:02.735570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81e40a60-5fdf-4049-9692-3273ef1d86f8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:02.742845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e40a60-5fdf-4049-9692-3273ef1d86f8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.743309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e40a60-5fdf-4049-9692-3273ef1d86f8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.744277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e40a60-5fdf-4049-9692-3273ef1d86f8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.744723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81e40a60-5fdf-4049-9692-3273ef1d86f8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.827255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:02.836564 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2a5244df-88a1-4543-9474-164358b46519 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.257135 Apr 30 21:22:02.837143 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1530/2968] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:02 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:02.842048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:02.842859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:02.852847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.859115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.859115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.859115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.986050 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81e40a60-5fdf-4049-9692-3273ef1d86f8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612/action" status: 202 len: 0 microversion: 2.1 time: 0.250526 Apr 30 21:22:02.986050 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1439/2969] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:22:02 2022] POST /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:02.990428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:02.991211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:02.998331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:02.998796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:02.999594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:03.000041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:03.105277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:03.112770 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cc198b01-1f63-406a-8c9d-397cb423cc3b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1514 microversion: 2.1 time: 0.274403 Apr 30 21:22:03.113347 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1531/2970] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:02 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:03.254491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:03.262408 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-87eed48b-6a1e-4ea2-849c-fc3384709b8c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1575 microversion: 2.1 time: 0.276646 Apr 30 21:22:03.263303 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1440/2971] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:02 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1575 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:03.743754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:03.744369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:03.751643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:03.752217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:03.753109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:03.753556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:03.854568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:03.855403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:03.864471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:03.865028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:03.865959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:03.866489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:04.000546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:04.010485 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9129a32-2288-48ea-a8aa-0dbc78da66ab tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.270563 Apr 30 21:22:04.011496 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1532/2972] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:03 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:04.133959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:04.134922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:04.141908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:04.142684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:04.143987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:04.144647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:04.158408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:04.177230 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78d3d718-c9d8-4675-89bc-ee9f71bd5f2a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.327844 Apr 30 21:22:04.178329 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1441/2973] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:03 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:04.283352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:04.284054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:04.299535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:04.301470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:04.302364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:04.302819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:04.480505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:04.488087 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8355ee5-16c8-477e-a81a-5f6dd1d94f79 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1532 microversion: 2.1 time: 0.360916 Apr 30 21:22:04.488725 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1533/2974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:04 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1532 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:04.493210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e9756f93-ce8b-41d8-a90a-1ee88d6d92c2 req-15a04aa2-589d-4339-9b9e-88651334f51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cff1b97-a0f9-40ae-95b5-54d8cbf64720", "name": "network-vif-plugged", "status": "completed", "tag": "782e899c-e697-463d-a2f3-2518f28f1d5b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:04.505004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e9756f93-ce8b-41d8-a90a-1ee88d6d92c2 req-15a04aa2-589d-4339-9b9e-88651334f51b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:04.505004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e9756f93-ce8b-41d8-a90a-1ee88d6d92c2 req-15a04aa2-589d-4339-9b9e-88651334f51b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:04.512662 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e9756f93-ce8b-41d8-a90a-1ee88d6d92c2 req-15a04aa2-589d-4339-9b9e-88651334f51b service nova] Creating event network-vif-plugged:782e899c-e697-463d-a2f3-2518f28f1d5b for instance 7cff1b97-a0f9-40ae-95b5-54d8cbf64720 on nch2-master-1 Apr 30 21:22:04.517835 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e9756f93-ce8b-41d8-a90a-1ee88d6d92c2 req-15a04aa2-589d-4339-9b9e-88651334f51b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027955 Apr 30 21:22:04.518434 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1534/2975] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:04.525380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:04.532985 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e9abdc3-0e9b-4e17-853c-84359437d07c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1575 microversion: 2.1 time: 0.255574 Apr 30 21:22:04.538085 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1442/2976] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:04 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:05.029131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:05.029862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:05.036120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.036631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.037421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.037891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.169346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:05.178458 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-72b28ab5-a12f-4210-a250-70a2b7ac5748 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.154530 Apr 30 21:22:05.179037 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1535/2977] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:05 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:05.195439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:05.196062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:05.203198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.203673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.204477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.204933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.349482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:05.376337 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88c0c72b-aee9-46bd-b0db-12e37827d403 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.184671 Apr 30 21:22:05.377210 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1443/2978] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:05 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:05.506742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:05.507876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:05.515411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.516114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.517143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.517586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.551891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:05.552599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:05.562030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.562488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.563504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:05.564106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:05.889481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:05.896925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-583b62cc-f9c3-4c83-a5d0-82e6ff498687 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1520 microversion: 2.1 time: 0.395267 Apr 30 21:22:05.897499 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1536/2979] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:05 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:05.916450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:05.924117 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23654225-741b-480f-b5ba-521ef69f76c1 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1575 microversion: 2.1 time: 0.376645 Apr 30 21:22:05.924890 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1444/2980] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:05 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1575 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:06.194876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:06.196167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:06.203714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.204177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.204967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.205422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.352227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:06.359697 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f8035c6-9a67-4dd8-a883-abaecfe109a6 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1325 microversion: 2.1 time: 0.168788 Apr 30 21:22:06.360329 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1537/2981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:06 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:06.394895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:06.395720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:06.403100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.403567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.404365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.404814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.535034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:06.543788 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-404a9419-fbfb-4811-8921-577e41fd526c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.153220 Apr 30 21:22:06.544671 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1445/2982] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:06 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:06.875096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-191f2dd2-0a56-486d-bfde-1cf653d4dba5 req-78ab928c-15e5-4f15-9ad5-6db63c09a5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284", "name": "network-vif-unplugged", "status": "completed", "tag": "03bbeaca-a3de-45e7-975b-56c33a1d9bff"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:06.884318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-191f2dd2-0a56-486d-bfde-1cf653d4dba5 req-78ab928c-15e5-4f15-9ad5-6db63c09a5b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.884769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-191f2dd2-0a56-486d-bfde-1cf653d4dba5 req-78ab928c-15e5-4f15-9ad5-6db63c09a5b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.900395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-191f2dd2-0a56-486d-bfde-1cf653d4dba5 req-78ab928c-15e5-4f15-9ad5-6db63c09a5b8 service nova] Creating event network-vif-unplugged:03bbeaca-a3de-45e7-975b-56c33a1d9bff for instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 on nch1-master-1 Apr 30 21:22:06.907527 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-191f2dd2-0a56-486d-bfde-1cf653d4dba5 req-78ab928c-15e5-4f15-9ad5-6db63c09a5b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036053 Apr 30 21:22:06.908226 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1538/2983] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:06.920798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:06.921617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:06.928061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.928522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.929551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.930038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.942248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:06.942988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:06.950328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.950836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:06.951589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:06.952031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.135384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:07.143167 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-657c2db6-0b2f-4a3b-aee2-8a0e94329e9e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1520 microversion: 2.1 time: 0.226390 Apr 30 21:22:07.143839 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1446/2984] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:06 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:07.158844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:07.166499 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7dd61b10-58ea-498c-88f5-c6f75c760960 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1580 microversion: 2.1 time: 0.228562 Apr 30 21:22:07.167067 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1539/2985] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:06 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1580 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:07.376498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:07.377030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:07.383776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.384236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.385062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.385512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.516305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:07.524900 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8993114d-dde7-4347-9c3b-341c56c48cbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1522 microversion: 2.1 time: 0.152620 Apr 30 21:22:07.525488 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1447/2986] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:07 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:07.541348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:07.545639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:07.548652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.549101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.549903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.550346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.561428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:07.562205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:07.568662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.569126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.570835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.571290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.581328 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] HTTP exception thrown: Action 999 not found Apr 30 21:22:07.582100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Returning 404 to user: Action 999 not found {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:07.583025 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2692bdcc-d7ac-4b78-b0d1-fb97acbd9cd5 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.045675 Apr 30 21:22:07.583651 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1540/2987] 10.222.0.23 () {58 vars in 1307 bytes} [Sat Apr 30 21:22:07 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720/os-instance-actions/999 => generated 66 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:22:07.592823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dbcf282d-b1e1-468f-82b1-d46a63728bbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '.version_select at 0x7fdc261af160>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:07.593519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dbcf282d-b1e1-468f-82b1-d46a63728bbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 9c66719b-f525-467e-9d4f-fc0f53d4a76c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:07.599234 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-dbcf282d-b1e1-468f-82b1-d46a63728bbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] HTTP exception thrown: Instance 9c66719b-f525-467e-9d4f-fc0f53d4a76c could not be found. Apr 30 21:22:07.599823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dbcf282d-b1e1-468f-82b1-d46a63728bbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Returning 404 to user: Instance 9c66719b-f525-467e-9d4f-fc0f53d4a76c could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:07.600649 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dbcf282d-b1e1-468f-82b1-d46a63728bbe tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/9c66719b-f525-467e-9d4f-fc0f53d4a76c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.011784 Apr 30 21:22:07.601251 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1541/2988] 10.222.0.23 () {58 vars in 1295 bytes} [Sat Apr 30 21:22:07 2022] GET /compute/v2.1/servers/9c66719b-f525-467e-9d4f-fc0f53d4a76c/os-instance-actions => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:07.610339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:07.610839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:07.618720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.619146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.619976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.620423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.651161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:22:07.707105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:07.714527 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78afc94f-44d6-45fd-8f09-d2c5086ff5cd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1509 microversion: 2.1 time: 0.157448 Apr 30 21:22:07.715101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1448/2989] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:07 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:07.936267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f137672-fcc2-4a54-bef6-297133a1ffb3 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 204 len: 0 microversion: 2.1 time: 0.329600 Apr 30 21:22:07.936818 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1542/2990] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:07 2022] DELETE /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:22:07.944921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:07.945559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:07.951705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.952169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:07.952957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:07.953417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.081406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:08.088887 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d82cfcd-0697-4080-a09a-d40a9d345303 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1528 microversion: 2.1 time: 0.147981 Apr 30 21:22:08.089467 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1449/2991] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:07 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1528 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:08.162666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:08.163536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:08.171691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.172536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.173979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.174441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.184621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:08.185865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:08.193058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.193058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.194229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.194229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.383362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:08.390788 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8bc5225-d8bd-49f2-8d70-90e383173c0b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1520 microversion: 2.1 time: 0.233690 Apr 30 21:22:08.391361 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1543/2992] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:08 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:08.400045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:08.408446 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a10341f-de20-4419-ac8d-c41b644f151f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1573 microversion: 2.1 time: 0.227698 Apr 30 21:22:08.409051 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1450/2993] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:08 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1573 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:08.427134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-526780883"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:08.427670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:08.434297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.434754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.435519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.435992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.568303 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.network.security_group_api [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Adding security group d3ae815d-5315-4395-8139-f5d582e807b0 to port 7fed5ec0-2e20-45e9-adca-fbfa5aac5d72 Apr 30 21:22:08.732287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:08.732915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:08.739150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.739644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:08.740480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:08.740932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.259082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:09.266664 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bac6d509-6356-435c-880e-1a5af22d693b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1530 microversion: 2.1 time: 0.538299 Apr 30 21:22:09.267239 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1451/2994] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:08 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1530 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:09.272290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:09.275741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:09.282255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.282713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.283504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.283955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.412586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6db87486-c982-4c88-af58-dc0163537b7e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612/action" status: 202 len: 0 microversion: 2.1 time: 0.989526 Apr 30 21:22:09.417422 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1544/2995] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:22:08 2022] POST /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612/action => generated 0 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:22:09.423259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:09.423792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:09.447316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.447781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.448776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.453676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.497226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:09.508140 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f9c87839-f32f-40c3-84fd-e45b059c81be tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1528 microversion: 2.1 time: 0.239289 Apr 30 21:22:09.509247 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1452/2996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:09 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1528 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:09.515447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cc0e4089-feba-4441-a259-ae955b32acdd req-8742846b-486a-446d-9ea3-9ba1fb547132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703208f7-1534-4904-bd47-2912f134e612", "tag": "7fed5ec0-2e20-45e9-adca-fbfa5aac5d72"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:09.525273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cc0e4089-feba-4441-a259-ae955b32acdd req-8742846b-486a-446d-9ea3-9ba1fb547132 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.525726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cc0e4089-feba-4441-a259-ae955b32acdd req-8742846b-486a-446d-9ea3-9ba1fb547132 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.539771 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cc0e4089-feba-4441-a259-ae955b32acdd req-8742846b-486a-446d-9ea3-9ba1fb547132 service nova] Creating event network-changed:7fed5ec0-2e20-45e9-adca-fbfa5aac5d72 for instance 703208f7-1534-4904-bd47-2912f134e612 on nch1-master-1 Apr 30 21:22:09.545237 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cc0e4089-feba-4441-a259-ae955b32acdd req-8742846b-486a-446d-9ea3-9ba1fb547132 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034454 Apr 30 21:22:09.546962 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1453/2997] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:09.556332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-15a322bb-1a58-4652-bc09-a4896ab07481 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc2088b5e0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:09.676615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:09.686710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92b9d8e5-1074-4a53-9d74-116672242f52 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1520 microversion: 2.1 time: 0.267509 Apr 30 21:22:09.687297 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1545/2998] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:09 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:09.875325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-15a322bb-1a58-4652-bc09-a4896ab07481 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d3ae815d-5315-4395-8139-f5d582e807b0 in use.", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:09.876440 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-15a322bb-1a58-4652-bc09-a4896ab07481 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security Group d3ae815d-5315-4395-8139-f5d582e807b0 in use. Apr 30 21:22:09.876440 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-30aaac27-0710-4c8d-bea9-e97ca6986b3b'] Apr 30 21:22:09.877379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-15a322bb-1a58-4652-bc09-a4896ab07481 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 400 to user: Security Group d3ae815d-5315-4395-8139-f5d582e807b0 in use. Apr 30 21:22:09.877379 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-30aaac27-0710-4c8d-bea9-e97ca6986b3b'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:09.878450 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-15a322bb-1a58-4652-bc09-a4896ab07481 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d3ae815d-5315-4395-8139-f5d582e807b0" status: 400 len: 185 microversion: 2.1 time: 0.326906 Apr 30 21:22:09.879245 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1454/2999] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:09 2022] DELETE /compute/v2.1/os-security-groups/d3ae815d-5315-4395-8139-f5d582e807b0 => generated 185 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:22:09.888216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:09.888935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:09.900000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d3f79b81-85c3-4a37-b498-a4d27a788180 req-fbe5f553-c102-4a49-940b-a04a2da6e5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284", "name": "network-vif-plugged", "status": "completed", "tag": "03bbeaca-a3de-45e7-975b-56c33a1d9bff"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:09.903029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.905597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.906551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.907916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.910876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d3f79b81-85c3-4a37-b498-a4d27a788180 req-fbe5f553-c102-4a49-940b-a04a2da6e5a1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:09.911563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d3f79b81-85c3-4a37-b498-a4d27a788180 req-fbe5f553-c102-4a49-940b-a04a2da6e5a1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:09.924417 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d3f79b81-85c3-4a37-b498-a4d27a788180 req-fbe5f553-c102-4a49-940b-a04a2da6e5a1 service nova] Creating event network-vif-plugged:03bbeaca-a3de-45e7-975b-56c33a1d9bff for instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 on nch1-master-1 Apr 30 21:22:09.931299 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d3f79b81-85c3-4a37-b498-a4d27a788180 req-fbe5f553-c102-4a49-940b-a04a2da6e5a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040035 Apr 30 21:22:09.932604 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1455/3000] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:09.959055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:22:10.290185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:10.291693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:10.299151 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9fc7f53e-b42d-48da-8fa8-3cdc764fee18 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 204 len: 0 microversion: 2.1 time: 0.414435 Apr 30 21:22:10.299617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.300504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.301943 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1546/3001] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:09 2022] DELETE /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:22:10.302262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.302942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.329917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:10.329917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:10.353584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.358386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.359532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.359658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.569117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:10.579818 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c47a6b29-8467-4dc3-97f2-fe296db5d55d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.298743 Apr 30 21:22:10.583206 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1456/3002] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:10 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:10.596942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:10.597799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:10.612500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.614429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.615794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.616260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.666849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:10.679783 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aed95f13-ce94-4c87-914e-8452fd352f4c tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1647 microversion: 2.1 time: 0.371751 Apr 30 21:22:10.680992 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1547/3003] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:10 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1647 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:10.706467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d214c299b614208912789b9e3d7daae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc17b1f657d4f6caefcd0aae175053d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:10.709947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:10.711337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:10.716420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-05cb33a2-5e4d-4133-b189-53f7d8ccbe98 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 200 len: 1486 microversion: 2.1 time: 0.130132 Apr 30 21:22:10.724210 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1457/3004] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:10 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 1486 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:10.724360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.724360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.724360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:10.724360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:10.871525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:10.879115 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad5e8ce6-3522-47e1-9748-f33a0681ceef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1520 microversion: 2.1 time: 0.178600 Apr 30 21:22:10.879695 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1548/3005] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:10 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:11.566902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b992222b-4bdf-42b2-b791-5c1bae02205e req-f47f679c-2a6f-417f-b45e-7048fa8ea2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cff1b97-a0f9-40ae-95b5-54d8cbf64720", "name": "network-vif-deleted", "tag": "782e899c-e697-463d-a2f3-2518f28f1d5b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:11.592011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b992222b-4bdf-42b2-b791-5c1bae02205e req-f47f679c-2a6f-417f-b45e-7048fa8ea2e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:11.592617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b992222b-4bdf-42b2-b791-5c1bae02205e req-f47f679c-2a6f-417f-b45e-7048fa8ea2e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:11.602345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:11.603209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:11.618125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:11.618754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:11.619712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:11.620251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:11.626805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b992222b-4bdf-42b2-b791-5c1bae02205e req-f47f679c-2a6f-417f-b45e-7048fa8ea2e5 service nova] Creating event network-vif-deleted:782e899c-e697-463d-a2f3-2518f28f1d5b for instance 7cff1b97-a0f9-40ae-95b5-54d8cbf64720 on nch2-master-1 Apr 30 21:22:11.640216 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b992222b-4bdf-42b2-b791-5c1bae02205e req-f47f679c-2a6f-417f-b45e-7048fa8ea2e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076803 Apr 30 21:22:11.641207 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1458/3006] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:11.708465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:11.709370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:11.780363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:11.783066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:11.784539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:11.785402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:11.923848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:11.932592 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67162c4a-5c30-48f3-9c39-29ef3d176ef5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.335713 Apr 30 21:22:11.933191 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1549/3007] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:11 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:11.946767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:11.949097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] [instance: 7cff1b97-a0f9-40ae-95b5-54d8cbf64720] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:11.966776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:11.967266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:11.968169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:11.968688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:11.991484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] HTTP exception thrown: Instance 7cff1b97-a0f9-40ae-95b5-54d8cbf64720 could not be found. Apr 30 21:22:11.992160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] Returning 404 to user: Instance 7cff1b97-a0f9-40ae-95b5-54d8cbf64720 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:11.993243 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-218efe34-d820-4655-a47f-5ed00a924556 tempest-InstanceActionsNegativeTestJSON-1744550906 tempest-InstanceActionsNegativeTestJSON-1744550906-project] 10.222.0.23 "GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720" status: 404 len: 111 microversion: 2.1 time: 0.054427 Apr 30 21:22:11.994000 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1550/3008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:11 2022] GET /compute/v2.1/servers/7cff1b97-a0f9-40ae-95b5-54d8cbf64720 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:12.001173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:12.002384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:12.011545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:12.012134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:12.013041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:12.013568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:12.047569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:12.056580 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d3d06f63-c704-4998-b81e-c6bdff6c5511 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1647 microversion: 2.1 time: 0.355521 Apr 30 21:22:12.059788 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1459/3009] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:11 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1647 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:12.190086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:12.198801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45a5c867-1d3d-4d5f-9bdd-0a6f1a4399a5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1520 microversion: 2.1 time: 0.203593 Apr 30 21:22:12.199511 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1551/3010] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:11 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:12.355413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b72cad04-d0c1-4f51-b34a-7be5a1a18577 req-295b6de0-b01d-4d09-a9aa-1f72b2ed284d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3443c916-dda1-43d3-b094-442c866c9184", "name": "network-vif-plugged", "status": "completed", "tag": "5337eefd-6282-4815-8142-ab29768bf85b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:12.370472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b72cad04-d0c1-4f51-b34a-7be5a1a18577 req-295b6de0-b01d-4d09-a9aa-1f72b2ed284d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:12.371282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b72cad04-d0c1-4f51-b34a-7be5a1a18577 req-295b6de0-b01d-4d09-a9aa-1f72b2ed284d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:12.388013 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b72cad04-d0c1-4f51-b34a-7be5a1a18577 req-295b6de0-b01d-4d09-a9aa-1f72b2ed284d service nova] Creating event network-vif-plugged:5337eefd-6282-4815-8142-ab29768bf85b for instance 3443c916-dda1-43d3-b094-442c866c9184 on nch2-master-1 Apr 30 21:22:12.394141 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b72cad04-d0c1-4f51-b34a-7be5a1a18577 req-295b6de0-b01d-4d09-a9aa-1f72b2ed284d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044097 Apr 30 21:22:12.395343 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1460/3011] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:12.951363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:12.953049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:12.970829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:12.971769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:12.982956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:12.983410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.084008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:13.084627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:13.091998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:13.093113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.094150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:13.094758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.332363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:13.340417 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01a08fde-5fae-4072-ac03-9a5717d1c48d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.392920 Apr 30 21:22:13.340982 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1552/3012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:12 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:13.345648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:13.346596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:13.356657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:13.357453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.358518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:13.359009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.404327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:13.411977 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a976fd58-3450-41d8-bec6-e0d897ec6196 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1647 microversion: 2.1 time: 0.333213 Apr 30 21:22:13.412874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1461/3013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:13 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1647 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:13.592769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:13.601717 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-167d439d-04ef-4ab7-a597-7ee7d269f60e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1505 microversion: 2.1 time: 0.259232 Apr 30 21:22:13.602419 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1553/3014] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:13 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:13.625032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:13.626821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:13.651665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:13.654401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.656231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:13.656845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.667634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-cb01c8e6-427f-400b-b90b-be1705b342fa req-8b523639-0479-4bf3-a260-9424636ba32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703208f7-1534-4904-bd47-2912f134e612", "name": "network-vif-deleted", "tag": "7fed5ec0-2e20-45e9-adca-fbfa5aac5d72"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:13.699262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cb01c8e6-427f-400b-b90b-be1705b342fa req-8b523639-0479-4bf3-a260-9424636ba32e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:13.702539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cb01c8e6-427f-400b-b90b-be1705b342fa req-8b523639-0479-4bf3-a260-9424636ba32e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:13.750953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-cb01c8e6-427f-400b-b90b-be1705b342fa req-8b523639-0479-4bf3-a260-9424636ba32e service nova] Creating event network-vif-deleted:7fed5ec0-2e20-45e9-adca-fbfa5aac5d72 for instance 703208f7-1534-4904-bd47-2912f134e612 on nch1-master-1 Apr 30 21:22:13.767481 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-cb01c8e6-427f-400b-b90b-be1705b342fa req-8b523639-0479-4bf3-a260-9424636ba32e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107221 Apr 30 21:22:13.786286 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1554/3015] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:13.959300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:13.972288 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a4bb4e9-a77c-4adc-883b-b88eb285f9f1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 200 len: 1505 microversion: 2.1 time: 0.351895 Apr 30 21:22:13.973216 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1462/3016] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:13 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:13.990776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:13.996401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:14.000819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:14.001476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:14.002503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:14.003098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:14.033285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:22:14.358541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:14.359914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:14.373120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:14.374010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:14.375086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:14.375682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:14.390345 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1b9c27a8-cd0e-46e6-8bf7-a088d31ea7c3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 204 len: 0 microversion: 2.1 time: 0.403135 Apr 30 21:22:14.391924 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1555/3017] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:13 2022] DELETE /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:22:14.431802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:14.432580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:14.447854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:14.454455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:14.460752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:14.461997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:14.519975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:14.520632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:14.525885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lazy-loading 'fault' on Instance uuid 703208f7-1534-4904-bd47-2912f134e612 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:22:14.625279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:14.635097 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e8f33a4b-f60e-4750-aa5b-ab4bf16c4eb7 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 200 len: 1306 microversion: 2.1 time: 0.209631 Apr 30 21:22:14.637164 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1556/3018] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:14 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 1306 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:14.641093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1763700175", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "4e174604-3d00-4575-a608-2f7eb012a46b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:14.665256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:14.689736 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bb5d800f-570c-452b-a557-45166a098f38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.335425 Apr 30 21:22:14.690400 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1463/3019] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:14 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:14.721943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] validate_networks() for [('4e174604-3d00-4575-a608-2f7eb012a46b', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:22:15.128123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:22:15.129232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:22:15.129711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:22:15.130242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:22:15.130649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:22:15.144433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:15.145040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:15.146367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:15.146813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:15.167609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Getting quotas for project 3e12f061321b434e92c0f85031c54ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:15.174117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Getting quotas for user a42c6a51b78b408f85cbacb545f06707 and project 3e12f061321b434e92c0f85031c54ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:15.190222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:22:15.192986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:22:15.345065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-60998aef-8b1d-4a8b-b07e-a1f76b23d5d8 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707842 Apr 30 21:22:15.356488 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1557/3020] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:22:15.368753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ded6950f-4155-4ca0-b6eb-4b19c2559463 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:15.369981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ded6950f-4155-4ca0-b6eb-4b19c2559463 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:15.473976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ded6950f-4155-4ca0-b6eb-4b19c2559463 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:15.480342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ded6950f-4155-4ca0-b6eb-4b19c2559463 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1218 microversion: 2.1 time: 0.122751 Apr 30 21:22:15.482224 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1464/3021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:15 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:15.665486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:15.666433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:15.674572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:15.675028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:15.676139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:15.676533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:15.690796 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Instance 703208f7-1534-4904-bd47-2912f134e612 could not be found. Apr 30 21:22:15.692241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Instance 703208f7-1534-4904-bd47-2912f134e612 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:15.693271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cc8acf1-766d-44b8-aeab-0a4b28c7a80e tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 404 len: 111 microversion: 2.1 time: 0.032473 Apr 30 21:22:15.694311 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1558/3022] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:15 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:15.706273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9906589-d578-479b-8286-18b4fbeec92a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc206a9dc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:15.708955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:15.709860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:15.719402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:15.720151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:15.721181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:15.722058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:16.195036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:16.206175 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1942988-d274-4680-b57c-18d475e606cf tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.501726 Apr 30 21:22:16.206964 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1559/3023] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:15 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:16.425943 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a9906589-d578-479b-8286-18b4fbeec92a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/48bf3612-bf9b-470a-96a8-0ba6432dc15a" status: 202 len: 0 microversion: 2.1 time: 0.722686 Apr 30 21:22:16.428125 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1465/3024] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:15 2022] DELETE /compute/v2.1/os-security-groups/48bf3612-bf9b-470a-96a8-0ba6432dc15a => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:16.437026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ed9ca86b-7056-4fdc-a86d-112731d3e305 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc13cfedc0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:16.499705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:16.500886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:16.517337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:16.518098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:16.519090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:16.519697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:16.618529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:16.629607 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-efdfa084-e765-450e-9494-f08b2afca49d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1222 microversion: 2.1 time: 0.135246 Apr 30 21:22:16.645885 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1466/3025] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:16 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1222 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:16.971456 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ed9ca86b-7056-4fdc-a86d-112731d3e305 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d3ae815d-5315-4395-8139-f5d582e807b0" status: 202 len: 0 microversion: 2.1 time: 0.538723 Apr 30 21:22:16.974020 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1560/3026] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:16 2022] DELETE /compute/v2.1/os-security-groups/d3ae815d-5315-4395-8139-f5d582e807b0 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:16.992432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12035f4b-16b4-4534-9239-a1e7f16c70e4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'create', calling method: .version_select at 0x7fdc20089550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1343656220", "description": "tempest-description-1787453620"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:17.034810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5f0db0f1-cedb-4128-807c-a445489c3233 req-4edea22e-e4b6-4845-bcee-be3274dadb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284", "name": "network-vif-deleted", "tag": "03bbeaca-a3de-45e7-975b-56c33a1d9bff"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:17.052152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5f0db0f1-cedb-4128-807c-a445489c3233 req-4edea22e-e4b6-4845-bcee-be3274dadb07 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:17.055096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5f0db0f1-cedb-4128-807c-a445489c3233 req-4edea22e-e4b6-4845-bcee-be3274dadb07 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:17.073197 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5f0db0f1-cedb-4128-807c-a445489c3233 req-4edea22e-e4b6-4845-bcee-be3274dadb07 service nova] Creating event network-vif-deleted:03bbeaca-a3de-45e7-975b-56c33a1d9bff for instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 on nch1-master-1 Apr 30 21:22:17.092295 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5f0db0f1-cedb-4128-807c-a445489c3233 req-4edea22e-e4b6-4845-bcee-be3274dadb07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062033 Apr 30 21:22:17.098528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1561/3027] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:17.227857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:17.229297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:17.251991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:17.252663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:17.255127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:17.268059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:17.512746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:17.515776 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12035f4b-16b4-4534-9239-a1e7f16c70e4 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.529082 Apr 30 21:22:17.516388 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1467/3028] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:22:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:17.533680 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4296a6f4-b139-421c-a547-4dda3df3a790 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.312320 Apr 30 21:22:17.537265 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1562/3029] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:17 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:17.539228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b71ffb00-9c6b-4224-9dba-ea6dbf206b50 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Action: 'update', calling method: .version_select at 0x7fdc2084c550>, body: {"security_group": {"name": "tempest-sg-hth-1243429234", "description": "tempest-description-hth-2100716974"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:17.558701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4131dbec-d515-4af8-9434-86d45b517465 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:17.559222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4131dbec-d515-4af8-9434-86d45b517465 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:17.571291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4131dbec-d515-4af8-9434-86d45b517465 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:17.574663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4131dbec-d515-4af8-9434-86d45b517465 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:17.575736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4131dbec-d515-4af8-9434-86d45b517465 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:17.579250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4131dbec-d515-4af8-9434-86d45b517465 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:17.630700 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4131dbec-d515-4af8-9434-86d45b517465 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/ips" status: 200 len: 150 microversion: 2.20 time: 0.075752 Apr 30 21:22:17.631718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1563/3030] 10.222.0.23 () {60 vars in 1288 bytes} [Sat Apr 30 21:22:17 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/ips => generated 150 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:22:17.653958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:17.654511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:17.683451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:17.683753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:17.684542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:17.684981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:17.829350 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b71ffb00-9c6b-4224-9dba-ea6dbf206b50 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/eb3baa4a-7469-4bdd-a850-2b5b4ad92ffb" status: 200 len: 218 microversion: 2.1 time: 0.305288 Apr 30 21:22:17.830795 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1468/3031] 10.222.0.23 () {60 vars in 1289 bytes} [Sat Apr 30 21:22:17 2022] PUT /compute/v2.1/os-security-groups/eb3baa4a-7469-4bdd-a850-2b5b4ad92ffb => generated 218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:17.841518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a26c0ccf-6492-4fc5-8d26-429f7a1b4d23 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc20815d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:18.011813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:18.019761 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-542f0722-3e68-4a19-aca9-73ff21946161 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1270 microversion: 2.1 time: 0.375901 Apr 30 21:22:18.030179 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1564/3032] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:17 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:18.232202 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a26c0ccf-6492-4fc5-8d26-429f7a1b4d23 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/eb3baa4a-7469-4bdd-a850-2b5b4ad92ffb" status: 200 len: 218 microversion: 2.1 time: 0.395174 Apr 30 21:22:18.233906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1469/3033] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:22:17 2022] GET /compute/v2.1/os-security-groups/eb3baa4a-7469-4bdd-a850-2b5b4ad92ffb => generated 218 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:18.249617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-83a4cb6c-9785-467f-8785-17af2ab79af8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc206f01f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:18.262608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-993073ad-3c5e-4f56-a9b0-6d645de9cb84 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Action: 'create', calling method: .version_select at 0x7fdc13d250d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1286579747", "policies": ["affinity"]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:18.307464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-993073ad-3c5e-4f56-a9b0-6d645de9cb84 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:18.326887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-993073ad-3c5e-4f56-a9b0-6d645de9cb84 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:18.476791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-993073ad-3c5e-4f56-a9b0-6d645de9cb84 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:18.483434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-993073ad-3c5e-4f56-a9b0-6d645de9cb84 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:18.498634 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-993073ad-3c5e-4f56-a9b0-6d645de9cb84 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.466880 Apr 30 21:22:18.501806 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1565/3034] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:22:18 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:18.509497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-911eded5-ffab-4bf7-904d-0a9497b0db5c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Action: 'create', calling method: .version_select at 0x7fdc13d3df70>, body: {"server_group": {"name": "tempest-server-group-1430455718", "policies": ["affinity"]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:18.528858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-911eded5-ffab-4bf7-904d-0a9497b0db5c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:18.534129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-911eded5-ffab-4bf7-904d-0a9497b0db5c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:18.807500 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-83a4cb6c-9785-467f-8785-17af2ab79af8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/eb3baa4a-7469-4bdd-a850-2b5b4ad92ffb" status: 202 len: 0 microversion: 2.1 time: 0.564100 Apr 30 21:22:18.808424 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1470/3035] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:18 2022] DELETE /compute/v2.1/os-security-groups/eb3baa4a-7469-4bdd-a850-2b5b4ad92ffb => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:18.813458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:18.814116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:18.827904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:18.828367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:18.829168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:18.829628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:18.846062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-911eded5-ffab-4bf7-904d-0a9497b0db5c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:18.863307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-911eded5-ffab-4bf7-904d-0a9497b0db5c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:18.908845 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-911eded5-ffab-4bf7-904d-0a9497b0db5c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.402882 Apr 30 21:22:18.918156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1566/3036] 10.222.0.23 () {60 vars in 1172 bytes} [Sat Apr 30 21:22:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:18.929609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:18.930173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:18.939998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:18.940674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:18.941542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:18.942582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:18.961737 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Instance 703208f7-1534-4904-bd47-2912f134e612 could not be found. Apr 30 21:22:19.006138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Instance 703208f7-1534-4904-bd47-2912f134e612 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.006138 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ebeff3c-c037-48be-a566-f2c057b19104 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 404 len: 111 microversion: 2.1 time: 0.044483 Apr 30 21:22:19.006138 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1567/3037] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:18 2022] DELETE /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:19.006138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c5c85f83-4b48-44b8-9216-1c4ae81ecaae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Action: 'create', calling method: .version_select at 0x7fdc210959d0>, body: {"server_group": {"name": "tempest-server-group-1430455718", "policies": ["affinity"]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:19.006138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c5c85f83-4b48-44b8-9216-1c4ae81ecaae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:19.006138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c5c85f83-4b48-44b8-9216-1c4ae81ecaae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:19.073589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:19.081104 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2b205ff-e80c-49a7-b0c4-37aeb1894885 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.271706 Apr 30 21:22:19.081686 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1471/3038] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:18 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:19.086170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.086792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: 703208f7-1534-4904-bd47-2912f134e612] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:19.092494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.092953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.093737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.094206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.108737 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Instance 703208f7-1534-4904-bd47-2912f134e612 could not be found. Apr 30 21:22:19.109339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Instance 703208f7-1534-4904-bd47-2912f134e612 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.110244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e1a5e855-f051-49fc-ad0c-5fee0ecada90 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612" status: 404 len: 111 microversion: 2.1 time: 0.027620 Apr 30 21:22:19.110779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1472/3039] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:19 2022] GET /compute/v2.1/servers/703208f7-1534-4904-bd47-2912f134e612 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:19.115266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.115914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:19.122245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.122708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.123487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.123935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.188241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:19.196491 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ee540b83-8642-431b-8cb1-6274665a6899 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1276 microversion: 2.1 time: 0.084559 Apr 30 21:22:19.196870 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1473/3040] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:19 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:19.201716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98fe4a2b-4f01-4ec8-8dd7-9902851ea4a0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc207ae3a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.224296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-98fe4a2b-4f01-4ec8-8dd7-9902851ea4a0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3ae815d-5315-4395-8139-f5d582e807b0 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:19.224936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-98fe4a2b-4f01-4ec8-8dd7-9902851ea4a0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group d3ae815d-5315-4395-8139-f5d582e807b0 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:22:19.225470 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-98fe4a2b-4f01-4ec8-8dd7-9902851ea4a0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group d3ae815d-5315-4395-8139-f5d582e807b0 does not exist Apr 30 21:22:19.225470 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-cd483411-77ee-4ac0-9689-beccd3ea15d8'] Apr 30 21:22:19.226739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98fe4a2b-4f01-4ec8-8dd7-9902851ea4a0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group d3ae815d-5315-4395-8139-f5d582e807b0 does not exist Apr 30 21:22:19.226739 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-cd483411-77ee-4ac0-9689-beccd3ea15d8'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.228015 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98fe4a2b-4f01-4ec8-8dd7-9902851ea4a0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d3ae815d-5315-4395-8139-f5d582e807b0" status: 404 len: 194 microversion: 2.1 time: 0.029998 Apr 30 21:22:19.228575 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1474/3041] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-security-groups/d3ae815d-5315-4395-8139-f5d582e807b0 => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:19.237068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3099a698-3cdf-4e91-9b35-7864202dafbd tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc20746a60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.262747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-3099a698-3cdf-4e91-9b35-7864202dafbd tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48bf3612-bf9b-470a-96a8-0ba6432dc15a does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:19.263378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-3099a698-3cdf-4e91-9b35-7864202dafbd tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group 48bf3612-bf9b-470a-96a8-0ba6432dc15a not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:22:19.263952 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3099a698-3cdf-4e91-9b35-7864202dafbd tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group 48bf3612-bf9b-470a-96a8-0ba6432dc15a does not exist Apr 30 21:22:19.263952 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-e8f2392b-4091-4146-ab39-8e7910e1ba3d'] Apr 30 21:22:19.264544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3099a698-3cdf-4e91-9b35-7864202dafbd tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group 48bf3612-bf9b-470a-96a8-0ba6432dc15a does not exist Apr 30 21:22:19.264544 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-e8f2392b-4091-4146-ab39-8e7910e1ba3d'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.266525 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3099a698-3cdf-4e91-9b35-7864202dafbd tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/48bf3612-bf9b-470a-96a8-0ba6432dc15a" status: 404 len: 194 microversion: 2.1 time: 0.032275 Apr 30 21:22:19.267155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1475/3042] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-security-groups/48bf3612-bf9b-470a-96a8-0ba6432dc15a => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:19.275885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e544fb0-bd4c-4898-93e7-fedbaae913b0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc2084c550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.298371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-9e544fb0-bd4c-4898-93e7-fedbaae913b0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2572a270-49b7-46ba-a411-000d6d75f164 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:19.309021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-9e544fb0-bd4c-4898-93e7-fedbaae913b0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group 2572a270-49b7-46ba-a411-000d6d75f164 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:22:19.309021 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-9e544fb0-bd4c-4898-93e7-fedbaae913b0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group 2572a270-49b7-46ba-a411-000d6d75f164 does not exist Apr 30 21:22:19.309021 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-0643d25f-abe9-40b0-89e4-a9a8d8a994d5'] Apr 30 21:22:19.309021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e544fb0-bd4c-4898-93e7-fedbaae913b0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group 2572a270-49b7-46ba-a411-000d6d75f164 does not exist Apr 30 21:22:19.309021 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-0643d25f-abe9-40b0-89e4-a9a8d8a994d5'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.309021 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9e544fb0-bd4c-4898-93e7-fedbaae913b0 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/2572a270-49b7-46ba-a411-000d6d75f164" status: 404 len: 194 microversion: 2.1 time: 0.029714 Apr 30 21:22:19.309021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1476/3043] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-security-groups/2572a270-49b7-46ba-a411-000d6d75f164 => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:19.315632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4880b1c2-62d2-4760-b905-269f1e4e657f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc206f0af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.337261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-4880b1c2-62d2-4760-b905-269f1e4e657f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group db752416-2acb-42fa-9e08-aac4aed4c913 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:19.337946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-4880b1c2-62d2-4760-b905-269f1e4e657f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group db752416-2acb-42fa-9e08-aac4aed4c913 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:22:19.338492 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-4880b1c2-62d2-4760-b905-269f1e4e657f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group db752416-2acb-42fa-9e08-aac4aed4c913 does not exist Apr 30 21:22:19.338492 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-72fba98a-7c23-459a-a2dd-ac22367eb0c3'] Apr 30 21:22:19.339084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4880b1c2-62d2-4760-b905-269f1e4e657f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group db752416-2acb-42fa-9e08-aac4aed4c913 does not exist Apr 30 21:22:19.339084 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-72fba98a-7c23-459a-a2dd-ac22367eb0c3'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.339898 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4880b1c2-62d2-4760-b905-269f1e4e657f tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/db752416-2acb-42fa-9e08-aac4aed4c913" status: 404 len: 194 microversion: 2.1 time: 0.028064 Apr 30 21:22:19.340435 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1477/3044] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-security-groups/db752416-2acb-42fa-9e08-aac4aed4c913 => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:19.349233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2c48aae9-73cc-4ddb-99b8-3b5e61bdb6ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc206f0670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.371776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-2c48aae9-73cc-4ddb-99b8-3b5e61bdb6ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:19.372481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-2c48aae9-73cc-4ddb-99b8-3b5e61bdb6ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:22:19.373006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-2c48aae9-73cc-4ddb-99b8-3b5e61bdb6ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca does not exist Apr 30 21:22:19.373006 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-f67d6e90-6f42-4fdb-9cfe-da76820116c4'] Apr 30 21:22:19.373597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2c48aae9-73cc-4ddb-99b8-3b5e61bdb6ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group 22a28b49-9aa7-4a27-8872-ae42cb7445ca does not exist Apr 30 21:22:19.373597 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-f67d6e90-6f42-4fdb-9cfe-da76820116c4'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.375138 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2c48aae9-73cc-4ddb-99b8-3b5e61bdb6ac tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/22a28b49-9aa7-4a27-8872-ae42cb7445ca" status: 404 len: 194 microversion: 2.1 time: 0.030687 Apr 30 21:22:19.375693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1478/3045] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-security-groups/22a28b49-9aa7-4a27-8872-ae42cb7445ca => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:19.384287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c227261-2590-49c7-ad29-2eeddddd1832 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc226e1550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.421408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG neutronclient.v2_0.client [None req-8c227261-2590-49c7-ad29-2eeddddd1832 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 does not exist", "detail": ""}} {{(pid=130670) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 30 21:22:19.421552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.security_group_api [None req-8c227261-2590-49c7-ad29-2eeddddd1832 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Neutron security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 not found {{(pid=130670) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 30 21:22:19.422223 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-8c227261-2590-49c7-ad29-2eeddddd1832 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 does not exist Apr 30 21:22:19.422223 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-90e5ead1-8a8e-4313-a713-5915d915fdff'] Apr 30 21:22:19.424261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c227261-2590-49c7-ad29-2eeddddd1832 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Security group 6cfd577b-a269-4b2b-9878-4905dcb7c717 does not exist Apr 30 21:22:19.424261 ncdv-master-1 devstack@n-api.service[130670]: Neutron server returns request_ids: ['req-90e5ead1-8a8e-4313-a713-5915d915fdff'] {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:19.427125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c227261-2590-49c7-ad29-2eeddddd1832 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717" status: 404 len: 194 microversion: 2.1 time: 0.045605 Apr 30 21:22:19.428223 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1479/3046] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-security-groups/6cfd577b-a269-4b2b-9878-4905dcb7c717 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:19.438178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.442688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:19.448337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.448535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c5c85f83-4b48-44b8-9216-1c4ae81ecaae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:19.449258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.451298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.451877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.465795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c5c85f83-4b48-44b8-9216-1c4ae81ecaae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:19.486125 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c5c85f83-4b48-44b8-9216-1c4ae81ecaae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.520697 Apr 30 21:22:19.488632 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1568/3047] 10.222.0.23 () {60 vars in 1172 bytes} [Sat Apr 30 21:22:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:19.490607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:22:19.501385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3590fa3a-4738-4c9d-9ee1-e0f2c366e917 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.598313 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3590fa3a-4738-4c9d-9ee1-e0f2c366e917 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/2e6274b1-9a9c-44d2-a0b4-e80620cbf3bc" status: 204 len: 0 microversion: 2.1 time: 0.104140 Apr 30 21:22:19.598313 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1569/3048] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-server-groups/2e6274b1-9a9c-44d2-a0b4-e80620cbf3bc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:22:19.609250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-408972ab-0c17-4cf9-82ce-fbee04935bde tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.626897 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-408972ab-0c17-4cf9-82ce-fbee04935bde tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.023342 Apr 30 21:22:19.631323 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1570/3049] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:22:19 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:19.645033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7e5b5780-e52a-449f-9d02-413fbc4e2bd3 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.784953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7e5b5780-e52a-449f-9d02-413fbc4e2bd3 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/319fb279-4d6b-46ca-b932-9aca532afec1" status: 204 len: 0 microversion: 2.1 time: 0.147347 Apr 30 21:22:19.786107 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1571/3050] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/os-server-groups/319fb279-4d6b-46ca-b932-9aca532afec1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:22:19.794065 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2bddc2e1-d89f-4df4-b515-4c8218c3aee8 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 204 len: 0 microversion: 2.1 time: 0.360181 Apr 30 21:22:19.795878 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1480/3051] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:19 2022] DELETE /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:22:19.806743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42cc662f-d11c-4e51-b012-a07ad61d0ea4 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.807063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:19.809414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:19.821880 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42cc662f-d11c-4e51-b012-a07ad61d0ea4 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031440 Apr 30 21:22:19.826828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.826828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.826828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:19.827206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:19.829527 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1572/3052] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:22:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:19.834917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c6afd61-7782-4344-8be2-084d5c8ed235 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Action: 'create', calling method: .version_select at 0x7fdc13cd8e50>, body: {"server_group": {"name": "tempest-server-group-1101806295", "policies": ["affinity"]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:19.867119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1c6afd61-7782-4344-8be2-084d5c8ed235 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:19.876190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1c6afd61-7782-4344-8be2-084d5c8ed235 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:19.999439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1c6afd61-7782-4344-8be2-084d5c8ed235 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:20.010760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1c6afd61-7782-4344-8be2-084d5c8ed235 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:20.027310 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c6afd61-7782-4344-8be2-084d5c8ed235 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.196392 Apr 30 21:22:20.028553 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1573/3053] 10.222.0.23 () {60 vars in 1172 bytes} [Sat Apr 30 21:22:19 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:20.038340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e72b7b00-953b-4b95-a807-e4e99de0584c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:20.173013 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e72b7b00-953b-4b95-a807-e4e99de0584c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/bd904402-3e11-410a-90c6-2a5ce4f5e360" status: 204 len: 0 microversion: 2.1 time: 0.138571 Apr 30 21:22:20.173831 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1574/3054] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:20 2022] DELETE /compute/v2.1/os-server-groups/bd904402-3e11-410a-90c6-2a5ce4f5e360 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:22:20.179572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:20.183287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:20.200552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:20.200763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:20.203918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:20.204447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:20.464857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:20.496535 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f3d6c97-fcaf-4521-8333-3109db508957 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1645 microversion: 2.1 time: 0.696380 Apr 30 21:22:20.506740 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1481/3055] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:19 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1645 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:20.507095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:20.507776 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6add0e2e-9ca1-4f8e-a2ce-74681bedab6a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.332915 Apr 30 21:22:20.508370 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1575/3056] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:20 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:20.510008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-069f4745-a083-43ee-b087-24f5e4ee9bb2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:20.515976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:20.516680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:20.533569 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-069f4745-a083-43ee-b087-24f5e4ee9bb2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035148 Apr 30 21:22:20.534183 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1482/3057] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:22:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:20.535551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:20.536023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:20.536828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:20.537277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:20.559087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-502ecb63-1d55-47fb-8af1-62577b08049a tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Action: 'create', calling method: .version_select at 0x7fdc20875ca0>, body: {"server_group": {"name": "tempest-server-group-1446312422", "policies": ["anti-affinity"]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:20.581683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-502ecb63-1d55-47fb-8af1-62577b08049a tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:20.591744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-502ecb63-1d55-47fb-8af1-62577b08049a tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:20.751867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:20.762176 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c56ff477-d4b0-4b12-abea-01e0e85ca0a4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1318 microversion: 2.1 time: 0.251346 Apr 30 21:22:20.774137 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1576/3058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:20 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:20.816024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-502ecb63-1d55-47fb-8af1-62577b08049a tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:20.822348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-502ecb63-1d55-47fb-8af1-62577b08049a tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:20.843862 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-502ecb63-1d55-47fb-8af1-62577b08049a tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.298615 Apr 30 21:22:20.850303 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1483/3059] 10.222.0.23 () {60 vars in 1172 bytes} [Sat Apr 30 21:22:20 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:20.856211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6cd23be9-60ca-452c-bfc3-879321267022 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:21.028673 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6cd23be9-60ca-452c-bfc3-879321267022 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/9d41a4e0-a1c0-4b64-bd75-abd45ce4f132" status: 204 len: 0 microversion: 2.1 time: 0.177768 Apr 30 21:22:21.031033 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1577/3060] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:20 2022] DELETE /compute/v2.1/os-server-groups/9d41a4e0-a1c0-4b64-bd75-abd45ce4f132 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:22:21.039508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dbaa2edc-1f57-4c46-87fd-288cd3fa99e6 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:21.056744 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dbaa2edc-1f57-4c46-87fd-288cd3fa99e6 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023278 Apr 30 21:22:21.069712 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1484/3061] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:22:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:21.133952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-983287331", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "896bc984-19f0-4812-b66b-5fd5d59f2642"}]}, "os:scheduler_hints": {"group": "7de11a40-b965-4c3b-a44e-fee4d72ab877"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:21.197151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] validate_networks() for [('896bc984-19f0-4812-b66b-5fd5d59f2642', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:22:21.304892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-96c3ba11-6d2e-4071-8f61-d76a0255bfa1 req-70061f91-7cbb-4b05-92b8-1e24b04358bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d140b58d-54d4-4d07-a911-6b4ce98c09d3", "tag": "86e1db01-58fa-40a2-8fdb-edc142f30736"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:21.320870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-96c3ba11-6d2e-4071-8f61-d76a0255bfa1 req-70061f91-7cbb-4b05-92b8-1e24b04358bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:21.321652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-96c3ba11-6d2e-4071-8f61-d76a0255bfa1 req-70061f91-7cbb-4b05-92b8-1e24b04358bf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:21.346458 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-96c3ba11-6d2e-4071-8f61-d76a0255bfa1 req-70061f91-7cbb-4b05-92b8-1e24b04358bf service nova] Creating event network-changed:86e1db01-58fa-40a2-8fdb-edc142f30736 for instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 on nch2-master-1 Apr 30 21:22:21.356367 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-96c3ba11-6d2e-4071-8f61-d76a0255bfa1 req-70061f91-7cbb-4b05-92b8-1e24b04358bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055585 Apr 30 21:22:21.357664 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1485/3062] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:21.363646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:21.367082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:21.374990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:21.379002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:21.379002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:21.379002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:21.408125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lazy-loading 'flavor' on Instance uuid 5651c8e3-b1ff-47a2-ac15-e68594650b70 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:22:22.185716 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a0bb457-fb54-4160-92f9-892e8d93bed6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/action" status: 202 len: 0 microversion: 2.20 time: 0.826431 Apr 30 21:22:22.191486 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1486/3063] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:22:21 2022] POST /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:22:22.200004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:22.200721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:22.214699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.215695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:22.215955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.216412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:22.296245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:22:22.297137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:22:22.298774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:22:22.299529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:22:22.300102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:22:22.317189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.318018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:22.319769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.320485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:22.339142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:22.345171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:22.358478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:22:22.360799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:22:22.601956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:22.616973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:22.618811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:22.637367 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8334aebd-8640-4181-af55-aefeabd80e3b tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1645 microversion: 2.1 time: 0.445053 Apr 30 21:22:22.640145 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1487/3064] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:22 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1645 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:22.651410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:22.652448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:22.667133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.668493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:22.669485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.670046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:22.889831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:22.898111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-feb1afbb-15a3-45dd-a7ae-0bf2c45fd11d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.257876 Apr 30 21:22:22.898690 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1488/3065] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:22 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:22.903347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:22.903967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:22.910120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.910589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:22.911365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:22.911803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.041632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:23.049364 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f306ebef-5ea4-4c78-8d87-eb6bb92d584c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1318 microversion: 2.1 time: 0.149680 Apr 30 21:22:23.049960 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1489/3066] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:22 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:23.055493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:23.056341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:23.063909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.064368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.065161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.065605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.209368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:23.220509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:23.222098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:23.223350 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e2eb23df-1fe1-43e0-944b-d76ac43d8fcc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.172184 Apr 30 21:22:23.223946 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1490/3067] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:23 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:23.229929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for project def690693f654dc8aff77fa04e78d762. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:23.236703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Getting quotas for user e56c6d1395334b3ebe2293ba9d59fe9b and project def690693f654dc8aff77fa04e78d762. Resources: {'server_group_members'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:23.295996 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e2bd5b3e-ea98-4658-9b0d-5285c4e54470 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.155033 Apr 30 21:22:23.295996 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1578/3068] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:22:23.302790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d106689b-9e80-4e7f-8f6a-f122f6a6eace tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:23.304105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d106689b-9e80-4e7f-8f6a-f122f6a6eace tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:23.367644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d106689b-9e80-4e7f-8f6a-f122f6a6eace tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:23.375406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d106689b-9e80-4e7f-8f6a-f122f6a6eace tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1212 microversion: 2.1 time: 0.078151 Apr 30 21:22:23.376197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1579/3069] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:23 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:23.390081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-6419be95-ac4f-4a5a-bf65-29f4cee62a76 req-cc5ddaff-4a43-4fd0-bd95-0b3b33a5560e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37", "name": "network-vif-deleted", "tag": "7e51ce70-02d6-4e28-b92b-1abce8dc8c21"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:23.403766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-435fcf63-252c-42ec-b6a0-513fe85a61c8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:23.405498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-435fcf63-252c-42ec-b6a0-513fe85a61c8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:23.410685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6419be95-ac4f-4a5a-bf65-29f4cee62a76 req-cc5ddaff-4a43-4fd0-bd95-0b3b33a5560e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.415897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6419be95-ac4f-4a5a-bf65-29f4cee62a76 req-cc5ddaff-4a43-4fd0-bd95-0b3b33a5560e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.416007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-435fcf63-252c-42ec-b6a0-513fe85a61c8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.416007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-435fcf63-252c-42ec-b6a0-513fe85a61c8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.416007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-435fcf63-252c-42ec-b6a0-513fe85a61c8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.416007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-435fcf63-252c-42ec-b6a0-513fe85a61c8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.423531 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-6419be95-ac4f-4a5a-bf65-29f4cee62a76 req-cc5ddaff-4a43-4fd0-bd95-0b3b33a5560e service nova] Creating event network-vif-deleted:7e51ce70-02d6-4e28-b92b-1abce8dc8c21 for instance c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 on nch2-master-1 Apr 30 21:22:23.429896 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-6419be95-ac4f-4a5a-bf65-29f4cee62a76 req-cc5ddaff-4a43-4fd0-bd95-0b3b33a5560e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043048 Apr 30 21:22:23.430508 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1580/3070] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:23.481935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-435fcf63-252c-42ec-b6a0-513fe85a61c8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "POST /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd/action" status: 200 len: 24570 microversion: 2.32 time: 0.256306 Apr 30 21:22:23.485791 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1491/3071] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:22:23 2022] POST /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd/action => generated 24570 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:23.656433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:23.657506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:23.667362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.668422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.669346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.669885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.747836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:23.759688 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f841ac0-afbf-4168-837a-4e88c17a8ef9 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1300 microversion: 2.1 time: 0.108162 Apr 30 21:22:23.769890 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1581/3072] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:23 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:23.917821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:23.918645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:23.926378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.926936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:23.928265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:23.929329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.066223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:24.067720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:24.068349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:24.074006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2561c648-8e25-4840-a5f9-61a804e34d2c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1525 microversion: 2.1 time: 0.161696 Apr 30 21:22:24.074733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.084217 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1492/3073] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:23 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:24.086214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.086214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.086214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.211047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:24.218823 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-87cbc4fa-5e4e-4dd4-aaa1-ef1b1ed31e09 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1318 microversion: 2.1 time: 0.155005 Apr 30 21:22:24.219928 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1582/3074] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:24 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:24.242763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:24.243396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:24.249998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.250467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.251307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.251757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.389273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:24.393273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:24.394058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:24.398645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:24.400363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:24.400714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.401167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.401894 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5860b91f-9f0e-4be8-8767-654bc170471b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.163685 Apr 30 21:22:24.402629 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1493/3075] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:24 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:24.407184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.407715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.473193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:24.481356 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8918ae4-1d8e-4a7c-bb81-aa26041c7fc8 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1216 microversion: 2.1 time: 0.092503 Apr 30 21:22:24.481956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1583/3076] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:24 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:24.777454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:24.778403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:24.785386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.785868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.786657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.787144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.822454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:24.822915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:24.823378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lazy-loading 'fault' on Instance uuid c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:22:24.868819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b78cd5fee5448b9e42dbb212f0de19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8ae5530f6847478106f78f50e7314d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:24.876951 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-488fef5d-0b5f-4927-bda9-f3443b415658 tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 200 len: 1305 microversion: 2.1 time: 0.103023 Apr 30 21:22:24.877814 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1494/3077] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:24 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:25.092165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:25.092715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:25.099147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.102020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.102020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.102020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.236888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:25.237515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:25.243494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.244088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.245200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.245322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.354841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:25.362724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d33a2e2b-5c6b-46d5-8fe5-94e8d97407d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1507 microversion: 2.1 time: 0.274503 Apr 30 21:22:25.363509 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1584/3078] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:25 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:25.420910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:25.421540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:25.429150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.429611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.430458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.430904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.500321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:25.510116 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8bd1986d-7296-45c3-94da-b5e0a61c41dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1318 microversion: 2.1 time: 0.276819 Apr 30 21:22:25.510713 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1495/3079] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:25 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:25.524446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:25.525081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:25.531153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.531623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.532419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.532871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.643431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:25.650911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6a7aacc1-f087-44a1-8266-4a8fd307ac17 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1272 microversion: 2.1 time: 0.130253 Apr 30 21:22:25.651493 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1496/3080] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:25 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:25.777560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:25.795508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:25.797023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:25.798279 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96ec7755-b726-46d9-b486-bb49d0a985fa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.381565 Apr 30 21:22:25.800810 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1585/3081] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:25 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:25.898593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:25.899147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] [instance: c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:25.905851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.906418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.907220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:25.907670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:25.923046 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] HTTP exception thrown: Instance c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 could not be found. Apr 30 21:22:25.923850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Returning 404 to user: Instance c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:25.924680 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9841cff8-a610-482e-b77b-220c0996710a tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37" status: 404 len: 111 microversion: 2.1 time: 0.030371 Apr 30 21:22:25.929308 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1497/3082] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:25 2022] GET /compute/v2.1/servers/c3896bdd-3ae4-4fd0-bd0f-bed9973e3d37 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:25.938651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70139727-eb1f-45fb-8d37-903224a3733d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc13cac550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:26.380761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:26.381676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:26.388241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.388836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:26.389847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.390498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:26.630694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:26.639535 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ee77ddf5-246e-49ab-bd47-efdf64850430 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1507 microversion: 2.1 time: 0.262475 Apr 30 21:22:26.641932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1498/3083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:26 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:26.655070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:26.655816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:26.662344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.662942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:26.664107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.664647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:26.740587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70139727-eb1f-45fb-8d37-903224a3733d tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3acd7fa0-ff34-4d41-9777-37c9353e5067" status: 202 len: 0 microversion: 2.1 time: 0.809999 Apr 30 21:22:26.743896 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1586/3084] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:25 2022] DELETE /compute/v2.1/os-security-groups/3acd7fa0-ff34-4d41-9777-37c9353e5067 => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:26.749468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:26.750214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:26.757831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.758367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:26.759153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.759597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:26.856672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:26.864260 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8da683d1-04a9-4146-bbb7-1e593bfd7f11 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1270 microversion: 2.1 time: 0.121374 Apr 30 21:22:26.864840 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1587/3085] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:26 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1270 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:26.874205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4388769-d4a7-4d35-9872-7b7ca9996ebb tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] Calling method '.version_select at 0x7fdc13cbf5e0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:26.908814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:26.916366 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-657f9cec-752d-4850-acf3-ae94bb1aa90d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1318 microversion: 2.1 time: 0.265279 Apr 30 21:22:26.916942 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1499/3086] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:26 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:26.921750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:26.922389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:26.928863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.929306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:26.930110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:26.930556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:27.202636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:27.211427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:27.212977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:27.214191 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df8e3387-6d37-41f6-8148-0dd6a5d8ef97 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.296301 Apr 30 21:22:27.214764 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1500/3087] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:26 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:27.313228 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4388769-d4a7-4d35-9872-7b7ca9996ebb tempest-SecurityGroupsTestJSON-332661857 tempest-SecurityGroupsTestJSON-332661857-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f7ef8d53-d162-4fc5-aa9a-1e25d138b59a" status: 202 len: 0 microversion: 2.1 time: 0.447318 Apr 30 21:22:27.317589 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1588/3088] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:22:26 2022] DELETE /compute/v2.1/os-security-groups/f7ef8d53-d162-4fc5-aa9a-1e25d138b59a => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:27.661346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:27.662197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:27.671789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:27.672325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:27.673357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:27.673951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:27.862254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:27.870380 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cbf11c29-30fb-42e1-aa80-26644b6d604f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1507 microversion: 2.1 time: 0.213385 Apr 30 21:22:27.870971 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1501/3089] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:27 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:27.884131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:27.884754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:27.890789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:27.891251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:27.892173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:27.892486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:27.934978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:27.935721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:27.943167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:27.944413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:27.948703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:27.949250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:28.155519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:28.164803 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a07cc11-a34b-420e-baeb-a2a95b0370ee tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.286412 Apr 30 21:22:28.165608 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1589/3090] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:27 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:28.210614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:28.218134 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-efee163f-e8d2-45cd-91ae-dfa4cfd05ce6 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1318 microversion: 2.1 time: 0.287947 Apr 30 21:22:28.218767 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1502/3091] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:27 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:28.231558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:28.232168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:28.238171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:28.238627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:28.239391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:28.239826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:28.392600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-eb0e8c86-8b71-4bc4-8f35-8ece35dd3689 req-d44302e4-c42d-48ef-a41a-54e31a3a9a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d140b58d-54d4-4d07-a911-6b4ce98c09d3", "name": "network-vif-plugged", "status": "completed", "tag": "86e1db01-58fa-40a2-8fdb-edc142f30736"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:28.401285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-eb0e8c86-8b71-4bc4-8f35-8ece35dd3689 req-d44302e4-c42d-48ef-a41a-54e31a3a9a88 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:28.401736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-eb0e8c86-8b71-4bc4-8f35-8ece35dd3689 req-d44302e4-c42d-48ef-a41a-54e31a3a9a88 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:28.412639 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-eb0e8c86-8b71-4bc4-8f35-8ece35dd3689 req-d44302e4-c42d-48ef-a41a-54e31a3a9a88 service nova] Creating event network-vif-plugged:86e1db01-58fa-40a2-8fdb-edc142f30736 for instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 on nch2-master-1 Apr 30 21:22:28.418029 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-eb0e8c86-8b71-4bc4-8f35-8ece35dd3689 req-d44302e4-c42d-48ef-a41a-54e31a3a9a88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029429 Apr 30 21:22:28.418625 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1503/3092] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:28.430407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:28.443292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-58f9c64e-a1d4-4e6f-a42d-4034c173a53c req-3c358652-5d42-4d1e-958d-55c0d4602f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e018247-8af5-4fb9-8e4a-9530ce9fea58", "tag": "84957c75-79ae-4d1b-b3b8-dbbefc739b40"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:28.451209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:28.453145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-58f9c64e-a1d4-4e6f-a42d-4034c173a53c req-3c358652-5d42-4d1e-958d-55c0d4602f9e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:28.454062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-58f9c64e-a1d4-4e6f-a42d-4034c173a53c req-3c358652-5d42-4d1e-958d-55c0d4602f9e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:28.456220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:28.463768 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-68a34ea6-1885-48f2-a130-02b3c84a06a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.233927 Apr 30 21:22:28.463768 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1590/3093] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:28 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:28.467863 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-58f9c64e-a1d4-4e6f-a42d-4034c173a53c req-3c358652-5d42-4d1e-958d-55c0d4602f9e service nova] Creating event network-changed:84957c75-79ae-4d1b-b3b8-dbbefc739b40 for instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 on nch1-master-1 Apr 30 21:22:28.472526 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-58f9c64e-a1d4-4e6f-a42d-4034c173a53c req-3c358652-5d42-4d1e-958d-55c0d4602f9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033309 Apr 30 21:22:28.474042 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1504/3094] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:28.887981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:28.889250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:28.896408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:28.896863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:28.898874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:28.899315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.130034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:29.139494 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d97a8c11-647b-43ad-ade9-20a29b347407 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 200 len: 1450 microversion: 2.1 time: 0.254618 Apr 30 21:22:29.139494 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1591/3095] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:28 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 1450 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:29.157556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:29.158496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:29.165493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.166030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.166818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.167542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.183199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:29.183877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:29.192193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.192878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.194674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.195275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.207455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:22:29.214696 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Working on deleting snapshot fda1fe8f-c1a2-4712-b101-522fcb3bc5d8 from shelved instance... Apr 30 21:22:29.445491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:29.454154 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e361b859-7937-4f4e-bf5a-bd704afd267d tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.275705 Apr 30 21:22:29.463766 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1592/3096] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:29 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:29.469456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:29.470203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:29.479026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.479625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.481586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.482219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.645001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:29.666795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8d657bc-b7fd-4781-955c-2397302df949 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1318 microversion: 2.1 time: 0.187884 Apr 30 21:22:29.666795 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1593/3097] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:29 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:29.666795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:29.666795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:29.667145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.667439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.668204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:29.668678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:29.814243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:29.828243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:29.829949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:29.831201 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cf9ecf88-a955-48ad-9d01-09395a26b526 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.175235 Apr 30 21:22:29.831805 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1594/3098] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:29 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:30.434530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-794e2343-48e2-4789-a7b3-c227e24e5cd8 req-d07b4a64-834a-4d6b-bea4-f4a026d2a152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3443c916-dda1-43d3-b094-442c866c9184", "name": "network-vif-unplugged", "status": "completed", "tag": "5337eefd-6282-4815-8142-ab29768bf85b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:30.446274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-794e2343-48e2-4789-a7b3-c227e24e5cd8 req-d07b4a64-834a-4d6b-bea4-f4a026d2a152 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.446725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-794e2343-48e2-4789-a7b3-c227e24e5cd8 req-d07b4a64-834a-4d6b-bea4-f4a026d2a152 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:30.458233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.server_external_events [req-794e2343-48e2-4789-a7b3-c227e24e5cd8 req-d07b4a64-834a-4d6b-bea4-f4a026d2a152 service nova] Unable to find a host for instance 3443c916-dda1-43d3-b094-442c866c9184. Dropping event network-vif-unplugged {{(pid=130671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 30 21:22:30.459124 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-794e2343-48e2-4789-a7b3-c227e24e5cd8 req-d07b4a64-834a-4d6b-bea4-f4a026d2a152 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030154 Apr 30 21:22:30.469401 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1595/3099] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 30 21:22:30.470572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:30.471196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:30.477062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.477528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:30.478418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.478872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:30.631090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:30.640261 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db49ba4f-019c-40cc-ac7f-84d2c0647d33 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.173407 Apr 30 21:22:30.640856 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1596/3100] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:30 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:30.674002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:30.679050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:30.681678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.682160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:30.682936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.683377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:30.802185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Doing local delete in cell a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=130670) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 30 21:22:30.804255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.804872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:30.805308 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 30 21:22:30.809108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] deallocate_for_instance() {{(pid=130670) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} Apr 30 21:22:30.817417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:30.826317 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96899f71-8a03-4f9d-a4a4-68b7f6905c35 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1508 microversion: 2.1 time: 0.156120 Apr 30 21:22:30.826802 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1597/3101] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:30 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:30.850373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:30.851227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:30.857972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.858621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:30.859478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:30.860709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.106503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:31.114702 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa4d28af-4eb6-4213-958a-ae34adbd38a2 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1508 microversion: 2.1 time: 0.268355 Apr 30 21:22:31.115304 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1598/3102] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:30 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:31.120096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:31.120707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:31.126734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.127396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.128091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.128538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.361417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:31.370680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:31.372625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:31.374340 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d359767-b80f-48a9-b070-c236663dbbde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.257749 Apr 30 21:22:31.377480 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1599/3103] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:31 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:31.380266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:31.381641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:31.388338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.388926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.389892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.390440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.552715 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "PUT /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1080 microversion: 2.1 time: 0.176600 Apr 30 21:22:31.553403 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1600/3104] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:22:31 2022] PUT /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1080 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:31.554393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:31.555259 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1a1bca4-29ef-418e-8144-707dbc4cd68a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001115 Apr 30 21:22:31.555656 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1601/3105] 10.222.0.23 () {56 vars in 885 bytes} [Sat Apr 30 21:22:31 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 30 21:22:31.565335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4bc7f247-b0f4-40a8-9997-4c2a54dcd385 req-bae1386d-2595-47c0-abfb-82489f6fba81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3443c916-dda1-43d3-b094-442c866c9184", "name": "network-vif-deleted", "tag": "5337eefd-6282-4815-8142-ab29768bf85b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:31.573335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4bc7f247-b0f4-40a8-9997-4c2a54dcd385 req-bae1386d-2595-47c0-abfb-82489f6fba81 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.573807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4bc7f247-b0f4-40a8-9997-4c2a54dcd385 req-bae1386d-2595-47c0-abfb-82489f6fba81 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.585439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.server_external_events [req-4bc7f247-b0f4-40a8-9997-4c2a54dcd385 req-bae1386d-2595-47c0-abfb-82489f6fba81 service nova] Unable to find a host for instance 3443c916-dda1-43d3-b094-442c866c9184. Dropping event network-vif-deleted {{(pid=130671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 30 21:22:31.586367 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4bc7f247-b0f4-40a8-9997-4c2a54dcd385 req-bae1386d-2595-47c0-abfb-82489f6fba81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029881 Apr 30 21:22:31.586941 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1602/3106] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 30 21:22:31.592369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:31.592984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:31.598934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.601040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.601040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.601223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.621088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Updating instance_info_cache with network_info: [] {{(pid=130670) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:22:31.734162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:31.742614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cfadca7a-9cdd-46d9-bda8-be5c4cb5f9e0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1506 microversion: 2.1 time: 0.154304 Apr 30 21:22:31.743245 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1603/3107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:31 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:31.747873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:31.748478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:31.754571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.755031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:31.755914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:31.756903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.221806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:32.229554 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e7d0292-4a5e-45bf-8a9e-55952b8bc250 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.485327 Apr 30 21:22:32.230341 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1604/3108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:31 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:32.234796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:32.235438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:32.247335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.247795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.248638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.249090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.406064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:32.413750 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c27eb9a-8523-4ad1-8df5-124d8563f62e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1506 microversion: 2.1 time: 0.182448 Apr 30 21:22:32.414331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1605/3109] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:32 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:32.418953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:32.419569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:32.425614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.426116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.432051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.432051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.477783 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-31745579-99ee-4826-acd6-2b818d2d3204 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 204 len: 0 microversion: 2.1 time: 3.326130 Apr 30 21:22:32.478521 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1505/3110] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:29 2022] DELETE /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 0 bytes in 3328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:22:32.484338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:32.485981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:32.492665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.493152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.493958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.494408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.562115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:32.570492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:32.570997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:22:32.571428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:22:32.571903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:22:32.572224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:32.572345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:22:32.572711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:22:32.573411 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-27eebf7e-5d0f-4733-a56a-f7ab07a2ed3b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.158150 Apr 30 21:22:32.574140 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1606/3111] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:32 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:32.584414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:32.584414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:32.585267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.585732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.586551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.587073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.601026 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 3443c916-dda1-43d3-b094-442c866c9184 could not be found. Apr 30 21:22:32.601635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 3443c916-dda1-43d3-b094-442c866c9184 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:32.602482 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c6f7af5-7288-42da-8167-f184833975d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 404 len: 111 microversion: 2.1 time: 0.027435 Apr 30 21:22:32.603284 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1607/3112] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:32 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:32.707971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-334030940", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5c8b504b-43e7-4642-bbf0-dab49293fda8"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:32.723234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:32.733154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.733668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.735055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.735055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.764786 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8344878a-55e0-4101-9abb-b59ac18af4a1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "POST /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3/action" status: 202 len: 1112 microversion: 2.1 time: 0.284340 Apr 30 21:22:32.765558 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1506/3113] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:22:32 2022] POST /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3/action => generated 1112 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 30 21:22:32.776615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] validate_networks() for [('5c8b504b-43e7-4642-bbf0-dab49293fda8', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:22:32.781742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:32.782398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:32.789470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.789962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:32.791353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:32.791353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:33.032147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:33.041185 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f9da6d78-94a0-4128-8751-4b371cb570db tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.265097 Apr 30 21:22:33.047460 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1507/3114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:32 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:33.247400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:33.248082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:33.255117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:33.255577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:33.256458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:33.257113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:33.607208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:33.615870 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-29feddbb-d555-4ada-beac-ae4738fb892c tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.372408 Apr 30 21:22:33.625670 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1508/3115] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:33 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:33.633218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:33.633935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:33.640892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:33.643811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:33.643811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:33.643811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:33.660893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:22:33.661482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:22:33.662003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:22:33.666887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:22:33.666887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:22:33.673442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:33.674007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:33.675309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:33.675746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:33.695139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:33.700669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for user 2f5eafa970bd4247bdaef1cda747c3fc and project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:33.713484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:22:33.715867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:22:33.785243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:33.794391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:33.796005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:33.797530 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a5f64814-27b1-4469-bcb8-b0d8cf407e31 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.170637 Apr 30 21:22:33.798123 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1509/3116] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:33 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:33.846508 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe84a309-0f71-4915-98fb-0cd026be4d5c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.142345 Apr 30 21:22:33.847147 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1608/3117] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:22:33.858618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5c95d998-9b65-49ae-84d7-1d34f2b458aa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:33.861921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5c95d998-9b65-49ae-84d7-1d34f2b458aa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:33.916344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5c95d998-9b65-49ae-84d7-1d34f2b458aa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:33.924980 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5c95d998-9b65-49ae-84d7-1d34f2b458aa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1214 microversion: 2.1 time: 0.070877 Apr 30 21:22:33.931764 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1510/3118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:33 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:34.059448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:34.060065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:34.066863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.067328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.068090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.068531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.205248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:34.214713 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f1796c7-caff-4a45-826e-dca1d319ebf3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.159681 Apr 30 21:22:34.215313 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1609/3119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:34 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:34.632847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:34.633472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:34.641795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.642257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.643033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.643473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.772248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:34.779688 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-85433686-b5d7-4c3a-99d1-f6d014de3128 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.150779 Apr 30 21:22:34.780259 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1511/3120] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:34 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:34.816399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:34.817016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:34.824219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.824681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.825476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.826015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.943443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:34.944292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:34.950618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.951303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.952106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:34.952551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:34.973743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:34.983163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:34.985050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:34.986748 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af421af1-f5ed-4fd4-905d-c3f07c671097 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.174301 Apr 30 21:22:34.988093 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1610/3121] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:34 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:35.039754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:35.047947 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7233abdc-ed25-4e87-b35b-e4b79779314a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1218 microversion: 2.1 time: 0.108716 Apr 30 21:22:35.048525 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1512/3122] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:34 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:35.232574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:35.233208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:35.240273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:35.241210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:35.242359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:35.242800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:35.382348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:35.391054 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-57af5ac8-4e31-472c-ad49-7290d5ac731f tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.162988 Apr 30 21:22:35.391636 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1611/3123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:35 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:35.792561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2570ff08-0e15-436a-9e83-1109801618c1 req-58ae8e5a-8131-4292-b26a-d3822f255541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e018247-8af5-4fb9-8e4a-9530ce9fea58", "name": "network-vif-plugged", "status": "completed", "tag": "84957c75-79ae-4d1b-b3b8-dbbefc739b40"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:35.797198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:35.797932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:35.804977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:35.805610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:35.806428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:35.806869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:35.814734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2570ff08-0e15-436a-9e83-1109801618c1 req-58ae8e5a-8131-4292-b26a-d3822f255541 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:35.815374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2570ff08-0e15-436a-9e83-1109801618c1 req-58ae8e5a-8131-4292-b26a-d3822f255541 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:35.829182 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2570ff08-0e15-436a-9e83-1109801618c1 req-58ae8e5a-8131-4292-b26a-d3822f255541 service nova] Creating event network-vif-plugged:84957c75-79ae-4d1b-b3b8-dbbefc739b40 for instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 on nch1-master-1 Apr 30 21:22:35.836914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2570ff08-0e15-436a-9e83-1109801618c1 req-58ae8e5a-8131-4292-b26a-d3822f255541 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048179 Apr 30 21:22:35.837639 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1513/3124] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:36.007595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:36.008212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:36.014610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:36.015082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:36.015879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:36.016325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:36.071498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:36.085267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b01fe75a-f3bc-463a-8445-6a3a6583f01f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.291800 Apr 30 21:22:36.086246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1612/3125] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:35 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:36.093679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:36.094544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:36.104320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:36.105056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:36.106070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:36.106707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:36.204568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:36.217723 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bc99ceba-f6e1-4d05-84e9-87dd19707d38 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1274 microversion: 2.1 time: 0.130123 Apr 30 21:22:36.218513 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1613/3126] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:36 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:36.309866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:36.318402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:36.319973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:36.321410 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2a4a22c-edfb-4f2c-8dae-534c44028d54 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.318491 Apr 30 21:22:36.322540 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1514/3127] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:36 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:36.408454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:36.409084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:36.416137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:36.416600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:36.417389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:36.417876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:36.608697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:36.616109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cd153362-2080-4ee4-bf54-5592f790c751 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.211601 Apr 30 21:22:36.616676 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1614/3128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:36 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:37.102886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:37.103602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:37.111412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.112092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.112942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.113386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.236821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:37.243642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:37.254357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.254357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.255006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.255866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.336392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:37.346203 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-983ed66c-f061-4521-ba74-bedb3940e8e2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1312 microversion: 2.1 time: 0.247343 Apr 30 21:22:37.348134 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1515/3129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:37 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:37.354860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:37.355733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:37.362977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.363443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.364416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.365191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.625525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:37.635076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fdb678d3-dec9-4821-8b2b-b0099ae3ecfa tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.403046 Apr 30 21:22:37.636240 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1615/3130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:37 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:37.641706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:37.642519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:37.649462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.650012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.652731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:37.652731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:37.665195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:37.679158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:37.682515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:37.684231 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3fb7bdfa-eee1-48ce-b888-6a822e43d97c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.334730 Apr 30 21:22:37.685297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1516/3131] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:37 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:37.843484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:37.851146 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e10cae3-9b0a-47c5-a8be-c7174c71aba4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.212970 Apr 30 21:22:37.851713 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1616/3132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:37 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:38.300308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6a5e6f93-556e-4df7-a0ce-ab7cbe0d13ff req-40f339f3-c004-46bc-bbae-0c70b285b105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea01481-3f35-431b-aa50-2295fd12c5c2", "tag": "cd0808cc-294c-40d5-8a93-da73a96261d2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:38.309957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6a5e6f93-556e-4df7-a0ce-ab7cbe0d13ff req-40f339f3-c004-46bc-bbae-0c70b285b105 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.310458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6a5e6f93-556e-4df7-a0ce-ab7cbe0d13ff req-40f339f3-c004-46bc-bbae-0c70b285b105 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.328428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6a5e6f93-556e-4df7-a0ce-ab7cbe0d13ff req-40f339f3-c004-46bc-bbae-0c70b285b105 service nova] Creating event network-changed:cd0808cc-294c-40d5-8a93-da73a96261d2 for instance aea01481-3f35-431b-aa50-2295fd12c5c2 on nch2-master-1 Apr 30 21:22:38.328863 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6a5e6f93-556e-4df7-a0ce-ab7cbe0d13ff req-40f339f3-c004-46bc-bbae-0c70b285b105 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033562 Apr 30 21:22:38.329990 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1517/3133] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:38.366094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:38.366829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:38.373921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.374465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.375333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.375858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.600426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:38.610291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ebb8c9f-5018-40bd-bacb-7688ea5434cd tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1497 microversion: 2.1 time: 0.248548 Apr 30 21:22:38.610406 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1617/3134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:38 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:38.628588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56274a76-62ed-4554-8827-a11a55bfdbc2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:38.643246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.compute.server_groups [None req-56274a76-62ed-4554-8827-a11a55bfdbc2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Querying cell a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) for 1 instances {{(pid=130670) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 30 21:22:38.644012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56274a76-62ed-4554-8827-a11a55bfdbc2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.644473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56274a76-62ed-4554-8827-a11a55bfdbc2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.654737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:38.656740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:38.664381 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56274a76-62ed-4554-8827-a11a55bfdbc2 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/7de11a40-b965-4c3b-a44e-fee4d72ab877" status: 200 len: 222 microversion: 2.1 time: 0.041371 Apr 30 21:22:38.665417 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1518/3135] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:22:38 2022] GET /compute/v2.1/os-server-groups/7de11a40-b965-4c3b-a44e-fee4d72ab877 => generated 222 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:38.671407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.672293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.673209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.673955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.677122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:38.678930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:38.685045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.685516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.686347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.686973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.714521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:22:38.928378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:38.937288 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5a1fe46e-0b1a-478a-b0d8-af199cb4852c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.287665 Apr 30 21:22:38.937967 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1618/3136] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:38 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:38.951734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:38.952371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:38.960351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.960803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.961612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:38.963077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:38.998821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3306036f-69fc-4fd3-8ebe-54bbbd57eade tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 204 len: 0 microversion: 2.1 time: 0.326942 Apr 30 21:22:38.999516 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1519/3137] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:38 2022] DELETE /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:22:39.005146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:39.006203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:39.014625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:39.015094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:39.015894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:39.016344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:39.283972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:39.292398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:39.293955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:39.295151 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-78ba3eab-a437-4cc1-ae9f-e8c7bb8e84d9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1742 microversion: 2.20 time: 0.347322 Apr 30 21:22:39.295713 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1619/3138] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:38 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1742 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:39.296731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:39.306078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd1c3ccf-0b79-4931-9328-8dbfe0540d5c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.304979 Apr 30 21:22:39.306717 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1520/3139] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:38 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:39.311815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:39.312442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:39.320079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:39.320610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:39.321512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:39.322051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:39.457048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:39.464538 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4204b97a-0f0b-4fa9-a3e7-238eadd922de tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1503 microversion: 2.1 time: 0.156575 Apr 30 21:22:39.465103 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1620/3140] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:39 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:39.953648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:39.954308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:39.961439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:39.961948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:39.962728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:39.963169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:40.093349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:40.100786 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-09fc5292-99dd-498a-a8a7-cdc20641e675 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.150964 Apr 30 21:22:40.101367 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1521/3141] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:39 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:40.315187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:40.315840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:40.324524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:40.327004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:40.327004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:40.327004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:40.327339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:40.328089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:40.336789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:40.337989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:40.339959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:40.340664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:40.608443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:40.618713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:40.618872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:40.621001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:40.622956 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6fb991ce-e091-494e-9b20-0fe636ddcd08 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1742 microversion: 2.20 time: 0.312176 Apr 30 21:22:40.635733 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1621/3142] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:40 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1742 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:40.638981 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e1b7d758-3ac2-47c9-8049-df3894b80696 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.319158 Apr 30 21:22:40.639707 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1522/3143] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:40 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:40.641346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:40.643914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:40.652685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:40.652685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:40.653542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:40.654770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:40.879480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:40.887199 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-00f4a785-068b-43cc-b7e9-38907565afae tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1503 microversion: 2.1 time: 0.250099 Apr 30 21:22:40.887758 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1622/3144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:40 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:41.118141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:41.118840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:41.129436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.131875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.131875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.131875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.203789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a0338915-01b8-430e-8de6-c4186d6242d7 req-88e3de19-aee4-46b9-b211-fb3863c52d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e018247-8af5-4fb9-8e4a-9530ce9fea58", "name": "network-vif-deleted", "tag": "84957c75-79ae-4d1b-b3b8-dbbefc739b40"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:41.213062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a0338915-01b8-430e-8de6-c4186d6242d7 req-88e3de19-aee4-46b9-b211-fb3863c52d59 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.213847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a0338915-01b8-430e-8de6-c4186d6242d7 req-88e3de19-aee4-46b9-b211-fb3863c52d59 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.224937 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a0338915-01b8-430e-8de6-c4186d6242d7 req-88e3de19-aee4-46b9-b211-fb3863c52d59 service nova] Creating event network-vif-deleted:84957c75-79ae-4d1b-b3b8-dbbefc739b40 for instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 on nch1-master-1 Apr 30 21:22:41.230582 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a0338915-01b8-430e-8de6-c4186d6242d7 req-88e3de19-aee4-46b9-b211-fb3863c52d59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 Apr 30 21:22:41.231526 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1623/3145] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:41.310139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:41.319173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9b3cf87-2bbb-4714-93b2-a3fd0193495f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.204698 Apr 30 21:22:41.319848 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1523/3146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:41 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:41.643157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:41.643896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:41.651703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.652161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.652934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.653422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.668216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:41.673851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:41.680285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.680873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.681829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.682522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.894871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:41.903450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:41.907925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:41.909860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:41.911217 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ae2bddd-0fbb-4705-8496-01dfe6a17f5b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.272549 Apr 30 21:22:41.911726 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e82c6b1-a49e-44ed-9b34-a3c964778653 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.247753 Apr 30 21:22:41.923022 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1624/3147] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:41 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:41.923022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:41.923022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:41.923692 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1524/3148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:41 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:41.928244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.929062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.930412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.931918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.966334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:41.966978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:41.967412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lazy-loading 'fault' on Instance uuid 8e018247-8af5-4fb9-8e4a-9530ce9fea58 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:22:42.013696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56c6d1395334b3ebe2293ba9d59fe9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def690693f654dc8aff77fa04e78d762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:42.022571 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ace954e8-8e30-4a9e-b50b-79972ec98f8b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 200 len: 1302 microversion: 2.1 time: 0.108410 Apr 30 21:22:42.023258 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1625/3149] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:41 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:42.345338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:42.346489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:42.376433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:42.378306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:42.379594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:42.381195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:42.577778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:42.587985 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bad201f8-31c5-4f18-9dc0-c0a9bc38164e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.253411 Apr 30 21:22:42.589467 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1525/3150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:42 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:42.611759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-0fc95938-b174-4774-b026-45d7253a4bda req-27ea30dc-48f7-4430-b02b-883ee874416c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "name": "network-vif-plugged", "status": "completed", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:42.622424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0fc95938-b174-4774-b026-45d7253a4bda req-27ea30dc-48f7-4430-b02b-883ee874416c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:42.623245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0fc95938-b174-4774-b026-45d7253a4bda req-27ea30dc-48f7-4430-b02b-883ee874416c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:42.643276 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-0fc95938-b174-4774-b026-45d7253a4bda req-27ea30dc-48f7-4430-b02b-883ee874416c service nova] Creating event network-vif-plugged:25241eca-3984-4407-9196-eb00543c2900 for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 on nch2-master-1 Apr 30 21:22:42.651181 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-0fc95938-b174-4774-b026-45d7253a4bda req-27ea30dc-48f7-4430-b02b-883ee874416c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045138 Apr 30 21:22:42.653266 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1626/3151] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:42.935790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:42.937397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:42.938521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:42.941235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:42.952114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:42.953020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:42.953917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:42.958310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:42.959896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:42.960553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:42.962787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:42.963399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.261898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:43.270578 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8e7c4d32-5793-4bfe-a5ab-24c1781145b1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.345591 Apr 30 21:22:43.274111 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1526/3152] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:42 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:43.286687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.288735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:43.297676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.297676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.297676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.298465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.314080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:43.325448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:43.325927 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] HTTP exception thrown: Instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 could not be found. Apr 30 21:22:43.326551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Returning 404 to user: Instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:43.328335 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-223ed6de-f890-4286-a675-40599d0e03ef tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 404 len: 111 microversion: 2.1 time: 0.052138 Apr 30 21:22:43.328900 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1527/3153] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:43 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:43.338733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:43.340930 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d8a8f5d-b29b-44dc-93e7-06eb3b4ce160 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.414234 Apr 30 21:22:43.341870 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1627/3154] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:42 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:43.357166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7c13e378-89e8-4c5c-833d-5987aa7b0139 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.377190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.compute.server_groups [None req-7c13e378-89e8-4c5c-833d-5987aa7b0139 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Querying cell a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) for 1 instances {{(pid=130670) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 30 21:22:43.378067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c13e378-89e8-4c5c-833d-5987aa7b0139 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.378519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c13e378-89e8-4c5c-833d-5987aa7b0139 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.390192 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7c13e378-89e8-4c5c-833d-5987aa7b0139 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.051418 Apr 30 21:22:43.391101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1528/3155] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:22:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:43.403813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d6861b92-8613-415c-a61d-35897bed9f36 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.427240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.server_groups [None req-d6861b92-8613-415c-a61d-35897bed9f36 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Querying cell a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) for 1 instances {{(pid=130671) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 30 21:22:43.428526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6861b92-8613-415c-a61d-35897bed9f36 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.429174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6861b92-8613-415c-a61d-35897bed9f36 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.453604 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d6861b92-8613-415c-a61d-35897bed9f36 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/7de11a40-b965-4c3b-a44e-fee4d72ab877" status: 200 len: 184 microversion: 2.1 time: 0.053890 Apr 30 21:22:43.454222 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1628/3156] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:22:43 2022] GET /compute/v2.1/os-server-groups/7de11a40-b965-4c3b-a44e-fee4d72ab877 => generated 184 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:43.466289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.467074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:43.474894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.483166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.483166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.483166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.493696 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] HTTP exception thrown: Instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 could not be found. Apr 30 21:22:43.494553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Returning 404 to user: Instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:43.495490 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b73ee807-05f3-4498-9893-086a77f0748f tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 404 len: 111 microversion: 2.1 time: 0.034927 Apr 30 21:22:43.496137 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1529/3157] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:22:43 2022] DELETE /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:43.504196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.505173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] [instance: 8e018247-8af5-4fb9-8e4a-9530ce9fea58] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:43.512456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.513626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.514240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.514689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.530978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] HTTP exception thrown: Instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 could not be found. Apr 30 21:22:43.531586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Returning 404 to user: Instance 8e018247-8af5-4fb9-8e4a-9530ce9fea58 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:43.532436 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e74e80d1-4a84-4247-bfe3-ca462fe31daf tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58" status: 404 len: 111 microversion: 2.1 time: 0.032179 Apr 30 21:22:43.533342 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1629/3158] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:43 2022] GET /compute/v2.1/servers/8e018247-8af5-4fb9-8e4a-9530ce9fea58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:43.543461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f162fa77-3c4c-4a4f-a280-086851522b0e tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.552497 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-f162fa77-3c4c-4a4f-a280-086851522b0e tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] HTTP exception thrown: Instance group 9d41a4e0-a1c0-4b64-bd75-abd45ce4f132 could not be found. Apr 30 21:22:43.553711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f162fa77-3c4c-4a4f-a280-086851522b0e tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Returning 404 to user: Instance group 9d41a4e0-a1c0-4b64-bd75-abd45ce4f132 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:43.554706 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f162fa77-3c4c-4a4f-a280-086851522b0e tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/9d41a4e0-a1c0-4b64-bd75-abd45ce4f132" status: 404 len: 117 microversion: 2.1 time: 0.017282 Apr 30 21:22:43.559061 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1530/3159] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:43 2022] DELETE /compute/v2.1/os-server-groups/9d41a4e0-a1c0-4b64-bd75-abd45ce4f132 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:43.563683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea897ade-b339-4b4d-9d4b-00def7aab2b5 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.583726 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ea897ade-b339-4b4d-9d4b-00def7aab2b5 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] HTTP exception thrown: Instance group bd904402-3e11-410a-90c6-2a5ce4f5e360 could not be found. Apr 30 21:22:43.584474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea897ade-b339-4b4d-9d4b-00def7aab2b5 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Returning 404 to user: Instance group bd904402-3e11-410a-90c6-2a5ce4f5e360 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:43.585347 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea897ade-b339-4b4d-9d4b-00def7aab2b5 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/bd904402-3e11-410a-90c6-2a5ce4f5e360" status: 404 len: 117 microversion: 2.1 time: 0.025566 Apr 30 21:22:43.586141 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1630/3160] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:43 2022] DELETE /compute/v2.1/os-server-groups/bd904402-3e11-410a-90c6-2a5ce4f5e360 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:43.596223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12aab3e2-bdb1-4d23-9c8b-f6622661eb92 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.605364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.608267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:43.609402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-12aab3e2-bdb1-4d23-9c8b-f6622661eb92 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] HTTP exception thrown: Instance group 319fb279-4d6b-46ca-b932-9aca532afec1 could not be found. Apr 30 21:22:43.611121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12aab3e2-bdb1-4d23-9c8b-f6622661eb92 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Returning 404 to user: Instance group 319fb279-4d6b-46ca-b932-9aca532afec1 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:43.612741 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12aab3e2-bdb1-4d23-9c8b-f6622661eb92 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/319fb279-4d6b-46ca-b932-9aca532afec1" status: 404 len: 117 microversion: 2.1 time: 0.022128 Apr 30 21:22:43.616034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1531/3161] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:43 2022] DELETE /compute/v2.1/os-server-groups/319fb279-4d6b-46ca-b932-9aca532afec1 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:43.622099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.622099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.622099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:43.622099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:43.634945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2711030-7d1d-4b59-9eef-c494bd48610b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.648943 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-c2711030-7d1d-4b59-9eef-c494bd48610b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] HTTP exception thrown: Instance group 2e6274b1-9a9c-44d2-a0b4-e80620cbf3bc could not be found. Apr 30 21:22:43.649554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2711030-7d1d-4b59-9eef-c494bd48610b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Returning 404 to user: Instance group 2e6274b1-9a9c-44d2-a0b4-e80620cbf3bc could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:22:43.658596 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2711030-7d1d-4b59-9eef-c494bd48610b tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/2e6274b1-9a9c-44d2-a0b4-e80620cbf3bc" status: 404 len: 117 microversion: 2.1 time: 0.034392 Apr 30 21:22:43.667383 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1532/3162] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:43 2022] DELETE /compute/v2.1/os-server-groups/2e6274b1-9a9c-44d2-a0b4-e80620cbf3bc => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:43.682457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a7b58f91-3552-46c8-80f2-fb405bf82ca1 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:43.762009 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a7b58f91-3552-46c8-80f2-fb405bf82ca1 tempest-ServerGroupTestJSON-1706015977 tempest-ServerGroupTestJSON-1706015977-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/7de11a40-b965-4c3b-a44e-fee4d72ab877" status: 204 len: 0 microversion: 2.1 time: 0.092580 Apr 30 21:22:43.778442 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1533/3163] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:22:43 2022] DELETE /compute/v2.1/os-server-groups/7de11a40-b965-4c3b-a44e-fee4d72ab877 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:22:43.836319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:43.848943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc77ab9f-9000-4b94-b4ff-b126e96ba9a4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.247952 Apr 30 21:22:43.862127 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1631/3164] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:43 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:44.289900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:44.291147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:44.312569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:44.313509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:44.320132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:44.320808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:44.361126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:44.364051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:44.379593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:44.380503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:44.382286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:44.383025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:45.008432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:45.024973 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9e485c7-b587-4cf1-a417-de2265a3daf0 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.739942 Apr 30 21:22:45.027828 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1534/3165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:44 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:45.041889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d5086574-5116-44f2-b24a-f5f992a64de7 req-bbe3a86e-61df-4abc-9856-9b65e0d5e3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea01481-3f35-431b-aa50-2295fd12c5c2", "name": "network-vif-plugged", "status": "completed", "tag": "cd0808cc-294c-40d5-8a93-da73a96261d2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:45.058918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d5086574-5116-44f2-b24a-f5f992a64de7 req-bbe3a86e-61df-4abc-9856-9b65e0d5e3ad service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:45.059655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d5086574-5116-44f2-b24a-f5f992a64de7 req-bbe3a86e-61df-4abc-9856-9b65e0d5e3ad service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:45.076542 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d5086574-5116-44f2-b24a-f5f992a64de7 req-bbe3a86e-61df-4abc-9856-9b65e0d5e3ad service nova] Creating event network-vif-plugged:cd0808cc-294c-40d5-8a93-da73a96261d2 for instance aea01481-3f35-431b-aa50-2295fd12c5c2 on nch2-master-1 Apr 30 21:22:45.083516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:45.102159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:45.103385 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d5086574-5116-44f2-b24a-f5f992a64de7 req-bbe3a86e-61df-4abc-9856-9b65e0d5e3ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073955 Apr 30 21:22:45.106180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:45.109751 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1535/3166] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:22:45.112190 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e3220301-9e79-4072-8589-282ad5083357 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.756545 Apr 30 21:22:45.115829 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1632/3167] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:44 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:45.117894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:45.118631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:45.128136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:45.132904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:45.132904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:45.132904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:45.420591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:45.427780 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70371e13-9888-4348-8334-e2aa7da4d27d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.317788 Apr 30 21:22:45.428656 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1536/3168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:45 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:46.048492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:46.049351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:46.058075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:46.058544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:46.059344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:46.059797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:46.135768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:46.136456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:46.142745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:46.143643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:46.143988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:46.144502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:46.239491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:46.276120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2103dd83-00b3-4249-8625-54ad2ffe464a tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.232843 Apr 30 21:22:46.291754 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1633/3169] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:46 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:46.355874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:46.386041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:46.397800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:46.400133 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c481040f-5b51-44ef-aedb-2c23b78f63df tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.268282 Apr 30 21:22:46.413305 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1537/3170] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:46 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:46.447375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:46.448400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:46.466645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:46.468285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:46.469129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:46.469587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:46.715911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:46.724164 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-677f7015-c07a-49d5-9a1f-dd3ffc83aac1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1314 microversion: 2.1 time: 0.283438 Apr 30 21:22:46.730331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1634/3171] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:46 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:47.294072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:47.294650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:47.304509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:47.305362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:47.306347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:47.306978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:47.420849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:47.422380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:47.432793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:47.433594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:47.434556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:47.435503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:47.499070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:47.513927 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bb0b4f69-ad13-440b-b33f-63e3f0471a64 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.224195 Apr 30 21:22:47.524618 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1538/3172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:47 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:47.641299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:47.652185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:47.653839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:47.655053 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b2a47a3-2bc4-4efc-a5e0-b692a798b1c6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.238370 Apr 30 21:22:47.655620 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1635/3173] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:47 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:47.744723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:47.745504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:47.764122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:47.764122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:47.764122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:47.773673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:47.974347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:47.983398 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8582995-8d2f-4f3a-9052-5242b3dc5a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1501 microversion: 2.1 time: 0.243696 Apr 30 21:22:47.984102 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1539/3174] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:47 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:48.004263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fbbbffd6-f6bc-4775-bdee-d6752edfd9b2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:48.015030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbbbffd6-f6bc-4775-bdee-d6752edfd9b2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:48.020622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbbbffd6-f6bc-4775-bdee-d6752edfd9b2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:48.052401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fbbbffd6-f6bc-4775-bdee-d6752edfd9b2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Going to try to stop instance {{(pid=130671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:22:48.230368 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fbbbffd6-f6bc-4775-bdee-d6752edfd9b2 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2/action" status: 202 len: 0 microversion: 2.1 time: 0.230233 Apr 30 21:22:48.234310 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1636/3175] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:22:47 2022] POST /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:22:48.244363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:48.244363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:48.250446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:48.250913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:48.251830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:48.252277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:48.424106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:48.450311 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-48b86cc5-9adb-4568-b40e-c1dd985bdae5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.212426 Apr 30 21:22:48.451248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1540/3176] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:48 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:48.544619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:48.545492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:48.557442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:48.558993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:48.564760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:48.565317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:48.673911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:48.674985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:48.693143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:48.699210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:48.699210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:48.699210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:48.772217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:48.783700 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-629485a9-c2f6-4f1e-909e-6758950b24e4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.245195 Apr 30 21:22:48.793787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1637/3177] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:48 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:48.928946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:48.937961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:48.944272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:48.945914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0fd1432c-7b15-42ec-b6e9-eb8ad23d835f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.275688 Apr 30 21:22:48.950950 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1541/3178] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:48 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:49.473927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:49.473927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:49.478860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:49.479209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:49.480023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:49.480481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:49.663702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:49.672427 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-faa391f7-255c-4407-91fd-1f6c39b67efd tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.206339 Apr 30 21:22:49.673168 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1638/3179] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:49 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:49.930859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:49.930859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:49.930859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:49.930859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:49.930859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:49.930859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:49.946679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:49.954114 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fc273a8-d8b0-4661-b649-987f8c910e9c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.155284 Apr 30 21:22:49.954687 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1542/3180] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:49 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:49.964943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:49.965567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:49.971644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:49.972104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:49.972884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:49.973330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:50.114766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:50.122645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:50.124149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:50.125370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eded883e-02fa-499a-a4eb-932df103412f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.164373 Apr 30 21:22:50.126103 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1639/3181] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:49 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:50.695109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:50.701574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:50.705419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:50.706340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:50.707456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:50.708251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:50.746080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-527418124", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "a18bd1b2-5934-4e48-a955-c0e02d4a1da2"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:50.819553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] validate_networks() for [('a18bd1b2-5934-4e48-a955-c0e02d4a1da2', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:22:50.981115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:50.998035 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1990ef9-d7ca-4db1-b413-70f67cda4d17 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.306261 Apr 30 21:22:51.001091 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1640/3182] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:50 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:51.023562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:51.024198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:51.040035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:51.040848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:51.041936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:51.042687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:51.352625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:51.361649 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f8a6e0e-cf0a-4036-8273-19c15404d92c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.357990 Apr 30 21:22:51.367836 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1641/3183] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:51 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:51.373274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:51.374005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:51.380555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:51.382234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:51.383098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:51.383795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:51.385318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:22:51.385850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:22:51.386321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:22:51.386742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:22:51.387158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:22:51.404248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:51.405700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:51.407189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:51.408727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:51.448035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Getting quotas for project 03431e5f43c045d78e741327bacf5d1c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:22:51.455902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Getting quotas for user f230caf9b44f4c11b91e2f9dcb3a3d82 and project 03431e5f43c045d78e741327bacf5d1c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:22:51.473361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:22:51.476737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:22:51.564445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:51.578726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:51.578726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:51.578726 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37e73708-2251-41a1-94d1-4f92d10f72d1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.213469 Apr 30 21:22:51.578726 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1642/3184] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:51 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:51.591997 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8cef1bee-bf28-4653-81ef-8db8295605eb tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073713 Apr 30 21:22:51.592656 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1543/3185] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:22:51.612307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ebdbe41d-c206-4c58-9438-a0cb49023db4 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:51.614638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ebdbe41d-c206-4c58-9438-a0cb49023db4 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:51.692244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebdbe41d-c206-4c58-9438-a0cb49023db4 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:51.706074 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ebdbe41d-c206-4c58-9438-a0cb49023db4 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1223 microversion: 2.1 time: 0.105479 Apr 30 21:22:51.706996 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1643/3186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:51 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:52.018702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:52.019317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:52.029315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:52.029947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:52.031336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:52.031887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:52.251279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:52.255123 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ff899fe-c374-4118-a4f4-5cbb7e26468e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.241666 Apr 30 21:22:52.266572 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1544/3187] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:52 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:52.381216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:52.382050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:52.392962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:52.392962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:52.392962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:52.393345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:52.575123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:52.583023 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-36d11e5f-0130-41f5-ad52-398ead11e632 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.206567 Apr 30 21:22:52.590407 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1644/3188] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:52 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:52.598380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:52.599649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:52.608103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:52.615993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:52.615993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:52.615993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:52.723042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9743839d-e16b-4a14-9ee9-e6772b800d3b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:52.724414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9743839d-e16b-4a14-9ee9-e6772b800d3b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:52.790924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:52.818490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:52.820619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:52.822115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb9bf085-db0e-4561-b4e4-619366a9a49b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.227998 Apr 30 21:22:52.823312 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1545/3189] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:52 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:52.827396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9743839d-e16b-4a14-9ee9-e6772b800d3b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:52.836101 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9743839d-e16b-4a14-9ee9-e6772b800d3b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1223 microversion: 2.1 time: 0.117204 Apr 30 21:22:52.837355 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1645/3190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:52 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:53.275724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:53.277028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:53.291473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.291473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:53.291473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.291473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:53.445631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:53.453112 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f58d172-f640-4808-82a4-9452d43ff067 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.181935 Apr 30 21:22:53.453687 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1546/3191] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:53 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:53.606923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:53.607578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:53.614739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.615197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:53.616022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.616463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:53.782202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:53.790599 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2a7a0fe-1e43-43cc-95ba-c7e685f57f29 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.187744 Apr 30 21:22:53.791774 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1646/3192] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:53 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:53.844530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:53.853661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:53.854488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:53.859581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:53.867852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.868567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:53.869447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.869696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.869967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:53.870469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:53.870840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:53.871294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:54.061678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:54.073641 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b8f0afb-c573-4c9c-b85f-def332b60515 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1219 microversion: 2.1 time: 0.223796 Apr 30 21:22:54.078813 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1647/3193] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:53 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1219 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:54.106286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:54.119381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:54.121788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:54.123416 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ff383dc-7e4e-425f-8323-f156d067c981 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.286333 Apr 30 21:22:54.123824 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1547/3194] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:53 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:54.481313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:54.482316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:54.489606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:54.490346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:54.491952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:54.492538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:54.683678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:54.695697 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c30301f-bd4e-47d2-995b-5920578356de tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.223438 Apr 30 21:22:54.696663 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1648/3195] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:54 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:54.810383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:54.811032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:54.818279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:54.818750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:54.819542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:54.820056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:55.048186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:55.056087 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-05a40134-91a9-4f02-85de-4bfb78a1c649 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.249585 Apr 30 21:22:55.056668 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1548/3196] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:54 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:55.095999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:55.096635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:55.103841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:55.108965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:55.108965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:55.108965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:55.141211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:55.141862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:55.148893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:55.149875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:55.151039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:55.151673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:55.252429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:55.261338 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-33380e3b-d0b3-4397-baa0-c72536c63efe tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1281 microversion: 2.1 time: 0.168793 Apr 30 21:22:55.261608 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1649/3197] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:55 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:55.362026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:55.370614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:55.372200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:55.373391 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5552d420-8024-46e0-a0be-cd5d0586be9a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1737 microversion: 2.20 time: 0.236198 Apr 30 21:22:55.377183 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1549/3198] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:55 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:55.713841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:55.714633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:55.721296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:55.721897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:55.722900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:55.723436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:56.007669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:56.015359 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0d8486ca-d996-4258-9cae-17df233563fb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.305912 Apr 30 21:22:56.015942 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1650/3199] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:55 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:56.075846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:56.081705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:56.087791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:56.088257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:56.089049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:56.089500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:56.283934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:56.284801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:56.292241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:56.292700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:56.293500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:56.293971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:56.403011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:56.410670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b1803766-9275-4543-a7c2-1a9ee7feafef tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.342032 Apr 30 21:22:56.413192 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1550/3200] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:56 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:56.416533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:56.417154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:56.423911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:56.424931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:56.425728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:56.426212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:56.648525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:56.656408 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-33afd0fe-f672-4cb1-8d76-02aa4b736a2e tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.378507 Apr 30 21:22:56.656991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1651/3201] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:56 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:56.708951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:56.717493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:56.719082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:56.720243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-99a74b21-fe17-4101-a5e8-36f42fbed6d8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1719 microversion: 2.20 time: 0.308088 Apr 30 21:22:56.720890 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1551/3202] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:56 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1719 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:22:57.032355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:57.033063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:57.039739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.040534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.041716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.042558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.114274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ab6d5f39-d7a7-4041-8cba-094c241e4eb1 req-875442e0-ec46-475c-9ad6-910cdf8b0e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b49131-df20-4dde-9c8f-eba13c1f9a8b", "tag": "60f58a50-d792-48a6-9c70-5e4356d53e72"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:57.123056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ab6d5f39-d7a7-4041-8cba-094c241e4eb1 req-875442e0-ec46-475c-9ad6-910cdf8b0e1a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.123680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ab6d5f39-d7a7-4041-8cba-094c241e4eb1 req-875442e0-ec46-475c-9ad6-910cdf8b0e1a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.136388 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ab6d5f39-d7a7-4041-8cba-094c241e4eb1 req-875442e0-ec46-475c-9ad6-910cdf8b0e1a service nova] Creating event network-changed:60f58a50-d792-48a6-9c70-5e4356d53e72 for instance 40b49131-df20-4dde-9c8f-eba13c1f9a8b on nch1-master-1 Apr 30 21:22:57.141972 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ab6d5f39-d7a7-4041-8cba-094c241e4eb1 req-875442e0-ec46-475c-9ad6-910cdf8b0e1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032886 Apr 30 21:22:57.142588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1552/3203] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:22:57.265013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:57.276206 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37221b54-a8dc-49b0-bb9f-8a0c7d78d445 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.247624 Apr 30 21:22:57.277195 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1652/3204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:57 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:57.429310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:57.430456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:57.437553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.438471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.439517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.440088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.668564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:57.672819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:57.673439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:57.678211 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-924d08ea-7869-4c27-a426-c89e959d0a70 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.253204 Apr 30 21:22:57.694349 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1553/3205] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:57 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:57.694594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.694594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.694594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.694594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.740071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:57.740817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:57.748099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.748558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:57.749344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:57.749825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:58.262169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:58.282014 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-153e104f-5ad9-4026-9974-d118a6f0cd57 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.613254 Apr 30 21:22:58.282606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1653/3206] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:57 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:58.296692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:58.297549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:58.304991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:58.305685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:58.306783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:58.306952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:58.339336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:58.348189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:58.350389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:58.351919 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7d31aa97-38a7-48c7-949b-03e13e559151 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1719 microversion: 2.20 time: 0.615846 Apr 30 21:22:58.352869 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1554/3207] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:57 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1719 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:58.481959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:58.489673 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8416032a-2944-426b-9d19-cdb1aa8e00f7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.197477 Apr 30 21:22:58.499801 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1654/3208] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:58 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:22:58.709746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:58.710395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:58.716411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:58.716875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:58.717659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:58.718133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:58.865921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:58.873412 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35d6c8ac-b6ce-4279-817a-9b1cbeb2e678 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.167656 Apr 30 21:22:58.874030 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1555/3209] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:58 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:59.372637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:59.372637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:59.372637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.372637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.372637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.372637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.373534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:59.373534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:59.378458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.378917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.379698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.380323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.489878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:59.500548 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ccf7765e-d84a-4e26-9185-15f624e2227a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.205739 Apr 30 21:22:59.511492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1655/3210] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:59 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:59.518164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:59.519057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:59.526828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.533327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.533327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.533327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.551018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:59.559033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:59.560610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:59.561799 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b2ad833-0f57-47bd-b5c1-feb4d178e958 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1722 microversion: 2.20 time: 0.194731 Apr 30 21:22:59.562366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1556/3211] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:22:59 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:22:59.587590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fde7df80-5e31-4177-a1b7-c0643f234018 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecaa8fc8-122d-4201-b4ec-f389b692b0fa"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:22:59.588892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fde7df80-5e31-4177-a1b7-c0643f234018 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:59.603934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fde7df80-5e31-4177-a1b7-c0643f234018 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.603934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fde7df80-5e31-4177-a1b7-c0643f234018 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.603934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fde7df80-5e31-4177-a1b7-c0643f234018 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.604227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fde7df80-5e31-4177-a1b7-c0643f234018 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.690895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:22:59.699429 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c92dd9b9-4cc0-4e8d-bdd8-3c10330e9340 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.185391 Apr 30 21:22:59.701220 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1656/3212] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:59 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:22:59.890520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:22:59.891198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:22:59.897142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.897599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:22:59.898535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:22:59.898984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.034846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:00.046145 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-561c074a-93ec-430c-9750-9184d1fba45c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.156151 Apr 30 21:23:00.046145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1657/3213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:22:59 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:00.470036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a3acd59c-2ed1-4f6c-aa97-3f8e8c1abc84 req-358d4e65-2679-4121-bc55-5628ab85578a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "name": "network-vif-unplugged", "status": "completed", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:00.479565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a3acd59c-2ed1-4f6c-aa97-3f8e8c1abc84 req-358d4e65-2679-4121-bc55-5628ab85578a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:00.480015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a3acd59c-2ed1-4f6c-aa97-3f8e8c1abc84 req-358d4e65-2679-4121-bc55-5628ab85578a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.491323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.server_external_events [req-a3acd59c-2ed1-4f6c-aa97-3f8e8c1abc84 req-358d4e65-2679-4121-bc55-5628ab85578a service nova] Unable to find a host for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70. Dropping event network-vif-unplugged {{(pid=130671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 30 21:23:00.492239 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a3acd59c-2ed1-4f6c-aa97-3f8e8c1abc84 req-358d4e65-2679-4121-bc55-5628ab85578a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026199 Apr 30 21:23:00.492819 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1658/3214] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 30 21:23:00.519291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:00.519940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:00.527948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:00.528382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.529172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:00.530162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.654275 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fde7df80-5e31-4177-a1b7-c0643f234018 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.071795 Apr 30 21:23:00.672068 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1557/3215] 10.222.0.23 () {62 vars in 1363 bytes} [Sat Apr 30 21:22:59 2022] POST /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments => generated 188 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:23:00.681151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:00.689465 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4484bfc9-a622-431f-b999-ada86d24640d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.175258 Apr 30 21:23:00.690076 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1659/3216] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:00 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:00.716315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:00.716933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:00.723896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:00.724364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.725699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:00.736379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.782591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-32e95766-1555-494a-8f22-726993839724 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:00.782591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-32e95766-1555-494a-8f22-726993839724 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:00.788811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32e95766-1555-494a-8f22-726993839724 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:00.789305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32e95766-1555-494a-8f22-726993839724 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.790942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32e95766-1555-494a-8f22-726993839724 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:00.791395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32e95766-1555-494a-8f22-726993839724 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:00.874129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:00.882287 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-25104628-41f2-4f30-8c72-1b487bffa070 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.169772 Apr 30 21:23:00.884849 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1558/3217] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:00 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:01.023889 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-32e95766-1555-494a-8f22-726993839724 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/action" status: 202 len: 0 microversion: 2.20 time: 0.240809 Apr 30 21:23:01.023889 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1660/3218] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:23:00 2022] POST /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:23:01.028820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:01.029490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:01.043829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.044330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:01.045068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.045515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:01.061678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:01.062524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:01.072768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.073315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:01.074297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.074803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:01.258394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:01.268772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:01.270689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:01.273099 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2577855-86ac-4357-b2d9-d40ee39498a8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1748 microversion: 2.20 time: 0.248222 Apr 30 21:23:01.276790 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1559/3219] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:01 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1748 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:01.285202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:01.297460 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99a0c9d9-6865-4211-9ccc-c76d8fec5cd3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.236762 Apr 30 21:23:01.297460 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1661/3220] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:01 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:01.706581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:01.707304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:01.714557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.716320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:01.716320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.716533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:01.898071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:01.900427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:01.900989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:01.908113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-90ebb084-7584-4c16-b730-3225d9453bc0 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.205119 Apr 30 21:23:01.908625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.909096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:01.909277 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1560/3221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:01 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:01.909924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:01.911131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:02.066454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:02.073957 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c532c2b-bd56-4b88-ab45-8d7a8ed4b6d5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.178390 Apr 30 21:23:02.074551 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1662/3222] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:01 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:02.295546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:02.295546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:02.301783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:02.302306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:02.303184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:02.303671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:02.317821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:02.319662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:02.329827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:02.330477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:02.331544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:02.332382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:02.504349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:02.513689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:02.515227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:02.516492 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-00db484f-f015-46b7-a772-cb3cd378023b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1748 microversion: 2.20 time: 0.226214 Apr 30 21:23:02.517092 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1561/3223] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:02 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1748 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:02.520144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:02.528179 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2daa69d-0247-46b0-a824-00383303cdc4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.216690 Apr 30 21:23:02.528734 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1663/3224] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:02 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:02.926151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:02.926860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:02.937533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:02.938510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:02.939942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:02.942458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:03.098693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:03.100480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:03.106929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:03.116285 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f193b1a0-078b-4369-928e-39159b15df28 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.194157 Apr 30 21:23:03.117282 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1562/3225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:02 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:03.118703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:03.119274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:03.120346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:03.121173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:03.276018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:03.285030 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a52f3a2-a583-4781-b511-fc5a117b2a1f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.196783 Apr 30 21:23:03.285606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1664/3226] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:03 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:03.535038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:03.535676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:03.542384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:03.545493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:03.545493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:03.545493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:03.545793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:03.546098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:03.554072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:03.554759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:03.555752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:03.556209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:03.757175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:03.760068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:03.766957 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-81bf5758-2261-4da1-9a87-5509617f044b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.226291 Apr 30 21:23:03.767759 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1665/3227] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:03 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:03.777465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:03.777465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:03.777465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e375c6ab-8ab1-480b-bf2f-56c270c5cdc6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1750 microversion: 2.20 time: 0.240209 Apr 30 21:23:03.777465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1563/3228] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:03 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:03.983919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-24449dad-7273-4293-a119-8b78598f6829 req-71a92fa8-8a42-4cdd-a3d9-3dd7c23f5c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b49131-df20-4dde-9c8f-eba13c1f9a8b", "name": "network-vif-plugged", "status": "completed", "tag": "60f58a50-d792-48a6-9c70-5e4356d53e72"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:03.996909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-24449dad-7273-4293-a119-8b78598f6829 req-71a92fa8-8a42-4cdd-a3d9-3dd7c23f5c8e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:03.997461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-24449dad-7273-4293-a119-8b78598f6829 req-71a92fa8-8a42-4cdd-a3d9-3dd7c23f5c8e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.010943 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-24449dad-7273-4293-a119-8b78598f6829 req-71a92fa8-8a42-4cdd-a3d9-3dd7c23f5c8e service nova] Creating event network-vif-plugged:60f58a50-d792-48a6-9c70-5e4356d53e72 for instance 40b49131-df20-4dde-9c8f-eba13c1f9a8b on nch1-master-1 Apr 30 21:23:04.016242 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-24449dad-7273-4293-a119-8b78598f6829 req-71a92fa8-8a42-4cdd-a3d9-3dd7c23f5c8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Apr 30 21:23:04.016851 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1564/3229] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:04.133389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:04.134045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:04.141355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.141817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.142611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.143065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.297104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:04.304018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:04.305105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:04.309049 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4dbb7fc-5d83-4953-a5cb-1b9d8912cbd6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.177335 Apr 30 21:23:04.309049 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1666/3230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:04 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:04.320151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.320613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.321407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.321884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.498171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:04.505681 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0ae19a7-db93-4948-ac6b-26d8f7710595 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.206868 Apr 30 21:23:04.506317 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1565/3231] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:04 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:04.784791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:04.785731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:04.790715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:04.791601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:04.792351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.792810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.793600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.794262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.798560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.799045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:04.800264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:04.800705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:05.014044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:05.022521 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8e16587-c519-4966-8dcd-7db4aed7c890 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1517 microversion: 2.1 time: 0.241201 Apr 30 21:23:05.023265 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1667/3232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:04 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:05.053352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:05.065551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:05.067113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:05.068903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4bf93c58-98fd-4e87-bf55-2985a3860eeb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.281915 Apr 30 21:23:05.069483 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1566/3233] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:04 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:05.324255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:05.324914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:05.331773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:05.332285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:05.340260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:05.340260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:05.479008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:05.487643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-713620c6-55ab-415f-9efa-35c121e19770 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1323 microversion: 2.1 time: 0.167269 Apr 30 21:23:05.488225 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1668/3234] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:05 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:05.531372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:05.532233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:05.547670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:05.550671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:05.550671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:05.551157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:05.801352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:05.816386 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c76e3de-1984-49a6-9dda-b3f6c3e8a6cb tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.297803 Apr 30 21:23:05.821940 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1567/3235] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:05 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:06.040895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:06.041699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:06.050729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.051247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.052380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.053195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.089461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:06.090943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:06.101862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.109178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.109178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.109178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.389423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:06.400346 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e5dd1b5-241a-40a1-9b14-91163f65a284 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1523 microversion: 2.1 time: 0.363996 Apr 30 21:23:06.401263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1669/3236] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:06 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:06.461503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:06.477554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:06.481673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:06.484172 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-001d0136-abac-481d-8384-b3c491e57693 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.400005 Apr 30 21:23:06.497172 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1568/3237] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:06 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:06.505266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:06.506087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:06.514189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.517646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.517646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.517646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.752700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:06.773408 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-071e8779-aba9-4fee-84cd-06c68997c986 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1519 microversion: 2.1 time: 0.272408 Apr 30 21:23:06.775011 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1670/3238] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:06 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:06.815929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-13ad747a-ea3f-4997-ba43-b34f36da180f req-a91afecd-5967-49c6-9e7a-3a9d81cfbe27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:06.838539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:06.844281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13ad747a-ea3f-4997-ba43-b34f36da180f req-a91afecd-5967-49c6-9e7a-3a9d81cfbe27 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.844281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13ad747a-ea3f-4997-ba43-b34f36da180f req-a91afecd-5967-49c6-9e7a-3a9d81cfbe27 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.844705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:06.866250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.866888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.867686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:06.868303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:06.876627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-13ad747a-ea3f-4997-ba43-b34f36da180f req-a91afecd-5967-49c6-9e7a-3a9d81cfbe27 service nova] Creating event network-changed:25241eca-3984-4407-9196-eb00543c2900 for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 on nch1-master-1 Apr 30 21:23:06.895962 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-13ad747a-ea3f-4997-ba43-b34f36da180f req-a91afecd-5967-49c6-9e7a-3a9d81cfbe27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082997 Apr 30 21:23:06.900432 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1569/3239] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:06.979277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e74c1e6b-e6d4-4907-99c1-5d320a2517c8 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-693875701", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "a18bd1b2-5934-4e48-a955-c0e02d4a1da2"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:06.981104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e74c1e6b-e6d4-4907-99c1-5d320a2517c8 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:06.982426 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e74c1e6b-e6d4-4907-99c1-5d320a2517c8 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.008291 Apr 30 21:23:06.983790 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1570/3240] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:23:06 2022] POST /compute/v2.1/servers => generated 175 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:23:07.000541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67e47a50-7a8e-4f5c-96bd-5bc26452644b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:07.001241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67e47a50-7a8e-4f5c-96bd-5bc26452644b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: a7fe647e-318b-4ee0-9dd1-020a45d4645d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:07.011141 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-67e47a50-7a8e-4f5c-96bd-5bc26452644b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] HTTP exception thrown: Instance a7fe647e-318b-4ee0-9dd1-020a45d4645d could not be found. Apr 30 21:23:07.017386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67e47a50-7a8e-4f5c-96bd-5bc26452644b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 404 to user: Instance a7fe647e-318b-4ee0-9dd1-020a45d4645d could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:07.018504 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67e47a50-7a8e-4f5c-96bd-5bc26452644b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/a7fe647e-318b-4ee0-9dd1-020a45d4645d/metadata" status: 404 len: 111 microversion: 2.1 time: 0.022821 Apr 30 21:23:07.019263 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1571/3241] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:23:06 2022] GET /compute/v2.1/servers/a7fe647e-318b-4ee0-9dd1-020a45d4645d/metadata => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:23:07.188415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:07.201741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d997854-03fc-48c3-bf9a-f85e79c5780b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.366514 Apr 30 21:23:07.202747 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1671/3242] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:06 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:07.262064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6abba141-80f1-4db9-9aa9-e3d951b2fd5a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1251363858", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a18bd1b2-5934-4e48-a955-c0e02d4a1da2"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:07.264319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6abba141-80f1-4db9-9aa9-e3d951b2fd5a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:07.265488 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6abba141-80f1-4db9-9aa9-e3d951b2fd5a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.007670 Apr 30 21:23:07.266230 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1572/3243] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:23:07 2022] POST /compute/v2.1/servers => generated 687 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:23:07.325568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22ed7f73-9192-4e54-86e1-d84a5198dfc6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1660031481", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a18bd1b2-5934-4e48-a955-c0e02d4a1da2"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:07.327800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22ed7f73-9192-4e54-86e1-d84a5198dfc6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:07.328821 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22ed7f73-9192-4e54-86e1-d84a5198dfc6 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.008755 Apr 30 21:23:07.329870 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1672/3244] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:23:07 2022] POST /compute/v2.1/servers => generated 689 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:23:07.401630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fcce0f64-3e41-41fe-8043-57fda2b98877 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1798310547", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a18bd1b2-5934-4e48-a955-c0e02d4a1da2"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:07.403861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fcce0f64-3e41-41fe-8043-57fda2b98877 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:07.404691 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fcce0f64-3e41-41fe-8043-57fda2b98877 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.008484 Apr 30 21:23:07.405214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1573/3245] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:23:07 2022] POST /compute/v2.1/servers => generated 1197 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Apr 30 21:23:07.422324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:07.422986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:07.436462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:07.438088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:07.441706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:07.442496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:07.484651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1df444ea-c7e2-4460-bb0a-4ae410d563f3 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1570962446", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a18bd1b2-5934-4e48-a955-c0e02d4a1da2"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:07.486374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1df444ea-c7e2-4460-bb0a-4ae410d563f3 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:07.487444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1df444ea-c7e2-4460-bb0a-4ae410d563f3 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.007601 Apr 30 21:23:07.488428 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1574/3246] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Apr 30 21:23:07 2022] POST /compute/v2.1/servers => generated 2221 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Apr 30 21:23:07.503150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76b31f09-2572-4b96-9e23-65cfd8bc86ac tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:07.503866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76b31f09-2572-4b96-9e23-65cfd8bc86ac tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 4efb0b08-7a09-4733-b57d-3476cb50db6b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:07.511078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-76b31f09-2572-4b96-9e23-65cfd8bc86ac tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] HTTP exception thrown: Instance 4efb0b08-7a09-4733-b57d-3476cb50db6b could not be found. Apr 30 21:23:07.511875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76b31f09-2572-4b96-9e23-65cfd8bc86ac tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 404 to user: Instance 4efb0b08-7a09-4733-b57d-3476cb50db6b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:07.513046 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-76b31f09-2572-4b96-9e23-65cfd8bc86ac tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/4efb0b08-7a09-4733-b57d-3476cb50db6b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014694 Apr 30 21:23:07.527630 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1575/3247] 10.222.0.23 () {58 vars in 1280 bytes} [Sat Apr 30 21:23:07 2022] GET /compute/v2.1/servers/4efb0b08-7a09-4733-b57d-3476cb50db6b/metadata/test2 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:07.538045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:07.538880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:07.547607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:07.548076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:07.548882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:07.549643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:07.833151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:07.834451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:07.843986 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a065f14-b1ad-43e9-883f-e7abc652506b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1523 microversion: 2.1 time: 0.426536 Apr 30 21:23:07.848140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:07.850344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:07.852608 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-777f95af-7636-4184-aa4c-09e62ac8e4f1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.328053 Apr 30 21:23:07.868065 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1673/3248] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:07 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:07.872935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:07.873630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:07.877306 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1576/3249] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:07 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:07.891899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:07.892649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:07.893417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:07.894050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:07.943267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:23:08.220177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:08.222167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:08.232519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.238618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.239917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.240382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.318231 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6a8c29f7-8f34-4397-ae07-64f90b082edf tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "DELETE /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 204 len: 0 microversion: 2.1 time: 0.451179 Apr 30 21:23:08.318833 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1674/3250] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:07 2022] DELETE /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:08.327912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:08.328865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:08.335695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.336173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.336982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.337427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.452047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:08.472303 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-06289b5e-f954-409c-835a-f1657d0b297f tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.253284 Apr 30 21:23:08.485399 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1577/3251] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:08 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:08.520901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:08.534023 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f2ed39d-b045-4c4a-84e1-f513216bc3ca tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.206781 Apr 30 21:23:08.536356 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1675/3252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:08 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:08.698220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6ac331f4-ab62-4d4a-afc0-a719684b0440 req-febcc255-3afb-45e1-ad13-3d9b0afd67d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d140b58d-54d4-4d07-a911-6b4ce98c09d3", "name": "network-vif-unplugged", "status": "completed", "tag": "86e1db01-58fa-40a2-8fdb-edc142f30736"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:08.707501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ac331f4-ab62-4d4a-afc0-a719684b0440 req-febcc255-3afb-45e1-ad13-3d9b0afd67d9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.708483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ac331f4-ab62-4d4a-afc0-a719684b0440 req-febcc255-3afb-45e1-ad13-3d9b0afd67d9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.722063 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6ac331f4-ab62-4d4a-afc0-a719684b0440 req-febcc255-3afb-45e1-ad13-3d9b0afd67d9 service nova] Creating event network-vif-unplugged:86e1db01-58fa-40a2-8fdb-edc142f30736 for instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 on nch2-master-1 Apr 30 21:23:08.728669 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6ac331f4-ab62-4d4a-afc0-a719684b0440 req-febcc255-3afb-45e1-ad13-3d9b0afd67d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034724 Apr 30 21:23:08.729351 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1578/3253] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:08.860931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:08.861553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:08.867727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.868180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.868959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.869405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.896859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:08.897583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:08.903899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.904365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:08.905156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:08.905603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:09.064807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:09.076940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c327337e-ebf4-43a4-8ebf-c67e283b0c90 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1523 microversion: 2.1 time: 0.219768 Apr 30 21:23:09.077547 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1676/3254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:08 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:09.091034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:09.101046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:09.102879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:09.104225 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f9e9799-b0fe-4d71-a805-061b1750949d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.212350 Apr 30 21:23:09.105787 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1579/3255] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:08 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:09.494143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:09.494865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:09.504861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:09.504861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:09.504861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:09.504861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:09.555886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:09.556839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:09.570601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:09.571068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:09.572196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:09.572818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:09.812547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:09.823747 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3af50847-a8f8-4d68-81ee-6aca3af7b73b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.334456 Apr 30 21:23:09.825411 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1677/3256] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:09 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:09.834405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:09.850427 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e392e0b6-a097-4548-9180-09da2f688c1b tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.300059 Apr 30 21:23:09.851110 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1580/3257] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:09 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:10.095195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:10.096028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:10.102838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.104118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.110094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.110094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.124009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:10.124713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:10.134179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.134777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.138681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.138681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.365414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:10.380868 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-430b3027-adb3-4d10-ba8b-2d5c7cf6f657 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1523 microversion: 2.1 time: 0.289689 Apr 30 21:23:10.382279 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1678/3258] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:10 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:10.443912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:10.453998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:10.455935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:10.467543 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e6ab4c5-abfa-4d45-8d9e-6313b7db5961 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.337735 Apr 30 21:23:10.467543 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1581/3259] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:10 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:10.744044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-92813c38-6791-4983-b72a-1cc6a66119ba req-1be70ac8-f954-4a46-b9b1-efa25bbb37a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d140b58d-54d4-4d07-a911-6b4ce98c09d3", "name": "network-vif-plugged", "status": "completed", "tag": "86e1db01-58fa-40a2-8fdb-edc142f30736"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:10.753126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-92813c38-6791-4983-b72a-1cc6a66119ba req-1be70ac8-f954-4a46-b9b1-efa25bbb37a6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.753577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-92813c38-6791-4983-b72a-1cc6a66119ba req-1be70ac8-f954-4a46-b9b1-efa25bbb37a6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.765210 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-92813c38-6791-4983-b72a-1cc6a66119ba req-1be70ac8-f954-4a46-b9b1-efa25bbb37a6 service nova] Creating event network-vif-plugged:86e1db01-58fa-40a2-8fdb-edc142f30736 for instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 on nch2-master-1 Apr 30 21:23:10.770271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-92813c38-6791-4983-b72a-1cc6a66119ba req-1be70ac8-f954-4a46-b9b1-efa25bbb37a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029817 Apr 30 21:23:10.770950 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1679/3260] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:10.841423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:10.842084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:10.854194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.854930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.855899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.858247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.867775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:10.869091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:10.876316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.878487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:10.879479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:10.887542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:11.186573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:11.190335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:11.199492 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f799e7c4-42d9-4d64-b7a8-7277d6fe699a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.336481 Apr 30 21:23:11.200080 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1680/3261] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:10 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:11.200656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b0505d54-678a-4dc7-9ea7-58dea182522a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.362995 Apr 30 21:23:11.211322 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1582/3262] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:10 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:11.399882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:11.400555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:11.408965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:11.409774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:11.410841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:11.411520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:11.476512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:11.477143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:11.486867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:11.486867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:11.486867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:11.486867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:11.665494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:11.673302 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f09bd9aa-8047-4535-9aef-3f6932285a6d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1523 microversion: 2.1 time: 0.277790 Apr 30 21:23:11.673912 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1681/3263] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:11 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:11.707609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:11.717816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:11.719319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:11.720532 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3357eff1-4b7d-4f01-801f-62b47dc3bf8e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.248078 Apr 30 21:23:11.721083 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1583/3264] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:11 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:12.219120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:12.220589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:12.222722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:12.228371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:12.231731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.232539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.233770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.235835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.236835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.237296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.238367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.238824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.543271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:12.546658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:12.553437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-346814b6-c39f-41e2-8d85-89e69af5bf68 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.338233 Apr 30 21:23:12.554263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1682/3265] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:12 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:12.555705 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ff12a0d-b3cf-4fba-9daf-98d3fb0ed9c5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.340538 Apr 30 21:23:12.556472 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1584/3266] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:12 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:12.692361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:12.693052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:12.699374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.699857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.700658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.701111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.744702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:12.745875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:12.757180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.758262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.759310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.763364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.933291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:12.943491 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3155c67c-4b95-49f7-96d8-66e4340fec49 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1508 microversion: 2.1 time: 0.255776 Apr 30 21:23:12.944531 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1683/3267] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:12 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:12.961073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:12.968992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:12.969659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:12.975675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:12.979187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:12.981321 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-79255e47-8e1d-41fe-9d82-7a4b786563dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.241177 Apr 30 21:23:12.982489 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1585/3268] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:12 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:12.982836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.983641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:12.991841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:12.992315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:13.175692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:13.184019 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8410e4c-fdf4-4364-a3b5-6941b445b123 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 200 len: 1508 microversion: 2.1 time: 0.222098 Apr 30 21:23:13.184595 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1684/3269] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:12 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:13.200360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:13.200890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:13.207746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:13.208287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:13.209151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:13.209606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:13.271322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:23:13.571136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:13.571921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:13.582736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:13.582736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:13.582736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:13.582736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:13.592313 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5cccd563-52c2-41c1-ab4e-1f6e2960a1dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 204 len: 0 microversion: 2.1 time: 0.395552 Apr 30 21:23:13.593396 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1586/3270] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:13 2022] DELETE /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:13.622078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:13.622829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:13.643333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:13.648396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:13.648396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:13.650062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:13.798373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:13.814579 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58d5ec15-75a0-428f-a64f-632699f6df69 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.247289 Apr 30 21:23:13.815529 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1685/3271] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:13 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:13.838546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-884103429", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "4e174604-3d00-4575-a608-2f7eb012a46b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:13.872160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:13.886141 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-64e53a12-0144-45ea-939d-b70d5eac6ad4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.290521 Apr 30 21:23:13.894440 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1587/3272] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:13 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:13.908018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] validate_networks() for [('4e174604-3d00-4575-a608-2f7eb012a46b', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:23:14.001201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:14.001994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:14.008845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:14.009294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:14.010117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:14.010570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:14.302441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:14.326883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:14.328811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:14.330333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a9246b6-dfff-4d29-998e-ee0f2ea80356 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.333048 Apr 30 21:23:14.343367 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1588/3273] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:13 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:14.557441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:23:14.558314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:23:14.558748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:23:14.559232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:23:14.559719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:23:14.570193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:14.570898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:14.571832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:14.572945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:14.592967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Getting quotas for project 3e12f061321b434e92c0f85031c54ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:23:14.598456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Getting quotas for user a42c6a51b78b408f85cbacb545f06707 and project 3e12f061321b434e92c0f85031c54ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:23:14.615067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:23:14.615067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:23:14.835552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:14.836099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:14.842460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:14.855826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:14.855826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:14.855826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:15.005350 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af03efde-9d90-4c5e-bc53-b3f2c077e82d tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170547 Apr 30 21:23:15.006057 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1686/3274] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:23:15.018829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:15.018829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:15.024701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:15.025172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:15.026016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:15.026470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:15.517338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:15.525128 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b0ce247-f35d-4149-a75e-9d42d89be2b1 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.694006 Apr 30 21:23:15.542212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:15.554315 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1589/3275] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:14 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:15.568721 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f40b0ea9-43ab-454c-89ad-8bfc432ceae7 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.561484 Apr 30 21:23:15.572535 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1687/3276] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:15 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:15.588554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:15.600028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-104e1f1c-f389-4121-9941-e94489548f98 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:15.600028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-104e1f1c-f389-4121-9941-e94489548f98 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:15.614750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:15.639182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:15.639622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:15.644335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:15.646530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:15.712412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-104e1f1c-f389-4121-9941-e94489548f98 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:15.722674 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-104e1f1c-f389-4121-9941-e94489548f98 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1217 microversion: 2.1 time: 0.166796 Apr 30 21:23:15.735449 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1590/3277] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:15 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:15.936819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:15.957910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:15.957910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:15.957910 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b9f1175-d7d4-4cd7-8a74-0f0a641ffa48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.378365 Apr 30 21:23:15.958920 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1688/3278] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:15 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:16.227276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-29e269bc-c3e6-45dc-b652-496dca130e58 req-08e13b11-1668-40d3-9aed-28ea2b9a26ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d140b58d-54d4-4d07-a911-6b4ce98c09d3", "name": "network-vif-deleted", "tag": "86e1db01-58fa-40a2-8fdb-edc142f30736"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:16.236667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-29e269bc-c3e6-45dc-b652-496dca130e58 req-08e13b11-1668-40d3-9aed-28ea2b9a26ca service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.237116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-29e269bc-c3e6-45dc-b652-496dca130e58 req-08e13b11-1668-40d3-9aed-28ea2b9a26ca service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.248873 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-29e269bc-c3e6-45dc-b652-496dca130e58 req-08e13b11-1668-40d3-9aed-28ea2b9a26ca service nova] Creating event network-vif-deleted:86e1db01-58fa-40a2-8fdb-edc142f30736 for instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 on nch2-master-1 Apr 30 21:23:16.258727 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-29e269bc-c3e6-45dc-b652-496dca130e58 req-08e13b11-1668-40d3-9aed-28ea2b9a26ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035024 Apr 30 21:23:16.262993 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1591/3279] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:16.545473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:16.546473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:16.554967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.653853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.653853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.653853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.655893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:16.655893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:16.655893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.655893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.655893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.655893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.765540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:16.777406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1df8986f-8c65-434a-8b8b-51bce3aab358 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.237503 Apr 30 21:23:16.789154 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1689/3280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:16 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:16.826464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:16.826464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:16.826464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.826464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.826464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.826464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.827147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:16.827147 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e8d4e7e3-5933-47f5-b3cf-21e88b044785 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.228251 Apr 30 21:23:16.827147 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1592/3281] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:16 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:16.896585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:16.906086 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2cd248f0-a485-4067-a2ca-fafe379fad45 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1221 microversion: 2.1 time: 0.115489 Apr 30 21:23:16.906936 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1690/3282] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:16 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:16.974699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:16.974699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:16.982015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.982482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:16.983279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:16.983730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:17.216194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:17.225846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:17.229751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:17.231390 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-25e259ef-1936-4811-9287-08a545f393b9 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.262602 Apr 30 21:23:17.232484 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1593/3283] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:16 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:17.800592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:17.800592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:17.817349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:17.818020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:17.820121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:17.820808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:17.837526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:17.838880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:17.851400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:17.853367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:17.855034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:17.856858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:18.103293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:18.109045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:18.116783 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a48a02c2-ec1f-49d8-ae31-be278d4df71e tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1511 microversion: 2.1 time: 0.284439 Apr 30 21:23:18.117824 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-625bc82a-43f9-46de-aacd-ee32ec993752 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.322375 Apr 30 21:23:18.118169 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1594/3284] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:17 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:18.119180 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1691/3285] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:17 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:18.123610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:18.124245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:18.134783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:18.135337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:18.136221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:18.136831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:18.250735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:18.251632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:18.263719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:18.273701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:18.278957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:18.280011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:18.280466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:18.280569 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93489151-5557-4e66-921f-5b3b7b81ddc9 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1269 microversion: 2.1 time: 0.160879 Apr 30 21:23:18.283854 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1595/3286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:18 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:18.453680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:18.464945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:18.466505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:18.475572 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc45d675-0bb8-440f-8702-7c7ed6ff5885 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.228689 Apr 30 21:23:18.487408 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1692/3287] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:18 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:19.136812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:19.138288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:19.140149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:19.141587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:19.150015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.150476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.151470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.151923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.154035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.154679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.155677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.158927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.452672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:19.456779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:19.461424 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3af0fb7-90ba-4ed0-85e1-370687e8cc13 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.329106 Apr 30 21:23:19.471056 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1693/3288] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:19 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:19.471199 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-559f9b0a-ff6a-4e0b-8d3f-4b6111287f9c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1488 microversion: 2.1 time: 0.333991 Apr 30 21:23:19.471199 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1596/3289] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:19 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1488 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:19.471385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:19.471385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:19.472937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.473385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.474765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.475237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.481982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:19.482719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:19.489000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.490744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.491619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.492116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.521814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:23:19.704906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:19.713877 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9349fc0b-be32-4183-b6f7-569a3203bc22 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.250797 Apr 30 21:23:19.722275 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1694/3290] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:19 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:19.722275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:19.722275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:19.727491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.728256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.729060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.729510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.788315 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2c822ba-d047-45fa-b3d5-7453882df7ab tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 204 len: 0 microversion: 2.1 time: 0.309414 Apr 30 21:23:19.792725 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1597/3291] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:19 2022] DELETE /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:23:19.797402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:19.798158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:19.804662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.805120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.815959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:19.815959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:19.997487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:20.008421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:20.010275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:20.011573 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31c6e1bc-9a26-47d9-aa05-0186cebeefa8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.294653 Apr 30 21:23:20.012147 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1695/3292] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:19 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:20.096072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:20.104238 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab63c533-7fb8-4e5b-83fb-6626c587f4d8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1494 microversion: 2.1 time: 0.310741 Apr 30 21:23:20.105296 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1598/3293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:19 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1494 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:20.479181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:20.480592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:20.492686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:20.493412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:20.496280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:20.496865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:20.731398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:20.732625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:20.740447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:20.741130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:20.742006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:20.742454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:21.001562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:21.011320 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff3f57bc-7b4d-4920-93cd-f0533d575e5d tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1525 microversion: 2.1 time: 0.535993 Apr 30 21:23:21.016170 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1696/3294] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:20 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1525 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:21.017327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9b94d955-6301-4e0d-bf25-9c4117fef17f req-689f9833-eee8-4f1a-91b7-b6e30bc0627b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b49131-df20-4dde-9c8f-eba13c1f9a8b", "name": "network-vif-deleted", "tag": "60f58a50-d792-48a6-9c70-5e4356d53e72"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:21.028201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9b94d955-6301-4e0d-bf25-9c4117fef17f req-689f9833-eee8-4f1a-91b7-b6e30bc0627b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:21.028669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9b94d955-6301-4e0d-bf25-9c4117fef17f req-689f9833-eee8-4f1a-91b7-b6e30bc0627b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:21.042094 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9b94d955-6301-4e0d-bf25-9c4117fef17f req-689f9833-eee8-4f1a-91b7-b6e30bc0627b service nova] Creating event network-vif-deleted:60f58a50-d792-48a6-9c70-5e4356d53e72 for instance 40b49131-df20-4dde-9c8f-eba13c1f9a8b on nch1-master-1 Apr 30 21:23:21.047461 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9b94d955-6301-4e0d-bf25-9c4117fef17f req-689f9833-eee8-4f1a-91b7-b6e30bc0627b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034233 Apr 30 21:23:21.048066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1697/3295] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:21.054055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:21.054766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:21.062083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:21.062548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:21.063348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:21.063802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:21.241034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:21.248772 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d62774ad-1f41-4309-a33c-d7c3ef1f9260 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.521195 Apr 30 21:23:21.249284 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1599/3296] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:20 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:21.262117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:21.262752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:21.268659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:21.269114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:21.270119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:21.271269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:21.868640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:21.879531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:21.888420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:21.888420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-178c27db-8bf7-4b9e-bc6c-9d646677c862 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.832678 Apr 30 21:23:21.888420 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1698/3297] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:21 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:21.945951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-288789f6-e0c9-4fdb-b6b1-e5301cddea3a req-b21feb84-04e8-4a3a-a759-1377f329885b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68ea920-b2de-476c-91c8-ffcb2dc8aebc", "tag": "73100fec-86e0-498c-92e3-2401522c8b0f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:21.956323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-288789f6-e0c9-4fdb-b6b1-e5301cddea3a req-b21feb84-04e8-4a3a-a759-1377f329885b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:21.956818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-288789f6-e0c9-4fdb-b6b1-e5301cddea3a req-b21feb84-04e8-4a3a-a759-1377f329885b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:21.969425 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-288789f6-e0c9-4fdb-b6b1-e5301cddea3a req-b21feb84-04e8-4a3a-a759-1377f329885b service nova] Creating event network-changed:73100fec-86e0-498c-92e3-2401522c8b0f for instance f68ea920-b2de-476c-91c8-ffcb2dc8aebc on nch2-master-1 Apr 30 21:23:21.974685 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-288789f6-e0c9-4fdb-b6b1-e5301cddea3a req-b21feb84-04e8-4a3a-a759-1377f329885b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Apr 30 21:23:21.975275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:21.975983 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1699/3298] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:23:21.984886 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12ea2cf4-6975-42ca-8ab7-29b7f2c61b78 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1494 microversion: 2.1 time: 0.734518 Apr 30 21:23:21.985679 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1600/3299] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:21 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1494 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:22.036382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:22.037505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:22.045167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:22.046124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:22.047121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:22.047759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:22.102264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:22.102829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:22.103436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lazy-loading 'fault' on Instance uuid 40b49131-df20-4dde-9c8f-eba13c1f9a8b {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:23:22.197610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f230caf9b44f4c11b91e2f9dcb3a3d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431e5f43c045d78e741327bacf5d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:22.205883 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-456ea6f0-12a1-40ac-8f41-e8dececff126 tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 200 len: 1313 microversion: 2.1 time: 0.175620 Apr 30 21:23:22.206657 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1700/3300] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:22 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:22.266173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:22.266804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:22.277401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:22.281934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:22.283465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:22.284108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:22.537448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:22.544946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-921a0869-3b07-42db-bdf9-6b512ff4df20 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.282688 Apr 30 21:23:22.545528 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1601/3301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:22 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:22.903164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:22.903807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:22.911061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:22.911544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:22.912324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:22.912773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.002443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:23.003063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:23.010190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:23.010669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.011456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:23.011898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.044579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:23.044922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.045372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lazy-loading 'fault' on Instance uuid aea01481-3f35-431b-aa50-2295fd12c5c2 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:23:23.099632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:23.102754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:23.107078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2152fbcf-39d3-49af-b18a-6f4b725aba89 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1304 microversion: 2.1 time: 0.108562 Apr 30 21:23:23.107733 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1602/3302] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:22 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:23.114841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:23.114841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:23.115932 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-12c96161-af60-45a0-8b8c-2c5b517ae9be tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.216685 Apr 30 21:23:23.116789 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1701/3303] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:22 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:23.227684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:23.228315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] [instance: 40b49131-df20-4dde-9c8f-eba13c1f9a8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:23.234338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:23.234785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.235570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:23.236016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.254251 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] HTTP exception thrown: Instance 40b49131-df20-4dde-9c8f-eba13c1f9a8b could not be found. Apr 30 21:23:23.255510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] Returning 404 to user: Instance 40b49131-df20-4dde-9c8f-eba13c1f9a8b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:23.256350 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-09eef4ce-97d3-4806-9f07-b7a18230489a tempest-ServerMetadataNegativeTestJSON-281332971 tempest-ServerMetadataNegativeTestJSON-281332971-project] 10.222.0.23 "GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b" status: 404 len: 111 microversion: 2.1 time: 0.032716 Apr 30 21:23:23.256908 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1603/3304] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:23 2022] GET /compute/v2.1/servers/40b49131-df20-4dde-9c8f-eba13c1f9a8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:23.564059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:23.564879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:23.572420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:23.572882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.573792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:23.574300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:23.719659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:23.727330 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96dbfad9-bc75-418c-b007-26d83438e49e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.167729 Apr 30 21:23:23.727909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1702/3305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:23 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:23.992366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-384c9c30-8271-420f-9d78-0a3afd386cf9 req-846eecf4-364c-4700-9120-f3bbdc6f970e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea01481-3f35-431b-aa50-2295fd12c5c2", "name": "network-vif-deleted", "tag": "cd0808cc-294c-40d5-8a93-da73a96261d2"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:24.004132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-384c9c30-8271-420f-9d78-0a3afd386cf9 req-846eecf4-364c-4700-9120-f3bbdc6f970e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.004132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-384c9c30-8271-420f-9d78-0a3afd386cf9 req-846eecf4-364c-4700-9120-f3bbdc6f970e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.024659 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-384c9c30-8271-420f-9d78-0a3afd386cf9 req-846eecf4-364c-4700-9120-f3bbdc6f970e service nova] Creating event network-vif-deleted:cd0808cc-294c-40d5-8a93-da73a96261d2 for instance aea01481-3f35-431b-aa50-2295fd12c5c2 on nch2-master-1 Apr 30 21:23:24.029656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-384c9c30-8271-420f-9d78-0a3afd386cf9 req-846eecf4-364c-4700-9120-f3bbdc6f970e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041809 Apr 30 21:23:24.030926 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1604/3306] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:24.124556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:24.125241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:24.133391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.134362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.135460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:24.135683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.136220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:24.137172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.143222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.143868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.144667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.145112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.177551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.178055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.178685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lazy-loading 'fault' on Instance uuid aea01481-3f35-431b-aa50-2295fd12c5c2 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:23:24.240337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:24.250024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90e25ebc-1924-4959-baac-aee106bdc678 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 200 len: 1304 microversion: 2.1 time: 0.129286 Apr 30 21:23:24.250819 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1703/3307] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:24 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:24.311702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:24.325374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:24.326912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:24.328077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6fa2da3c-d4ff-4b6f-913e-5911c0820edb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.196968 Apr 30 21:23:24.336694 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1605/3308] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:24 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:24.744288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:24.745287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:24.752243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.752718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.753569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:24.754436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:24.903069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:24.912414 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-efdec894-f2a6-4eac-9556-ba98a121b54b tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.172076 Apr 30 21:23:24.913604 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1704/3309] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:24 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:25.267692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:25.268324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:25.276443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:25.276900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:25.277679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:25.278172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:25.292911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance aea01481-3f35-431b-aa50-2295fd12c5c2 could not be found. Apr 30 21:23:25.293512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance aea01481-3f35-431b-aa50-2295fd12c5c2 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:25.294371 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12b99eb0-36c0-4c6f-bc20-eb1c59ab5062 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 404 len: 111 microversion: 2.1 time: 0.030818 Apr 30 21:23:25.294914 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1606/3310] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:25 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:25.346057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:25.346671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:25.354652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:25.355230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:25.356112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:25.356572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:25.472160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1773116646", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5c8b504b-43e7-4642-bbf0-dab49293fda8"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:25.497900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:25.508387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:25.516821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:25.518322 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d66add94-338c-42c4-a986-47d8ea8e1a48 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.176164 Apr 30 21:23:25.519530 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1705/3311] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:25 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:25.539636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] validate_networks() for [('5c8b504b-43e7-4642-bbf0-dab49293fda8', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:23:25.931733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:25.938450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:25.940430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:25.940900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:25.941961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:25.942459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:26.112642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:23:26.113092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:23:26.114090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:23:26.116400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:23:26.116400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:23:26.127916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:26.128567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:26.129727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:26.130350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:26.145075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:26.150821 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ae679de-6206-4226-9704-a6cc820e711e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.224561 Apr 30 21:23:26.151410 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1706/3312] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:25 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:26.155740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:23:26.164618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Getting quotas for user 2f5eafa970bd4247bdaef1cda747c3fc and project 713c8f2f4e2141f18904b10656eaf37f. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:23:26.168821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-89d03abc-7e1d-485e-9b02-3300c4c21f4c req-4fb0a3a4-2be6-457c-a611-a8657cdfe8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "name": "network-vif-plugged", "status": "completed", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:26.181767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:23:26.184684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:23:26.186629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-89d03abc-7e1d-485e-9b02-3300c4c21f4c req-4fb0a3a4-2be6-457c-a611-a8657cdfe8fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:26.187487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-89d03abc-7e1d-485e-9b02-3300c4c21f4c req-4fb0a3a4-2be6-457c-a611-a8657cdfe8fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:26.202610 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-89d03abc-7e1d-485e-9b02-3300c4c21f4c req-4fb0a3a4-2be6-457c-a611-a8657cdfe8fe service nova] Creating event network-vif-plugged:25241eca-3984-4407-9196-eb00543c2900 for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 on nch1-master-1 Apr 30 21:23:26.207634 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-89d03abc-7e1d-485e-9b02-3300c4c21f4c req-4fb0a3a4-2be6-457c-a611-a8657cdfe8fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048640 Apr 30 21:23:26.209023 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1707/3313] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:23:26.427821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-57b466f9-2670-40a3-bdd5-26c5bd5c6059 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959933 Apr 30 21:23:26.433598 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1607/3314] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:23:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:23:26.449587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67463835-70b7-4737-b9c0-03846d7d88ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:26.450471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-67463835-70b7-4737-b9c0-03846d7d88ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:26.543218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:26.546309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-67463835-70b7-4737-b9c0-03846d7d88ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:26.554988 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67463835-70b7-4737-b9c0-03846d7d88ce tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1215 microversion: 2.1 time: 0.119822 Apr 30 21:23:26.556408 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1708/3315] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:26 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:26.566709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:26.600285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:26.601780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:26.603944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:26.604400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:26.785035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:26.793353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:26.794986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:26.796147 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fab347ea-dcf8-4e26-958d-52e8b73ad62d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.261824 Apr 30 21:23:26.796718 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1608/3316] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:26 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:27.172879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:27.174171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:27.186521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:27.187374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:27.189227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:27.190080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:27.365285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:27.384077 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-29ab5bd3-d411-4df6-9302-52a2c09f1563 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.218416 Apr 30 21:23:27.385432 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1709/3317] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:27 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:27.572606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:27.573480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:27.580905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:27.581528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:27.582355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:27.583437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:27.646772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:27.654287 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6a03e8b9-54e1-4855-ae32-5a1a9dd1d33c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1219 microversion: 2.1 time: 0.085601 Apr 30 21:23:27.664189 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1609/3318] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:27 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:27.815559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:27.816256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:27.823883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:27.824426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:27.825295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:27.825868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:27.991372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:28.001315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:28.003526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:28.006468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ebfddb66-94e4-4730-81cc-65f658582953 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.194873 Apr 30 21:23:28.007290 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1710/3319] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:27 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:28.277257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-578087109", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "10cf88fc-5161-456c-9bb9-10fd173e980a"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:28.330429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] validate_networks() for [('10cf88fc-5161-456c-9bb9-10fd173e980a', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:23:28.400910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:28.401540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:28.407815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:28.408281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:28.409069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:28.409519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:28.643574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:28.654421 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f254b565-f889-4dc0-ab43-26c082296a92 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.257578 Apr 30 21:23:28.655027 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1711/3320] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:28 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:28.671974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:28.672616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:28.682079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:28.682547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:28.683357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:28.683810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:28.865337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:28.876666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:23:28.878124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:23:28.878980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:23:28.880188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:23:28.881095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:23:28.886189 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-708825e4-332e-40a1-be38-12056ed28b04 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1267 microversion: 2.1 time: 0.217067 Apr 30 21:23:28.886963 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1712/3321] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:28 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:28.892118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:28.892910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:28.894023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:28.894700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:28.915732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Getting quotas for project 8e529167b5244152802e4fb30080be96. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:23:28.920822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Getting quotas for user 9a3a68305ff545f4a13f6dd9eb091f7d and project 8e529167b5244152802e4fb30080be96. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:23:28.924833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-63d4ecbc-9962-4b70-8ad7-d0d842093f68 req-7fc0a1ce-f774-49d1-942d-010f141dce7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68ea920-b2de-476c-91c8-ffcb2dc8aebc", "name": "network-vif-plugged", "status": "completed", "tag": "73100fec-86e0-498c-92e3-2401522c8b0f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:28.934098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:23:28.934394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-63d4ecbc-9962-4b70-8ad7-d0d842093f68 req-7fc0a1ce-f774-49d1-942d-010f141dce7d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:28.934890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-63d4ecbc-9962-4b70-8ad7-d0d842093f68 req-7fc0a1ce-f774-49d1-942d-010f141dce7d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:28.936235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:23:28.947663 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-63d4ecbc-9962-4b70-8ad7-d0d842093f68 req-7fc0a1ce-f774-49d1-942d-010f141dce7d service nova] Creating event network-vif-plugged:73100fec-86e0-498c-92e3-2401522c8b0f for instance f68ea920-b2de-476c-91c8-ffcb2dc8aebc on nch2-master-1 Apr 30 21:23:28.953162 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-63d4ecbc-9962-4b70-8ad7-d0d842093f68 req-7fc0a1ce-f774-49d1-942d-010f141dce7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 Apr 30 21:23:28.954197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1713/3322] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:29.032607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:29.033848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:29.045563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:29.046628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:29.048175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:29.049830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:29.059283 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-245970d3-28f6-4793-bdfa-35689dc6866c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895629 Apr 30 21:23:29.063039 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1610/3323] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:23:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:23:29.073332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dea51963-7a08-4000-b052-addb8c427c78 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:29.077420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dea51963-7a08-4000-b052-addb8c427c78 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:29.201550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dea51963-7a08-4000-b052-addb8c427c78 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:29.215531 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dea51963-7a08-4000-b052-addb8c427c78 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1215 microversion: 2.1 time: 0.143712 Apr 30 21:23:29.215531 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1611/3324] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:29 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:29.413163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:29.422303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:29.424105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:29.425318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-82ebbe7d-271e-469e-8007-0f9652157176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.402218 Apr 30 21:23:29.425909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1714/3325] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:29 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:29.673874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:29.674589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:29.682599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:29.683058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:29.689658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:29.689658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:29.874319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:29.902906 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-26967457-088a-45c0-9bed-7ccb001175d3 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1317 microversion: 2.1 time: 0.234576 Apr 30 21:23:29.905273 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1612/3326] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:29 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:29.922209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:29.926432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:29.941463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:29.942042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:29.943074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:29.943529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:30.027099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:30.034918 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e3a3b9ca-5b55-465b-b21b-9cf531a5bef8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1273 microversion: 2.1 time: 0.134613 Apr 30 21:23:30.035687 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1715/3327] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:29 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:30.230829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3baf301d-2a53-45df-b34b-409d48767e7e tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:30.231482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3baf301d-2a53-45df-b34b-409d48767e7e tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:30.307723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3baf301d-2a53-45df-b34b-409d48767e7e tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:30.314307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3baf301d-2a53-45df-b34b-409d48767e7e tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1215 microversion: 2.1 time: 0.087728 Apr 30 21:23:30.330427 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1613/3328] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:30 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:30.445030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:30.446017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:30.457370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:30.457370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:30.457370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:30.457370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:30.737842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:30.747131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:30.748857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:30.750080 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e9f35a5c-b5ad-494a-b73d-62e4148a585e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1806 microversion: 2.20 time: 0.309598 Apr 30 21:23:30.750740 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1716/3329] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:30 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1806 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:30.921443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:30.922188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:30.930507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:30.930968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:30.931832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:30.932277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.054056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:31.054681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:31.062001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.062448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.063380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.063852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.188780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:31.198136 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7ff009e-c5ca-404a-b2dd-997e9d4b7ad7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1507 microversion: 2.1 time: 0.280417 Apr 30 21:23:31.198734 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1614/3330] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:30 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:31.214709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:31.215327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:31.221374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.222213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.223780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.224230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.279877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:31.290008 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6366ec81-fceb-4cb7-ae53-37070cc8d6a8 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1315 microversion: 2.1 time: 0.241103 Apr 30 21:23:31.291003 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1717/3331] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:31 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:31.332027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:31.333233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:31.339496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.339980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.340880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.341197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.424136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:31.432079 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-204cffd8-6326-4c8f-8173-89fcdbe1968a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1267 microversion: 2.1 time: 0.103833 Apr 30 21:23:31.433728 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1718/3332] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:31 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:31.449619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:31.458754 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a867cda2-c05e-4770-96f7-3f7aba709edd tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1507 microversion: 2.1 time: 0.247918 Apr 30 21:23:31.459479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1615/3333] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:31 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:31.475428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c0edf8f-00de-45af-bba9-69c54cb96171 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:31.476652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4c0edf8f-00de-45af-bba9-69c54cb96171 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:31.483234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c0edf8f-00de-45af-bba9-69c54cb96171 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.483687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c0edf8f-00de-45af-bba9-69c54cb96171 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.484468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c0edf8f-00de-45af-bba9-69c54cb96171 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.485076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c0edf8f-00de-45af-bba9-69c54cb96171 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.534661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8df63f52-bb7a-43a2-8a8b-5d3e85ceb71b req-f1dac977-e903-4468-895f-e318efc6934d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea365ed-b6bf-45aa-a641-9910a053bff4", "tag": "a0e222ae-5b71-43e3-93df-41e695206783"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:31.541121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8df63f52-bb7a-43a2-8a8b-5d3e85ceb71b req-f1dac977-e903-4468-895f-e318efc6934d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.541796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8df63f52-bb7a-43a2-8a8b-5d3e85ceb71b req-f1dac977-e903-4468-895f-e318efc6934d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.556219 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8df63f52-bb7a-43a2-8a8b-5d3e85ceb71b req-f1dac977-e903-4468-895f-e318efc6934d service nova] Creating event network-changed:a0e222ae-5b71-43e3-93df-41e695206783 for instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 on nch1-master-1 Apr 30 21:23:31.560991 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8df63f52-bb7a-43a2-8a8b-5d3e85ceb71b req-f1dac977-e903-4468-895f-e318efc6934d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035619 Apr 30 21:23:31.561673 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1616/3334] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:31.715699 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c0edf8f-00de-45af-bba9-69c54cb96171 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "PUT /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1079 microversion: 2.1 time: 0.244849 Apr 30 21:23:31.725473 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1719/3335] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:23:31 2022] PUT /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1079 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:31.731205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:31.732143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:31.739708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.739881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.740893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.741482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.769090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:31.769710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:31.777869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.779102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:31.780008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:31.780561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.434575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:32.439838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:32.444332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:32.445224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:32.446475 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-673453a5-3c6c-4f8c-8dca-7dacc4d91bfa tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1793 microversion: 2.20 time: 0.681430 Apr 30 21:23:32.447102 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1720/3336] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:31 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1793 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:32.450766 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e1f8ccf4-76e6-4633-b166-195abb8c4641 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1505 microversion: 2.1 time: 0.723632 Apr 30 21:23:32.461925 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1617/3337] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:31 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1505 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:32.461925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:32.461925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:32.463635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.464176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.464963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.465410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.478425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:32.479168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:32.496592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.498141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.499265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.499783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.572920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:32.581107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-217121e2-fe74-4448-bd5f-bcdc3955e208 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1273 microversion: 2.1 time: 0.128686 Apr 30 21:23:32.581690 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1618/3338] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:32 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:32.593087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:32.593702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:32.600219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.605914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.605914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.605914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.900260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:32.907787 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5721f60a-9e9a-40aa-9a65-d2f98dec9bf9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1315 microversion: 2.1 time: 0.434443 Apr 30 21:23:32.908362 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1721/3339] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:32 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:32.952749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:32.960876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a04b322a-aff1-45a6-bd5a-7b80d878bc40 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1505 microversion: 2.1 time: 0.378014 Apr 30 21:23:32.961464 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1619/3340] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:32 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:32.977850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a15e225a-b3dc-4496-b6ba-9ba0a2b5a31e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:32.979016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a15e225a-b3dc-4496-b6ba-9ba0a2b5a31e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:32.984890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a15e225a-b3dc-4496-b6ba-9ba0a2b5a31e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.985359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a15e225a-b3dc-4496-b6ba-9ba0a2b5a31e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:32.986160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a15e225a-b3dc-4496-b6ba-9ba0a2b5a31e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:32.991339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a15e225a-b3dc-4496-b6ba-9ba0a2b5a31e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.121645 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a15e225a-b3dc-4496-b6ba-9ba0a2b5a31e tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "PUT /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1081 microversion: 2.1 time: 0.148335 Apr 30 21:23:33.122415 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1722/3341] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:23:32 2022] PUT /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1081 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:33.135937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:33.136587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:33.142590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.143050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.143835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.144288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.344961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:33.352562 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c68d20c-323c-4850-8439-43dbe4e931b4 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1507 microversion: 2.1 time: 0.220504 Apr 30 21:23:33.353138 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1620/3342] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:33 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:33.368425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:33.369042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:33.375069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.375524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.376289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.376728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.598900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:33.599535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:33.605603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.606143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.606931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.607392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.607818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:33.616422 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc2afb99-712a-48a8-921d-979a963709fa tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1507 microversion: 2.1 time: 0.251844 Apr 30 21:23:33.617322 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1723/3343] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:33 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:33.635358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:33.636014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:33.642901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.643361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.644144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.644589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.674760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:23:33.809775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:33.817682 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1dd3860d-eeca-4938-917d-a359f66e0ea3 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.222977 Apr 30 21:23:33.818307 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1621/3344] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:33 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:33.925430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:33.926139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:33.932651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.933198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.934014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.934468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.975168 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bc6752d6-3c2d-4228-9e5e-5dab3ca3cb01 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 204 len: 0 microversion: 2.1 time: 0.344086 Apr 30 21:23:33.975893 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1724/3345] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:33 2022] DELETE /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:23:33.988865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:33.989502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:33.995672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.996128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:33.996913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:33.997357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:34.024540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:23:34.071880 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.compute.api [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Instance is already in deleting state, ignoring this request Apr 30 21:23:34.072625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f699352e-ab4e-4f6c-a1e8-779955c2bf6c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 204 len: 0 microversion: 2.1 time: 0.088191 Apr 30 21:23:34.073377 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1725/3346] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:33 2022] DELETE /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:23:34.080811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:34.081431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:34.088065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:34.088527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:34.089317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:34.089788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:34.122800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:34.131266 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e2cf22de-7a82-42e4-9b97-b196bbe59656 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1315 microversion: 2.1 time: 0.210090 Apr 30 21:23:34.131896 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1622/3347] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:33 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:34.263426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:34.271612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d68f2e1c-e527-4247-9b2d-3341d6607ad5 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1513 microversion: 2.1 time: 0.194431 Apr 30 21:23:34.272179 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1726/3348] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:34 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:34.592320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2af9c1b4-69d5-4add-8674-3e522a164062 req-e698caa5-8f74-4749-b31d-0570de3780fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf3087c-f703-4c0c-a5cd-eee33eb353ac", "tag": "8cd19e61-12c2-4e50-b7c2-20f3747fbe6b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:34.595851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2af9c1b4-69d5-4add-8674-3e522a164062 req-e698caa5-8f74-4749-b31d-0570de3780fd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:34.596387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2af9c1b4-69d5-4add-8674-3e522a164062 req-e698caa5-8f74-4749-b31d-0570de3780fd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:34.607518 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2af9c1b4-69d5-4add-8674-3e522a164062 req-e698caa5-8f74-4749-b31d-0570de3780fd service nova] Creating event network-changed:8cd19e61-12c2-4e50-b7c2-20f3747fbe6b for instance adf3087c-f703-4c0c-a5cd-eee33eb353ac on nch2-master-1 Apr 30 21:23:34.612995 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2af9c1b4-69d5-4add-8674-3e522a164062 req-e698caa5-8f74-4749-b31d-0570de3780fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029278 Apr 30 21:23:34.614124 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1623/3349] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:34.834686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:34.835312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:34.841317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:34.841801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:34.842655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:34.843027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:34.986373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:34.994536 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7a28aebb-258c-436d-b627-57fef1d55e1d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.163846 Apr 30 21:23:34.995117 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1727/3350] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:34 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:35.150195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:35.151054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:35.157368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:35.157961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:35.158816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:35.159324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:35.288558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:35.289223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:35.297033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:35.297565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:35.298642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:35.299088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:35.548117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:35.556977 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b43509ce-6213-433f-ac50-8f7c357a9363 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1315 microversion: 2.1 time: 0.411968 Apr 30 21:23:35.557779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1624/3351] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:35 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:35.624612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:35.634162 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-932ba966-ac24-45f4-8eae-821bc8ed5e4c tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1513 microversion: 2.1 time: 0.349108 Apr 30 21:23:35.634482 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1728/3352] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:35 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1513 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:36.012649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:36.013292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:36.019515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:36.020214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:36.021450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:36.022185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:36.216652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:36.226097 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d51cc9f9-e78d-4eb0-8c38-34e2ef952d58 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.217772 Apr 30 21:23:36.226644 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1625/3353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:36 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:36.574327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:36.574956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:36.582788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:36.583246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:36.584070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:36.584522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:36.627198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-80e1d90a-a1cd-4276-8e23-044c1e44424f req-bbcc2f65-ed20-457b-9a60-12dd2a4e2d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68ea920-b2de-476c-91c8-ffcb2dc8aebc", "name": "network-vif-deleted", "tag": "73100fec-86e0-498c-92e3-2401522c8b0f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:36.635436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-80e1d90a-a1cd-4276-8e23-044c1e44424f req-bbcc2f65-ed20-457b-9a60-12dd2a4e2d8f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:36.635892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-80e1d90a-a1cd-4276-8e23-044c1e44424f req-bbcc2f65-ed20-457b-9a60-12dd2a4e2d8f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:36.648769 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-80e1d90a-a1cd-4276-8e23-044c1e44424f req-bbcc2f65-ed20-457b-9a60-12dd2a4e2d8f service nova] Creating event network-vif-deleted:73100fec-86e0-498c-92e3-2401522c8b0f for instance f68ea920-b2de-476c-91c8-ffcb2dc8aebc on nch2-master-1 Apr 30 21:23:36.653994 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-80e1d90a-a1cd-4276-8e23-044c1e44424f req-bbcc2f65-ed20-457b-9a60-12dd2a4e2d8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 Apr 30 21:23:36.654931 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1626/3354] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:23:36.661112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:36.661852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:36.668260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:36.668724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:36.669512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:36.669989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:36.743746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:36.751340 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-69cd0db2-7735-415d-bf4c-8b6c75e9f7e7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1471 microversion: 2.1 time: 0.095465 Apr 30 21:23:36.751918 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1627/3355] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:36 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1471 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:36.757746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:36.765144 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d50f7ec-5574-4ed4-ae1e-ad131d35757d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1315 microversion: 2.1 time: 0.194766 Apr 30 21:23:36.765700 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1729/3356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:36 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:37.242614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:37.243240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:37.250215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:37.250679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:37.251465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:37.251990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:37.384271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:37.391805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-215b2cd0-38e2-4a39-ad37-9ffdaa33e30c tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.153805 Apr 30 21:23:37.392380 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1628/3357] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:37 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:37.768432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:37.769050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:37.776715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:37.777326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:37.778239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:37.778674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:37.783432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:37.784055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:37.790697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:37.791152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:37.792178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:37.792623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:37.814201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:37.814655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:37.815113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lazy-loading 'fault' on Instance uuid f68ea920-b2de-476c-91c8-ffcb2dc8aebc {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:23:37.883131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c6a51b78b408f85cbacb545f06707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e12f061321b434e92c0f85031c54ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:37.890939 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02a6146b-de7e-4ca7-8a3e-81ea8751d8a7 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 200 len: 1307 microversion: 2.1 time: 0.126500 Apr 30 21:23:37.895435 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1730/3358] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:37 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 1307 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:37.952352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:37.962575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a66fa52b-2045-4016-98b9-982a787a6161 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1315 microversion: 2.1 time: 0.182907 Apr 30 21:23:37.963168 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1629/3359] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:37 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:38.148863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-0cf6046b-d1a7-4610-94b0-f10a33ff2459 req-18946d6f-eb15-465b-ac5c-3176f70ff2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea365ed-b6bf-45aa-a641-9910a053bff4", "name": "network-vif-plugged", "status": "completed", "tag": "a0e222ae-5b71-43e3-93df-41e695206783"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:38.157082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0cf6046b-d1a7-4610-94b0-f10a33ff2459 req-18946d6f-eb15-465b-ac5c-3176f70ff2c8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.157546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0cf6046b-d1a7-4610-94b0-f10a33ff2459 req-18946d6f-eb15-465b-ac5c-3176f70ff2c8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.168395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-0cf6046b-d1a7-4610-94b0-f10a33ff2459 req-18946d6f-eb15-465b-ac5c-3176f70ff2c8 service nova] Creating event network-vif-plugged:a0e222ae-5b71-43e3-93df-41e695206783 for instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 on nch1-master-1 Apr 30 21:23:38.173597 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-0cf6046b-d1a7-4610-94b0-f10a33ff2459 req-18946d6f-eb15-465b-ac5c-3176f70ff2c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028295 Apr 30 21:23:38.174321 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1731/3360] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:38.413980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:38.414647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:38.421565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.422053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.422830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.423526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.564246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:38.572457 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02f7479c-0717-4dd9-ad17-158d26dec433 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.163005 Apr 30 21:23:38.573041 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1630/3361] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:38 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:38.909830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:38.910548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: f68ea920-b2de-476c-91c8-ffcb2dc8aebc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:38.916974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.917411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.918223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.918664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.933091 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] HTTP exception thrown: Instance f68ea920-b2de-476c-91c8-ffcb2dc8aebc could not be found. Apr 30 21:23:38.939776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Returning 404 to user: Instance f68ea920-b2de-476c-91c8-ffcb2dc8aebc could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:38.939776 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-477cb45d-8a58-4ffb-9a88-632071782d00 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc" status: 404 len: 111 microversion: 2.1 time: 0.029846 Apr 30 21:23:38.939776 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1732/3362] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:38 2022] GET /compute/v2.1/servers/f68ea920-b2de-476c-91c8-ffcb2dc8aebc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:38.943895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:38.944411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:38.950507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.950962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.951771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.952214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.967123 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] HTTP exception thrown: Instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 could not be found. Apr 30 21:23:38.967721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Returning 404 to user: Instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:38.968558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fed80a7c-72b9-42fa-9df5-956ceb6187dc tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 404 len: 111 microversion: 2.1 time: 0.029329 Apr 30 21:23:38.969106 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1631/3363] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:38 2022] DELETE /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:38.977367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:38.978075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d140b58d-54d4-4d07-a911-6b4ce98c09d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:38.979382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:38.979991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:38.984320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.984777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.985558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.985815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.986098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.986263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:38.987033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:38.987477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:39.000566 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] HTTP exception thrown: Instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 could not be found. Apr 30 21:23:39.001198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Returning 404 to user: Instance d140b58d-54d4-4d07-a911-6b4ce98c09d3 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:39.002075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd4d00af-d3e8-4711-995c-078951cbc6d1 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3" status: 404 len: 111 microversion: 2.1 time: 0.028648 Apr 30 21:23:39.002632 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1733/3364] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:38 2022] GET /compute/v2.1/servers/d140b58d-54d4-4d07-a911-6b4ce98c09d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:39.011651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:39.012156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:39.018260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:39.018739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:39.019507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:39.020548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:39.037635 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] HTTP exception thrown: Instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 could not be found. Apr 30 21:23:39.038302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Returning 404 to user: Instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:39.039221 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fbaeffb5-db48-41e8-a2d5-98cc79ef5021 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 404 len: 111 microversion: 2.1 time: 0.031495 Apr 30 21:23:39.050780 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1734/3365] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:39 2022] DELETE /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:39.050780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:39.050780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] [instance: d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:39.054491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:39.055401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:39.055724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:39.056346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:39.071014 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] HTTP exception thrown: Instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 could not be found. Apr 30 21:23:39.071758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] Returning 404 to user: Instance d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:39.072707 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d0eaa44-ead4-4b13-83f3-984ce8546313 tempest-ServerDiskConfigTestJSON-156620508 tempest-ServerDiskConfigTestJSON-156620508-project] 10.222.0.23 "GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284" status: 404 len: 111 microversion: 2.1 time: 0.028718 Apr 30 21:23:39.076422 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1735/3366] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:39 2022] GET /compute/v2.1/servers/d5cd1ae9-f07c-4fe0-8c7d-84e3cab56284 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:39.132438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:39.141278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dd49db78-de85-4ec9-8f5d-3f5dd7ef1ea1 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1315 microversion: 2.1 time: 0.165443 Apr 30 21:23:39.151929 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1632/3367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:38 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:39.589074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:39.589811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:39.595831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:39.596354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:39.597195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:39.597702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:39.731838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:39.739766 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7fa61ffc-cfc4-4812-b005-ac168d6037a4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.154712 Apr 30 21:23:39.740341 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1736/3368] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:39 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:40.159668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:40.160329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:40.167041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.167500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.168279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.168726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.339519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:40.346951 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-60ebc2ce-d4a6-4ea5-8f69-a19cd1bb1811 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1502 microversion: 2.1 time: 0.191206 Apr 30 21:23:40.347713 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1633/3369] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:40 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:40.366749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:40.367289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:40.374066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.374527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.375298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.375737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.399755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lazy-loading 'flavor' on Instance uuid 7ea365ed-b6bf-45aa-a641-9910a053bff4 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:23:40.627187 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-13bb7908-58df-459f-a1a1-2ba74aa3d230 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "POST /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4/action" status: 202 len: 0 microversion: 2.1 time: 0.264053 Apr 30 21:23:40.631336 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1737/3370] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:23:40 2022] POST /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:23:40.637871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:40.638498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:40.644431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.646044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.646375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.646825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.756637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:40.757400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:40.764206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.764747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.765750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.766006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.791393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:40.800118 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94f3da9f-52b3-4166-a43d-bd8aae7e8e57 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1510 microversion: 2.1 time: 0.167623 Apr 30 21:23:40.801808 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1634/3371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:40 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:40.852519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a5355d06-e976-445d-8149-4be3bd41532c req-02a50477-3ec1-498e-b38c-7adfe3533f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf3087c-f703-4c0c-a5cd-eee33eb353ac", "name": "network-vif-plugged", "status": "completed", "tag": "8cd19e61-12c2-4e50-b7c2-20f3747fbe6b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:40.861326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a5355d06-e976-445d-8149-4be3bd41532c req-02a50477-3ec1-498e-b38c-7adfe3533f4a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:40.861808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a5355d06-e976-445d-8149-4be3bd41532c req-02a50477-3ec1-498e-b38c-7adfe3533f4a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:40.875691 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a5355d06-e976-445d-8149-4be3bd41532c req-02a50477-3ec1-498e-b38c-7adfe3533f4a service nova] Creating event network-vif-plugged:8cd19e61-12c2-4e50-b7c2-20f3747fbe6b for instance adf3087c-f703-4c0c-a5cd-eee33eb353ac on nch2-master-1 Apr 30 21:23:40.881291 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a5355d06-e976-445d-8149-4be3bd41532c req-02a50477-3ec1-498e-b38c-7adfe3533f4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032723 Apr 30 21:23:40.882118 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1635/3372] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:40.920797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:40.929392 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3815a408-94ba-426d-a6d1-9bfb216067ec tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.177020 Apr 30 21:23:40.930921 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1738/3373] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:40 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:41.798017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7369908a-e355-419b-a92d-16e71b77439a tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Calling method '.version_select at 0x7fdc13eeaca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:41.818234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:41.818900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:41.825704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:41.826201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:41.826990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:41.827438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:41.852511 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7369908a-e355-419b-a92d-16e71b77439a tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.164488 Apr 30 21:23:41.853096 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1636/3374] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:23:41 2022] GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea/defaults => generated 371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:41.863356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-708453c8-9883-4eb2-aa10-4f29980cd081 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Calling method '.version_select at 0x7fdc13eea550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:41.932524 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-708453c8-9883-4eb2-aa10-4f29980cd081 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea" status: 200 len: 371 microversion: 2.1 time: 0.071660 Apr 30 21:23:41.933084 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1637/3375] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:23:41 2022] GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:23:41.948636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b24d471-393d-43ec-a4eb-051af0ab7322 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Calling method '.version_select at 0x7fdc13f103a0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:42.011380 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b24d471-393d-43ec-a4eb-051af0ab7322 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.066016 Apr 30 21:23:42.017935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1638/3376] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:23:41 2022] GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea/defaults => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:42.017935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:42.018209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:42.025630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:42.026112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:42.026900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:42.027341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:42.327871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:42.332714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:42.336147 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f5c4e658-0ed7-482f-b652-9611e6ae58d4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1493 microversion: 2.1 time: 0.521744 Apr 30 21:23:42.336727 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1739/3377] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:41 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1493 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:42.341256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ed5abde-2376-48f8-8b20-1cadeeb404d5 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Calling method '.version_select at 0x7fdc261fba60>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:42.341670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4d741bd4-aceb-4174-aec0-4218868bb61d tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1315 microversion: 2.1 time: 0.328324 Apr 30 21:23:42.342355 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1639/3378] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:42 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:42.353244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:42.353772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:42.360140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:42.360606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:42.361394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:42.361869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:42.387701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:23:42.412676 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ed5abde-2376-48f8-8b20-1cadeeb404d5 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea" status: 200 len: 371 microversion: 2.1 time: 0.074842 Apr 30 21:23:42.413560 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1740/3379] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:23:42 2022] GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:42.425074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-924b69ff-2661-4d90-b88b-40a55555ef98 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Calling method '.version_select at 0x7fdc204cbaf0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:42.494757 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-924b69ff-2661-4d90-b88b-40a55555ef98 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea?user_id=f1377a9a42b344329e636b7a471ea89c" status: 200 len: 371 microversion: 2.1 time: 0.073779 Apr 30 21:23:42.495271 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1741/3380] 10.222.0.23 () {58 vars in 1322 bytes} [Sat Apr 30 21:23:42 2022] GET /compute/v2.1/os-quota-sets/f310fd5a6bdd4e1ebf08bfbc064975ea?user_id=f1377a9a42b344329e636b7a471ea89c => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:23:42.756601 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-295381e4-bb03-4944-b3dc-f63501b43137 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 204 len: 0 microversion: 2.1 time: 0.406743 Apr 30 21:23:42.757126 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1640/3381] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:42 2022] DELETE /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:23:42.765489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:42.766180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:42.772854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:42.773307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:42.774103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:42.774542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:42.916540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:42.925612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-590bbc76-edbb-46d7-9312-e159986406e6 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1499 microversion: 2.1 time: 0.164174 Apr 30 21:23:42.929749 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1742/3382] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:42 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:43.359899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:43.360660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:43.367148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.367610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.368389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.368827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.505170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:43.513127 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a6b3e681-c43f-4001-b589-386b97d5ba18 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1502 microversion: 2.1 time: 0.157583 Apr 30 21:23:43.513781 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1641/3383] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:43 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:43.530392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d5b5cf20-7b6b-41a5-a4a2-e09e0648a221 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:43.530834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d5b5cf20-7b6b-41a5-a4a2-e09e0648a221 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:43.537791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf20-7b6b-41a5-a4a2-e09e0648a221 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.541913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf20-7b6b-41a5-a4a2-e09e0648a221 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.541913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf20-7b6b-41a5-a4a2-e09e0648a221 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.541913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf20-7b6b-41a5-a4a2-e09e0648a221 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.736993 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d5b5cf20-7b6b-41a5-a4a2-e09e0648a221 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "DELETE /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.210580 Apr 30 21:23:43.737623 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1743/3384] 10.222.0.23 () {58 vars in 1295 bytes} [Sat Apr 30 21:23:43 2022] DELETE /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac/os-server-password => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:43.746817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34ce9de7-8b62-409e-bae3-049d8b1532d4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:43.747340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-34ce9de7-8b62-409e-bae3-049d8b1532d4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:43.753776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34ce9de7-8b62-409e-bae3-049d8b1532d4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.754893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34ce9de7-8b62-409e-bae3-049d8b1532d4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.755699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34ce9de7-8b62-409e-bae3-049d8b1532d4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.756141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34ce9de7-8b62-409e-bae3-049d8b1532d4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.779912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-34ce9de7-8b62-409e-bae3-049d8b1532d4 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.037094 Apr 30 21:23:43.780535 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1642/3385] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:23:43 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac/os-server-password => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:23:43.790297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:43.790800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:43.797443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.798038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.799179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.799683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.828802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:23:43.944040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:43.944663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:43.952404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.952873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:43.953666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:43.954141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:44.065446 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-07a02c79-f89c-4d78-83c3-72f9c65bd280 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "DELETE /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 204 len: 0 microversion: 2.1 time: 0.278716 Apr 30 21:23:44.068990 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1744/3386] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:43 2022] DELETE /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:44.075119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:44.075827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:44.081913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:44.082394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:44.083170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:44.083609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:44.100242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:44.108538 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fca1e83e-01de-414a-b7a6-e1ca1608c37a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1499 microversion: 2.1 time: 0.168824 Apr 30 21:23:44.109166 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1643/3387] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:43 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:44.223419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:44.230907 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b3ca12c4-7df3-4bf8-a04e-b7f61108aeb9 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1508 microversion: 2.1 time: 0.159923 Apr 30 21:23:44.231477 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1745/3388] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:44 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:44.965311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b6d30e85-b0b8-4133-a420-832dd9be97ac req-0d925d5d-e997-4561-8f62-4280705c78ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea365ed-b6bf-45aa-a641-9910a053bff4", "name": "network-vif-deleted", "tag": "a0e222ae-5b71-43e3-93df-41e695206783"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:44.974958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b6d30e85-b0b8-4133-a420-832dd9be97ac req-0d925d5d-e997-4561-8f62-4280705c78ec service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:44.975411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b6d30e85-b0b8-4133-a420-832dd9be97ac req-0d925d5d-e997-4561-8f62-4280705c78ec service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:44.986682 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b6d30e85-b0b8-4133-a420-832dd9be97ac req-0d925d5d-e997-4561-8f62-4280705c78ec service nova] Creating event network-vif-deleted:a0e222ae-5b71-43e3-93df-41e695206783 for instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 on nch1-master-1 Apr 30 21:23:44.992066 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b6d30e85-b0b8-4133-a420-832dd9be97ac req-0d925d5d-e997-4561-8f62-4280705c78ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030386 Apr 30 21:23:44.992738 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1644/3389] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:45.126922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:45.127463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:45.135811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:45.136324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:45.137142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:45.138092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:45.213368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5eafa970bd4247bdaef1cda747c3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713c8f2f4e2141f18904b10656eaf37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:45.221509 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3e9c28eb-8d3e-40b2-8fe1-4a2a75c7bc7d tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 200 len: 1291 microversion: 2.1 time: 0.099119 Apr 30 21:23:45.222111 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1746/3390] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:45 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 1291 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:45.249121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:45.249853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:45.256259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:45.256722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:45.257532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:45.258315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:45.479924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:45.488469 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4443a254-1df9-4081-86a6-175243838bfe tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1508 microversion: 2.1 time: 0.243765 Apr 30 21:23:45.489194 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1645/3391] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:45 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:46.239544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.240190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.247410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.247874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.248662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.249129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.264322 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 could not be found. Apr 30 21:23:46.264916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.265744 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0262099f-9d14-4c3e-a52a-a4c3ec9ee165 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 404 len: 111 microversion: 2.1 time: 0.030121 Apr 30 21:23:46.266300 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1747/3392] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:46 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.276910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.277413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.284407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.284871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.286280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.286739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.302684 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 could not be found. Apr 30 21:23:46.303286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.304119 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e97c0898-8eb5-4a42-9b32-dd9954313ba5 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 404 len: 111 microversion: 2.1 time: 0.031193 Apr 30 21:23:46.304652 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1646/3393] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:46 2022] DELETE /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.312768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.313391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 7ea365ed-b6bf-45aa-a641-9910a053bff4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.319338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.319838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.320605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.321159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.335260 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 could not be found. Apr 30 21:23:46.335849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 7ea365ed-b6bf-45aa-a641-9910a053bff4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.336672 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-717bda98-7ff8-454b-95e7-f49acf9a5864 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4" status: 404 len: 111 microversion: 2.1 time: 0.027898 Apr 30 21:23:46.337197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1748/3394] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:46 2022] GET /compute/v2.1/servers/7ea365ed-b6bf-45aa-a641-9910a053bff4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.345178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.345689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.352662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.353116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.353930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.354430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.368296 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance aea01481-3f35-431b-aa50-2295fd12c5c2 could not be found. Apr 30 21:23:46.368947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance aea01481-3f35-431b-aa50-2295fd12c5c2 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.369781 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8bd12847-d96a-469c-9919-70ed0a17d298 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 404 len: 111 microversion: 2.1 time: 0.028530 Apr 30 21:23:46.370282 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1647/3395] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:46 2022] DELETE /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.378770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.379386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: aea01481-3f35-431b-aa50-2295fd12c5c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.385518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.388840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.388840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.388840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.401213 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance aea01481-3f35-431b-aa50-2295fd12c5c2 could not be found. Apr 30 21:23:46.401826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance aea01481-3f35-431b-aa50-2295fd12c5c2 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.402648 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4d8e9cb4-e5e0-4ec1-b58e-6feec1e63500 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2" status: 404 len: 111 microversion: 2.1 time: 0.027857 Apr 30 21:23:46.403177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1749/3396] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:46 2022] GET /compute/v2.1/servers/aea01481-3f35-431b-aa50-2295fd12c5c2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.411909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.412420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.418320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.418782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.419566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.420013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.434028 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 3443c916-dda1-43d3-b094-442c866c9184 could not be found. Apr 30 21:23:46.434621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 3443c916-dda1-43d3-b094-442c866c9184 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.440558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0aad9a34-a2b2-4c42-b747-c601909a22d3 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 404 len: 111 microversion: 2.1 time: 0.028106 Apr 30 21:23:46.440558 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1648/3397] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:46 2022] DELETE /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.445051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.445706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 3443c916-dda1-43d3-b094-442c866c9184] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.452020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.452484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.453273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.453720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.468177 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 3443c916-dda1-43d3-b094-442c866c9184 could not be found. Apr 30 21:23:46.468804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 3443c916-dda1-43d3-b094-442c866c9184 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.469637 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8da9ef32-068c-45e0-9c21-1733142d7510 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184" status: 404 len: 111 microversion: 2.1 time: 0.029801 Apr 30 21:23:46.470214 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1750/3398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:46 2022] GET /compute/v2.1/servers/3443c916-dda1-43d3-b094-442c866c9184 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.478269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.478885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.485861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.486091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.486913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.487358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.502087 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 535d878c-5289-4a05-abdb-c65a639e113d could not be found. Apr 30 21:23:46.502605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 535d878c-5289-4a05-abdb-c65a639e113d could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.503493 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5bdf89c6-5762-4eba-8d38-e5fe2e49abc9 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 404 len: 111 microversion: 2.1 time: 0.029224 Apr 30 21:23:46.504772 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1649/3399] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:46 2022] DELETE /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:46.507307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.507999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.512693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.513389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 535d878c-5289-4a05-abdb-c65a639e113d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.514320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.514936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.516194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.516305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.519321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.520342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.521123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.521568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.537410 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 535d878c-5289-4a05-abdb-c65a639e113d could not be found. Apr 30 21:23:46.538043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 535d878c-5289-4a05-abdb-c65a639e113d could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.538937 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-07845729-41ba-4159-a383-48e1fa6297db tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d" status: 404 len: 111 microversion: 2.1 time: 0.030310 Apr 30 21:23:46.539491 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1650/3400] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:46 2022] GET /compute/v2.1/servers/535d878c-5289-4a05-abdb-c65a639e113d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:23:46.547210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.547783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.550609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.551071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.551531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lazy-loading 'fault' on Instance uuid adf3087c-f703-4c0c-a5cd-eee33eb353ac {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:23:46.553988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.554362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.555138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.555584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.569046 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 could not be found. Apr 30 21:23:46.569643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.570497 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-acaffaa6-cb60-4001-bc08-45fd063b49c0 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5" status: 404 len: 111 microversion: 2.1 time: 0.026963 Apr 30 21:23:46.574400 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1651/3401] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:46 2022] DELETE /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:23:46.579126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:46.579747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:46.586245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.586699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.591787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:46.591787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:46.593689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3a68305ff545f4a13f6dd9eb091f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e529167b5244152802e4fb30080be96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:46.601701 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fb3b5de0-cc71-4c0c-9bd8-f5c855622251 tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 200 len: 1305 microversion: 2.1 time: 0.099320 Apr 30 21:23:46.602294 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1751/3402] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:46 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:46.602427 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 could not be found. Apr 30 21:23:46.603023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:46.603850 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8f58712a-8118-4346-87ea-95f69431c52b tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5" status: 404 len: 111 microversion: 2.1 time: 0.028527 Apr 30 21:23:46.604388 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1652/3403] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:46 2022] GET /compute/v2.1/servers/0cfebf72-b8c0-4538-9ba8-5098a8bfd6a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:23:47.006859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-dde52bbf-fdec-40a7-aaa3-edcba8e3e3e5 req-dcd29dfe-30fa-448a-a6e1-61dc73cf575a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf3087c-f703-4c0c-a5cd-eee33eb353ac", "name": "network-vif-deleted", "tag": "8cd19e61-12c2-4e50-b7c2-20f3747fbe6b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:47.015174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dde52bbf-fdec-40a7-aaa3-edcba8e3e3e5 req-dcd29dfe-30fa-448a-a6e1-61dc73cf575a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:47.015669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dde52bbf-fdec-40a7-aaa3-edcba8e3e3e5 req-dcd29dfe-30fa-448a-a6e1-61dc73cf575a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:47.026404 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-dde52bbf-fdec-40a7-aaa3-edcba8e3e3e5 req-dcd29dfe-30fa-448a-a6e1-61dc73cf575a service nova] Creating event network-vif-deleted:8cd19e61-12c2-4e50-b7c2-20f3747fbe6b for instance adf3087c-f703-4c0c-a5cd-eee33eb353ac on nch2-master-1 Apr 30 21:23:47.031264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-dde52bbf-fdec-40a7-aaa3-edcba8e3e3e5 req-dcd29dfe-30fa-448a-a6e1-61dc73cf575a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028346 Apr 30 21:23:47.031841 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1752/3404] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:47.587165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8fa9a493-395e-4efe-bfc7-9d283676962e tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13ef4820>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:47.625928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:47.626635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] [instance: adf3087c-f703-4c0c-a5cd-eee33eb353ac] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:47.633462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:47.633948 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8fa9a493-395e-4efe-bfc7-9d283676962e tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76" status: 200 len: 344 microversion: 2.1 time: 0.050573 Apr 30 21:23:47.634092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:47.634514 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1653/3405] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:23:47 2022] GET /compute/v2.1/os-volumes/4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:47.634775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:47.635346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:47.650366 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] HTTP exception thrown: Instance adf3087c-f703-4c0c-a5cd-eee33eb353ac could not be found. Apr 30 21:23:47.651045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] Returning 404 to user: Instance adf3087c-f703-4c0c-a5cd-eee33eb353ac could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:47.651880 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19ceade4-29fa-40a0-9db0-db28f23dff0a tempest-ServerPasswordTestJSON-1397838956 tempest-ServerPasswordTestJSON-1397838956-project] 10.222.0.23 "GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac" status: 404 len: 111 microversion: 2.1 time: 0.031422 Apr 30 21:23:47.652425 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1753/3406] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:47 2022] GET /compute/v2.1/servers/adf3087c-f703-4c0c-a5cd-eee33eb353ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:23:50.606054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8951dd1d-35ce-41be-8cf7-c5288d057c0e tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13eeaaf0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:50.675072 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8951dd1d-35ce-41be-8cf7-c5288d057c0e tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2" status: 200 len: 344 microversion: 2.1 time: 0.073782 Apr 30 21:23:50.675703 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1654/3407] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:23:50 2022] GET /compute/v2.1/os-volumes/6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:51.685881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-982795397", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "df6d16cb-5552-4b55-bc98-90dda2709a95"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:51.742186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] validate_networks() for [('df6d16cb-5552-4b55-bc98-90dda2709a95', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:23:52.090085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:23:52.090522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:23:52.091086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:23:52.091510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:23:52.092061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:23:52.101611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:52.102032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:52.102941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:52.103303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:52.120719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Getting quotas for project bfe1b39ed5644c20ac54608a6f25e0bf. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:23:52.125996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Getting quotas for user f2be8a8f7a034cddb01078690b5bd364 and project bfe1b39ed5644c20ac54608a6f25e0bf. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:23:52.138293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:23:52.140570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:23:52.301567 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-48307cc6-ccc2-4a64-87da-4aed2db410b7 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.732388 Apr 30 21:23:52.302250 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1754/3408] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:23:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:23:52.313272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9105aaf2-58d8-4e5f-8c4b-ae6317216b0c tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:52.314468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9105aaf2-58d8-4e5f-8c4b-ae6317216b0c tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:52.375657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9105aaf2-58d8-4e5f-8c4b-ae6317216b0c tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:52.383164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9105aaf2-58d8-4e5f-8c4b-ae6317216b0c tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:52.384727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9105aaf2-58d8-4e5f-8c4b-ae6317216b0c tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:52.385930 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9105aaf2-58d8-4e5f-8c4b-ae6317216b0c tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1261 microversion: 2.26 time: 0.077633 Apr 30 21:23:52.386479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1655/3409] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:52 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:53.405627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9805365d-b0a6-45aa-8714-bc3d6ce57674 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:53.407016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9805365d-b0a6-45aa-8714-bc3d6ce57674 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:53.432379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e80654c6-d065-4608-b876-b280c9067b57 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13eeaca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:53.462065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9805365d-b0a6-45aa-8714-bc3d6ce57674 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:53.469169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9805365d-b0a6-45aa-8714-bc3d6ce57674 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:53.470705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9805365d-b0a6-45aa-8714-bc3d6ce57674 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:53.474572 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9805365d-b0a6-45aa-8714-bc3d6ce57674 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1261 microversion: 2.26 time: 0.071201 Apr 30 21:23:53.474572 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1755/3410] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1261 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:23:53.485289 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e80654c6-d065-4608-b876-b280c9067b57 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/c3b6d437-2ca0-4de7-a114-53af39c8ccd3" status: 200 len: 344 microversion: 2.1 time: 0.056568 Apr 30 21:23:53.485884 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1656/3411] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/os-volumes/c3b6d437-2ca0-4de7-a114-53af39c8ccd3 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:23:53.497600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70d41419-f633-417d-94cd-bfcdbb5b23e5 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13d7d790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:53.582580 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70d41419-f633-417d-94cd-bfcdbb5b23e5 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.088581 Apr 30 21:23:53.588190 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1756/3412] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:53.595535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ba9518d0-f46e-4d73-b141-f4aaacfac249 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13ec9af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:53.680309 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ba9518d0-f46e-4d73-b141-f4aaacfac249 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.088649 Apr 30 21:23:53.680966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1657/3413] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 681 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:53.693095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b1b33cf-9e38-4a64-aaa4-5f768e55b349 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc204cbaf0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:53.777922 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3b1b33cf-9e38-4a64-aaa4-5f768e55b349 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.087273 Apr 30 21:23:53.777922 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1757/3414] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:53.787852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-be092000-7b2d-4d69-bff5-9f321315bd4a tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13f36790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:53.870293 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-be092000-7b2d-4d69-bff5-9f321315bd4a tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.086115 Apr 30 21:23:53.870876 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1658/3415] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:53.886882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f3b048a-9727-47ae-b42f-3cad59faeb98 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc26226310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:53.976727 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f3b048a-9727-47ae-b42f-3cad59faeb98 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.095251 Apr 30 21:23:53.977314 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1758/3416] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 681 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:53.989662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1496bc4f-8afc-4519-b593-a2d9c4ffe436 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13f6f9d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:54.069910 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1496bc4f-8afc-4519-b593-a2d9c4ffe436 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.084379 Apr 30 21:23:54.070493 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1659/3417] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:23:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:54.082428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea284c3a-3a50-431b-9613-6ecdeb76e9b0 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc26226ee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:54.163803 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea284c3a-3a50-431b-9613-6ecdeb76e9b0 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.085716 Apr 30 21:23:54.164432 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1759/3418] 10.222.0.23 () {58 vars in 1187 bytes} [Sat Apr 30 21:23:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:54.178721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b5066877-ea14-400b-b423-f2a34747d120 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] Calling method '.version_select at 0x7fdc13edbd30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:54.282782 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b5066877-ea14-400b-b423-f2a34747d120 tempest-VolumesTestJSON-905126376 tempest-VolumesTestJSON-905126376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.108443 Apr 30 21:23:54.283599 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1660/3419] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:23:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:54.492133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:54.492759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:54.500678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:54.501144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:54.501976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:54.502468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:54.572001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:54.580974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:54.582621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:54.583741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e2cc201-0793-4d8e-9e7f-0b1370531aaf tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1313 microversion: 2.26 time: 0.097171 Apr 30 21:23:54.584302 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1760/3420] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:54 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1313 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:55.608177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:55.608177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:55.616919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:55.617440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:55.618321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:55.618769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:55.876731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:55.906669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:55.909159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:55.911002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d7e2539d-4e26-4e91-a322-e7aae043651d tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1361 microversion: 2.26 time: 0.307615 Apr 30 21:23:55.914234 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1661/3421] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:55 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:56.297279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:56.298156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:56.305781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.306326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.307109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.307553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.321825 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. Apr 30 21:23:56.322427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:56.323292 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35b9e605-732d-4a56-8fd7-39f01292692c tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 404 len: 111 microversion: 2.1 time: 0.030034 Apr 30 21:23:56.323829 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1761/3422] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:56 2022] DELETE /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:56.331937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:56.332671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 91a99313-2234-43cf-92e0-80ad0262a063] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:56.338720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.339251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.340098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.340621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.355195 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. Apr 30 21:23:56.355798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 91a99313-2234-43cf-92e0-80ad0262a063 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:56.356628 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fe29d5b7-283a-48c8-8f67-3a603449481a tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063" status: 404 len: 111 microversion: 2.1 time: 0.028725 Apr 30 21:23:56.357960 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1662/3423] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:56 2022] GET /compute/v2.1/servers/91a99313-2234-43cf-92e0-80ad0262a063 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:56.366354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:56.366858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:56.372965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.375083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.375083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.377515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.394480 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 12defef4-f959-4394-a3e1-14296a084329 could not be found. Apr 30 21:23:56.395103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 12defef4-f959-4394-a3e1-14296a084329 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:56.395952 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-409d1d39-6fc9-4be3-97d6-215b3eeef684 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 404 len: 111 microversion: 2.1 time: 0.034154 Apr 30 21:23:56.396519 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1762/3424] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:23:56 2022] DELETE /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:56.403592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0bef0640-908b-47f7-aabd-2b091c857124 req-9f024cd7-1af9-4ffe-9b4d-b4239dcfaaaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b4eece-01bc-4235-bec9-19ce66fb8765", "tag": "f59ac01b-d3e8-48d7-8da6-56f2417e58e1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:23:56.405489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:56.406139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] [instance: 12defef4-f959-4394-a3e1-14296a084329] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:56.412590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0bef0640-908b-47f7-aabd-2b091c857124 req-9f024cd7-1af9-4ffe-9b4d-b4239dcfaaaa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.412946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.413059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0bef0640-908b-47f7-aabd-2b091c857124 req-9f024cd7-1af9-4ffe-9b4d-b4239dcfaaaa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.413406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.414243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.414691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.426415 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0bef0640-908b-47f7-aabd-2b091c857124 req-9f024cd7-1af9-4ffe-9b4d-b4239dcfaaaa service nova] Creating event network-changed:f59ac01b-d3e8-48d7-8da6-56f2417e58e1 for instance 72b4eece-01bc-4235-bec9-19ce66fb8765 on nch2-master-1 Apr 30 21:23:56.429717 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] HTTP exception thrown: Instance 12defef4-f959-4394-a3e1-14296a084329 could not be found. Apr 30 21:23:56.430433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] Returning 404 to user: Instance 12defef4-f959-4394-a3e1-14296a084329 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:23:56.431617 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ca0a1dc-e0d6-47d6-8aea-f38eb54a3fc4 tempest-DeleteServersTestJSON-557044403 tempest-DeleteServersTestJSON-557044403-project] 10.222.0.23 "GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329" status: 404 len: 111 microversion: 2.1 time: 0.029689 Apr 30 21:23:56.431877 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1763/3425] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:23:56 2022] GET /compute/v2.1/servers/12defef4-f959-4394-a3e1-14296a084329 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:56.433108 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0bef0640-908b-47f7-aabd-2b091c857124 req-9f024cd7-1af9-4ffe-9b4d-b4239dcfaaaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034708 Apr 30 21:23:56.433696 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1663/3426] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:23:56.932272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:56.933322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:56.940243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.941485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:56.943382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:56.943847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:57.187656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:57.197051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:57.198610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:57.199986 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f150dc2e-3b12-4bf5-96fb-31f2782dde85 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1361 microversion: 2.26 time: 0.272368 Apr 30 21:23:57.201026 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1764/3427] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:56 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:58.220076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:58.220768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:58.230770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:58.231511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:58.232530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:58.233235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:58.378007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:58.387289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:58.388909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:58.390093 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab0a78f2-888a-4a08-85d2-1fa7c0e16e0e tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1361 microversion: 2.26 time: 0.175161 Apr 30 21:23:58.390645 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1664/3428] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:58 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:23:59.408612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:23:59.409227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:23:59.416622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:59.417080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:59.417920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:23:59.425389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:23:59.615450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:59.626088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:59.627633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:23:59.628976 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f67752f-8a41-4396-bab1-d6993e3bf8da tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1361 microversion: 2.26 time: 0.224416 Apr 30 21:23:59.629533 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1765/3429] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:23:59 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:00.652627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:00.659354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:00.684275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:00.684899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:00.687517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:00.689741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:01.319716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:01.332813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:01.343406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:01.344892 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e84fab36-f482-4837-a926-900f0e530ef8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1361 microversion: 2.26 time: 0.701656 Apr 30 21:24:01.345720 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1665/3430] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:00 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1361 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:02.364985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:02.366751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:02.375106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:02.375613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:02.376425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:02.377052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:02.600124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:02.609652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:02.611353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:02.613195 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0744b08f-9621-4584-990e-12f2d4c3cdb1 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1361 microversion: 2.26 time: 0.252073 Apr 30 21:24:02.613796 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1766/3431] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:02 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:03.076531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9f61a288-e719-429d-a942-5db3a8c7052b req-adb89da4-89c4-4247-843e-7e1b1281e937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b4eece-01bc-4235-bec9-19ce66fb8765", "name": "network-vif-plugged", "status": "completed", "tag": "f59ac01b-d3e8-48d7-8da6-56f2417e58e1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:03.094104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9f61a288-e719-429d-a942-5db3a8c7052b req-adb89da4-89c4-4247-843e-7e1b1281e937 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:03.094559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9f61a288-e719-429d-a942-5db3a8c7052b req-adb89da4-89c4-4247-843e-7e1b1281e937 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:03.117447 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9f61a288-e719-429d-a942-5db3a8c7052b req-adb89da4-89c4-4247-843e-7e1b1281e937 service nova] Creating event network-vif-plugged:f59ac01b-d3e8-48d7-8da6-56f2417e58e1 for instance 72b4eece-01bc-4235-bec9-19ce66fb8765 on nch2-master-1 Apr 30 21:24:03.129107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9f61a288-e719-429d-a942-5db3a8c7052b req-adb89da4-89c4-4247-843e-7e1b1281e937 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056116 Apr 30 21:24:03.129721 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1666/3432] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:03.632157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:03.632865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:03.649349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:03.649848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:03.653482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:03.653482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:03.816398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:03.826430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:03.828323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:03.829659 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac686558-41e8-4bc5-b288-c8128d0cad4a tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1361 microversion: 2.26 time: 0.202062 Apr 30 21:24:03.830345 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1767/3433] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:03 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:04.851365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:04.852197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:04.868768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:04.869619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:04.871310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:04.872005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.091938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:05.101974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:05.103502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:05.104802 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0bf21955-9fca-4eed-a0b2-3a7b0cca2b56 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1546 microversion: 2.26 time: 0.258762 Apr 30 21:24:05.105489 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1667/3434] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:04 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1546 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:05.131872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc262fcf70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:05.149646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.150206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.150715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:05.157202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.157667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.158536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.158981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.197808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.198521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.226493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.226956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.350725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:05.378393 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d518e1be-99a8-42c4-bb22-ee2368f18428 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-2125023373" status: 201 len: 0 microversion: 2.26 time: 0.252763 Apr 30 21:24:05.379091 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1768/3435] 10.222.0.23 () {62 vars in 1379 bytes} [Sat Apr 30 21:24:05 2022] PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-2125023373 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 30 21:24:05.390705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de301c9d-9a43-4b15-a2c7-262bd340ac92 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13e8e430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:05.414540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de301c9d-9a43-4b15-a2c7-262bd340ac92 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.417035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de301c9d-9a43-4b15-a2c7-262bd340ac92 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.464371 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de301c9d-9a43-4b15-a2c7-262bd340ac92 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-2125023373" status: 204 len: 0 microversion: 2.26 time: 0.079698 Apr 30 21:24:05.465030 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1668/3436] 10.222.0.23 () {60 vars in 1360 bytes} [Sat Apr 30 21:24:05 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-2125023373 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:05.477050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13e8e790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:05.500351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.500827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.501328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:05.513947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.514414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.517600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.518116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.549593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.550850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.616463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe7854e2-9eca-417f-8af3-afa24085818c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'create', calling method: .version_select at 0x7fdc262fcca0>, body: {"keypair": {"name": "tempest-keypair-1909017049"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:05.632598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-fe7854e2-9eca-417f-8af3-afa24085818c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for project 3364787934af4f59b17a58b380fe95da. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:05.638475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-fe7854e2-9eca-417f-8af3-afa24085818c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for user 20b4082fa07249e2b6dfb9b4506ab398 and project 3364787934af4f59b17a58b380fe95da. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:05.645739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:05.668945 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11c1faf9-1f8b-4e17-ab1b-4bfe21211726 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 204 len: 0 microversion: 2.26 time: 0.199263 Apr 30 21:24:05.669877 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1669/3437] 10.222.0.23 () {60 vars in 1294 bytes} [Sat Apr 30 21:24:05 2022] DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:05.682375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fbbb343a-4aa6-4eb6-a00e-5fdb21941113 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13ef4940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:05.691353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fbbb343a-4aa6-4eb6-a00e-5fdb21941113 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.692018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fbbb343a-4aa6-4eb6-a00e-5fdb21941113 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.704361 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fbbb343a-4aa6-4eb6-a00e-5fdb21941113 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 200 len: 12 microversion: 2.26 time: 0.026151 Apr 30 21:24:05.705169 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1670/3438] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:24:05 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:05.715187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13e93ee0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:05.724490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.725225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.726092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:05.739580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.740306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.741263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.742056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.775478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.776500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.787943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.788405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.887540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:05.905950 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d7754141-b3fd-4efa-8d04-d4a4635ddb23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-1166126915" status: 201 len: 0 microversion: 2.26 time: 0.194816 Apr 30 21:24:05.912241 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1671/3439] 10.222.0.23 () {62 vars in 1379 bytes} [Sat Apr 30 21:24:05 2022] PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-1166126915 => generated 0 bytes in 202 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 30 21:24:05.922344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e4b600c-0924-4b4b-9c12-5f6e61cf2f7a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:05.923534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9e4b600c-0924-4b4b-9c12-5f6e61cf2f7a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:05.926574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-fe7854e2-9eca-417f-8af3-afa24085818c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for project 3364787934af4f59b17a58b380fe95da. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:05.931694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e4b600c-0924-4b4b-9c12-5f6e61cf2f7a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.935034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e4b600c-0924-4b4b-9c12-5f6e61cf2f7a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.935034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e4b600c-0924-4b4b-9c12-5f6e61cf2f7a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.935034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e4b600c-0924-4b4b-9c12-5f6e61cf2f7a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:05.953666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-fe7854e2-9eca-417f-8af3-afa24085818c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for user 20b4082fa07249e2b6dfb9b4506ab398 and project 3364787934af4f59b17a58b380fe95da. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:05.967825 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9e4b600c-0924-4b4b-9c12-5f6e61cf2f7a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments/ecaa8fc8-122d-4201-b4ec-f389b692b0fa" status: 200 len: 194 microversion: 2.20 time: 0.049892 Apr 30 21:24:05.971502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1672/3440] 10.222.0.23 () {60 vars in 1453 bytes} [Sat Apr 30 21:24:05 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments/ecaa8fc8-122d-4201-b4ec-f389b692b0fa => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:24:05.974933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18efc7da-cf3c-47c3-8d96-155b017c7a37 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13efdd30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:05.994945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18efc7da-cf3c-47c3-8d96-155b017c7a37 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:05.994945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18efc7da-cf3c-47c3-8d96-155b017c7a37 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.004308 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18efc7da-cf3c-47c3-8d96-155b017c7a37 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 200 len: 36 microversion: 2.26 time: 0.034169 Apr 30 21:24:06.004935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1673/3441] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:24:05 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 36 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:06.016868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13efd0d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:06.028931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.029587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.030127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:06.037604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.038110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.039186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.039988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.046763 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe7854e2-9eca-417f-8af3-afa24085818c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.652319 Apr 30 21:24:06.046763 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1769/3442] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:24:05 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:06.139604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:06.140962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:06.148435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.150421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.150913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.158000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.159591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.162298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.303162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:06.357226 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9dd5d70-5ad5-4eb5-be87-ca059a523177 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-1166126915" status: 204 len: 0 microversion: 2.26 time: 0.345366 Apr 30 21:24:06.357880 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1674/3443] 10.222.0.23 () {60 vars in 1363 bytes} [Sat Apr 30 21:24:06 2022] DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-1166126915 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:06.373995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a95db1f-ba18-4423-8c5c-1770079579f5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13efd9d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:06.397983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lazy-loading 'services' on Instance uuid 5651c8e3-b1ff-47a2-ac15-e68594650b70 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:06.406180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a95db1f-ba18-4423-8c5c-1770079579f5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.406715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a95db1f-ba18-4423-8c5c-1770079579f5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.427650 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a95db1f-ba18-4423-8c5c-1770079579f5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 200 len: 12 microversion: 2.26 time: 0.063197 Apr 30 21:24:06.433234 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1675/3444] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:24:06 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:06.444274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13efdaf0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:06.469347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.471344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.471344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:06.482378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.483565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.488291 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.488559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.524952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.525410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.540518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:06.566388 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df3cd1a4-79e0-4f60-b4c8-ec05cdbb7488 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 204 len: 0 microversion: 2.26 time: 0.126447 Apr 30 21:24:06.575316 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1676/3445] 10.222.0.23 () {60 vars in 1294 bytes} [Sat Apr 30 21:24:06 2022] DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:06.588606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13ef4280>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:06.599048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.608028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.608028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:06.608028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.608945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.610292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.610972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.642507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.643065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.656760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.657314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.692363 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c8bb11b-eb18-491d-a965-eb713cd488c3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments/ecaa8fc8-122d-4201-b4ec-f389b692b0fa" status: 202 len: 0 microversion: 2.20 time: 0.557446 Apr 30 21:24:06.693727 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1770/3446] 10.222.0.23 () {60 vars in 1456 bytes} [Sat Apr 30 21:24:06 2022] DELETE /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments/ecaa8fc8-122d-4201-b4ec-f389b692b0fa => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:24:06.713633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-405d4fc3-dcec-451b-9575-5de12485b2dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:06.714276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-405d4fc3-dcec-451b-9575-5de12485b2dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:06.731563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-405d4fc3-dcec-451b-9575-5de12485b2dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.734206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-405d4fc3-dcec-451b-9575-5de12485b2dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.741674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-405d4fc3-dcec-451b-9575-5de12485b2dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.741674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-405d4fc3-dcec-451b-9575-5de12485b2dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.778612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-405d4fc3-dcec-451b-9575-5de12485b2dc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076283 Apr 30 21:24:06.779268 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1771/3447] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:24:06 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:24:06.812567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:06.829379 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71cc02ea-a878-4542-8970-d3829d5130bc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-681665625" status: 201 len: 0 microversion: 2.26 time: 0.254272 Apr 30 21:24:06.831662 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1677/3448] 10.222.0.23 () {62 vars in 1376 bytes} [Sat Apr 30 21:24:06 2022] PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-681665625 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Apr 30 21:24:06.839980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc20640040>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:06.857574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.859588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.866325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:06.881657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.882125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.882918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.883372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.932824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.933484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:06.944078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:06.944786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.053182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:07.189400 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16e84ae0-db45-4a56-ab9f-3b519a710cee tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-596500518" status: 201 len: 0 microversion: 2.26 time: 0.353442 Apr 30 21:24:07.190097 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1772/3449] 10.222.0.23 () {62 vars in 1376 bytes} [Sat Apr 30 21:24:06 2022] PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-596500518 => generated 0 bytes in 355 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Apr 30 21:24:07.199874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13eea310>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:07.209171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.217084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.217084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:07.217084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.217084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.217084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.217546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.239675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.240177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.311208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:07.326946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-43223212-d77e-4b24-94b0-33aebcfcc3c8 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 204 len: 0 microversion: 2.26 time: 0.131429 Apr 30 21:24:07.327781 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1678/3450] 10.222.0.23 () {60 vars in 1294 bytes} [Sat Apr 30 21:24:07 2022] DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:07.336994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a2ae131-09d8-46fa-b6e2-2fc339e1dea6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc262fcee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:07.347793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a2ae131-09d8-46fa-b6e2-2fc339e1dea6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.348452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a2ae131-09d8-46fa-b6e2-2fc339e1dea6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.358117 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a2ae131-09d8-46fa-b6e2-2fc339e1dea6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 200 len: 12 microversion: 2.26 time: 0.025644 Apr 30 21:24:07.359357 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1773/3451] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:24:07 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:07.370791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13eeab80>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:07.380397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.380849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.381354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:07.386893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.387348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.388096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.393364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.410413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.410935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.421004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:07.436186 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23acf888-3182-4c37-ae8a-6854d3d35fd5 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 204 len: 0 microversion: 2.26 time: 0.070127 Apr 30 21:24:07.436736 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1679/3452] 10.222.0.23 () {60 vars in 1294 bytes} [Sat Apr 30 21:24:07 2022] DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:24:07.448438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc20640af0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:07.457201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.458083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.458712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:07.465441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.466116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.467047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.467833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.497829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.498235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.507818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.508359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.585149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:07.604056 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b21cb60-bab6-4fde-b1bf-b39a2b0601a9 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-762691022" status: 201 len: 0 microversion: 2.26 time: 0.161533 Apr 30 21:24:07.605129 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1774/3453] 10.222.0.23 () {62 vars in 1376 bytes} [Sat Apr 30 21:24:07 2022] PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-762691022 => generated 0 bytes in 163 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Apr 30 21:24:07.614731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13e8e280>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:07.630139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.630605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.631096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:07.644584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.645292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.646127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.646888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.687192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.687845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.698674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.699140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.791991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1de9b46-a27a-48eb-97f2-89732ea648fe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:07.793788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1de9b46-a27a-48eb-97f2-89732ea648fe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:07.800437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:07.802073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1de9b46-a27a-48eb-97f2-89732ea648fe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.802601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1de9b46-a27a-48eb-97f2-89732ea648fe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.803461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1de9b46-a27a-48eb-97f2-89732ea648fe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.803986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1de9b46-a27a-48eb-97f2-89732ea648fe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.823650 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e0d9190-592c-404e-9647-90a891784b45 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-34485887" status: 201 len: 0 microversion: 2.26 time: 0.212916 Apr 30 21:24:07.824562 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1680/3454] 10.222.0.23 () {62 vars in 1373 bytes} [Sat Apr 30 21:24:07 2022] PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags/tempest-tag-34485887 => generated 0 bytes in 215 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Apr 30 21:24:07.834635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Action: 'update_all', calling method: .version_select at 0x7fdc13e8e1f0>, body: {"tags": ["tempest-tag-241161239", "tempest-tag-36612761"]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:07.855647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.857880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.858647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:07.860435 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1de9b46-a27a-48eb-97f2-89732ea648fe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073778 Apr 30 21:24:07.862704 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1775/3455] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:24:07 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:24:07.871172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.872057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.873866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.876541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:07.907882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:07.908353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.064457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:08.094202 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0aded062-70e1-4779-8e8a-5c8b03220c23 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 200 len: 59 microversion: 2.26 time: 0.263934 Apr 30 21:24:08.096250 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1681/3456] 10.222.0.23 () {62 vars in 1311 bytes} [Sat Apr 30 21:24:07 2022] PUT /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 59 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:08.118045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c507a7aa-49b2-4971-8942-c86b4df1e508 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc20b7c310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:08.130992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c507a7aa-49b2-4971-8942-c86b4df1e508 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.132096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c507a7aa-49b2-4971-8942-c86b4df1e508 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.153739 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c507a7aa-49b2-4971-8942-c86b4df1e508 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 200 len: 59 microversion: 2.26 time: 0.050807 Apr 30 21:24:08.155917 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1776/3457] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Apr 30 21:24:08 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 59 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:08.165560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '.version_select at 0x7fdc13e8ea60>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:08.191592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.192132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.192544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:08.199549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.199917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.200716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.201317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.227758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.228498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.353003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lazy-loading 'flavor' on Instance uuid 72b4eece-01bc-4235-bec9-19ce66fb8765 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:08.377646 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-53b1e606-85f6-468b-88f9-133097f71369 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags" status: 204 len: 0 microversion: 2.26 time: 0.216983 Apr 30 21:24:08.381947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1682/3458] 10.222.0.23 () {60 vars in 1294 bytes} [Sat Apr 30 21:24:08 2022] DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765/tags => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:08.392132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:08.393953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:08.408857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.409894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.412177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.413568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.464605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:24:08.613232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e744c51-3d58-49cf-b9e5-237800aae789 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:08.614284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e744c51-3d58-49cf-b9e5-237800aae789 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:08.621791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e744c51-3d58-49cf-b9e5-237800aae789 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.622310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e744c51-3d58-49cf-b9e5-237800aae789 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.623396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e744c51-3d58-49cf-b9e5-237800aae789 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.623850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e744c51-3d58-49cf-b9e5-237800aae789 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.673441 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e744c51-3d58-49cf-b9e5-237800aae789 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "POST /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df/action" status: 200 len: 24562 microversion: 2.1 time: 0.391035 Apr 30 21:24:08.674535 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1777/3459] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:24:08 2022] POST /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df/action => generated 24562 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:24:08.689561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:08.690888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:08.698535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.699246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.700262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.700744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.751568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:24:08.883385 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-22387bd5-f3a9-4302-ae2b-4c3bdfa29c60 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 204 len: 0 microversion: 2.26 time: 0.496540 Apr 30 21:24:08.884270 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1683/3460] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:24:08 2022] DELETE /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:24:08.891142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1199aa1c-584f-4d99-b194-67f945d72c33 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:08.892161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1199aa1c-584f-4d99-b194-67f945d72c33 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:08.898196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1199aa1c-584f-4d99-b194-67f945d72c33 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.898648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1199aa1c-584f-4d99-b194-67f945d72c33 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.899482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1199aa1c-584f-4d99-b194-67f945d72c33 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.899923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1199aa1c-584f-4d99-b194-67f945d72c33 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.931249 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1199aa1c-584f-4d99-b194-67f945d72c33 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045031 Apr 30 21:24:08.931823 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1684/3461] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:24:08 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:08.936635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:08.937562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:08.944679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.945138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:08.946130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:08.946587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:09.191015 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e2683536-8903-4a33-a28e-acda5d7dc730 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 204 len: 0 microversion: 2.1 time: 0.505683 Apr 30 21:24:09.191944 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1778/3462] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:24:08 2022] DELETE /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:24:09.199017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:09.199915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:09.225318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:09.226021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:09.226912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:09.227367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:09.245667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:09.254406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:09.255929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:09.260105 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b226ba51-0d80-452e-a50e-49e7d2ebe5dc tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1552 microversion: 2.26 time: 0.327013 Apr 30 21:24:09.260697 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1685/3463] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:08 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1552 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:09.287187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:09.289056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:09.305629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:24:09.317977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:09.318745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:09.320703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:09.320703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:09.572851 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-88f6773e-adca-4462-bd3c-3d37c59688a1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 204 len: 0 microversion: 2.20 time: 0.378211 Apr 30 21:24:09.573800 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1779/3464] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:24:09 2022] DELETE /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:09.588415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:09.589564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:09.605019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:09.606948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:09.608569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:09.609187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:09.648171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:09.656567 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c114ac6f-0444-4c87-aa39-dca0b26ba80b tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1608 microversion: 2.1 time: 0.385853 Apr 30 21:24:09.667067 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1686/3465] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:09 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1608 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:09.883895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:09.894477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:09.899618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:09.901909 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a62d1fc-fa85-4103-a8fd-7fb30ee58588 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.322995 Apr 30 21:24:09.918633 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1780/3466] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:09 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:10.280473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:10.281443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:10.291004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:10.291881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:10.292929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:10.293590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:10.429470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1099772323", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d21022d-393a-4eff-ba51-560f37353f44"}], "security_groups": [{"name": "tempest-securitygroup--32066545"}], "key_name": "tempest-keypair-1909017049", "user_data": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:10.626086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:10.636073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:10.637634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:10.647198 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82161b9d-4f6d-4048-b0af-533cf09dab52 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1552 microversion: 2.26 time: 0.370739 Apr 30 21:24:10.648374 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1687/3467] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:10 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1552 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:10.675664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:10.677095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:10.690465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:10.691280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:10.692253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:10.692866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:10.698811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] validate_networks() for [('6d21022d-393a-4eff-ba51-560f37353f44', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:24:11.038328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:11.046744 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-31501a28-c311-4631-8275-cf33d27736b8 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1608 microversion: 2.1 time: 0.375973 Apr 30 21:24:11.050865 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1688/3468] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:10 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1608 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:11.055746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:11.056378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:11.068523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:11.069278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:11.070544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:11.071224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:11.522743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:11.532180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:11.534005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:11.537033 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78b6adce-3c13-495e-ba64-2366697700cd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.485020 Apr 30 21:24:11.537603 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1689/3469] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:11 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:11.625937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9d08733f-c243-4f02-8d6f-72848ec82eca req-fc4e73a6-8bfb-4ec6-8c73-e075ea4d41fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b4eece-01bc-4235-bec9-19ce66fb8765", "name": "network-vif-deleted", "tag": "f59ac01b-d3e8-48d7-8da6-56f2417e58e1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:11.637097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9d08733f-c243-4f02-8d6f-72848ec82eca req-fc4e73a6-8bfb-4ec6-8c73-e075ea4d41fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:11.639981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9d08733f-c243-4f02-8d6f-72848ec82eca req-fc4e73a6-8bfb-4ec6-8c73-e075ea4d41fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:11.660868 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9d08733f-c243-4f02-8d6f-72848ec82eca req-fc4e73a6-8bfb-4ec6-8c73-e075ea4d41fe service nova] Creating event network-vif-deleted:f59ac01b-d3e8-48d7-8da6-56f2417e58e1 for instance 72b4eece-01bc-4235-bec9-19ce66fb8765 on nch2-master-1 Apr 30 21:24:11.667552 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9d08733f-c243-4f02-8d6f-72848ec82eca req-fc4e73a6-8bfb-4ec6-8c73-e075ea4d41fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046934 Apr 30 21:24:11.668405 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1690/3470] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:11.668783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:24:11.669877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:24:11.670405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:24:11.670836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:24:11.671261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:24:11.679802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:11.682782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:11.685104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:11.685831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:11.691702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:11.691702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:11.695394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:11.699607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:11.700530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:11.700995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:11.719379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:11.726543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for user 20b4082fa07249e2b6dfb9b4506ab398 and project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:11.741352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:24:11.744393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:24:11.840970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:11.851268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:11.852855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2be8a8f7a034cddb01078690b5bd364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:11.858024 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32ead854-ec18-4a50-be67-a02a8cd26f77 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 200 len: 1510 microversion: 2.26 time: 0.185109 Apr 30 21:24:11.858024 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1691/3471] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:11 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:12.027084 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e7348fb-8284-4a61-9f3e-21f233ac115c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.602104 Apr 30 21:24:12.027703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1781/3472] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:24:10 2022] POST /compute/v2.1/servers => generated 407 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:24:12.039149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e6978df7-d88b-40d1-a7ac-bc0d54300645 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:12.041870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e6978df7-d88b-40d1-a7ac-bc0d54300645 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:12.070132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:12.071229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:12.088880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:12.089592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:12.090606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:12.092513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:12.374192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6978df7-d88b-40d1-a7ac-bc0d54300645 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:12.382587 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e6978df7-d88b-40d1-a7ac-bc0d54300645 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1239 microversion: 2.1 time: 0.348175 Apr 30 21:24:12.387469 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1692/3473] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:12 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1239 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:12.454312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:12.462674 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dee09336-2306-41bc-8dc8-98d246ea1870 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1608 microversion: 2.1 time: 0.402576 Apr 30 21:24:12.470243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1782/3474] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:12 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1608 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:12.556929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:12.558148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:12.583143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:12.584007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:12.584888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:12.585561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:12.743658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:12.754319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:12.760677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:12.764195 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb11ed53-ce77-4285-9712-8ead69aa4dfe tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1721 microversion: 2.20 time: 0.204431 Apr 30 21:24:12.767603 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1693/3475] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:12 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:12.875853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:12.876701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] [instance: 72b4eece-01bc-4235-bec9-19ce66fb8765] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:12.896942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:12.897416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:12.902228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:12.902228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:12.914573 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] HTTP exception thrown: Instance 72b4eece-01bc-4235-bec9-19ce66fb8765 could not be found. Apr 30 21:24:12.915188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] Returning 404 to user: Instance 72b4eece-01bc-4235-bec9-19ce66fb8765 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:12.916226 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9056cbd8-e38f-4507-b073-fd47499a64b6 tempest-ServerTagsTestJSON-1932595909 tempest-ServerTagsTestJSON-1932595909-project] 10.222.0.23 "GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765" status: 404 len: 111 microversion: 2.26 time: 0.046361 Apr 30 21:24:12.917296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1783/3476] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:12 2022] GET /compute/v2.1/servers/72b4eece-01bc-4235-bec9-19ce66fb8765 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:24:13.406572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:13.407236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:13.476088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:13.482998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:13.486676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:13.486881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:13.487315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:13.488515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:13.510472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:13.513198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:13.519210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:13.520673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:13.832527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:13.833478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:13.843719 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e683ac7-973d-4586-a981-f0e1a349eea0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1243 microversion: 2.1 time: 0.444093 Apr 30 21:24:13.844691 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1694/3477] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:13 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1243 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:13.844933 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a699557d-4ad3-4a05-8105-ac0989441bd0 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1540 microversion: 2.1 time: 0.367777 Apr 30 21:24:13.846024 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1784/3478] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:13 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1540 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:13.851331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9eed2ef4-95be-4c47-91c0-a6350d22e9d2 req-df8392da-f35f-4ef9-80c2-b46b281084e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff0823b-a621-444c-a64b-dfd437b832df", "name": "network-vif-deleted", "tag": "39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:13.857846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:13.858735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:13.865280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9eed2ef4-95be-4c47-91c0-a6350d22e9d2 req-df8392da-f35f-4ef9-80c2-b46b281084e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:13.866529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9eed2ef4-95be-4c47-91c0-a6350d22e9d2 req-df8392da-f35f-4ef9-80c2-b46b281084e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:13.870252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:13.875263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:13.877465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:13.883506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:13.884343 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9eed2ef4-95be-4c47-91c0-a6350d22e9d2 req-df8392da-f35f-4ef9-80c2-b46b281084e5 service nova] Creating event network-vif-deleted:39ef5c24-20cd-43eb-b6dd-5ac35f46b4f0 for instance 7ff0823b-a621-444c-a64b-dfd437b832df on nch1-master-1 Apr 30 21:24:13.890029 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9eed2ef4-95be-4c47-91c0-a6350d22e9d2 req-df8392da-f35f-4ef9-80c2-b46b281084e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043675 Apr 30 21:24:13.891170 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1695/3479] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:14.041277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:14.054494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:14.060670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:14.061945 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b55ff807-a51a-472e-b80d-9c14c04e4143 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1366 microversion: 2.20 time: 0.214284 Apr 30 21:24:14.062533 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1785/3480] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:13 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:14.869203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:14.870061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:14.871097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:14.871899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:14.879534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:14.880114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:14.880919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:14.881815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:14.886898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:14.887707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:14.888521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:14.889133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:14.982938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:14.983412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:14.983925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lazy-loading 'fault' on Instance uuid 7ff0823b-a621-444c-a64b-dfd437b832df {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:14.991250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:15.008247 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5745bc33-1301-4e43-ba53-414904e47fb1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1291 microversion: 2.1 time: 0.144557 Apr 30 21:24:15.017976 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1696/3481] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:14 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1291 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:15.078561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df6ea2992c04a97af023bfb428ac44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c121a94ec3445baa05dcaa3dc22af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:15.085995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:15.086585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:15.088362 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c6239a87-e3e5-47b3-8284-13fd1ac38854 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 200 len: 1257 microversion: 2.1 time: 0.227923 Apr 30 21:24:15.088966 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1786/3482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:14 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 1257 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:15.099233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:15.104468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:15.105395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:15.105888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:15.190288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:15.190760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:15.191234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lazy-loading 'fault' on Instance uuid 5651c8e3-b1ff-47a2-ac15-e68594650b70 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:24:15.307022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:15.316860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:15.320023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:15.336565 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c952377-2004-41db-8b68-dc64ac23b997 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 200 len: 1371 microversion: 2.20 time: 0.255219 Apr 30 21:24:15.337289 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1697/3483] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:15 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:24:15.908199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-fec2f86c-0510-421b-a774-a3dfc57b4e0f req-9573c731-fee8-442b-a631-8c01c619e4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5651c8e3-b1ff-47a2-ac15-e68594650b70", "name": "network-vif-deleted", "tag": "25241eca-3984-4407-9196-eb00543c2900"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:15.917668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fec2f86c-0510-421b-a774-a3dfc57b4e0f req-9573c731-fee8-442b-a631-8c01c619e4cc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:15.918160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fec2f86c-0510-421b-a774-a3dfc57b4e0f req-9573c731-fee8-442b-a631-8c01c619e4cc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:15.938002 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fec2f86c-0510-421b-a774-a3dfc57b4e0f req-9573c731-fee8-442b-a631-8c01c619e4cc service nova] Creating event network-vif-deleted:25241eca-3984-4407-9196-eb00543c2900 for instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 on nch1-master-1 Apr 30 21:24:15.944488 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-fec2f86c-0510-421b-a774-a3dfc57b4e0f req-9573c731-fee8-442b-a631-8c01c619e4cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039787 Apr 30 21:24:15.945480 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1787/3484] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:16.028317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:16.028931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:16.037216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:16.037670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:16.038491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:16.038934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:16.103766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:16.106557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:16.107278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] [instance: 7ff0823b-a621-444c-a64b-dfd437b832df] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:16.111593 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-40268163-0b94-4b81-9406-a3a347bc37e3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1297 microversion: 2.1 time: 0.086921 Apr 30 21:24:16.113029 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1698/3485] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:16 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:16.114959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:16.115432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:16.117616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:16.117616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:16.131120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] HTTP exception thrown: Instance 7ff0823b-a621-444c-a64b-dfd437b832df could not be found. Apr 30 21:24:16.131888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Returning 404 to user: Instance 7ff0823b-a621-444c-a64b-dfd437b832df could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:16.132729 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d81b8ad8-5173-44c0-9184-fb4512b41d58 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df" status: 404 len: 111 microversion: 2.1 time: 0.030410 Apr 30 21:24:16.133273 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1788/3486] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:16 2022] GET /compute/v2.1/servers/7ff0823b-a621-444c-a64b-dfd437b832df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:24:16.141738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-652c4eeb-98a0-4521-9ee3-0e6851dcf922 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] Calling method '.version_select at 0x7fdc13e4e5e0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:16.277562 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-652c4eeb-98a0-4521-9ee3-0e6851dcf922 tempest-ServersTestBootFromVolume-307388374 tempest-ServersTestBootFromVolume-307388374-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575200531" status: 202 len: 0 microversion: 2.1 time: 0.139549 Apr 30 21:24:16.278491 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1699/3487] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575200531 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:24:16.364149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:16.364149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:16.371054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:16.372105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:16.373188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:16.374072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:16.407342 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] HTTP exception thrown: Instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 could not be found. Apr 30 21:24:16.408093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Returning 404 to user: Instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:16.410284 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 404 len: 111 microversion: 2.20 time: 0.053616 Apr 30 21:24:16.421011 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1789/3488] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:16 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:24:16.421117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-144349f9-dfdd-47d6-9cc5-aa870d5e9dca tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '.version_select at 0x7fdc13e8e4c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:16.519397 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-144349f9-dfdd-47d6-9cc5-aa870d5e9dca tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798288353" status: 204 len: 0 microversion: 2.20 time: 0.100929 Apr 30 21:24:16.519397 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1700/3489] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798288353 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:17.005099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:17.006218 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001488 Apr 30 21:24:17.006745 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1790/3490] 10.222.0.23 () {56 vars in 885 bytes} [Sat Apr 30 21:24:17 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 30 21:24:17.014508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-144349f9-dfdd-47d6-9cc5-aa870d5e9dca tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:17.015850 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-144349f9-dfdd-47d6-9cc5-aa870d5e9dca tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002026 Apr 30 21:24:17.016663 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1701/3491] 10.222.0.23 () {54 vars in 1034 bytes} [Sat Apr 30 21:24:17 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Apr 30 21:24:17.022894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:17.023937 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-debec474-cfb8-43ec-b13d-94285a4fb757 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001463 Apr 30 21:24:17.024494 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1791/3492] 10.222.0.23 () {54 vars in 1040 bytes} [Sat Apr 30 21:24:17 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:17.031727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-144349f9-dfdd-47d6-9cc5-aa870d5e9dca tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:17.033266 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-144349f9-dfdd-47d6-9cc5-aa870d5e9dca tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002047 Apr 30 21:24:17.034409 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1702/3493] 10.222.0.23 () {56 vars in 885 bytes} [Sat Apr 30 21:24:17 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 30 21:24:17.130302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:17.131144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:17.140411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:17.141489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:17.144692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:17.145266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:17.361656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:17.370929 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6966b571-9b3a-4abc-a89a-c7feb4af6bef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.245059 Apr 30 21:24:17.371525 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1792/3494] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:17 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:18.167542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9e1ca67-f38a-4646-be89-5d424c9c839d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'create', calling method: .version_select at 0x7fdc13efd430>, body: {"keypair": {"name": "tempest-keypair-956615821"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:18.206094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d9e1ca67-f38a-4646-be89-5d424c9c839d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:18.220038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d9e1ca67-f38a-4646-be89-5d424c9c839d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for user 65bedbcb4d094160a9a9fc3b6ba6f603 and project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:18.388285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:18.388900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:18.424073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:18.426179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:18.429408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:18.430659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:18.488310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d9e1ca67-f38a-4646-be89-5d424c9c839d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:18.504586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d9e1ca67-f38a-4646-be89-5d424c9c839d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for user 65bedbcb4d094160a9a9fc3b6ba6f603 and project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:18.556668 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9e1ca67-f38a-4646-be89-5d424c9c839d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.402698 Apr 30 21:24:18.557291 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1703/3495] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Apr 30 21:24:18 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 405 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:24:18.566785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3c35c54e-e976-4778-a98b-0658a8ff4a99 req-5421aae8-324c-42e8-8586-b3b34eee6102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:18.578192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3c35c54e-e976-4778-a98b-0658a8ff4a99 req-5421aae8-324c-42e8-8586-b3b34eee6102 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:18.579097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3c35c54e-e976-4778-a98b-0658a8ff4a99 req-5421aae8-324c-42e8-8586-b3b34eee6102 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:18.595860 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3c35c54e-e976-4778-a98b-0658a8ff4a99 req-5421aae8-324c-42e8-8586-b3b34eee6102 service nova] Creating event network-changed:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:24:18.604187 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3c35c54e-e976-4778-a98b-0658a8ff4a99 req-5421aae8-324c-42e8-8586-b3b34eee6102 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045140 Apr 30 21:24:18.606780 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1704/3496] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:18.790062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:18.808471 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0d247a94-9770-4b43-843f-2f2a2b8d7473 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.423925 Apr 30 21:24:18.818900 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1793/3497] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:18 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:19.832306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:19.833842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:19.840692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:19.841161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:19.841993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:19.842443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:20.013810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:20.021984 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-08ac05af-69d4-4b0d-9aed-6a38dcd18d8b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.195213 Apr 30 21:24:20.022572 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1705/3498] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:19 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:21.040992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:21.045490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:21.049861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:21.050384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:21.051251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:21.051698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:21.326874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:21.339539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f32e49f-c7e2-471f-b836-1a147c666317 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.303388 Apr 30 21:24:21.342059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1794/3499] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:21 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:22.339967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1221685999", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1ba9505-d2cf-4c5a-934a-6a1e685fc411"}], "security_groups": [{"name": "tempest-securitygroup--47565424"}], "key_name": "tempest-keypair-956615821", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:22.356750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:22.357986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:22.371202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:22.371660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:22.374712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:22.375340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:22.538836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] validate_networks() for [('b1ba9505-d2cf-4c5a-934a-6a1e685fc411', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:24:22.775726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:22.795590 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-938c015e-5204-4c01-89e9-6062a452db98 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.440593 Apr 30 21:24:22.797818 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1795/3500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:22 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:23.553982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:24:23.556977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:24:23.559945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:24:23.563285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:24:23.565431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:24:23.596849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:23.597027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:23.604679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:23.605313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:23.650677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:23.661141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Getting quotas for user 65bedbcb4d094160a9a9fc3b6ba6f603 and project afc5d20f2f9f4ecf981cdfe980cfc21d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:23.684250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:24:23.686771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:24:23.817652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:23.818837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:23.834107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:23.835157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:23.836668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:23.841748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:23.898374 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59cd05bc-0bee-4ff9-bfe9-6ea76d4d9ba1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.562938 Apr 30 21:24:23.899035 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1706/3501] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:24:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:24:23.930454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71891c79-7078-4402-8d31-ed895bc99286 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:23.934868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-71891c79-7078-4402-8d31-ed895bc99286 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:24.140581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-71891c79-7078-4402-8d31-ed895bc99286 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:24.155398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-71891c79-7078-4402-8d31-ed895bc99286 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:24.160094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-71891c79-7078-4402-8d31-ed895bc99286 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:24.176874 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71891c79-7078-4402-8d31-ed895bc99286 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1281 microversion: 2.20 time: 0.257615 Apr 30 21:24:24.186209 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1707/3502] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:23 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:24.259769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:24.270437 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a7eca84c-cc48-40e2-9c38-7e9e0f079871 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.458104 Apr 30 21:24:24.271263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1796/3503] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:23 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:25.112700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7715101e-32fd-4bb3-92fd-f55ca1df1402 req-458f986e-8e18-4fd5-8f2d-17d5f8d96a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-plugged", "status": "completed", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:25.130212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7715101e-32fd-4bb3-92fd-f55ca1df1402 req-458f986e-8e18-4fd5-8f2d-17d5f8d96a24 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:25.131004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7715101e-32fd-4bb3-92fd-f55ca1df1402 req-458f986e-8e18-4fd5-8f2d-17d5f8d96a24 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:25.144727 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7715101e-32fd-4bb3-92fd-f55ca1df1402 req-458f986e-8e18-4fd5-8f2d-17d5f8d96a24 service nova] Creating event network-vif-plugged:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:24:25.153174 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7715101e-32fd-4bb3-92fd-f55ca1df1402 req-458f986e-8e18-4fd5-8f2d-17d5f8d96a24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041263 Apr 30 21:24:25.153174 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1708/3504] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:25.196920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:25.197555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:25.216218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:25.216520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:25.217328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:25.217830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:25.289561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:25.290413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:25.310421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:25.311114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:25.312099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:25.313296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:25.375890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:25.392398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:25.398459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:25.402158 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d994af39-644c-4672-b3b5-18e8108acbb7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1285 microversion: 2.20 time: 0.208511 Apr 30 21:24:25.414527 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1797/3505] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:25 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:25.646903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:25.660123 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-587364d0-53f9-4869-b58a-318ce506d648 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.375025 Apr 30 21:24:25.661231 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1709/3506] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:25 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:26.422384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:26.423088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:26.431843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:26.432659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:26.433660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:26.434476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:26.666203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7bd23a18-bbdc-4a7c-acc6-5019a0222098 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Action: 'create', calling method: .version_select at 0x7fdc21095310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-665771229", "metadata": {"Type": "work"}}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:26.667692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7bd23a18-bbdc-4a7c-acc6-5019a0222098 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:26.668538 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7bd23a18-bbdc-4a7c-acc6-5019a0222098 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.333057 Apr 30 21:24:26.673364 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1798/3507] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:24:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:24:26.680429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:26.681069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:26.702180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:26.708154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:26.708630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:26.710172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:26.713930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:26.715827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:26.719423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:26.720574 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d656a3d8-2e77-4646-bb8e-8c4d4ef53ecd tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1341 microversion: 2.20 time: 0.302513 Apr 30 21:24:26.725748 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1710/3508] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:26 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1341 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:24:26.738477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fccd1fab-2286-43b6-b4d6-b70a7e8cf71a tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Action: 'create', calling method: .version_select at 0x7fdc13e51af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-837482185", "metadata": {"Type": "work"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:26.745723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fccd1fab-2286-43b6-b4d6-b70a7e8cf71a tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:26.746900 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fccd1fab-2286-43b6-b4d6-b70a7e8cf71a tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019917 Apr 30 21:24:26.752702 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1711/3509] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:24:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:24:26.761646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f5e334d-27ae-4968-ac90-69b5eae93cd3 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Action: 'create', calling method: .version_select at 0x7fdc13e42820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2069445813", "metadata": {"Type": "work"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:26.766181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f5e334d-27ae-4968-ac90-69b5eae93cd3 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:26.769428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f5e334d-27ae-4968-ac90-69b5eae93cd3 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015513 Apr 30 21:24:26.770233 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1712/3510] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:24:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:24:27.120263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:27.135740 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f1e42cc-b5ca-43da-8349-9fce39f4cc2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1363 microversion: 2.1 time: 0.460625 Apr 30 21:24:27.141561 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1799/3511] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1363 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:27.246364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-047e11b3-fed7-4c81-9984-9e16b50eb07f tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Calling method '.version_select at 0x7fdc13e5d790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:27.311981 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-047e11b3-fed7-4c81-9984-9e16b50eb07f tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] HTTP exception thrown: Volume tempest-invalid-1851120422 could not be found. Apr 30 21:24:27.312959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-047e11b3-fed7-4c81-9984-9e16b50eb07f tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Returning 404 to user: Volume tempest-invalid-1851120422 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:27.314020 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-047e11b3-fed7-4c81-9984-9e16b50eb07f tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1851120422" status: 404 len: 99 microversion: 2.1 time: 0.534347 Apr 30 21:24:27.314665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1713/3512] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:24:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1851120422 => generated 99 bytes in 537 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:24:27.327267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-44d128c2-4247-4c9d-a997-6ea1a060039a tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003927 Apr 30 21:24:27.327894 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1800/3513] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Apr 30 21:24:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 21:24:27.340599 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9d1b527-d94b-43a6-b35d-29ba10a10867 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006562 Apr 30 21:24:27.342924 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1714/3514] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:24:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 21:24:27.355372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b708f3ac-8f3e-4794-8a76-963db5f89d41 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Calling method '.version_select at 0x7fdc26288310>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:27.395301 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b708f3ac-8f3e-4794-8a76-963db5f89d41 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] HTTP exception thrown: Volume c1222d0e-dca5-4849-accf-d009284bf260 could not be found. Apr 30 21:24:27.395924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b708f3ac-8f3e-4794-8a76-963db5f89d41 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Returning 404 to user: Volume c1222d0e-dca5-4849-accf-d009284bf260 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:27.396793 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b708f3ac-8f3e-4794-8a76-963db5f89d41 tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/c1222d0e-dca5-4849-accf-d009284bf260" status: 404 len: 109 microversion: 2.1 time: 0.046274 Apr 30 21:24:27.397329 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1801/3515] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:27 2022] DELETE /compute/v2.1/os-volumes/c1222d0e-dca5-4849-accf-d009284bf260 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:24:27.407937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-992c12cf-b71d-4720-99c1-59268e12badc tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Calling method '.version_select at 0x7fdc13e5d940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:27.460377 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-992c12cf-b71d-4720-99c1-59268e12badc tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] HTTP exception thrown: Volume 3fb6c08e-c456-4d72-8a56-e0403912e8b9 could not be found. Apr 30 21:24:27.461041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-992c12cf-b71d-4720-99c1-59268e12badc tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] Returning 404 to user: Volume 3fb6c08e-c456-4d72-8a56-e0403912e8b9 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:27.463114 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-992c12cf-b71d-4720-99c1-59268e12badc tempest-VolumesNegativeTest-812864942 tempest-VolumesNegativeTest-812864942-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3fb6c08e-c456-4d72-8a56-e0403912e8b9" status: 404 len: 109 microversion: 2.1 time: 0.060204 Apr 30 21:24:27.467966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1715/3516] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:24:27 2022] GET /compute/v2.1/os-volumes/3fb6c08e-c456-4d72-8a56-e0403912e8b9 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:24:27.745544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:27.746182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:27.759584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:27.761637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:27.764428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:27.765211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:28.159075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:28.159718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:28.170561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:28.173284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:28.173284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:28.187225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:28.451624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:28.464213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:28.468264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:28.473389 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9a7c9b3-c65a-42a6-9e0c-a09389a9efab tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1405 microversion: 2.20 time: 0.730835 Apr 30 21:24:28.473389 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1802/3517] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:27 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1405 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:28.716658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:28.726083 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f86538e3-3d29-4acb-8c3b-aa55aff99aee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1550 microversion: 2.1 time: 0.571290 Apr 30 21:24:28.738970 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1716/3518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:28 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1550 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:28.745162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-74d676d8-e3fa-4c93-bc6b-f48c25b52652 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:28.746094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-74d676d8-e3fa-4c93-bc6b-f48c25b52652 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:28.758262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74d676d8-e3fa-4c93-bc6b-f48c25b52652 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:28.759800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74d676d8-e3fa-4c93-bc6b-f48c25b52652 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:28.760912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74d676d8-e3fa-4c93-bc6b-f48c25b52652 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:28.761734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74d676d8-e3fa-4c93-bc6b-f48c25b52652 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:28.920495 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-74d676d8-e3fa-4c93-bc6b-f48c25b52652 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179437 Apr 30 21:24:28.923025 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1803/3519] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:24:28 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:29.489524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:29.490519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:29.511158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:29.511945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:29.514066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:29.520564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:29.817273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-025fd375-c52f-4bf2-a4a5-2e97f223984e req-94431aa0-a85c-42a9-a870-5e263a9a03fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:29.832355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-025fd375-c52f-4bf2-a4a5-2e97f223984e req-94431aa0-a85c-42a9-a870-5e263a9a03fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:29.832809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-025fd375-c52f-4bf2-a4a5-2e97f223984e req-94431aa0-a85c-42a9-a870-5e263a9a03fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:29.865350 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-025fd375-c52f-4bf2-a4a5-2e97f223984e req-94431aa0-a85c-42a9-a870-5e263a9a03fc service nova] Creating event network-changed:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch1-master-1 Apr 30 21:24:29.881657 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-025fd375-c52f-4bf2-a4a5-2e97f223984e req-94431aa0-a85c-42a9-a870-5e263a9a03fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069064 Apr 30 21:24:29.891940 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1804/3520] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:30.252844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:30.265643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:30.290880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:30.292368 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-28a8fb2e-230d-4d04-ad17-8bdcf4550317 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1405 microversion: 2.20 time: 0.806771 Apr 30 21:24:30.293508 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1717/3521] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:29 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1405 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:31.181838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15db5835-9ed5-42e1-a577-08552847b12d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: .version_select at 0x7fdc262263a0>, body: {"keypair": {"name": "tempest-keypair-1591866211"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:31.215792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-15db5835-9ed5-42e1-a577-08552847b12d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:31.231765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-15db5835-9ed5-42e1-a577-08552847b12d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:31.310780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:31.311403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:31.323238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:31.323697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:31.324501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:31.331493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:31.660778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-15db5835-9ed5-42e1-a577-08552847b12d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:31.667608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-15db5835-9ed5-42e1-a577-08552847b12d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:31.686397 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15db5835-9ed5-42e1-a577-08552847b12d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.804558 Apr 30 21:24:31.687767 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1805/3522] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:24:30 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:31.697210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:31.713481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:31.719436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:31.721481 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f77cc23-37a1-4a86-af5a-b2dbc6762ace tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1405 microversion: 2.20 time: 0.414118 Apr 30 21:24:31.735066 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1718/3523] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:31 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:31.867049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:31.867986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:31.875540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:31.879177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:31.880223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:31.882360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:32.013234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-68014019", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "369c733a-e1a7-43a2-a645-492680c2535f"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:32.119560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] validate_networks() for [('369c733a-e1a7-43a2-a645-492680c2535f', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:24:32.238360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:32.246391 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-13dad0a4-d58a-4555-be0c-cd52b97e7499 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1550 microversion: 2.1 time: 0.384237 Apr 30 21:24:32.251037 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1719/3524] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:31 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1550 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:32.286385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5e3c8c55-6d1f-4d55-9db3-788f3621c5a5 req-c194385c-682e-4a3c-9f56-d728e11ffbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:32.286385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5e3c8c55-6d1f-4d55-9db3-788f3621c5a5 req-c194385c-682e-4a3c-9f56-d728e11ffbbf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:32.286385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5e3c8c55-6d1f-4d55-9db3-788f3621c5a5 req-c194385c-682e-4a3c-9f56-d728e11ffbbf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:32.310351 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5e3c8c55-6d1f-4d55-9db3-788f3621c5a5 req-c194385c-682e-4a3c-9f56-d728e11ffbbf service nova] Creating event network-changed:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:24:32.330504 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5e3c8c55-6d1f-4d55-9db3-788f3621c5a5 req-c194385c-682e-4a3c-9f56-d728e11ffbbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076941 Apr 30 21:24:32.332561 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1720/3525] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:32.339040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:32.343995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:32.363338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:32.364498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:32.365542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:32.366338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:32.880898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:32.897914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4c13ead-2240-44c9-a255-cca7b979b367 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1550 microversion: 2.1 time: 0.563893 Apr 30 21:24:32.916845 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1721/3526] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:32 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1550 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:32.922855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:32.923482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:32.941024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:32.941286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:32.942112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:32.942557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:33.539565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:33.565395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:33.567628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:33.578658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b957c13d-e563-46cd-9dc3-f44968fe198d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1405 microversion: 2.20 time: 0.665276 Apr 30 21:24:33.578658 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1722/3527] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:32 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1405 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:33.665384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:24:33.665939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:24:33.666528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:24:33.667049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:24:33.667567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:24:33.690230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:33.690903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:33.691824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:33.692366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:33.732710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Getting quotas for project dd851d0a5daa4d03977b37c9b6904b6c. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:33.739896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Getting quotas for user 17921dea12554204984a990f94a9b354 and project dd851d0a5daa4d03977b37c9b6904b6c. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:33.754582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:24:33.758112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:24:33.879273 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99932831-0b84-40d5-b562-03154d630758 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.190151 Apr 30 21:24:33.880293 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1806/3528] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:24:33.896124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-463a6fb0-5695-428a-a2f1-16b3e17f1108 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:33.896771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-463a6fb0-5695-428a-a2f1-16b3e17f1108 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:33.925856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:33.926570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:33.944795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:33.945359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:33.946296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:33.946838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:34.051388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-463a6fb0-5695-428a-a2f1-16b3e17f1108 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:34.062191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-463a6fb0-5695-428a-a2f1-16b3e17f1108 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:34.087955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-463a6fb0-5695-428a-a2f1-16b3e17f1108 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:34.114930 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-463a6fb0-5695-428a-a2f1-16b3e17f1108 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1257 microversion: 2.21 time: 0.228165 Apr 30 21:24:34.116499 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1723/3529] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:33 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1257 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:24:34.474317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:34.483108 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75576034-3fb9-4a58-ab0f-380f2f8af5b3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1550 microversion: 2.1 time: 0.562584 Apr 30 21:24:34.484278 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1807/3530] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:33 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1550 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:34.595066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:34.596275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:34.611841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:34.612224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:34.617188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:34.617809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:34.886559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:34.895492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:34.897455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:34.898648 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f9ce9bb1-5a7e-4f24-90f0-5feda43af330 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1405 microversion: 2.20 time: 0.307651 Apr 30 21:24:34.899200 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1724/3531] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:34 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:35.134814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-511f11ff-b583-4055-931c-6d3ddebf7774 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:35.135367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-511f11ff-b583-4055-931c-6d3ddebf7774 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:35.234895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-511f11ff-b583-4055-931c-6d3ddebf7774 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:35.250338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-511f11ff-b583-4055-931c-6d3ddebf7774 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:35.255356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-511f11ff-b583-4055-931c-6d3ddebf7774 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:35.257291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-511f11ff-b583-4055-931c-6d3ddebf7774 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1257 microversion: 2.21 time: 0.128265 Apr 30 21:24:35.260305 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1808/3532] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:35 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1257 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:35.502843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:35.504230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:35.511112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:35.512304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:35.513215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:35.513957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:35.670528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1536128915", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f0cca1-4180-4eed-af9d-38f99c4f5357"}], "security_groups": [{"name": "tempest-securitygroup--332049069"}], "key_name": "tempest-keypair-1591866211", "user_data": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:35.707091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:35.715988 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44809d6d-fb1e-47e2-8dc5-3357ec4b13b5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.218119 Apr 30 21:24:35.716664 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1725/3533] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:35 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:35.732997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:35.733846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:35.741616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:35.742301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:35.743849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:35.744454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:35.874909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] validate_networks() for [('b4f0cca1-4180-4eed-af9d-38f99c4f5357', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:24:36.109579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:36.117645 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c5f452c3-8a4a-4e95-b0a9-c144797d70a6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.388566 Apr 30 21:24:36.118533 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1726/3534] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:35 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:36.123463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:36.124261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:36.137171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:36.137990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:36.139035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:36.139649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:36.865545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:36.886415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:36.887433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:36.892111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-614b3d8b-acbc-4fac-b8c0-e483f5579fb2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1405 microversion: 2.20 time: 0.768772 Apr 30 21:24:36.906486 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1727/3535] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:36 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1405 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:36.919280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc2879ed-d797-46a0-bf9b-f45cd7c5fc11 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-187865529"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:36.919280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cc2879ed-d797-46a0-bf9b-f45cd7c5fc11 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:36.930648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc2879ed-d797-46a0-bf9b-f45cd7c5fc11 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:36.931025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc2879ed-d797-46a0-bf9b-f45cd7c5fc11 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:36.931886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc2879ed-d797-46a0-bf9b-f45cd7c5fc11 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:36.932342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc2879ed-d797-46a0-bf9b-f45cd7c5fc11 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:37.184205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:24:37.184754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:24:37.185426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:24:37.185895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:24:37.186324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:24:37.195869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:37.196328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:37.197323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:37.197806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:37.218600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:24:37.224165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:24:37.238125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:24:37.240287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:24:37.404266 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7e0beeb1-04e6-4a81-a420-8229777bef30 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.744304 Apr 30 21:24:37.405595 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1809/3536] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:24:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:24:37.426682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:37.426682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:37.437206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:37.437851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:37.440684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:37.441262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:37.535785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:37.544288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:37.547611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:37.550549 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2e2cf6f-d584-4342-aaaa-22bfa77d730e tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1315 microversion: 2.21 time: 0.142799 Apr 30 21:24:37.561773 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1810/3537] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:37 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:37.561773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-030ff92a-abf3-4325-90fd-291461952c54 req-8c21cb25-3e1c-4ea4-8dd3-463b0c980f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "name": "network-vif-plugged", "status": "completed", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:37.576985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-030ff92a-abf3-4325-90fd-291461952c54 req-8c21cb25-3e1c-4ea4-8dd3-463b0c980f32 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:37.578012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-030ff92a-abf3-4325-90fd-291461952c54 req-8c21cb25-3e1c-4ea4-8dd3-463b0c980f32 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:37.595193 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-030ff92a-abf3-4325-90fd-291461952c54 req-8c21cb25-3e1c-4ea4-8dd3-463b0c980f32 service nova] Creating event network-vif-plugged:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch1-master-1 Apr 30 21:24:37.602953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-030ff92a-abf3-4325-90fd-291461952c54 req-8c21cb25-3e1c-4ea4-8dd3-463b0c980f32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048853 Apr 30 21:24:37.603999 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1811/3538] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:37.611451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21c5b574-9db1-41d8-8ae3-d759cdf2df35 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:37.612376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-21c5b574-9db1-41d8-8ae3-d759cdf2df35 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:37.625641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cc2879ed-d797-46a0-bf9b-f45cd7c5fc11 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.717566 Apr 30 21:24:37.648430 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1728/3539] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:24:36 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 30 21:24:37.747489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-21c5b574-9db1-41d8-8ae3-d759cdf2df35 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:37.756836 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21c5b574-9db1-41d8-8ae3-d759cdf2df35 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1242 microversion: 2.1 time: 0.151314 Apr 30 21:24:37.766929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1812/3540] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:37 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:37.923022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:37.927549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:37.942706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:37.946886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:37.947930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:37.948796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:38.389146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:38.398374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:38.399898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:38.401037 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a70fc83-3c4d-4526-94b2-649eb6b31756 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1405 microversion: 2.20 time: 0.491062 Apr 30 21:24:38.401591 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1729/3541] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:37 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:38.570294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:38.570840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:38.586966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:38.587708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:38.605536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:38.605536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:38.774388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:38.775017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:38.785655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:38.785655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:38.785655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:38.785655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:39.232624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:39.244882 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7ecccfc3-046a-423f-9f77-8ec68bb54501 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1246 microversion: 2.1 time: 0.474130 Apr 30 21:24:39.258021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1730/3542] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:38 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1246 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:39.326524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:39.338890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:39.340706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:39.350035 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89ed301b-a3a4-4f31-be83-97bae51a3418 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1357 microversion: 2.21 time: 0.776836 Apr 30 21:24:39.351038 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1813/3543] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:38 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1357 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:39.418296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:39.419557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:39.428375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:39.429421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:39.430903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:39.431716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:39.712133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:39.722170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:39.723810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:39.725114 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8e57640c-6280-448d-8c02-f731df6f6519 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1597 microversion: 2.20 time: 0.311145 Apr 30 21:24:39.726002 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1731/3544] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:39 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1597 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:39.750968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f304e6c-1ab4-4092-9cac-056184fee250 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:39.752033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8f304e6c-1ab4-4092-9cac-056184fee250 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:39.761779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f304e6c-1ab4-4092-9cac-056184fee250 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:39.762243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f304e6c-1ab4-4092-9cac-056184fee250 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:39.763039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f304e6c-1ab4-4092-9cac-056184fee250 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:39.763482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f304e6c-1ab4-4092-9cac-056184fee250 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:39.935810 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f304e6c-1ab4-4092-9cac-056184fee250 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.189912 Apr 30 21:24:39.936509 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1814/3545] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Apr 30 21:24:39 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:24:40.264455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:40.266012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:40.279759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:40.280777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:40.283778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:40.285663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:40.372483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:40.375275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:40.378508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:40.381210 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-22d028e9-c57f-4b5d-9c3d-ae0f8c80e30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1294 microversion: 2.1 time: 0.121486 Apr 30 21:24:40.382502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1732/3546] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:40 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:40.396655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:40.398054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:40.399190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:40.400412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:40.539908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-13ebe392-1e07-47f2-a6cc-3511987ce7e6 req-cd53c939-47fa-41ca-8ffe-ac341b36c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd46164-f27a-469c-a397-35c643decd85", "tag": "58e9c6ec-5174-49f0-a17b-c9fc8f666119"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:40.552388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13ebe392-1e07-47f2-a6cc-3511987ce7e6 req-cd53c939-47fa-41ca-8ffe-ac341b36c2a8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:40.552841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-13ebe392-1e07-47f2-a6cc-3511987ce7e6 req-cd53c939-47fa-41ca-8ffe-ac341b36c2a8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:40.565005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-13ebe392-1e07-47f2-a6cc-3511987ce7e6 req-cd53c939-47fa-41ca-8ffe-ac341b36c2a8 service nova] Creating event network-changed:58e9c6ec-5174-49f0-a17b-c9fc8f666119 for instance ebd46164-f27a-469c-a397-35c643decd85 on nch2-master-1 Apr 30 21:24:40.570355 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-13ebe392-1e07-47f2-a6cc-3511987ce7e6 req-cd53c939-47fa-41ca-8ffe-ac341b36c2a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035649 Apr 30 21:24:40.571600 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1733/3547] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:24:40.870143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:40.883272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:40.888721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:40.892843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c67ad79b-0add-49f3-b278-d2595051411b tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1357 microversion: 2.21 time: 0.524457 Apr 30 21:24:40.893706 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1815/3548] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:40 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1357 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:41.400594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:41.401325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:41.412657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:41.413118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:41.416836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:41.417308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:41.605243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:41.614676 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b360a41-4878-4fe6-ac8a-4cf953f03060 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1300 microversion: 2.1 time: 0.217765 Apr 30 21:24:41.618717 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1734/3549] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:41 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1300 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:41.736481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-79430737-f759-4e8b-8698-15b097255608 req-c96c1208-e416-4a53-842b-a1bef1e19af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:41.746269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-79430737-f759-4e8b-8698-15b097255608 req-c96c1208-e416-4a53-842b-a1bef1e19af2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:41.747087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-79430737-f759-4e8b-8698-15b097255608 req-c96c1208-e416-4a53-842b-a1bef1e19af2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:41.761976 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-79430737-f759-4e8b-8698-15b097255608 req-c96c1208-e416-4a53-842b-a1bef1e19af2 service nova] Creating event network-changed:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch1-master-1 Apr 30 21:24:41.768544 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-79430737-f759-4e8b-8698-15b097255608 req-c96c1208-e416-4a53-842b-a1bef1e19af2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036656 Apr 30 21:24:41.770434 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1816/3550] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:41.924366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:41.928213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:41.959786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:41.959786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:41.964072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:41.968167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:42.243268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:42.255777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:42.258074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:42.259406 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3bc38d81-e671-4682-8abd-a776bc88926f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1357 microversion: 2.21 time: 0.346749 Apr 30 21:24:42.270965 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1735/3551] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:41 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:42.643951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:42.645326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:42.666920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:42.670042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:42.674242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:42.677123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:43.004515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:43.026741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7bc59ca7-2932-4af0-82ea-9dbdd9b65d52 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1367 microversion: 2.1 time: 0.389152 Apr 30 21:24:43.035177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1817/3552] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:42 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:43.282782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:43.283626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:43.299580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:43.305122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:43.305122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:43.305122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:43.314650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8184b628-fa22-4760-b996-498ff2c7a0fb req-ddbac215-a967-4d8d-9b58-97c289bdba0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-plugged", "status": "completed", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:43.332198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8184b628-fa22-4760-b996-498ff2c7a0fb req-ddbac215-a967-4d8d-9b58-97c289bdba0e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:43.332656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8184b628-fa22-4760-b996-498ff2c7a0fb req-ddbac215-a967-4d8d-9b58-97c289bdba0e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:43.377265 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8184b628-fa22-4760-b996-498ff2c7a0fb req-ddbac215-a967-4d8d-9b58-97c289bdba0e service nova] Creating event network-vif-plugged:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:24:43.392065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8184b628-fa22-4760-b996-498ff2c7a0fb req-ddbac215-a967-4d8d-9b58-97c289bdba0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082117 Apr 30 21:24:43.413428 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1818/3553] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:24:43.838520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:43.851076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:43.853063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:43.855091 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45f0d4b0-0dff-43f1-83f4-3554a3107877 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1357 microversion: 2.21 time: 0.580628 Apr 30 21:24:43.865008 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1736/3554] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:43 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1357 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:44.048116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:44.058938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:44.075426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:44.077256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:44.078084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:44.080599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:44.418395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:44.429693 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d034708e-c857-42d5-8573-079f2a0b879f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1367 microversion: 2.1 time: 0.388051 Apr 30 21:24:44.430333 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1819/3555] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:44 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:44.672379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3904c663-be3b-4768-a27d-9c5a33bf55c3 req-d7cc1953-146c-4a55-ae1f-14b32b9d603c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3981cebe-916e-45b7-a15c-a2639be85842", "tag": "9f34796a-fd6b-425b-aaf7-911bec70b97e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:44.699912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3904c663-be3b-4768-a27d-9c5a33bf55c3 req-d7cc1953-146c-4a55-ae1f-14b32b9d603c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:44.702648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3904c663-be3b-4768-a27d-9c5a33bf55c3 req-d7cc1953-146c-4a55-ae1f-14b32b9d603c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:44.734110 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3904c663-be3b-4768-a27d-9c5a33bf55c3 req-d7cc1953-146c-4a55-ae1f-14b32b9d603c service nova] Creating event network-changed:9f34796a-fd6b-425b-aaf7-911bec70b97e for instance 3981cebe-916e-45b7-a15c-a2639be85842 on nch1-master-1 Apr 30 21:24:44.746672 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3904c663-be3b-4768-a27d-9c5a33bf55c3 req-d7cc1953-146c-4a55-ae1f-14b32b9d603c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079237 Apr 30 21:24:44.747829 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1737/3556] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:44.875162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:44.876138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:44.885187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:44.886778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:44.888229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:44.889683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:45.139952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:45.152342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:45.154172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:45.155613 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-135bc60a-7c3b-4c99-906e-0be9031dfea9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1357 microversion: 2.21 time: 0.285234 Apr 30 21:24:45.156909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1820/3557] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:44 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:45.450764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:45.451553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:45.465301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:45.466387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:45.467230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:45.467865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:46.179501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:46.180753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:46.189682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:46.190936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:46.194669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:46.195297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:46.444807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:46.455738 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f837bd7d-1e15-4478-8a64-c6616a1a8b69 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1367 microversion: 2.1 time: 1.010729 Apr 30 21:24:46.470512 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1738/3558] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:45 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1367 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:46.599486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:46.609064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:46.611230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:46.612786 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6c745ce-73f2-4696-a2d9-4d28de6c05ed tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1357 microversion: 2.21 time: 0.439979 Apr 30 21:24:46.613373 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1821/3559] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:46 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1357 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:47.226647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f5d07eed-6d19-429f-a598-605e88b7dd3c req-4c70deae-8b16-440e-9363-b843d52bcd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd46164-f27a-469c-a397-35c643decd85", "name": "network-vif-plugged", "status": "completed", "tag": "58e9c6ec-5174-49f0-a17b-c9fc8f666119"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:47.236726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f5d07eed-6d19-429f-a598-605e88b7dd3c req-4c70deae-8b16-440e-9363-b843d52bcd1f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:47.237256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f5d07eed-6d19-429f-a598-605e88b7dd3c req-4c70deae-8b16-440e-9363-b843d52bcd1f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:47.249708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f5d07eed-6d19-429f-a598-605e88b7dd3c req-4c70deae-8b16-440e-9363-b843d52bcd1f service nova] Creating event network-vif-plugged:58e9c6ec-5174-49f0-a17b-c9fc8f666119 for instance ebd46164-f27a-469c-a397-35c643decd85 on nch2-master-1 Apr 30 21:24:47.255627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f5d07eed-6d19-429f-a598-605e88b7dd3c req-4c70deae-8b16-440e-9363-b843d52bcd1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032721 Apr 30 21:24:47.257167 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1739/3560] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:47.479863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:47.480583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:47.488729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:47.489187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:47.490008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:47.490454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:47.638327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:47.639327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:47.651358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:47.651358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:47.651358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:47.651358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:47.678963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:47.686619 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42ed76d6-e63b-4fe4-802b-c03fc6b78e59 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1367 microversion: 2.1 time: 0.211760 Apr 30 21:24:47.693970 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1822/3561] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:47 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:48.001569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:48.012292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:48.013890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:48.021791 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-af0af550-8514-4e20-bb5b-775ab0df3440 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1357 microversion: 2.21 time: 0.389114 Apr 30 21:24:48.022743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1740/3562] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:47 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1357 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:24:48.705835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:48.706424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:48.717618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:48.723005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:48.724027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:48.724639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:49.023295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:49.041913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:49.042542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:49.056843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:49.059548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:49.060978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c715371-f4ff-400f-9cdb-aa4c7b738556 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1367 microversion: 2.1 time: 0.357037 Apr 30 21:24:49.061628 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1823/3563] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:48 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:49.063363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:49.064234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:49.325191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:49.334835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:49.340124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:49.340124 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ff28fa7f-0b9d-404f-a019-afb014c6528f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1550 microversion: 2.21 time: 0.301346 Apr 30 21:24:49.340124 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1741/3564] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:49 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1550 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:49.355789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:49.356391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:49.365203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:49.365998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:49.367019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:49.367648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:49.396988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:24:49.801693 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-06a1435a-0a67-4959-b0cc-dc32c1769eb9 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 204 len: 0 microversion: 2.21 time: 0.449535 Apr 30 21:24:49.802720 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1824/3565] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:24:49 2022] DELETE /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:24:49.823589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:49.824243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:49.841463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:49.843185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:49.848378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:49.850173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:50.074445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:50.080016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:50.080746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:50.090988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:50.093009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:50.093720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:50.095069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:50.096801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb28a0af-0783-4444-8436-f54a2298a1f8 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1556 microversion: 2.21 time: 0.287038 Apr 30 21:24:50.098630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:50.099270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:50.102654 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1742/3566] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:49 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1556 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:50.320221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:50.333148 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0622647f-4f03-421c-b3fe-16985addb23b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1367 microversion: 2.1 time: 0.253506 Apr 30 21:24:50.334244 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1825/3567] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:50 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:51.064325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e47bb8f1-f27b-4b1a-96a8-f85887c93200 req-a9e9a9f7-1f38-4630-aabb-72c463790694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3981cebe-916e-45b7-a15c-a2639be85842", "name": "network-vif-plugged", "status": "completed", "tag": "9f34796a-fd6b-425b-aaf7-911bec70b97e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:51.087637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e47bb8f1-f27b-4b1a-96a8-f85887c93200 req-a9e9a9f7-1f38-4630-aabb-72c463790694 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:51.088311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e47bb8f1-f27b-4b1a-96a8-f85887c93200 req-a9e9a9f7-1f38-4630-aabb-72c463790694 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:51.101913 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e47bb8f1-f27b-4b1a-96a8-f85887c93200 req-a9e9a9f7-1f38-4630-aabb-72c463790694 service nova] Creating event network-vif-plugged:9f34796a-fd6b-425b-aaf7-911bec70b97e for instance 3981cebe-916e-45b7-a15c-a2639be85842 on nch1-master-1 Apr 30 21:24:51.107563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e47bb8f1-f27b-4b1a-96a8-f85887c93200 req-a9e9a9f7-1f38-4630-aabb-72c463790694 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047911 Apr 30 21:24:51.108166 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1743/3568] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:51.116462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:51.117083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:51.125098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:51.125544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:51.126425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:51.126871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:51.372038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:51.373477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:51.390213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:51.390213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:51.390213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:51.390213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:51.933423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:51.946011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:51.952448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:51.965294 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e9964354-62eb-4aa1-85cd-06b1289ebb70 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1556 microversion: 2.21 time: 0.841308 Apr 30 21:24:51.965294 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1826/3569] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:51 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1556 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:52.116843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:52.131051 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2eca9a01-fe8d-4bda-bde5-5d39dd525551 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1367 microversion: 2.1 time: 0.779694 Apr 30 21:24:52.131675 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1744/3570] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:51 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1367 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:52.825059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d5cbcac6-0d12-4231-bda7-a3759c0dbed3 req-61839547-6b00-4db3-ae58-8b227af33a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd46164-f27a-469c-a397-35c643decd85", "name": "network-vif-deleted", "tag": "58e9c6ec-5174-49f0-a17b-c9fc8f666119"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:52.843060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d5cbcac6-0d12-4231-bda7-a3759c0dbed3 req-61839547-6b00-4db3-ae58-8b227af33a8e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:52.843608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d5cbcac6-0d12-4231-bda7-a3759c0dbed3 req-61839547-6b00-4db3-ae58-8b227af33a8e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:52.860878 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d5cbcac6-0d12-4231-bda7-a3759c0dbed3 req-61839547-6b00-4db3-ae58-8b227af33a8e service nova] Creating event network-vif-deleted:58e9c6ec-5174-49f0-a17b-c9fc8f666119 for instance ebd46164-f27a-469c-a397-35c643decd85 on nch2-master-1 Apr 30 21:24:52.867888 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d5cbcac6-0d12-4231-bda7-a3759c0dbed3 req-61839547-6b00-4db3-ae58-8b227af33a8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046601 Apr 30 21:24:52.869158 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1827/3571] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:24:52.973499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:52.974472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:52.988402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:52.990850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:52.993955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:52.994810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:53.104828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:53.111146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:53.113297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17921dea12554204984a990f94a9b354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd851d0a5daa4d03977b37c9b6904b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:53.114674 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47ac1b5d-2f0a-48d2-9632-408ce06fd35f tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 200 len: 1342 microversion: 2.21 time: 0.146027 Apr 30 21:24:53.115830 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1745/3572] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:52 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 1342 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:24:53.148753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:53.149460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:53.158861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:53.159545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:53.160422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:53.160947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:53.462556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:53.477630 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ff9561b-9e4c-44a3-b9e7-6529a7d1614b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1556 microversion: 2.1 time: 0.332695 Apr 30 21:24:53.478318 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1828/3573] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:53 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1556 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:24:53.499883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-004028d4-906d-48f7-8fe3-fbede8acb5dd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:53.500491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-004028d4-906d-48f7-8fe3-fbede8acb5dd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:53.518870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-004028d4-906d-48f7-8fe3-fbede8acb5dd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:53.519334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-004028d4-906d-48f7-8fe3-fbede8acb5dd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:53.520144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-004028d4-906d-48f7-8fe3-fbede8acb5dd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:53.520595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-004028d4-906d-48f7-8fe3-fbede8acb5dd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:53.672780 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-004028d4-906d-48f7-8fe3-fbede8acb5dd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175709 Apr 30 21:24:53.675775 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1746/3574] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:24:53 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:54.132388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:54.135562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:54.146721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.148527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.150816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.152195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.172607 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] HTTP exception thrown: Instance ebd46164-f27a-469c-a397-35c643decd85 could not be found. Apr 30 21:24:54.174110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Returning 404 to user: Instance ebd46164-f27a-469c-a397-35c643decd85 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:54.175184 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59be3529-a29d-4321-8301-159b582481a0 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 404 len: 111 microversion: 2.21 time: 0.046723 Apr 30 21:24:54.176029 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1829/3575] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:54 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:24:54.185708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-288c1bc7-a195-4277-a33c-9abf1cc68224 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '.version_select at 0x7fdc13f71c10>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:54.186739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-288c1bc7-a195-4277-a33c-9abf1cc68224 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:54.194846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-288c1bc7-a195-4277-a33c-9abf1cc68224 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.195663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-288c1bc7-a195-4277-a33c-9abf1cc68224 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.197186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-288c1bc7-a195-4277-a33c-9abf1cc68224 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.198492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-288c1bc7-a195-4277-a33c-9abf1cc68224 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.276430 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-288c1bc7-a195-4277-a33c-9abf1cc68224 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.095995 Apr 30 21:24:54.277402 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1747/3576] 10.222.0.23 () {60 vars in 1336 bytes} [Sat Apr 30 21:24:54 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85/os-instance-actions => generated 611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:24:54.291847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:54.292887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:54.301549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.302419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.303458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.304130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.351779 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] HTTP exception thrown: Instance ebd46164-f27a-469c-a397-35c643decd85 could not be found. Apr 30 21:24:54.355958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Returning 404 to user: Instance ebd46164-f27a-469c-a397-35c643decd85 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:54.355958 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b1fabeb-8b2f-474d-9aeb-646363a45fc2 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 404 len: 111 microversion: 2.21 time: 0.067243 Apr 30 21:24:54.355958 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1830/3577] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:24:54 2022] DELETE /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:24:54.363662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:54.364436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] [instance: ebd46164-f27a-469c-a397-35c643decd85] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:54.371641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.372167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.372974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:54.373460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:54.394759 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] HTTP exception thrown: Instance ebd46164-f27a-469c-a397-35c643decd85 could not be found. Apr 30 21:24:54.395381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] Returning 404 to user: Instance ebd46164-f27a-469c-a397-35c643decd85 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:24:54.396444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5e18de8b-b7b3-4740-8ac2-eea5dcbdeee4 tempest-InstanceActionsV221TestJSON-846204210 tempest-InstanceActionsV221TestJSON-846204210-project] 10.222.0.23 "GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85" status: 404 len: 111 microversion: 2.21 time: 0.037681 Apr 30 21:24:54.397938 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1748/3578] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:24:54 2022] GET /compute/v2.1/servers/ebd46164-f27a-469c-a397-35c643decd85 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:24:55.677479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3715bbc7-d6b0-4a73-a171-4a50c3f0a99a req-ac25a487-4ae4-4a5d-a966-67bf23aab07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3981cebe-916e-45b7-a15c-a2639be85842", "tag": "9f34796a-fd6b-425b-aaf7-911bec70b97e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:24:55.692271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3715bbc7-d6b0-4a73-a171-4a50c3f0a99a req-ac25a487-4ae4-4a5d-a966-67bf23aab07d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:55.699147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3715bbc7-d6b0-4a73-a171-4a50c3f0a99a req-ac25a487-4ae4-4a5d-a966-67bf23aab07d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:55.747452 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3715bbc7-d6b0-4a73-a171-4a50c3f0a99a req-ac25a487-4ae4-4a5d-a966-67bf23aab07d service nova] Creating event network-changed:9f34796a-fd6b-425b-aaf7-911bec70b97e for instance 3981cebe-916e-45b7-a15c-a2639be85842 on nch1-master-1 Apr 30 21:24:55.761033 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3715bbc7-d6b0-4a73-a171-4a50c3f0a99a req-ac25a487-4ae4-4a5d-a966-67bf23aab07d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087133 Apr 30 21:24:55.761655 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1831/3579] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:24:58.486282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:58.493385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:58.500336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:58.500849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:58.501658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:58.502146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:58.745372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:24:58.773177 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e182c1a6-e135-45f6-a5ec-4fae372e4935 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.291239 Apr 30 21:24:58.784862 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1749/3580] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:58 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:24:59.793242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:24:59.794641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:24:59.803861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:59.803861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:24:59.803861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:24:59.803861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:00.084302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:00.092986 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02ae43af-717c-435e-91d8-68fd1cd1564e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.304974 Apr 30 21:25:00.093585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1832/3581] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:59 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:00.112673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5d5cc1a-19f4-4a10-916c-4d2484b85a56 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1551652235"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:00.113994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5d5cc1a-19f4-4a10-916c-4d2484b85a56 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:00.121013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5d5cc1a-19f4-4a10-916c-4d2484b85a56 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:00.121598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5d5cc1a-19f4-4a10-916c-4d2484b85a56 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:00.122523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5d5cc1a-19f4-4a10-916c-4d2484b85a56 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:00.123158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5d5cc1a-19f4-4a10-916c-4d2484b85a56 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:00.679422 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5d5cc1a-19f4-4a10-916c-4d2484b85a56 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.571084 Apr 30 21:25:00.680911 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1750/3582] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:25:00 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 30 21:25:00.795730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1169805428", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "e8c74264-5714-4de9-a52a-c6c004380eb9"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:00.868285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] validate_networks() for [('e8c74264-5714-4de9-a52a-c6c004380eb9', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:25:01.566853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:25:01.567618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:25:01.568675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:25:01.570009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:25:01.570644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:25:01.586929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:01.588026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:01.589274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:01.589921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:01.628004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Getting quotas for project 1236f389e69047b8add7cbc7cefe8f24. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:25:01.634701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Getting quotas for user a466ad74049c4383af4a5f43f7023728 and project 1236f389e69047b8add7cbc7cefe8f24. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:25:01.654513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:25:01.657896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:25:01.795660 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d805b3ce-b478-452b-8ca8-ed5a45705a7c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180311 Apr 30 21:25:01.808422 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1833/3583] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:25:01.949674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1368684816", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "e8c74264-5714-4de9-a52a-c6c004380eb9"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:02.030851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] validate_networks() for [('e8c74264-5714-4de9-a52a-c6c004380eb9', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:25:02.704467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:25:02.704899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:25:02.705387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:25:02.706143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:25:02.706743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:25:02.726750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:02.727764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:02.728983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:02.730369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:02.807086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Getting quotas for project 1236f389e69047b8add7cbc7cefe8f24. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:25:02.830148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Getting quotas for user a466ad74049c4383af4a5f43f7023728 and project 1236f389e69047b8add7cbc7cefe8f24. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:25:02.855304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:25:02.860999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:25:03.140905 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-714b0e3b-53d6-4036-a24b-b7482069bc69 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197645 Apr 30 21:25:03.145454 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1751/3584] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:25:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:25:03.214179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ce9c9ec4-31ce-43f0-87fe-8c108ff6c47a req-56191cca-890e-409b-9cf6-a9d46a1c7fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-unplugged", "status": "completed", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:03.232853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ce9c9ec4-31ce-43f0-87fe-8c108ff6c47a req-56191cca-890e-409b-9cf6-a9d46a1c7fd0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:03.233593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ce9c9ec4-31ce-43f0-87fe-8c108ff6c47a req-56191cca-890e-409b-9cf6-a9d46a1c7fd0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:03.261383 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ce9c9ec4-31ce-43f0-87fe-8c108ff6c47a req-56191cca-890e-409b-9cf6-a9d46a1c7fd0 service nova] Creating event network-vif-unplugged:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:25:03.276149 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ce9c9ec4-31ce-43f0-87fe-8c108ff6c47a req-56191cca-890e-409b-9cf6-a9d46a1c7fd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066028 Apr 30 21:25:03.278716 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1834/3585] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:03.336430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-387527901", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "451", "networks": [{"uuid": "e8c74264-5714-4de9-a52a-c6c004380eb9"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:03.459192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] validate_networks() for [('e8c74264-5714-4de9-a52a-c6c004380eb9', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:25:04.289946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:25:04.289946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:25:04.289946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:25:04.289946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:25:04.290766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:25:04.306081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:04.306787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:04.308793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:04.309443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:04.332736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Getting quotas for project 1236f389e69047b8add7cbc7cefe8f24. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:25:04.338193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Getting quotas for user a466ad74049c4383af4a5f43f7023728 and project 1236f389e69047b8add7cbc7cefe8f24. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:25:04.351956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:25:04.354148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:25:04.505292 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-22a04144-c20e-4f46-8672-8ab217421552 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174448 Apr 30 21:25:04.511072 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1752/3586] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:25:04.516576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58b19824-6a81-4551-a263-063dd214aa95 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:04.517027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-58b19824-6a81-4551-a263-063dd214aa95 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:04.582416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-58b19824-6a81-4551-a263-063dd214aa95 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:04.589742 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58b19824-6a81-4551-a263-063dd214aa95 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1220 microversion: 2.1 time: 0.077678 Apr 30 21:25:04.594973 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1835/3587] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:04 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:05.609356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:05.613183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:05.624673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:05.625815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:05.627608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:05.628646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:05.796478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:05.805705 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23a202db-61cf-4024-929f-7bf0eef10c4a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1224 microversion: 2.1 time: 0.202162 Apr 30 21:25:05.806337 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1753/3588] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:05 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1224 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:06.825803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:06.827022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:06.869484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:06.869985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:06.880186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:06.880709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:07.108351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:07.122940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1a098f1-9d9a-40f0-ab83-c9426f55ffe2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1272 microversion: 2.1 time: 0.298714 Apr 30 21:25:07.124515 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1836/3589] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:06 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:07.428920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2d0c5ade-2517-43f1-8843-6f10fa8427d9 req-0aa9d3e4-8527-49ad-971b-5e22dda26799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-plugged", "status": "completed", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:07.448143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d0c5ade-2517-43f1-8843-6f10fa8427d9 req-0aa9d3e4-8527-49ad-971b-5e22dda26799 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:07.449594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d0c5ade-2517-43f1-8843-6f10fa8427d9 req-0aa9d3e4-8527-49ad-971b-5e22dda26799 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:07.469829 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2d0c5ade-2517-43f1-8843-6f10fa8427d9 req-0aa9d3e4-8527-49ad-971b-5e22dda26799 service nova] Creating event network-vif-plugged:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:25:07.478488 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2d0c5ade-2517-43f1-8843-6f10fa8427d9 req-0aa9d3e4-8527-49ad-971b-5e22dda26799 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054326 Apr 30 21:25:07.483777 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1754/3590] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:08.141960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:08.143169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:08.155385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:08.156106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:08.157614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:08.170563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:08.337598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:08.345710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-438dccfe-106f-4156-a2fb-359c2129d313 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1278 microversion: 2.1 time: 0.209081 Apr 30 21:25:08.346332 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1837/3591] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:08 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:08.732571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6ee23c1d-4e82-47f6-ad16-a7bcf6d11124 req-4cccd124-5025-4cb7-a2a4-7040821aa2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63d86ea-e808-48fc-a674-231fbfbca961", "tag": "ce973619-9d58-43bb-af05-38ad4e6df819"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:08.755003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ee23c1d-4e82-47f6-ad16-a7bcf6d11124 req-4cccd124-5025-4cb7-a2a4-7040821aa2d3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:08.756621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ee23c1d-4e82-47f6-ad16-a7bcf6d11124 req-4cccd124-5025-4cb7-a2a4-7040821aa2d3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:08.789307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6ee23c1d-4e82-47f6-ad16-a7bcf6d11124 req-4cccd124-5025-4cb7-a2a4-7040821aa2d3 service nova] Creating event network-changed:ce973619-9d58-43bb-af05-38ad4e6df819 for instance d63d86ea-e808-48fc-a674-231fbfbca961 on nch2-master-1 Apr 30 21:25:08.801440 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6ee23c1d-4e82-47f6-ad16-a7bcf6d11124 req-4cccd124-5025-4cb7-a2a4-7040821aa2d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073790 Apr 30 21:25:08.802097 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1755/3592] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:09.365165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:09.366097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:09.380953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:09.381942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:09.382229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:09.382688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:09.469439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2987ff7c-2e16-47db-9576-d1a02eb8529d tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:09.470460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2987ff7c-2e16-47db-9576-d1a02eb8529d tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:09.476660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2987ff7c-2e16-47db-9576-d1a02eb8529d tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:09.477490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2987ff7c-2e16-47db-9576-d1a02eb8529d tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:09.478623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2987ff7c-2e16-47db-9576-d1a02eb8529d tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:09.479249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2987ff7c-2e16-47db-9576-d1a02eb8529d tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:09.537109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2987ff7c-2e16-47db-9576-d1a02eb8529d tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "POST /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f/action" status: 200 len: 24584 microversion: 2.42 time: 0.561701 Apr 30 21:25:09.543070 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1838/3593] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:25:08 2022] POST /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f/action => generated 24584 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:25:09.557772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:09.572976 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2cda262-a97a-41ac-a1bc-db2b9f90cd11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1278 microversion: 2.1 time: 0.213549 Apr 30 21:25:09.574127 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1756/3594] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:09 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:10.590774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:10.591482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:10.600453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:10.601146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:10.606824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:10.606824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:11.106757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:11.117501 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c24fd5e8-23d6-4ffe-831b-3e46e82f8576 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.530982 Apr 30 21:25:11.118457 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1839/3595] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:10 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:12.135684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:12.137418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:12.151547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:12.152409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:12.155850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:12.157360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:12.313401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-af016ef7-fb68-4c05-ac86-06acf5a5f63a req-53234ca5-3540-4c36-899f-109ad8081635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e309dd58-b98d-4f90-ab4c-de3de6a69682", "tag": "083ed1b2-7dbf-4e5c-bc71-4e99b831b3bf"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:12.335725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-af016ef7-fb68-4c05-ac86-06acf5a5f63a req-53234ca5-3540-4c36-899f-109ad8081635 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:12.335725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-af016ef7-fb68-4c05-ac86-06acf5a5f63a req-53234ca5-3540-4c36-899f-109ad8081635 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:12.365563 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-af016ef7-fb68-4c05-ac86-06acf5a5f63a req-53234ca5-3540-4c36-899f-109ad8081635 service nova] Creating event network-changed:083ed1b2-7dbf-4e5c-bc71-4e99b831b3bf for instance e309dd58-b98d-4f90-ab4c-de3de6a69682 on nch2-master-1 Apr 30 21:25:12.385661 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-af016ef7-fb68-4c05-ac86-06acf5a5f63a req-53234ca5-3540-4c36-899f-109ad8081635 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076747 Apr 30 21:25:12.386446 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1840/3596] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:25:12.574184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:12.584317 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24a785e5-6bf7-4e33-b5f7-52608685d3b1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.453366 Apr 30 21:25:12.591272 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1757/3597] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:12 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:13.605467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:13.606915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:13.620517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:13.621159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:13.624611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:13.626352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:14.038367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:14.046705 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7a52da51-f9d5-40a7-9541-a33cfe1f08ac tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.445765 Apr 30 21:25:14.059471 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1841/3598] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:13 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:14.405298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-10983f0b-c991-4fca-bd1b-e55acbbc46bf req-cc7f91ab-a1c4-4732-bec3-3b3ce1832c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d16530-0c8c-460c-9fda-e6249fbd6d00", "tag": "36dd9bb6-ae98-4c2b-bbd6-8d93532b485e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:14.415566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-10983f0b-c991-4fca-bd1b-e55acbbc46bf req-cc7f91ab-a1c4-4732-bec3-3b3ce1832c6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:14.416262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-10983f0b-c991-4fca-bd1b-e55acbbc46bf req-cc7f91ab-a1c4-4732-bec3-3b3ce1832c6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:14.429051 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-10983f0b-c991-4fca-bd1b-e55acbbc46bf req-cc7f91ab-a1c4-4732-bec3-3b3ce1832c6a service nova] Creating event network-changed:36dd9bb6-ae98-4c2b-bbd6-8d93532b485e for instance 38d16530-0c8c-460c-9fda-e6249fbd6d00 on nch2-master-1 Apr 30 21:25:14.435042 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-10983f0b-c991-4fca-bd1b-e55acbbc46bf req-cc7f91ab-a1c4-4732-bec3-3b3ce1832c6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035305 Apr 30 21:25:14.435935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1758/3599] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:15.070078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:15.070707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:15.081234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:15.092107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:15.095792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:15.102278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:15.423859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:15.438524 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cb536d23-7213-4913-bd5d-21fbf68fb362 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.371760 Apr 30 21:25:15.440936 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1842/3600] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:15 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:16.457683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:16.458421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:16.464808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:16.465272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:16.466092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:16.466545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:17.054891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:17.064069 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-970b7c62-149d-445a-925b-a8522631ed10 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.611987 Apr 30 21:25:17.069606 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1759/3601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:16 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:17.601795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d932f852-410c-4bab-8e97-5ad117b23ed5 req-5c96c8a1-b109-4cf8-9b87-a2a719ade70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63d86ea-e808-48fc-a674-231fbfbca961", "name": "network-vif-plugged", "status": "completed", "tag": "ce973619-9d58-43bb-af05-38ad4e6df819"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:17.625594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d932f852-410c-4bab-8e97-5ad117b23ed5 req-5c96c8a1-b109-4cf8-9b87-a2a719ade70e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:17.626512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d932f852-410c-4bab-8e97-5ad117b23ed5 req-5c96c8a1-b109-4cf8-9b87-a2a719ade70e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:17.647146 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d932f852-410c-4bab-8e97-5ad117b23ed5 req-5c96c8a1-b109-4cf8-9b87-a2a719ade70e service nova] Creating event network-vif-plugged:ce973619-9d58-43bb-af05-38ad4e6df819 for instance d63d86ea-e808-48fc-a674-231fbfbca961 on nch2-master-1 Apr 30 21:25:17.656701 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d932f852-410c-4bab-8e97-5ad117b23ed5 req-5c96c8a1-b109-4cf8-9b87-a2a719ade70e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059930 Apr 30 21:25:17.658208 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1843/3602] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:25:18.086677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:18.087623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:18.102989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:18.103459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:18.104263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:18.104714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:18.266408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:18.277492 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-50dc2c59-92f6-4061-9b85-93d0892a9035 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.195720 Apr 30 21:25:18.286197 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1760/3603] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:18 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:18.581524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c89d06b-e1e3-4d00-bd06-0f01966b144a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:18.582179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c89d06b-e1e3-4d00-bd06-0f01966b144a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:18.589039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c89d06b-e1e3-4d00-bd06-0f01966b144a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:18.589607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c89d06b-e1e3-4d00-bd06-0f01966b144a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:18.591092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c89d06b-e1e3-4d00-bd06-0f01966b144a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:18.591549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c89d06b-e1e3-4d00-bd06-0f01966b144a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:18.619209 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c89d06b-e1e3-4d00-bd06-0f01966b144a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/ips" status: 200 len: 151 microversion: 2.20 time: 0.042664 Apr 30 21:25:18.620541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1844/3604] 10.222.0.23 () {60 vars in 1288 bytes} [Sat Apr 30 21:25:18 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:25:19.308831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:19.309323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:19.329623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:19.334217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:19.336582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:19.340317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:19.608427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:19.621481 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3913e09f-83cb-4111-bcc4-9a6e3dd26b32 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.320801 Apr 30 21:25:19.630918 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1761/3605] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:19 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:19.877823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c1eb4d52-613b-4671-b326-8d66252b2f44 req-733e15d9-ef69-465d-8371-9c68d08e4c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d16530-0c8c-460c-9fda-e6249fbd6d00", "name": "network-vif-plugged", "status": "completed", "tag": "36dd9bb6-ae98-4c2b-bbd6-8d93532b485e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:19.904854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c1eb4d52-613b-4671-b326-8d66252b2f44 req-733e15d9-ef69-465d-8371-9c68d08e4c77 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:19.905435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c1eb4d52-613b-4671-b326-8d66252b2f44 req-733e15d9-ef69-465d-8371-9c68d08e4c77 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:19.924916 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c1eb4d52-613b-4671-b326-8d66252b2f44 req-733e15d9-ef69-465d-8371-9c68d08e4c77 service nova] Creating event network-vif-plugged:36dd9bb6-ae98-4c2b-bbd6-8d93532b485e for instance 38d16530-0c8c-460c-9fda-e6249fbd6d00 on nch2-master-1 Apr 30 21:25:19.932886 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c1eb4d52-613b-4671-b326-8d66252b2f44 req-733e15d9-ef69-465d-8371-9c68d08e4c77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062543 Apr 30 21:25:19.934297 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1845/3606] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:20.643557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:20.645040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:20.656577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:20.660144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:20.660144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:20.660144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:20.848729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:20.856912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eaa258bc-e0ee-4a3f-86ff-b88a2618ebc2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1320 microversion: 2.1 time: 0.222054 Apr 30 21:25:20.857505 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1762/3607] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:20 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:21.875615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:21.876335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:21.883878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:21.884558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:21.885385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:21.886019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:21.951664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ad51c60e-8d23-4932-8988-89550ab7a51a req-8d3b366c-7cf4-4978-bb99-e90e56730562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e309dd58-b98d-4f90-ab4c-de3de6a69682", "name": "network-vif-plugged", "status": "completed", "tag": "083ed1b2-7dbf-4e5c-bc71-4e99b831b3bf"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:21.969789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ad51c60e-8d23-4932-8988-89550ab7a51a req-8d3b366c-7cf4-4978-bb99-e90e56730562 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:21.969789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ad51c60e-8d23-4932-8988-89550ab7a51a req-8d3b366c-7cf4-4978-bb99-e90e56730562 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:21.986311 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ad51c60e-8d23-4932-8988-89550ab7a51a req-8d3b366c-7cf4-4978-bb99-e90e56730562 service nova] Creating event network-vif-plugged:083ed1b2-7dbf-4e5c-bc71-4e99b831b3bf for instance e309dd58-b98d-4f90-ab4c-de3de6a69682 on nch2-master-1 Apr 30 21:25:21.992102 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ad51c60e-8d23-4932-8988-89550ab7a51a req-8d3b366c-7cf4-4978-bb99-e90e56730562 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044838 Apr 30 21:25:21.994364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1763/3608] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:25:22.305958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:22.314595 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e0a8f9c-00ec-41e7-bb87-e1685f90ea2a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1512 microversion: 2.1 time: 0.443470 Apr 30 21:25:22.325935 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1846/3609] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:21 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1512 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:22.331236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:22.332138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:22.338817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:22.339509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:22.340299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:22.340906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:22.511115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:22.520627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-64138205-841d-4085-95b9-f77f3784bfe5 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1512 microversion: 2.1 time: 0.193563 Apr 30 21:25:22.521553 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1764/3610] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:22 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:22.539030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:22.539736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:22.546636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:22.547215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:22.548076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:22.548590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:22.712897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:22.721235 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-299a0ab1-5929-4eac-9491-5ae28b35dc53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1321 microversion: 2.1 time: 0.187069 Apr 30 21:25:22.721842 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1847/3611] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:22 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:23.152582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:23.153227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:23.171012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:23.172058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:23.172867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:23.173319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:23.208954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lazy-loading 'flavor' on Instance uuid b45384b3-9650-4bdb-ac27-d291062e84b5 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:25:23.686418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:23.687293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:23.696216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:23.696883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:23.700033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:23.700033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:23.849540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:23.859415 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee104a2f-35a0-44e9-b14e-ad60db447c9a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.176802 Apr 30 21:25:23.872953 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1848/3612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:23 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:23.878971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:23.879972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:23.893502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:23.894401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:23.895594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:23.896269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:23.995067 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-83a61e68-693c-4e6c-8463-34b1abf48530 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/action" status: 202 len: 0 microversion: 2.20 time: 0.846382 Apr 30 21:25:23.996467 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1765/3613] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:25:23 2022] POST /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:25:24.024437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a037479a-d3dd-4fb7-a3b0-58f9079c4fcd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1935151834"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:24.026585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a037479a-d3dd-4fb7-a3b0-58f9079c4fcd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:24.044484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a037479a-d3dd-4fb7-a3b0-58f9079c4fcd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.045242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a037479a-d3dd-4fb7-a3b0-58f9079c4fcd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.049530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a037479a-d3dd-4fb7-a3b0-58f9079c4fcd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.049530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a037479a-d3dd-4fb7-a3b0-58f9079c4fcd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.057529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.065946 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c679f820-3f82-4fb2-b589-ef6dc73a4f93 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1513 microversion: 2.1 time: 0.191741 Apr 30 21:25:24.066764 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1849/3614] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:23 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:24.072158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:24.072625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:24.082004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.082526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.083331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.083778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.268841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.278108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.283785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.283785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cef5dd92-7348-401c-9d4a-26a23b56aaa7 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.213919 Apr 30 21:25:24.283785 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1850/3615] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:24 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:24.291209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:24.297583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.298590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:24.311168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.311856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.313512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.314025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.412646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:24.482841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.489556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.490062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.612547 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9bb41f04-3187-40e8-8d41-ba632c697133 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.327131 Apr 30 21:25:24.613167 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1851/3616] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Apr 30 21:25:24 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:24.630539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:24.634334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.635098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1169805428', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:24.641042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.641501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.642355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.642806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.734651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:24.774980 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a037479a-d3dd-4fb7-a3b0-58f9079c4fcd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.775689 Apr 30 21:25:24.775669 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1766/3617] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:25:23 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 30 21:25:24.790378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:24.791235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:24.798753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.802528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.805151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.805796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:24.809522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:24.815329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:24.815796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.009331 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20e3d529-0451-427f-aa6e-3e539d0900ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1169805428" status: 200 len: 1515 microversion: 2.1 time: 0.382315 Apr 30 21:25:25.010615 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1852/3618] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:25:24 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1169805428 => generated 1515 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:25.022252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.028325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:25.028842 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4f55b815-d3b5-476f-a6d6-686052437cca tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.242696 Apr 30 21:25:25.030373 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1767/3619] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:24 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:25.032293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.033298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:25.038565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.039033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.039852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.040299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.136261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:25.209236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.216355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.216822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.304308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:25.305777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:25.326187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.326187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.326187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.326187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.366253 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3d6afbf-d16e-46f1-998c-de15cb181005 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.341742 Apr 30 21:25:25.366878 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1853/3620] 10.222.0.23 () {58 vars in 1172 bytes} [Sat Apr 30 21:25:25 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:25.386241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:25.389991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.390694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.servers [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Removing options 'limit' from query {{(pid=130671) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 30 21:25:25.391463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:25.396912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.397606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.398457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.398907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.434011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.440031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.440491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.534903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.546443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.548033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.549564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-663eb9ca-a280-4a65-a21d-40ad06c61ca1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.251742 Apr 30 21:25:25.550319 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1768/3621] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:25 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:25.583268 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aae4576c-e466-42f4-a73f-e659611d4406 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.200334 Apr 30 21:25:25.587273 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1854/3622] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 21:25:25 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:25.603506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:25.608729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.608729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:25.614683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.615155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.615977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.616431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.712505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:25.773885 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a45d00f1-ab13-4755-8ea6-18e6cbfb436f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.175919 Apr 30 21:25:25.774489 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1769/3623] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:25:25 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:25.787312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:25.790729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.794693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.servers [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Removing options 'limit' from query {{(pid=130671) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 30 21:25:25.794693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:25.798265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.798726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.799535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.799979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.826545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:25.854925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f26550fd-f49c-40da-aca6-e31aaf79174a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.072700 Apr 30 21:25:25.855515 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1855/3624] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Apr 30 21:25:25 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:25.866087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:25.869510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.870114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:25.875756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.876218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.877039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.877492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.904564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:25.933164 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b95fefc1-f31a-494f-b17e-4dc03ebf8a19 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.070967 Apr 30 21:25:25.933787 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1770/3625] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:25:25 2022] GET /compute/v2.1/servers => generated 1011 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:25.945066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:25.948339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:25.949006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:25.961687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.962392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:25.963228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:25.963669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.047383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:26.048210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:26.049635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:26.054325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.054803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.055603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.056053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.116721 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ba9a0b0-8a96-489c-8d9d-abe54aa978a6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.175351 Apr 30 21:25:26.123960 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1856/3626] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:25:25 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:26.129670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:26.133138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:26.133591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.servers [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Removing options 'limit' from query {{(pid=130671) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 30 21:25:26.134281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:26.147759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.148821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.150168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.151230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.185104 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eaf288be-6940-4d1e-8194-6ea2b0e06e64 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.059177 Apr 30 21:25:26.185707 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1857/3627] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Apr 30 21:25:26 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:26.198681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:26.202333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:26.204380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1169805428', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:26.211209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.215814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.215814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.215814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.245057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:26.253814 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75837c73-ab1b-4583-b8dc-6b9259ff3711 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.211028 Apr 30 21:25:26.257875 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1771/3628] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:26.316162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:26.383825 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0d1ace6-8299-49f2-a7ac-f98c08263199 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1169805428" status: 200 len: 346 microversion: 2.1 time: 0.189131 Apr 30 21:25:26.384426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1858/3629] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:25:26 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1169805428 => generated 346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:26.403710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d5100b8-a060-46d6-92cc-1affa319dbb4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:26.411506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d5100b8-a060-46d6-92cc-1affa319dbb4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.411961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d5100b8-a060-46d6-92cc-1affa319dbb4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.478824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d5100b8-a060-46d6-92cc-1affa319dbb4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Going to try to stop instance {{(pid=130670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:25:26.569142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:26.570022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:26.576099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.576528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.577336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.577837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.685056 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d5100b8-a060-46d6-92cc-1affa319dbb4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "POST /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961/action" status: 202 len: 0 microversion: 2.1 time: 0.285115 Apr 30 21:25:26.685677 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1772/3630] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:25:26 2022] POST /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:25:26.695037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:26.696025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:26.703882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.704565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.706665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:26.706665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:26.723245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:26.731173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:26.732693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:26.733939 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3b1525f7-5c7b-41bf-9f21-ae01802af5ac tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.168807 Apr 30 21:25:26.734509 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1859/3631] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:26 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:26.861512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:26.869704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-092b2ded-cff2-4344-9fce-c3d1e1a27bb8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.179085 Apr 30 21:25:26.870354 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1773/3632] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:26 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:27.112990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-98ec532e-6620-4beb-809d-d3a443ab6a1e req-4bab0876-b92c-49b5-8d89-20b99d531f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-unplugged", "status": "completed", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:27.123530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-98ec532e-6620-4beb-809d-d3a443ab6a1e req-4bab0876-b92c-49b5-8d89-20b99d531f56 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:27.123983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-98ec532e-6620-4beb-809d-d3a443ab6a1e req-4bab0876-b92c-49b5-8d89-20b99d531f56 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:27.135878 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-98ec532e-6620-4beb-809d-d3a443ab6a1e req-4bab0876-b92c-49b5-8d89-20b99d531f56 service nova] Creating event network-vif-unplugged:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:25:27.141591 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-98ec532e-6620-4beb-809d-d3a443ab6a1e req-4bab0876-b92c-49b5-8d89-20b99d531f56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032177 Apr 30 21:25:27.142234 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1860/3633] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:27.273254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:27.274158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:27.282067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:27.282716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:27.283581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:27.284033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:27.423963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:27.432637 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d34da67-85d3-491b-b241-33fdd430765f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1687 microversion: 2.1 time: 0.163840 Apr 30 21:25:27.433361 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1774/3634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:27 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:27.753227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:27.754194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:27.762966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:27.763495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:27.764541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:27.765704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:27.888381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:27.889023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:27.895696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:27.896164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:27.897143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:27.897599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:27.905235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:27.918929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:27.920946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:27.922804 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e6e6a805-9e95-4411-9842-394e5e078223 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.174466 Apr 30 21:25:27.923470 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1861/3635] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:27 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:28.051904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:28.059765 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f530fcdf-be4f-45c2-aa30-8a5e6ca7b7b9 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.175774 Apr 30 21:25:28.060343 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1775/3636] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:27 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:28.450849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:28.451557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:28.458882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:28.459432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:28.460396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:28.461074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:28.609543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:28.617565 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c2aaa99-fef3-41fd-8804-cb6f2072d786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1687 microversion: 2.1 time: 0.170592 Apr 30 21:25:28.618452 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1862/3637] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:28 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:28.948951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:28.949594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:28.962881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:28.963347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:28.964133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:28.964579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:29.077815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:29.079190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:29.088195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:29.089112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:29.089963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:29.090409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:29.363072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:29.372787 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce650cf8-641e-4f34-be73-7532f9ff2b92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.299970 Apr 30 21:25:29.374435 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1863/3638] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:29 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:29.528764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:29.549904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:29.552457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:29.553997 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-559c0c8e-3761-4961-9bb8-3808128ce674 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.616063 Apr 30 21:25:29.567682 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1776/3639] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:28 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:29.636295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:29.636918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:29.648670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:29.651550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:29.654154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:29.655604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:29.839969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:29.848555 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15a7977b-0785-460c-af4f-bb00d22d383e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.216475 Apr 30 21:25:29.849420 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1864/3640] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:29 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:30.349885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bdcba4d8-27a7-4556-9843-6433b0078633 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:30.350425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bdcba4d8-27a7-4556-9843-6433b0078633 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:30.364736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdcba4d8-27a7-4556-9843-6433b0078633 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.365608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdcba4d8-27a7-4556-9843-6433b0078633 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.367485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdcba4d8-27a7-4556-9843-6433b0078633 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.368576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdcba4d8-27a7-4556-9843-6433b0078633 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.392647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:30.393649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:30.410665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.411342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.412312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.415933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.430925 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bdcba4d8-27a7-4556-9843-6433b0078633 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/ips" status: 200 len: 149 microversion: 2.1 time: 0.085116 Apr 30 21:25:30.438875 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1777/3641] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:25:30 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/ips => generated 149 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:30.573493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:30.574307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:30.599688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.600185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.601013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.601472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.795921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:30.812231 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3878237b-5061-45ec-9e6f-068c938190f2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.423848 Apr 30 21:25:30.814210 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1865/3642] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:30 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:30.865191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:30.870733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:30.870733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:30.879401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.880051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.881454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:30.882050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:30.883360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:30.884126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:30.885559 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7c4b66d4-f184-4d29-9f78-5d7064734700 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.316976 Apr 30 21:25:30.886650 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1778/3643] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:30 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:31.091967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:31.104351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7c3ec553-23f2-4326-aa7f-972b737a4ea6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.239169 Apr 30 21:25:31.104982 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1866/3644] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:30 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:31.332094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-112c9055-4348-4091-9dd7-45d690155291 req-94263bf4-e0f6-4620-8144-123bf3741c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-plugged", "status": "completed", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:31.350063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-112c9055-4348-4091-9dd7-45d690155291 req-94263bf4-e0f6-4620-8144-123bf3741c19 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:31.350681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-112c9055-4348-4091-9dd7-45d690155291 req-94263bf4-e0f6-4620-8144-123bf3741c19 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:31.372306 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-112c9055-4348-4091-9dd7-45d690155291 req-94263bf4-e0f6-4620-8144-123bf3741c19 service nova] Creating event network-vif-plugged:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:25:31.382930 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-112c9055-4348-4091-9dd7-45d690155291 req-94263bf4-e0f6-4620-8144-123bf3741c19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054522 Apr 30 21:25:31.388002 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1779/3645] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:31.835006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:31.837922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:31.844848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:31.845305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:31.846229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:31.846676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:31.905553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:31.907325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:31.914875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:31.915673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:31.916630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:31.917238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:32.102702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:32.114432 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9edc97c2-79a4-42b8-8b9e-62a54fcd7c39 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.282515 Apr 30 21:25:32.116787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1867/3646] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:31 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:32.129513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:32.130489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:32.142230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:32.144166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:32.149813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:32.150055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:32.150808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:32.159832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:32.161362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:32.163581 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-62ae0697-1090-404f-a36b-4aec8e29ad06 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.262632 Apr 30 21:25:32.183304 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1780/3647] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:31 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:32.338339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:32.348574 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-315cbda4-6bcd-4cba-b2ab-8d187f4686e5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.230444 Apr 30 21:25:32.349998 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1868/3648] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:32 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:33.140762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:33.141435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:33.150489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:33.150956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:33.151750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:33.152225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:33.186525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:33.190745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:33.207020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:33.207020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:33.207020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:33.208067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:33.389211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:33.397984 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-381f796e-2e4c-49d4-bf4e-9a97a16f401b tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.268484 Apr 30 21:25:33.398607 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1781/3649] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:33 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:33.403406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:33.404882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:33.410666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:33.411369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:33.412959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:33.413588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:33.421588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:33.432637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:33.435264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:33.439352 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71e8def4-e462-4676-a5b5-d063b4e88154 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.257650 Apr 30 21:25:33.439352 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1869/3650] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:33 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:33.630643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:33.639018 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c20559b-1632-49bd-a0a2-6395c05d6c48 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.239341 Apr 30 21:25:33.641665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1782/3651] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:33 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:34.415893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:34.416547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:34.424053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.424520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.425279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.425721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.456329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:34.457630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:34.464700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.465483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.466479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.467091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.673083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:34.688369 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7b7dd032-2f19-4457-98bf-dca5d0a50424 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.276624 Apr 30 21:25:34.689290 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1870/3652] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:34 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:34.694053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35c43610-673d-4088-a2c2-456cf8b3c025 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28cf7446-872a-4b61-8092-677879a5220a"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:34.695796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35c43610-673d-4088-a2c2-456cf8b3c025 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:34.704704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35c43610-673d-4088-a2c2-456cf8b3c025 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.705331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35c43610-673d-4088-a2c2-456cf8b3c025 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.707043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35c43610-673d-4088-a2c2-456cf8b3c025 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.707656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35c43610-673d-4088-a2c2-456cf8b3c025 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.776307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:34.787894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:34.789802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:34.793233 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-19b6d9f0-678a-4908-bc7b-2814d20da210 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.340943 Apr 30 21:25:34.794499 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1783/3653] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:34 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:34.802846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:34.803875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:34.810823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.812023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.813147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:34.813893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:34.982834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:34.992864 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ef30f22f-babf-495b-94a8-c25ff320ba5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.195716 Apr 30 21:25:35.003042 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1784/3654] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:34 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:35.530435 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35c43610-673d-4088-a2c2-456cf8b3c025 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839757 Apr 30 21:25:35.537964 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1871/3655] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:25:34 2022] POST /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:35.705426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:35.706862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:35.752280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:35.752847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:35.754439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:35.756676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:35.816949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:35.817658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:35.840805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:35.840805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:35.840805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:35.840805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:36.038586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:36.055225 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a2c2a10b-25dd-4bc1-bc18-ecd624637b2d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.354428 Apr 30 21:25:36.057432 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1785/3656] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:35 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:36.070445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:36.071770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:36.080870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:36.081553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:36.082725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:36.083565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:36.119362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:36.129801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:36.131598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:36.133011 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e018d50b-fa09-4883-8969-19a088f06d92 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1742 microversion: 2.20 time: 0.322339 Apr 30 21:25:36.133768 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1872/3657] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:35 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1742 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:36.272623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:36.295861 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-062e86b3-c770-4889-8024-677a24bb9be8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.237117 Apr 30 21:25:36.300728 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1786/3658] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:36 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:37.073019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:37.074544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:37.094233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:37.097243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:37.098586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:37.099280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:37.156812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:37.157511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:37.166881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:37.167413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:37.168373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:37.168880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:37.459623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:37.470196 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b925b498-9952-431b-9727-f844f73f0184 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.401491 Apr 30 21:25:37.472824 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1873/3659] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:37 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:37.480904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:37.481533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:37.497032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:37.498408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:37.501984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:37.502620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:37.539455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:37.548945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:37.550930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:37.552446 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e05647fc-7291-4d2b-bb2a-956337fcf85e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1742 microversion: 2.20 time: 0.403584 Apr 30 21:25:37.554331 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1787/3660] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:37 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1742 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:37.753440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:37.763751 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-44e12746-9c3c-4c4b-a35b-afe563664c02 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.289778 Apr 30 21:25:37.764759 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1874/3661] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:37 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:38.487661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:38.488848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:38.497790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:38.503596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:38.504703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:38.507395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:38.574803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:38.574803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:38.586870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:38.587599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:38.588561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:38.589160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:38.869553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:38.881812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:38.882299 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ffb2236e-66da-45db-a6a3-80c372ef74b4 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.398052 Apr 30 21:25:38.882490 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1788/3662] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:38 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:38.897036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:38.897674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:38.907482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:38.907941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:38.908846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:38.909486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:38.942200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:38.944962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:38.954293 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e52085c8-b02d-45e1-8371-570f6ced0da3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.383503 Apr 30 21:25:38.956312 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1875/3663] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:38 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:39.222473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:39.232896 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8448400-72e3-4c44-ab35-f480b669974c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.339600 Apr 30 21:25:39.249436 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1789/3664] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:38 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:39.297892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ca4c8004-9f0b-48bb-9697-84ac107d9c0f req-c432f418-649b-4d69-9794-9588365e0887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "name": "network-vif-plugged", "status": "completed", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:39.311527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ca4c8004-9f0b-48bb-9697-84ac107d9c0f req-c432f418-649b-4d69-9794-9588365e0887 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:39.313719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ca4c8004-9f0b-48bb-9697-84ac107d9c0f req-c432f418-649b-4d69-9794-9588365e0887 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:39.336165 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ca4c8004-9f0b-48bb-9697-84ac107d9c0f req-c432f418-649b-4d69-9794-9588365e0887 service nova] Creating event network-vif-plugged:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch1-master-1 Apr 30 21:25:39.345691 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ca4c8004-9f0b-48bb-9697-84ac107d9c0f req-c432f418-649b-4d69-9794-9588365e0887 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051678 Apr 30 21:25:39.347082 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1876/3665] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:39.905280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:39.907314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:39.931939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:39.934494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:39.935638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:39.936433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:39.979752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:39.980477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:40.006191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:40.011737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:40.012771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:40.013240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:40.344198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:40.356904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16b4c592-5579-482b-b7bf-4f01b9038103 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.460638 Apr 30 21:25:40.372140 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1790/3666] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:39 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:40.377747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:40.382219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:40.398016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:40.408036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:40.409564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:40.410792 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cacd5d24-3237-436d-aef3-7e7ef30e9849 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.437990 Apr 30 21:25:40.411580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:40.412209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:40.413330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:40.413816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:40.418176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1877/3667] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:39 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:40.902727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:40.912555 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a82b1d16-2cbf-4ff3-bd7d-b161118a8524 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.538643 Apr 30 21:25:40.917727 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1791/3668] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:40 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:41.248376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf9fdecd-35a8-4cd1-835b-7d9802cea210 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: .version_select at 0x7fdc20403430>, body: {"keypair": {"name": "tempest-keypair-556036263"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:41.284462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-cf9fdecd-35a8-4cd1-835b-7d9802cea210 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:25:41.297027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-cf9fdecd-35a8-4cd1-835b-7d9802cea210 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:25:41.382280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:41.383320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:41.398205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:41.398964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:41.401400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:41.409602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:41.683096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-cf9fdecd-35a8-4cd1-835b-7d9802cea210 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:25:41.683504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:41.691929 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d957575e-6945-46ef-848e-0b02fcb20a38 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.315089 Apr 30 21:25:41.701505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-cf9fdecd-35a8-4cd1-835b-7d9802cea210 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:25:41.705464 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1792/3669] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:41 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:41.727392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:41.738857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:41.762556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:41.766576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:41.767922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:41.775204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:41.788277 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cf9fdecd-35a8-4cd1-835b-7d9802cea210 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.543579 Apr 30 21:25:41.790607 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1878/3670] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:25:41 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:41.935513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:41.936321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:41.949480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:41.950309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:41.951248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:41.960036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:42.260176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:42.285959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:42.288272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:42.291301 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f91d5396-2a80-4161-801d-5e98a60f5a50 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.579802 Apr 30 21:25:42.293680 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1793/3671] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:41 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:42.400375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:42.414734 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2735254-c8c7-4e5c-9ac5-71f09039beed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.481378 Apr 30 21:25:42.416049 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1879/3672] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:41 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:42.721993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:42.722633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:42.742828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:42.745596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:42.747636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:42.748107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:43.315706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:43.316393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:43.329360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:43.329862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:43.331438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:43.332166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:43.822599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:43.837963 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9f79fdd-89b5-45ca-99cc-5c8fbe2261ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 1.120524 Apr 30 21:25:43.849807 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1794/3673] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:42 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:43.849807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:43.849807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:43.872028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:43.872522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:43.873395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:43.886760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:44.005809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:44.022537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:44.024700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:44.026580 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08c37ca9-e6ac-4943-b02e-c113cbc8ade4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.717380 Apr 30 21:25:44.028797 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1880/3674] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:43 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:44.158795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:44.166642 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c514f15d-5e3b-4bb6-8acf-3e6ae2d36a04 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.327113 Apr 30 21:25:44.167214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1795/3675] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:43 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:44.856835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:44.857621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:44.891886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:44.892353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:44.893335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:44.893807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:45.065108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:45.065919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:45.092919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:45.094301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:45.097322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:45.101679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:45.289000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:45.302995 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56f2ed84-ac3e-472e-a7e3-e9ffeb2a250a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.446283 Apr 30 21:25:45.304198 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1881/3676] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:44 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:45.318262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:45.322694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:45.360871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:45.364522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:45.365554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:45.366204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:45.705061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:45.721111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:45.721111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:45.721111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2505121a-4235-4bdc-81f6-d173217701cb tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.664394 Apr 30 21:25:45.721655 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1796/3677] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:45 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:45.794087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:45.812990 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be02afbb-96da-4f98-8966-20059ab93c54 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.502527 Apr 30 21:25:45.812990 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1882/3678] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:45 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:46.329612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:46.333380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:46.356867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:46.357738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:46.359397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:46.360066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:46.747513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:46.747513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:46.755483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:46.756955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:46.760255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:46.760894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:46.871646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:46.888831 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67d194c1-3b1a-40af-ac9d-9ce4b5d2ca17 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.568482 Apr 30 21:25:46.890707 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1797/3679] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:46 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:46.897032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:46.897940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:46.904601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:46.907736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:46.907736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:46.907736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:47.338030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:47.340866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:47.350314 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb415c0b-8d1b-4691-a3c3-b7b622682c1b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1682 microversion: 2.1 time: 0.458275 Apr 30 21:25:47.350902 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1798/3680] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:46 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1682 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:47.356939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:47.365211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:47.371488 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-310529c9-8b17-47c6-b3e6-f5125d36dd89 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.634415 Apr 30 21:25:47.371766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1500187695", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f0cca1-4180-4eed-af9d-38f99c4f5357"}], "security_groups": [{"name": "tempest-securitygroup--409668180"}], "key_name": "tempest-keypair-556036263", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:47.375371 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1883/3681] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:46 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:47.908081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:47.908999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:47.920481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:47.921155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:47.922904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:47.923443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:48.226592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:48.239951 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4678720d-327e-42b9-9b01-1a7797101112 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.336543 Apr 30 21:25:48.254932 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1884/3682] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:47 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:48.370299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:48.371647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:48.385658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:48.391940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:48.393992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:48.394721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:48.669286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:48.679673 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-81303daf-c527-4a83-ad99-c2878c37d099 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.313700 Apr 30 21:25:48.681013 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1885/3683] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:48 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:48.686272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:48.687172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:48.702343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:48.703134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:48.704318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:48.706558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:48.991617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:49.000461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:49.002028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:49.003199 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2aaaa5b7-8ec9-484f-90bb-62689aa6d59e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.320936 Apr 30 21:25:49.014201 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1886/3684] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:48 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:49.263877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:49.268246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:49.276052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:49.276795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:49.277847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:49.278449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:49.521265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:49.536924 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aaa52f04-802d-43d3-90c8-a1038dade56c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.276477 Apr 30 21:25:49.540132 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1887/3685] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:49 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:49.584883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:49.585678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:49.590197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] validate_networks() for [('b4f0cca1-4180-4eed-af9d-38f99c4f5357', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:25:49.594624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:49.599902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:49.601287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:49.604788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:49.860923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:49.870128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e5bd00b-293a-459e-8920-f85b04637396 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.289368 Apr 30 21:25:49.871165 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1888/3686] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:49 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:50.042563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:50.042563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:50.042563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:50.042563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:50.048161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:50.048622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:50.210061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:25:50.211447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:25:50.212426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:25:50.213083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:25:50.213741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:25:50.228936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:50.228936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:50.228936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:50.238550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:50.249045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:50.251709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:25:50.257812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:25:50.257968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:50.260678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:50.260678 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a690542-15d7-4552-989a-0560dcd86d59 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.237877 Apr 30 21:25:50.261322 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1889/3687] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:50 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:50.271547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:25:50.276408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:25:50.477850 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2597cd38-b03d-4b3f-94dc-a4c2d3b9ab09 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.116594 Apr 30 21:25:50.484290 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1799/3688] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:25:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 3124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:25:50.490945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0e1bce5b-2eb9-46eb-a898-96f7ae187df8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:50.491870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0e1bce5b-2eb9-46eb-a898-96f7ae187df8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:50.558017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:50.558610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:50.569097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:50.576214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:50.578611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:50.579279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:50.616081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0e1bce5b-2eb9-46eb-a898-96f7ae187df8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:50.627621 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0e1bce5b-2eb9-46eb-a898-96f7ae187df8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1241 microversion: 2.1 time: 0.142329 Apr 30 21:25:50.628246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1890/3689] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:50 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:50.815128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:50.824036 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e2eff4df-fb72-4d47-80a7-e605ebc97d6a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.270420 Apr 30 21:25:50.828265 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1800/3690] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:50 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:51.287578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-37174c27-47e0-4f10-9792-00f46a8bf13a req-a7be3531-c25b-47e2-8cb8-515987762fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-unplugged", "status": "completed", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:51.288427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:51.289108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:51.302676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:51.303158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:51.303715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-37174c27-47e0-4f10-9792-00f46a8bf13a req-a7be3531-c25b-47e2-8cb8-515987762fc8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:51.303932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:51.306405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-37174c27-47e0-4f10-9792-00f46a8bf13a req-a7be3531-c25b-47e2-8cb8-515987762fc8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:51.331893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:51.339460 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-37174c27-47e0-4f10-9792-00f46a8bf13a req-a7be3531-c25b-47e2-8cb8-515987762fc8 service nova] Creating event network-vif-unplugged:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:25:51.357299 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-37174c27-47e0-4f10-9792-00f46a8bf13a req-a7be3531-c25b-47e2-8cb8-515987762fc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072894 Apr 30 21:25:51.358448 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1801/3691] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:25:51.563047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:51.573074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:51.581290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:51.585962 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c61bf032-548b-42ab-a94e-21f422f06a82 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.310130 Apr 30 21:25:51.589623 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1891/3692] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:51 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:51.645618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5610046a-e013-4e66-9c85-63ed3ccebbfe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:51.646437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5610046a-e013-4e66-9c85-63ed3ccebbfe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:51.710190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5610046a-e013-4e66-9c85-63ed3ccebbfe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:51.717481 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5610046a-e013-4e66-9c85-63ed3ccebbfe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1241 microversion: 2.1 time: 0.076062 Apr 30 21:25:51.719138 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1802/3693] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:51 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:51.845815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:51.846442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:51.852944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:51.853798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:51.854668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:51.855343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:52.116759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:52.125554 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0a8ee9f-cefa-4002-9b28-da86ac0457ca tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1522 microversion: 2.1 time: 0.285484 Apr 30 21:25:52.137857 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1892/3694] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:51 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:52.604783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:52.605654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:52.613216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:52.613694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:52.614542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:52.614999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:52.734463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:52.735783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:52.747976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:52.750053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:52.751205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:52.755649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:52.884187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:52.900184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:52.906460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:52.908653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:52.909544 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-570e879a-104f-4de6-96a6-e60ca65b0a26 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1237 microversion: 2.1 time: 0.178938 Apr 30 21:25:52.910318 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c0e36a79-0fcb-40d1-b46e-45056d1ee6e2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.309610 Apr 30 21:25:52.910654 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1893/3695] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:52 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1237 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:52.911443 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1803/3696] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:52 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:53.145860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:53.146324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:53.154118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.154859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.156417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.156851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.326637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:53.343863 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20cf5c45-d970-421c-9b3b-824a8ed4fa3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1499 microversion: 2.1 time: 0.202083 Apr 30 21:25:53.345061 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1894/3697] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:53 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1499 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:53.372525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:53.380278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:53.382782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:53.389096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.390525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.392874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.393678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.436334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:53.505608 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6eaa9efc-85aa-4fdd-9af3-e1dc449a60b2 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.146919 Apr 30 21:25:53.515893 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1804/3698] 10.222.0.23 () {58 vars in 1153 bytes} [Sat Apr 30 21:25:53 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:53.518409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c69644c-a0d6-431e-968d-8c20ed3fe026 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:53.531186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c69644c-a0d6-431e-968d-8c20ed3fe026 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.537951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c69644c-a0d6-431e-968d-8c20ed3fe026 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.591961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c69644c-a0d6-431e-968d-8c20ed3fe026 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Going to try to start instance {{(pid=130671) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 30 21:25:53.645180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:53.646091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:53.667296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.669982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.672784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.674251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.943632 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c69644c-a0d6-431e-968d-8c20ed3fe026 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "POST /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961/action" status: 202 len: 0 microversion: 2.1 time: 0.426493 Apr 30 21:25:53.943632 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1895/3699] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:25:53 2022] POST /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:25:53.953244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:53.954635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:53.991743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.992376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:53.993281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:53.993867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:54.536522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:54.547530 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02093e22-2291-4414-93c6-9bdfa6a30173 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.908603 Apr 30 21:25:54.548616 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1805/3700] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:53 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:54.554480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:54.555204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:54.576150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:54.577067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:54.580787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:54.581504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:54.609039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:54.625479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:54.632546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:54.634789 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3adf526c-52ba-4124-a97a-e50cd94cc0d4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.691600 Apr 30 21:25:54.638330 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1896/3701] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:53 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:54.659882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:54.660968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:54.688222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:54.688934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:54.689996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:54.690625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:55.087393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:55.101897 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd6272ed-c7b0-4236-a213-b4225ce14eda tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.552012 Apr 30 21:25:55.108091 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1806/3702] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:54 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:55.125713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:55.128166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:55.145634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:55.146658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:55.148129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:55.148637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:55.228190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:55.240533 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a93ed8fe-3db7-4dba-9215-9d5c6243f0d1 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1508 microversion: 2.1 time: 0.589036 Apr 30 21:25:55.250887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1897/3703] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:54 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:55.642544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:55.660656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:55.660924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:55.667179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:55.667767 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f231e92-62e9-4aa8-968c-6704ff02a580 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.555378 Apr 30 21:25:55.668068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:55.669033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:55.669937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:55.674195 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1807/3704] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:55 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:55.701591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:55.703105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:55.710253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:55.711057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:55.712106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:55.713272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.064226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:56.073412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:56.075080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:56.077956 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a0dbd23a-7a56-4b06-8d50-93a1fe19386d tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1737 microversion: 2.20 time: 0.421043 Apr 30 21:25:56.090237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:56.099219 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46cc67bf-83bb-454f-ae86-ef635f405364 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.414055 Apr 30 21:25:56.112312 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1808/3705] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:55 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:56.112635 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1898/3706] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:55 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1737 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:25:56.117503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e0bb28c3-f90f-44d5-9466-7923a26e6973 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:56.118695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e0bb28c3-f90f-44d5-9466-7923a26e6973 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:56.125865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0bb28c3-f90f-44d5-9466-7923a26e6973 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.126316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0bb28c3-f90f-44d5-9466-7923a26e6973 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.131399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0bb28c3-f90f-44d5-9466-7923a26e6973 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.131399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e0bb28c3-f90f-44d5-9466-7923a26e6973 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.131737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:56.131737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:56.135746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.136323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.136984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.137627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.315376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:56.326368 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9080e260-aba5-4d7d-9c6b-e302bc7d9bed tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.201735 Apr 30 21:25:56.327787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1899/3707] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:56 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:56.336740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-fbf288be-96ea-40bb-bef2-4190ee532b82 req-1eec1429-c7c8-4ade-87fb-ad85ffc9b980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4", "tag": "54ba9216-14d1-48d9-91ae-2c676c6c24ca"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:56.346264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fbf288be-96ea-40bb-bef2-4190ee532b82 req-1eec1429-c7c8-4ade-87fb-ad85ffc9b980 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.347008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fbf288be-96ea-40bb-bef2-4190ee532b82 req-1eec1429-c7c8-4ade-87fb-ad85ffc9b980 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.360342 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fbf288be-96ea-40bb-bef2-4190ee532b82 req-1eec1429-c7c8-4ade-87fb-ad85ffc9b980 service nova] Creating event network-changed:54ba9216-14d1-48d9-91ae-2c676c6c24ca for instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 on nch1-master-1 Apr 30 21:25:56.367508 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-fbf288be-96ea-40bb-bef2-4190ee532b82 req-1eec1429-c7c8-4ade-87fb-ad85ffc9b980 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034568 Apr 30 21:25:56.368274 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1900/3708] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:56.375180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:56.378987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:56.382850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.383482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.384395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.384968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.493422 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e0bb28c3-f90f-44d5-9466-7923a26e6973 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.379865 Apr 30 21:25:56.494461 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1809/3709] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:25:56 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:25:56.502969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:56.503932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:56.510735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.511456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.515255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:56.515255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:56.542691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:56.552576 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1bc35539-3d37-4da3-bfba-db48a7818b6d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1508 microversion: 2.1 time: 0.183021 Apr 30 21:25:56.553326 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1901/3710] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:56 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:56.657634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:56.666792 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dd66f309-dfa8-44d1-b206-198f6ec5c04e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1671 microversion: 2.1 time: 0.167842 Apr 30 21:25:56.668634 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1810/3711] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:56 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:57.101299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:57.101952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:57.111483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.111867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.112856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.113582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.326228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:57.334724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:57.336241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:57.337450 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e60e24e6-b272-41e7-91b8-f4b36264979a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1719 microversion: 2.20 time: 0.240257 Apr 30 21:25:57.338279 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1902/3712] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:57 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1719 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:57.347559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:57.349522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:57.359475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.360544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.361827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.362466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.570352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:57.571225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:57.578312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.582164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.582164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.582164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.642207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:57.654050 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8763999-baab-44da-8750-b64c7c95ef60 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.313069 Apr 30 21:25:57.668416 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1811/3713] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:57 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:57.688256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:57.689177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:57.697557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.698132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.699038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.699549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.825019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:57.834522 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c8f498e-c652-4782-9123-ac26fd8cc6e8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1512 microversion: 2.1 time: 0.267794 Apr 30 21:25:57.835464 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1903/3714] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:57 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:57.862788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:57.866361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:57.866823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.servers [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Removing options 'limit' from query {{(pid=130671) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 30 21:25:57.867591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:57.868845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.869301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.870144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.870811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.872374 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55d3dc37-a98f-4275-a2e6-97eea57ba15f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.014107 Apr 30 21:25:57.873457 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1904/3715] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Apr 30 21:25:57 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:25:57.885493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:57.886141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:57.901338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.901893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:57.902697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:57.903146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.052392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.060107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-27e3f07c-7b3c-4019-ae07-a52e57512636 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1671 microversion: 2.1 time: 0.377829 Apr 30 21:25:58.071186 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1812/3716] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:57 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1671 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:58.076606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f5e47c2-727a-4fb9-9fcc-4cf29e23c69c tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:58.077983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f5e47c2-727a-4fb9-9fcc-4cf29e23c69c tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:58.084853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f5e47c2-727a-4fb9-9fcc-4cf29e23c69c tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.085587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f5e47c2-727a-4fb9-9fcc-4cf29e23c69c tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.086748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f5e47c2-727a-4fb9-9fcc-4cf29e23c69c tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.086870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f5e47c2-727a-4fb9-9fcc-4cf29e23c69c tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.132886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.141465 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-446c65ea-ad60-4ff8-9b29-dc3ef5b28883 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1512 microversion: 2.1 time: 0.259665 Apr 30 21:25:58.142077 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1905/3717] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:57 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:58.156944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:58.157901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:58.164108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.164799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.165808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.166315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.326298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.335265 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-05426875-02dc-4e22-a15c-982030dae9b8 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1513 microversion: 2.1 time: 0.182090 Apr 30 21:25:58.337079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1906/3718] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:58 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:58.354803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:58.355539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:58.361933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.362584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.363550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.364146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.512924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.521191 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac50bec5-51af-408b-bbb3-5ede8513fd53 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1512 microversion: 2.1 time: 0.172064 Apr 30 21:25:58.521800 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1907/3719] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:58 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:25:58.526229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:58.527046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:58.533490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.534176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.540986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.540986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.670214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.681360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.682951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.684136 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4805fc6-32aa-4bf1-b7f8-a94b82e4c528 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1719 microversion: 2.20 time: 0.161433 Apr 30 21:25:58.696044 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1908/3720] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:58 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:25:58.701478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:58.710454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:58.710454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:25:58.827598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.828042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.829360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:58.829860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:58.930067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:25:58.995730 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ccb986a-bb08-40f2-aaff-b7f1defebd98 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.298289 Apr 30 21:25:58.996322 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1909/3721] 10.222.0.23 () {58 vars in 1153 bytes} [Sat Apr 30 21:25:58 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:59.003827 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f5e47c2-727a-4fb9-9fcc-4cf29e23c69c tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "POST /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd/action" status: 200 len: 32479 microversion: 2.32 time: 0.924007 Apr 30 21:25:59.003827 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1813/3722] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:25:58 2022] POST /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd/action => generated 32479 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:25:59.005060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:59.005986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.013063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:59.013302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.013608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.013713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.015034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.015482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.021249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.021704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.022539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.022985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.224775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:59.231490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:59.232822 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5853bb4-0a8f-401c-85bf-ae220c5231f3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.233706 Apr 30 21:25:59.234008 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1814/3723] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:58 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:59.238884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:59.239674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.244411 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-677928fe-c12c-4061-adbc-e53c170f5986 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1512 microversion: 2.1 time: 0.235089 Apr 30 21:25:59.245068 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1910/3724] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:59 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:59.246376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.247095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.248524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.249902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.260829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:59.261748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.269657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.270421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.271422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.272070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.302611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:25:59.500947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:59.512578 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ed06c960-cbab-43df-be72-d7552f3fb9ee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.265942 Apr 30 21:25:59.525120 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1911/3725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:59 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:59.535357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:59.536219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.545131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.547474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.548534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.549183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.685130 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5af17c8-2c07-47d2-98c1-01aeca794804 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 204 len: 0 microversion: 2.32 time: 0.449593 Apr 30 21:25:59.689826 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1815/3726] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:25:59 2022] DELETE /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:25:59.696233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4256a7e8-3091-4f48-ae6b-2bb479098584 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:25:59.698906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4256a7e8-3091-4f48-ae6b-2bb479098584 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.707649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4256a7e8-3091-4f48-ae6b-2bb479098584 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.708166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4256a7e8-3091-4f48-ae6b-2bb479098584 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.708994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4256a7e8-3091-4f48-ae6b-2bb479098584 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.709448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4256a7e8-3091-4f48-ae6b-2bb479098584 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.770638 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4256a7e8-3091-4f48-ae6b-2bb479098584 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 200 len: 145 microversion: 2.1 time: 0.079237 Apr 30 21:25:59.771524 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1816/3727] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:25:59 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:25:59.780755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:59.787030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.795161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.796318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.797298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.797869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.838753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:25:59.847066 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-417852bc-30e7-48df-9e62-c2cf779d5a92 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1513 microversion: 2.1 time: 0.319186 Apr 30 21:25:59.847640 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1912/3728] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:25:59 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:25:59.852545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:25:59.857344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:25:59.859743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.860343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:25:59.868807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:25:59.869429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.378234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.394103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.403910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.405767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.408940 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24368200-0334-488b-815e-18040e49f6b5 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2950 microversion: 2.32 time: 0.632766 Apr 30 21:26:00.411790 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1817/3729] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:59 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2950 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:00.415112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.417166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.419005 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99408d4b-db83-447e-806d-c64138681275 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1719 microversion: 2.20 time: 0.569802 Apr 30 21:26:00.421132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:00.422161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:00.430829 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1913/3730] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:25:59 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1719 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:00.437389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:00.442255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:00.444238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.444810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.445782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.446386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.446675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.447750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.448540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.448982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.670964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.684511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.686038 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-250daed4-a531-4b22-ad11-1dacd30661d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.272683 Apr 30 21:26:00.687585 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1818/3731] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:00 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:00.693429 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1e2b7645-73d1-4e56-8638-d4e288e2a235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1512 microversion: 2.1 time: 0.261212 Apr 30 21:26:00.694039 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1914/3732] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:00 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:00.700224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:00.700224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:00.707820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.714505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.714505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.714505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.714905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:00.714905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:00.729738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.730514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.731805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.732462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.950869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.958601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.960075 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6205463b-f74f-401b-bf2e-be65284cf5fd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.270364 Apr 30 21:26:00.971587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b5de3a7-f32c-4864-8a38-b0b8e2e4e716 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.260614 Apr 30 21:26:00.971587 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1915/3733] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:00 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:00.971777 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1819/3734] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:00 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:00.972928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:00.976413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:00.977166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:26:00.982902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.984084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.984932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:00.985369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:00.991945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:00.997261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:01.008152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.008816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.009728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.010465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.020823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:26:01.074496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.082577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.083714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.283774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.292565 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70757334-4cb1-4e32-81bc-50385b1a3628 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.310014 Apr 30 21:26:01.294591 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1820/3735] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:00 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:01.301556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-86cf4ff2-6a6e-4e8d-8ccb-b81cc89e97f8 req-86ad5353-9ddc-4f3b-a9ca-efae68074673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "name": "network-vif-unplugged", "status": "completed", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:01.311183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-86cf4ff2-6a6e-4e8d-8ccb-b81cc89e97f8 req-86ad5353-9ddc-4f3b-a9ca-efae68074673 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.312067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-86cf4ff2-6a6e-4e8d-8ccb-b81cc89e97f8 req-86ad5353-9ddc-4f3b-a9ca-efae68074673 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.325533 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-86cf4ff2-6a6e-4e8d-8ccb-b81cc89e97f8 req-86ad5353-9ddc-4f3b-a9ca-efae68074673 service nova] Creating event network-vif-unplugged:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch1-master-1 Apr 30 21:26:01.331663 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-86cf4ff2-6a6e-4e8d-8ccb-b81cc89e97f8 req-86ad5353-9ddc-4f3b-a9ca-efae68074673 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035263 Apr 30 21:26:01.333113 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1821/3736] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:01.340216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:01.340949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:01.348315 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ca3d177-76b3-44cd-8a9e-d9b445381feb tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.374037 Apr 30 21:26:01.350178 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1916/3737] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:26:00 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:01.358760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.359236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.360323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.360786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.372720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:01.377407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.378749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:26:01.521361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.521981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.523155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.523430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.556167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:26:01.606703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.608532 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ecb58dc0-2790-41b8-9d30-4c0fbb903b58 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.240077 Apr 30 21:26:01.610020 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1917/3738] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Apr 30 21:26:01 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:01.615089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:01.617562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:01.626932 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ea3f66f-6a8c-4ca9-b71e-f5ab4f2fb022 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.292411 Apr 30 21:26:01.628443 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1822/3739] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:01 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:01.634170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:01.634459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.635172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.635466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:01.636240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.636695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.643848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.644613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.647232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.647232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.905532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.906730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.916757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.918476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.920283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.921840 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-005259c8-8cf6-4b68-9e47-109acf53050e tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2950 microversion: 2.32 time: 0.310821 Apr 30 21:26:01.934756 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1918/3740] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:01 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2950 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:01.935882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.937148 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4daafa3c-ed78-4973-aaf1-407f2c3782b8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1719 microversion: 2.20 time: 0.307047 Apr 30 21:26:01.938316 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1823/3741] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:01 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1719 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:01.948316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:01.952533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:01.953442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:26:01.960340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.960908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.962001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.962578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.978946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:01.979835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:01.990910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.991379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:01.994909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:01.995364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.095613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:26:02.187332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:02.197522 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-954c5084-9ebf-4ac2-bbdf-627ff786dff0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.222914 Apr 30 21:26:02.208088 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1824/3742] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:01 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:02.213430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1459317498", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "6d21022d-393a-4eff-ba51-560f37353f44"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:02.215801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ae44131-c6cc-47de-abaa-6717805a1eb7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.278698 Apr 30 21:26:02.223359 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1919/3743] 10.222.0.23 () {58 vars in 1211 bytes} [Sat Apr 30 21:26:01 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:02.229747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:02.234269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:02.235040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:26:02.242114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.242952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.249182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.249182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.274083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] validate_networks() for [('6d21022d-393a-4eff-ba51-560f37353f44', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:26:02.347856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:26:02.436380 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ccb6711b-cc83-49aa-93f6-52188776eca6 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.211723 Apr 30 21:26:02.441903 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1920/3744] 10.222.0.23 () {58 vars in 1195 bytes} [Sat Apr 30 21:26:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:02.450987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:02.455521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:02.457122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'name': '1169805428', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:26:02.463424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.463880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.464688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.465325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.554685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:26:02.905461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:26:02.906017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:26:02.906694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:26:02.907208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:26:02.907804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:26:02.924498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.925668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.926592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.927252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.942234 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-06d6d613-f24e-4402-ab57-fc27d2e0eb82 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?name=1169805428" status: 200 len: 346 microversion: 2.1 time: 0.495583 Apr 30 21:26:02.943198 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1921/3745] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Apr 30 21:26:02 2022] GET /compute/v2.1/servers?name=1169805428 => generated 346 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:26:02.960174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:26:02.962243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:02.963033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:02.971478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for user 20b4082fa07249e2b6dfb9b4506ab398 and project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:26:02.978298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.978723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.979583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:02.979966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:02.995347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:26:02.998845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:26:03.255996 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d81b59d8-bb2c-40ba-beaa-9ac1469c38a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046438 Apr 30 21:26:03.256895 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1825/3746] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:26:03.278918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:03.285245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:03.294546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:26:03.305439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:03.307143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:03.308400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:03.312487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:03.384398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:03.416847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:03.418481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:03.428883 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0deca815-73f9-43e4-a8d2-fe54b56189c4 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2950 microversion: 2.32 time: 0.484171 Apr 30 21:26:03.429361 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1922/3747] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:02 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2950 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:03.434232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:03.436817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:03.453886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:03.454646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:03.455653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:03.456257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:03.540624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:26:03.631111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cce4b5fe-f1c6-4d79-9b02-0263e784487f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.366216 Apr 30 21:26:03.637178 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1826/3748] 10.222.0.23 () {58 vars in 1153 bytes} [Sat Apr 30 21:26:03 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:03.637178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:03.637796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:03.645151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:03.646011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:03.646665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:03.647354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:03.814256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:03.838376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:03.855476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:03.857177 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cefbb9d0-7c52-45bc-9512-145218d5f96b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1662 microversion: 2.20 time: 0.426649 Apr 30 21:26:03.860586 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1923/3749] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:03 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1662 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:03.865975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3f1d2f2e-3f36-44cc-9d30-1a0764dc0368 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:03.868283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3f1d2f2e-3f36-44cc-9d30-1a0764dc0368 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:04.013632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3f1d2f2e-3f36-44cc-9d30-1a0764dc0368 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:04.022825 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3f1d2f2e-3f36-44cc-9d30-1a0764dc0368 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1215 microversion: 2.1 time: 0.160812 Apr 30 21:26:04.024854 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1924/3750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:03 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:04.119750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:04.127642 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-351424bc-807f-48e2-8e22-06b1782090d1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.494981 Apr 30 21:26:04.142088 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1827/3751] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:03 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:04.160212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:04.163978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:04.164649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-116980542', 'deleted': False, 'project_id': '1236f389e69047b8add7cbc7cefe8f24'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:26:04.194265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:04.194726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:04.195540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:04.195983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:04.303512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:26:04.429864 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-af2a2926-b618-4489-8c1c-5ee6f7263bfe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-116980542" status: 200 len: 346 microversion: 2.1 time: 0.286037 Apr 30 21:26:04.433043 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1828/3752] 10.222.0.23 () {58 vars in 1227 bytes} [Sat Apr 30 21:26:04 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-116980542 => generated 346 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:04.440923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-188ec60b-f478-42ce-ba6b-03571077cbdc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70c7df6b-296f-4bb3-a474-a0df44259086"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:04.442291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-82fb14be-aca8-41b8-968e-ba99a2c82f68 req-d2bd2418-7c70-4170-ba32-a921c2eac963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4", "name": "network-vif-plugged", "status": "completed", "tag": "54ba9216-14d1-48d9-91ae-2c676c6c24ca"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:04.442805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-188ec60b-f478-42ce-ba6b-03571077cbdc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:04.450793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-188ec60b-f478-42ce-ba6b-03571077cbdc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:04.451457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-188ec60b-f478-42ce-ba6b-03571077cbdc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:04.452777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-188ec60b-f478-42ce-ba6b-03571077cbdc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:04.453374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-188ec60b-f478-42ce-ba6b-03571077cbdc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:04.459701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-82fb14be-aca8-41b8-968e-ba99a2c82f68 req-d2bd2418-7c70-4170-ba32-a921c2eac963 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:04.460833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-82fb14be-aca8-41b8-968e-ba99a2c82f68 req-d2bd2418-7c70-4170-ba32-a921c2eac963 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:04.475626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-82fb14be-aca8-41b8-968e-ba99a2c82f68 req-d2bd2418-7c70-4170-ba32-a921c2eac963 service nova] Creating event network-vif-plugged:54ba9216-14d1-48d9-91ae-2c676c6c24ca for instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 on nch1-master-1 Apr 30 21:26:04.487118 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-82fb14be-aca8-41b8-968e-ba99a2c82f68 req-d2bd2418-7c70-4170-ba32-a921c2eac963 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.444453 Apr 30 21:26:04.490800 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1925/3753] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:04.496014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:04.496622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:04.521690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:04.522178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:04.522989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:04.523437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:04.559143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:26:05.006462 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c43a206c-70b6-4d35-a630-8039002a4235 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "DELETE /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 204 len: 0 microversion: 2.1 time: 0.510162 Apr 30 21:26:05.007324 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1926/3754] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:26:04 2022] DELETE /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:26:05.013291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:05.014539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:05.020694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.021162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.021991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.022615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.241675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:05.261917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:05.266493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:05.284995 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7cb36dcd-26f1-45e0-a446-f98af2cd293f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2908 microversion: 2.32 time: 0.274865 Apr 30 21:26:05.285824 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1927/3755] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:05 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2908 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:05.298559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:05.299427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:05.305889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.306352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.307206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.307574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.556261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:05.577527 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8e47195-0b79-4d62-b72a-d57fe9466308 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1518 microversion: 2.1 time: 0.288619 Apr 30 21:26:05.578177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1928/3756] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:05 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:05.589566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:05.590234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:05.597413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.598144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.598946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.599558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.661336 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-188ec60b-f478-42ce-ba6b-03571077cbdc tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.226372 Apr 30 21:26:05.662117 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1829/3757] 10.222.0.23 () {62 vars in 1363 bytes} [Sat Apr 30 21:26:04 2022] POST /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-volume_attachments => generated 188 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:26:05.670340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:05.671202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:05.678579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:05.687508 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-474ef46f-642a-4bec-be13-b6d3b70cce18 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1267 microversion: 2.1 time: 0.104216 Apr 30 21:26:05.690784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.691588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.695494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.696110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.704007 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1929/3758] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:05 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:05.847778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-74f772b8-6042-406c-8ba5-f53541b5ac24 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:05.848446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-74f772b8-6042-406c-8ba5-f53541b5ac24 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:05.859681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74f772b8-6042-406c-8ba5-f53541b5ac24 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.860616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74f772b8-6042-406c-8ba5-f53541b5ac24 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.861528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74f772b8-6042-406c-8ba5-f53541b5ac24 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:05.862319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74f772b8-6042-406c-8ba5-f53541b5ac24 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:05.979572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:05.988764 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98788849-965d-483d-a93b-c1fe62daf870 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1366 microversion: 2.1 time: 0.325228 Apr 30 21:26:05.989544 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1830/3759] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:05 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:05.995492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6f9ca898-5028-4d21-aff8-a0ca2813a97d req-3271813d-caaa-4ddb-ba47-755ab00bfa4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-deleted", "tag": "b3fce87b-a558-49fc-83b7-71bd012b7290"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:06.016863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6f9ca898-5028-4d21-aff8-a0ca2813a97d req-3271813d-caaa-4ddb-ba47-755ab00bfa4f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:06.017505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6f9ca898-5028-4d21-aff8-a0ca2813a97d req-3271813d-caaa-4ddb-ba47-755ab00bfa4f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:06.033424 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6f9ca898-5028-4d21-aff8-a0ca2813a97d req-3271813d-caaa-4ddb-ba47-755ab00bfa4f service nova] Creating event network-vif-deleted:b3fce87b-a558-49fc-83b7-71bd012b7290 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:06.039760 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6f9ca898-5028-4d21-aff8-a0ca2813a97d req-3271813d-caaa-4ddb-ba47-755ab00bfa4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048846 Apr 30 21:26:06.041362 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1831/3760] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:06.317649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:06.318701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:06.350426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:06.354329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:06.357660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:06.378289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:06.875051 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-74f772b8-6042-406c-8ba5-f53541b5ac24 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-volume_attachments/70c7df6b-296f-4bb3-a474-a0df44259086" status: 202 len: 0 microversion: 2.20 time: 1.029555 Apr 30 21:26:06.877194 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1930/3761] 10.222.0.23 () {60 vars in 1456 bytes} [Sat Apr 30 21:26:05 2022] DELETE /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-volume_attachments/70c7df6b-296f-4bb3-a474-a0df44259086 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:26:06.903438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:06.907048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:06.939727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:06.941772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:06.944169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:06.944890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:07.437319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:07.455541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:07.457287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:07.460057 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f234358-02fa-4dde-9e0c-9aaadd8b6ddf tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2749 microversion: 2.32 time: 1.154231 Apr 30 21:26:07.471522 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1832/3762] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:06 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2749 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:26:07.489295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-27dfc3c1-9388-4a4e-9b43-c664e62b5be9 req-8a6b3146-4c48-4329-953c-f86da1171d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-unplugged", "status": "completed", "tag": "3612a02c-d7fa-4f7d-8b59-27351eff0cc5"}, {"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-unplugged", "status": "completed", "tag": "1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:07.511419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-27dfc3c1-9388-4a4e-9b43-c664e62b5be9 req-8a6b3146-4c48-4329-953c-f86da1171d5e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:07.513908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-27dfc3c1-9388-4a4e-9b43-c664e62b5be9 req-8a6b3146-4c48-4329-953c-f86da1171d5e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:07.541077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-27dfc3c1-9388-4a4e-9b43-c664e62b5be9 req-8a6b3146-4c48-4329-953c-f86da1171d5e service nova] Creating event network-vif-unplugged:3612a02c-d7fa-4f7d-8b59-27351eff0cc5 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:07.541728 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-27dfc3c1-9388-4a4e-9b43-c664e62b5be9 req-8a6b3146-4c48-4329-953c-f86da1171d5e service nova] Creating event network-vif-unplugged:1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:07.555345 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-27dfc3c1-9388-4a4e-9b43-c664e62b5be9 req-8a6b3146-4c48-4329-953c-f86da1171d5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.082208 Apr 30 21:26:07.556051 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1833/3763] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:07.577919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:07.581461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:07.607110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:07.608424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:07.614820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:07.615361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:07.804329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:07.816627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df13ed55-0c6b-44a4-8d18-42481a76124e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1273 microversion: 2.1 time: 0.258329 Apr 30 21:26:07.817559 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1834/3764] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:07 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:07.827858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:07.842773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:07.842773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:07.848338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:07.849224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:07.850435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:07.851200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:07.851586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3b4d2b36-425c-434f-99a6-ab2116c6df96 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1518 microversion: 2.1 time: 0.971764 Apr 30 21:26:07.861671 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1931/3765] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:06 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1518 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:07.866734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8556a94-bc2b-45f3-9f36-48f00908686e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:07.867324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8556a94-bc2b-45f3-9f36-48f00908686e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:07.883151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8556a94-bc2b-45f3-9f36-48f00908686e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:07.894492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8556a94-bc2b-45f3-9f36-48f00908686e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:07.894492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8556a94-bc2b-45f3-9f36-48f00908686e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:07.894492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8556a94-bc2b-45f3-9f36-48f00908686e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:08.161786 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8556a94-bc2b-45f3-9f36-48f00908686e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "POST /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/action" status: 202 len: 0 microversion: 2.20 time: 0.298793 Apr 30 21:26:08.164663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:08.167344 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1932/3766] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:26:07 2022] POST /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:26:08.176732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a75585e5-ce26-4c2d-9d72-a342109c3f33 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1555 microversion: 2.1 time: 0.340967 Apr 30 21:26:08.182649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4ed22e09-b80e-46c4-a76f-f62386ecd084 req-6a902191-54e4-4184-9d62-bf090a8514e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-deleted", "tag": "3612a02c-d7fa-4f7d-8b59-27351eff0cc5"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:08.187255 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1835/3767] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:07 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1555 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:08.194041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:08.196167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4ed22e09-b80e-46c4-a76f-f62386ecd084 req-6a902191-54e4-4184-9d62-bf090a8514e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:08.196870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4ed22e09-b80e-46c4-a76f-f62386ecd084 req-6a902191-54e4-4184-9d62-bf090a8514e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:08.202941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:08.215690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:08.216950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:08.217864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:08.218404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:08.222228 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4ed22e09-b80e-46c4-a76f-f62386ecd084 req-6a902191-54e4-4184-9d62-bf090a8514e5 service nova] Creating event network-vif-deleted:3612a02c-d7fa-4f7d-8b59-27351eff0cc5 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:08.232283 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4ed22e09-b80e-46c4-a76f-f62386ecd084 req-6a902191-54e4-4184-9d62-bf090a8514e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063381 Apr 30 21:26:08.234561 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1933/3768] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:08.245574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8139429-0d80-4424-8686-896412dcd150 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:08.247704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8139429-0d80-4424-8686-896412dcd150 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:08.256840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8139429-0d80-4424-8686-896412dcd150 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:08.257602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8139429-0d80-4424-8686-896412dcd150 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:08.258674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8139429-0d80-4424-8686-896412dcd150 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:08.259755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8139429-0d80-4424-8686-896412dcd150 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.022588 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8139429-0d80-4424-8686-896412dcd150 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.785292 Apr 30 21:26:09.030460 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1934/3769] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:26:08 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4/os-interface => generated 284 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:09.035677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:09.036736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:09.043769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.047925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.049071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.049732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.074916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.107301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.146631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.150586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-872a2992-2f2d-4d29-b1c5-d14e4c1b5fef tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1670 microversion: 2.20 time: 0.961779 Apr 30 21:26:09.153481 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1836/3770] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:08 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1670 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:09.184419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:09.184419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:09.215068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.216232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.218054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.218410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.636378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.645615 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-afe9c823-53a2-4aea-8394-a0b8b6ebd50c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1273 microversion: 2.1 time: 0.490790 Apr 30 21:26:09.646264 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1837/3771] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:09 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1273 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:09.661125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:09.661666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:09.670924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.671709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.672535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.673148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.707827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.708525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.709156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lazy-loading 'fault' on Instance uuid 38d16530-0c8c-460c-9fda-e6249fbd6d00 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:26:09.816869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.822806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.826138 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ccf7a87d-f70b-4a6b-ab66-71b3bc66057d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 200 len: 1310 microversion: 2.1 time: 0.178601 Apr 30 21:26:09.842935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1838/3772] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:09 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 1310 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:09.856887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.867864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:09.869459 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-27934b52-ab0f-4296-aad8-64667f617367 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2590 microversion: 2.32 time: 0.837564 Apr 30 21:26:09.870853 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1935/3773] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:09 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2590 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:09.881323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-edb21cb6-c3b7-4f28-876e-fc4e3728610c req-b342f0ae-308c-468e-88ad-0443eb1b39ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-unplugged", "status": "completed", "tag": "0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e"}, {"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-unplugged", "status": "completed", "tag": "cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:09.895268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-edb21cb6-c3b7-4f28-876e-fc4e3728610c req-b342f0ae-308c-468e-88ad-0443eb1b39ff service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:09.896223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-edb21cb6-c3b7-4f28-876e-fc4e3728610c req-b342f0ae-308c-468e-88ad-0443eb1b39ff service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:09.912921 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-edb21cb6-c3b7-4f28-876e-fc4e3728610c req-b342f0ae-308c-468e-88ad-0443eb1b39ff service nova] Creating event network-vif-unplugged:0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:09.914005 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-edb21cb6-c3b7-4f28-876e-fc4e3728610c req-b342f0ae-308c-468e-88ad-0443eb1b39ff service nova] Creating event network-vif-unplugged:cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:09.921537 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-edb21cb6-c3b7-4f28-876e-fc4e3728610c req-b342f0ae-308c-468e-88ad-0443eb1b39ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.049143 Apr 30 21:26:09.922785 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1936/3774] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:09.985312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3079ef5b-0b47-46a7-be48-c6cd0b21eb5a req-a86725ac-2dbe-4d8b-bf30-c945840fc498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d16530-0c8c-460c-9fda-e6249fbd6d00", "name": "network-vif-deleted", "tag": "36dd9bb6-ae98-4c2b-bbd6-8d93532b485e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:10.000151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3079ef5b-0b47-46a7-be48-c6cd0b21eb5a req-a86725ac-2dbe-4d8b-bf30-c945840fc498 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.001337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3079ef5b-0b47-46a7-be48-c6cd0b21eb5a req-a86725ac-2dbe-4d8b-bf30-c945840fc498 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.016641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3079ef5b-0b47-46a7-be48-c6cd0b21eb5a req-a86725ac-2dbe-4d8b-bf30-c945840fc498 service nova] Creating event network-vif-deleted:36dd9bb6-ae98-4c2b-bbd6-8d93532b485e for instance 38d16530-0c8c-460c-9fda-e6249fbd6d00 on nch2-master-1 Apr 30 21:26:10.024322 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3079ef5b-0b47-46a7-be48-c6cd0b21eb5a req-a86725ac-2dbe-4d8b-bf30-c945840fc498 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178765 Apr 30 21:26:10.026509 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1839/3775] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:10.178416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:10.179749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:10.190681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.191446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.192911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.193853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.286746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-37742b2f-ffc7-4f42-9663-947424288a59 req-92c521af-a2d7-4c6f-985e-a46569832f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-deleted", "tag": "cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:10.297237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-37742b2f-ffc7-4f42-9663-947424288a59 req-92c521af-a2d7-4c6f-985e-a46569832f4e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.300274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-37742b2f-ffc7-4f42-9663-947424288a59 req-92c521af-a2d7-4c6f-985e-a46569832f4e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.315450 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-37742b2f-ffc7-4f42-9663-947424288a59 req-92c521af-a2d7-4c6f-985e-a46569832f4e service nova] Creating event network-vif-deleted:cf1a6f7c-2c09-4b51-bf2e-219bf5b8b382 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:10.323726 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-37742b2f-ffc7-4f42-9663-947424288a59 req-92c521af-a2d7-4c6f-985e-a46569832f4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044202 Apr 30 21:26:10.325809 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1840/3776] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:10.605249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:10.617333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:10.636191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:10.637460 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f25204e7-f0e9-458c-8bb4-ad88bb0fbb8f tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1670 microversion: 2.20 time: 0.464752 Apr 30 21:26:10.648277 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1937/3777] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:10 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1670 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:10.666880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:10.667927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:10.683668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.685018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.686740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.687484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.850371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:10.851058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: 38d16530-0c8c-460c-9fda-e6249fbd6d00] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:10.860434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.861843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.862663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.863270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.887079 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] HTTP exception thrown: Instance 38d16530-0c8c-460c-9fda-e6249fbd6d00 could not be found. Apr 30 21:26:10.890622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Returning 404 to user: Instance 38d16530-0c8c-460c-9fda-e6249fbd6d00 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:10.891575 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b3a34f9-7f1b-49c2-9328-76ae06e0f391 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00" status: 404 len: 111 microversion: 2.1 time: 0.046839 Apr 30 21:26:10.892160 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1938/3778] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:10 2022] GET /compute/v2.1/servers/38d16530-0c8c-460c-9fda-e6249fbd6d00 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:26:10.899201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:10.899899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:10.906838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.907639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:10.909105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:10.909604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:11.156201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:11.165529 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f7cbbc31-403e-4282-b7f4-71e61d47bf25 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.503118 Apr 30 21:26:11.169963 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1841/3779] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:10 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:11.188847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:11.190346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:11.200139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:11.200761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:11.203243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:11.203804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:11.238067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:26:11.378993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:11.388850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:11.391044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:11.392585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd0e6ec1-4744-4e9b-a7c4-f7f506562dd8 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2386 microversion: 2.32 time: 0.499144 Apr 30 21:26:11.406181 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1939/3780] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:10 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2386 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:11.755358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e7600e20-7138-4dcc-b13c-975c929c0e11 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 204 len: 0 microversion: 2.1 time: 0.582989 Apr 30 21:26:11.761156 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1842/3781] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:26:11 2022] DELETE /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:26:11.769575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:11.770818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:11.785881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:11.786753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:11.789737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:11.804303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:11.907640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:11.909653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:11.928653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:11.928653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:11.928653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:11.929832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:12.446971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:12.456638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:12.458240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:12.460211 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7f113bb4-b7b4-4777-ad50-2b25e9fc3cde tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.797177 Apr 30 21:26:12.460968 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1940/3782] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:11 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:26:12.463317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:12.467978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:12.467978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:12.474262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:12.474722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:12.475557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:12.476000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:12.477476 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6672cec0-e14d-4746-92e6-da68c18bcae0 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1519 microversion: 2.1 time: 0.714365 Apr 30 21:26:12.489421 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1843/3783] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:11 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1519 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:12.499891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:12.500542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:12.508135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:12.508610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:12.510170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:12.510633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:12.918627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:12.931421 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0233c019-838b-464d-9133-519c769db2e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.465902 Apr 30 21:26:12.932246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1941/3784] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:12 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:12.937600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9a899984-1c6f-4d2e-b748-159b3557c7ac req-bade07c9-9175-4cfe-afc0-6bc292d8c160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-deleted", "tag": "1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:12.966474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9a899984-1c6f-4d2e-b748-159b3557c7ac req-bade07c9-9175-4cfe-afc0-6bc292d8c160 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:12.966974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9a899984-1c6f-4d2e-b748-159b3557c7ac req-bade07c9-9175-4cfe-afc0-6bc292d8c160 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:12.991866 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9a899984-1c6f-4d2e-b748-159b3557c7ac req-bade07c9-9175-4cfe-afc0-6bc292d8c160 service nova] Creating event network-vif-deleted:1dee72be-0aaa-4eb2-8be1-5b0b65cdbe24 for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:12.993135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:13.004688 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9a899984-1c6f-4d2e-b748-159b3557c7ac req-bade07c9-9175-4cfe-afc0-6bc292d8c160 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071135 Apr 30 21:26:13.006469 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1942/3785] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:13.008131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:13.011587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:13.014537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d583a011-dcae-4b84-a0a1-17c5173ce825 req-9b6e96c3-b12b-4cd1-8cb0-965c36f5c4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4", "tag": "54ba9216-14d1-48d9-91ae-2c676c6c24ca"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:13.016647 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59d405a1-ab2b-485c-8360-1f1da178e76f tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 2386 microversion: 2.32 time: 0.522242 Apr 30 21:26:13.033433 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1844/3786] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:12 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 2386 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:13.039419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d583a011-dcae-4b84-a0a1-17c5173ce825 req-9b6e96c3-b12b-4cd1-8cb0-965c36f5c4b0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:13.041250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d583a011-dcae-4b84-a0a1-17c5173ce825 req-9b6e96c3-b12b-4cd1-8cb0-965c36f5c4b0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:13.056740 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d583a011-dcae-4b84-a0a1-17c5173ce825 req-9b6e96c3-b12b-4cd1-8cb0-965c36f5c4b0 service nova] Creating event network-changed:54ba9216-14d1-48d9-91ae-2c676c6c24ca for instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 on nch1-master-1 Apr 30 21:26:13.062935 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d583a011-dcae-4b84-a0a1-17c5173ce825 req-9b6e96c3-b12b-4cd1-8cb0-965c36f5c4b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056030 Apr 30 21:26:13.063956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1943/3787] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:13.480498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:13.481187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:13.498243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:13.500247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:13.512315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:13.512315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:13.513886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:13.515285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:13.520492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:13.523278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:13.525202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:13.526300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:14.497951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:14.536254 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6260c790-9f2b-4621-a181-5611917a977c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1519 microversion: 2.1 time: 1.043621 Apr 30 21:26:14.539519 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1944/3788] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:13 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1519 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:14.558949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:14.562298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:14.582410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:14.584325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:14.586415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:14.590915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:14.720280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:14.738184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:14.743932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:14.743932 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10545429-e1ac-409b-855b-a7d043c745ad tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 1.265616 Apr 30 21:26:14.743932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1845/3789] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:13 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:14.765595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:14.781866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:14.782231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:14.782725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:14.784364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:14.787127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:15.040140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:15.056253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:15.059074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0c43fdc22254d7f9c5999e044c4f844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57cf4c7f250443a8afd9460085f6951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:15.063421 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e24b41db-30b8-4305-88ac-02123deec2da tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 200 len: 1605 microversion: 2.32 time: 0.314913 Apr 30 21:26:15.074186 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1846/3790] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:14 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:15.074186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4c29d378-78a5-454f-ae06-f3a3171c602a req-b34ee10f-572c-44bd-b889-a53b1d7c7084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd", "name": "network-vif-deleted", "tag": "0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:15.097357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4c29d378-78a5-454f-ae06-f3a3171c602a req-b34ee10f-572c-44bd-b889-a53b1d7c7084 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:15.099833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4c29d378-78a5-454f-ae06-f3a3171c602a req-b34ee10f-572c-44bd-b889-a53b1d7c7084 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:15.113993 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4c29d378-78a5-454f-ae06-f3a3171c602a req-b34ee10f-572c-44bd-b889-a53b1d7c7084 service nova] Creating event network-vif-deleted:0db7a9c5-d9ee-4b9a-92e2-32c25f3c9a3e for instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd on nch1-master-1 Apr 30 21:26:15.120762 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4c29d378-78a5-454f-ae06-f3a3171c602a req-b34ee10f-572c-44bd-b889-a53b1d7c7084 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053043 Apr 30 21:26:15.127850 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1847/3791] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:15.143060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f1882e4a-f206-441e-a679-31924819fa91 req-b35bf227-0fe9-47df-8dcc-c7efffed2d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad593d69-b420-4af6-b0d2-73c63481895a", "tag": "dcd8283d-d19b-4e47-b08b-9296cfaa449a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:15.154759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f1882e4a-f206-441e-a679-31924819fa91 req-b35bf227-0fe9-47df-8dcc-c7efffed2d45 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:15.157273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f1882e4a-f206-441e-a679-31924819fa91 req-b35bf227-0fe9-47df-8dcc-c7efffed2d45 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:15.169748 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f1882e4a-f206-441e-a679-31924819fa91 req-b35bf227-0fe9-47df-8dcc-c7efffed2d45 service nova] Creating event network-changed:dcd8283d-d19b-4e47-b08b-9296cfaa449a for instance ad593d69-b420-4af6-b0d2-73c63481895a on nch1-master-1 Apr 30 21:26:15.180586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f1882e4a-f206-441e-a679-31924819fa91 req-b35bf227-0fe9-47df-8dcc-c7efffed2d45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040890 Apr 30 21:26:15.181899 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1848/3792] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:15.226965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:15.241995 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-88ac583f-d536-4cb6-aaf2-9c212d997a5d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.692590 Apr 30 21:26:15.242711 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1945/3793] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:14 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:15.565428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:15.567163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:15.588265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:15.593222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:15.597401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:15.598372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:15.761484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:15.763060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:15.774390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:15.776301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:15.778268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:15.780638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:17.131839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:17.146510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:17.153058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:17.158235 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fecbbad6-8b3c-4549-8faf-2da71a41ca96 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 1.398513 Apr 30 21:26:17.158235 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1946/3794] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:15 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:26:17.167996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:17.169155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] [instance: e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:17.193550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:17.194651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:17.198013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:17.202109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:17.231721 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] HTTP exception thrown: Instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd could not be found. Apr 30 21:26:17.233118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Returning 404 to user: Instance e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:17.234615 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8b105e35-07b4-41bd-af06-ccf90c97a11b tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd" status: 404 len: 111 microversion: 2.32 time: 0.076335 Apr 30 21:26:17.236699 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1947/3795] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:17 2022] GET /compute/v2.1/servers/e5ca51ea-2c60-43a5-aad6-45e4a3ea87dd => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:26:17.243275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:17.249600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:17.252405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:17.258724 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d04a0a76-edfa-47d1-8bff-3b52a278d40f tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1519 microversion: 2.1 time: 1.702373 Apr 30 21:26:17.259458 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1849/3796] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:15 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1519 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:17.265461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:17.266378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:17.267439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:17.268096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:17.305682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c64e641-3521-4816-9f5b-256b2e510455 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] Calling method '.version_select at 0x7fdc212c41f0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:17.481154 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c64e641-3521-4816-9f5b-256b2e510455 tempest-TaggedBootDevicesTest-1496276863 tempest-TaggedBootDevicesTest-1496276863-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856707096" status: 204 len: 0 microversion: 2.32 time: 0.179143 Apr 30 21:26:17.481795 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1850/3797] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:26:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856707096 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:26:17.656506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f41b9266-05d7-4674-93f7-edfcd4f98f7b req-eaeb97da-cfa0-443a-b35d-f963712abcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e309dd58-b98d-4f90-ab4c-de3de6a69682", "name": "network-vif-deleted", "tag": "083ed1b2-7dbf-4e5c-bc71-4e99b831b3bf"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:17.678097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f41b9266-05d7-4674-93f7-edfcd4f98f7b req-eaeb97da-cfa0-443a-b35d-f963712abcf0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:17.678825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f41b9266-05d7-4674-93f7-edfcd4f98f7b req-eaeb97da-cfa0-443a-b35d-f963712abcf0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:17.690300 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f41b9266-05d7-4674-93f7-edfcd4f98f7b req-eaeb97da-cfa0-443a-b35d-f963712abcf0 service nova] Creating event network-vif-deleted:083ed1b2-7dbf-4e5c-bc71-4e99b831b3bf for instance e309dd58-b98d-4f90-ab4c-de3de6a69682 on nch2-master-1 Apr 30 21:26:17.697245 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f41b9266-05d7-4674-93f7-edfcd4f98f7b req-eaeb97da-cfa0-443a-b35d-f963712abcf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044923 Apr 30 21:26:17.698052 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1851/3798] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:17.945289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:17.954450 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-52032952-b608-4e1f-9f5a-a04d81d08972 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.709600 Apr 30 21:26:17.956261 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1948/3799] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:17 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:18.179990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:18.183654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:18.196670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:18.197533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:18.200067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:18.200711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:18.278925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:18.280344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:18.291641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:18.298998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:18.299593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:18.300111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:18.361174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:18.361868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:18.362349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lazy-loading 'fault' on Instance uuid e309dd58-b98d-4f90-ab4c-de3de6a69682 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:26:18.469539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:18.482258 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f641f853-1232-45b3-8415-6ab141bd025a tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 200 len: 1311 microversion: 2.1 time: 0.207594 Apr 30 21:26:18.484942 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1949/3800] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:18 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:18.626463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:18.644108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:18.646720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:18.654998 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e6ae8ee0-cc4f-42a9-90ce-630ae5ac073a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.479578 Apr 30 21:26:18.654998 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1852/3801] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:18 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:18.972784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:18.974082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:18.981836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:18.983035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:18.984374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:18.985189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:19.312843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:19.337709 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-61cd9e5c-d05d-4338-a79e-ee4589f8c786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.365079 Apr 30 21:26:19.337709 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1950/3802] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:18 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:19.503035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:19.504506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: e309dd58-b98d-4f90-ab4c-de3de6a69682] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:19.512069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:19.513293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:19.514831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:19.517667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:19.549088 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] HTTP exception thrown: Instance e309dd58-b98d-4f90-ab4c-de3de6a69682 could not be found. Apr 30 21:26:19.549975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Returning 404 to user: Instance e309dd58-b98d-4f90-ab4c-de3de6a69682 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:19.555811 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67215eb3-d0fb-41b9-bdc1-23671b906e0c tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682" status: 404 len: 111 microversion: 2.1 time: 0.053320 Apr 30 21:26:19.555811 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1853/3803] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:19 2022] GET /compute/v2.1/servers/e309dd58-b98d-4f90-ab4c-de3de6a69682 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:26:19.561898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:19.562832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:19.576486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:19.577062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:19.578017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:19.581356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:19.637456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:26:19.669342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:19.672772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:19.683193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:19.683900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:19.685103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:19.685733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:20.054676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:20.062345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:20.067318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:20.068577 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ff620d5-d2b4-43ab-b249-ee625fb68323 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.403476 Apr 30 21:26:20.085796 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1854/3804] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:19 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:26:20.092358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7012e344-e562-439b-8602-e0291908c3dd req-cf43e70c-b440-4f52-821d-ea88477a5fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:20.102326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7012e344-e562-439b-8602-e0291908c3dd req-cf43e70c-b440-4f52-821d-ea88477a5fef service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:20.103303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7012e344-e562-439b-8602-e0291908c3dd req-cf43e70c-b440-4f52-821d-ea88477a5fef service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:20.106386 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a876c3b3-8c84-47c7-b77a-3730b3a07835 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 204 len: 0 microversion: 2.1 time: 0.548698 Apr 30 21:26:20.106988 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1951/3805] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:26:19 2022] DELETE /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:26:20.116376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:20.117088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:20.127935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7012e344-e562-439b-8602-e0291908c3dd req-cf43e70c-b440-4f52-821d-ea88477a5fef service nova] Creating event network-changed:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch2-master-1 Apr 30 21:26:20.131781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:20.131781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:20.132457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:20.132906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:20.136813 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7012e344-e562-439b-8602-e0291908c3dd req-cf43e70c-b440-4f52-821d-ea88477a5fef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049213 Apr 30 21:26:20.138318 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1855/3806] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:20.360879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:20.361897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:20.369001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:20.369616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:20.370582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:20.371197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:20.503831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:20.508154 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd27991a-36c0-4bdc-b8db-7447f21437b7 tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1518 microversion: 2.1 time: 0.395954 Apr 30 21:26:20.509350 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1952/3807] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:20 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1518 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:20.561352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:20.583675 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd6fa8fb-db99-4d66-8dd7-6295ed944f32 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.236107 Apr 30 21:26:20.596777 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1856/3808] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:20 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:21.087847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:21.088656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:21.102482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:21.104680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:21.112119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:21.112119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:21.525670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:21.529824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:21.544023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:21.544910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:21.545997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:21.549486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:22.257917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:22.313983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:22.318779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:22.323475 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bee90713-f9b0-46df-a29b-5a49f51138a3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 1.239874 Apr 30 21:26:22.325377 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1953/3809] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:21 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:22.340786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:22.344699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:22.356583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:22.368508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:22.374094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:22.385780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:22.388319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:22.392436 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-617fc173-a504-49bc-9c12-8dcc68939e3d tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1518 microversion: 2.1 time: 0.868431 Apr 30 21:26:22.399320 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1857/3810] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:21 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1518 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:22.415486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7ea8fed5-6414-4ccb-83c4-a7e0fa83381b req-d67c9c88-9775-4ec4-88a9-0c0ce6e96075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad593d69-b420-4af6-b0d2-73c63481895a", "name": "network-vif-plugged", "status": "completed", "tag": "dcd8283d-d19b-4e47-b08b-9296cfaa449a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:22.446005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7ea8fed5-6414-4ccb-83c4-a7e0fa83381b req-d67c9c88-9775-4ec4-88a9-0c0ce6e96075 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:22.447872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7ea8fed5-6414-4ccb-83c4-a7e0fa83381b req-d67c9c88-9775-4ec4-88a9-0c0ce6e96075 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:22.496910 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7ea8fed5-6414-4ccb-83c4-a7e0fa83381b req-d67c9c88-9775-4ec4-88a9-0c0ce6e96075 service nova] Creating event network-vif-plugged:dcd8283d-d19b-4e47-b08b-9296cfaa449a for instance ad593d69-b420-4af6-b0d2-73c63481895a on nch1-master-1 Apr 30 21:26:22.524711 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7ea8fed5-6414-4ccb-83c4-a7e0fa83381b req-d67c9c88-9775-4ec4-88a9-0c0ce6e96075 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117723 Apr 30 21:26:22.524711 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1858/3811] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:23.180628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:23.193589 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d76f9518-4ace-4627-a49f-e66a99e68b4a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.859871 Apr 30 21:26:23.194370 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1954/3812] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:22 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:23.349713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:23.352802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:23.376131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:23.377164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:23.378702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:23.381950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:23.415092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:23.416466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:23.431125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:23.436397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:23.436397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:23.436397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:23.695324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:23.708392 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c9d13d8-4e17-4d09-bb8e-1c95ecbe6bcd tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1476 microversion: 2.1 time: 0.297290 Apr 30 21:26:23.709370 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1955/3813] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:23 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:23.887317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:23.918124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:23.925140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:23.931243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-48af4694-014f-498e-9f04-7916c321879e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.591014 Apr 30 21:26:23.932505 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1859/3814] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:23 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:23.970596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-78af4352-aed5-4ad3-883c-663dde75d838 req-05f175df-6436-4a48-83cd-c0758fecbb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63d86ea-e808-48fc-a674-231fbfbca961", "name": "network-vif-deleted", "tag": "ce973619-9d58-43bb-af05-38ad4e6df819"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:23.997690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-78af4352-aed5-4ad3-883c-663dde75d838 req-05f175df-6436-4a48-83cd-c0758fecbb4e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.002419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-78af4352-aed5-4ad3-883c-663dde75d838 req-05f175df-6436-4a48-83cd-c0758fecbb4e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:24.040558 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-78af4352-aed5-4ad3-883c-663dde75d838 req-05f175df-6436-4a48-83cd-c0758fecbb4e service nova] Creating event network-vif-deleted:ce973619-9d58-43bb-af05-38ad4e6df819 for instance d63d86ea-e808-48fc-a674-231fbfbca961 on nch2-master-1 Apr 30 21:26:24.060337 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-78af4352-aed5-4ad3-883c-663dde75d838 req-05f175df-6436-4a48-83cd-c0758fecbb4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093042 Apr 30 21:26:24.063955 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1956/3815] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:24.217572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:24.218400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:24.229310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.231768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:24.232888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.233673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:24.583930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:24.596242 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5042e622-5411-4ba8-945f-13035f900163 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1315 microversion: 2.1 time: 0.383410 Apr 30 21:26:24.599561 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1860/3816] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:24 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:24.727106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:24.728474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:24.749688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.750495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:24.754629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.755357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:24.848716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.849460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:24.850189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lazy-loading 'fault' on Instance uuid d63d86ea-e808-48fc-a674-231fbfbca961 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:26:24.951821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:24.952596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:24.963308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.968671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:24.970902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:24.976952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:25.257029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a466ad74049c4383af4a5f43f7023728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1236f389e69047b8add7cbc7cefe8f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:25.266766 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-33bf2f9a-9bbb-44e7-a168-696bb56d583e tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 200 len: 1311 microversion: 2.1 time: 0.543316 Apr 30 21:26:25.278458 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1957/3817] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:24 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 1311 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:25.435991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:25.446416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:25.448297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:25.451313 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-735624eb-24b6-4374-ac0f-06f0b973fe6b tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.503621 Apr 30 21:26:25.462648 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1861/3818] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:24 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:26:25.615243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:25.616225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:25.634403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:25.636455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:25.639787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:25.642388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:25.832509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:25.854163 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c621fc08-f47b-4a5a-84a1-3deaace14d90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1503 microversion: 2.1 time: 0.240724 Apr 30 21:26:25.854163 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1958/3819] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:25 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:25.869869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ca559b2-72ac-448b-8062-242099cabe35 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:25.887228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ca559b2-72ac-448b-8062-242099cabe35 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:25.889848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ca559b2-72ac-448b-8062-242099cabe35 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:25.971636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6ca559b2-72ac-448b-8062-242099cabe35 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Going to try to stop instance {{(pid=130670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:26:26.248908 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ca559b2-72ac-448b-8062-242099cabe35 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a/action" status: 202 len: 0 microversion: 2.1 time: 0.381693 Apr 30 21:26:26.253251 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1862/3820] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:26:25 2022] POST /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:26:26.258613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:26.259412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:26.266866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:26.267673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:26.268831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:26.269502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:26.286072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:26.286786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] [instance: d63d86ea-e808-48fc-a674-231fbfbca961] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:26.295618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:26.296080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:26.296921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:26.297371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:26.333550 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] HTTP exception thrown: Instance d63d86ea-e808-48fc-a674-231fbfbca961 could not be found. Apr 30 21:26:26.334686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] Returning 404 to user: Instance d63d86ea-e808-48fc-a674-231fbfbca961 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:26.338840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67ec2579-6369-4bb1-80d4-3f643f1c4dbe tempest-ListServerFiltersTestJSON-1641589296 tempest-ListServerFiltersTestJSON-1641589296-project] 10.222.0.23 "GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961" status: 404 len: 111 microversion: 2.1 time: 0.055317 Apr 30 21:26:26.342354 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1863/3821] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:26 2022] GET /compute/v2.1/servers/d63d86ea-e808-48fc-a674-231fbfbca961 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:26:26.473248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:26.473888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:26.504075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:26.504949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:26.506680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:26.507454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:26.700132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:26.707970 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8296315c-8cfb-4936-9ecf-4f5d00428c3f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.453444 Apr 30 21:26:26.712331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1959/3822] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:26 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:26.831477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:26.840723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:26.845091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:26.846575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-169c7b6e-002b-4238-b9f6-223466de3495 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.377831 Apr 30 21:26:26.858580 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1864/3823] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:26 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:27.729738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:27.733161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:27.744042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:27.744513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:27.745330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:27.745815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:27.865085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:27.865694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:27.878961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:27.880218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:27.906727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:27.907211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:28.024759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:28.037881 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7fcbb1ca-bbdc-4e19-94a1-253358980de4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.312323 Apr 30 21:26:28.042929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1960/3824] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:27 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:28.160402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:28.176675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:28.178773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:28.189617 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e06fe0d-3634-4407-a311-070817db7de6 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.319372 Apr 30 21:26:28.189617 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1865/3825] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:27 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:29.063018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:29.063737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:29.078707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:29.083270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:29.084171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:29.084660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:29.201393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:29.202137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:29.212652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:29.213303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:29.214829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:29.215624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:29.554002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:29.572074 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-108be9ff-337b-4a67-a357-d9ae472088d4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.515369 Apr 30 21:26:29.572685 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1961/3826] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:29 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:29.588863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:29.612876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:29.620195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:29.625018 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-107f516c-e4c1-48f5-8927-8e5caece0176 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.424595 Apr 30 21:26:29.627073 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1866/3827] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:29 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:30.599275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:30.599900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:30.607399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:30.608278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:30.609266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:30.609915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:30.654130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:30.656215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:30.668021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:30.670256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:30.671268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:30.674402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:31.126915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:31.137212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:31.145241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:31.156214 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7bbb80af-800f-4a2b-b945-3af53c4f7c0a tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.507119 Apr 30 21:26:31.157171 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1867/3828] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:30 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:31.206046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:31.224380 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8067ee0-08e4-4392-a4a2-f9dcd7a9f398 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.629931 Apr 30 21:26:31.230630 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1962/3829] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:30 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:32.070748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a41a22ad-d397-45f4-b4f9-1f34e92aebc0 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1814766213", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:32.073605 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a41a22ad-d397-45f4-b4f9-1f34e92aebc0 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] HTTP exception thrown: min_count must be <= max_count Apr 30 21:26:32.078755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a41a22ad-d397-45f4-b4f9-1f34e92aebc0 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Returning 400 to user: min_count must be <= max_count {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:32.080402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a41a22ad-d397-45f4-b4f9-1f34e92aebc0 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.174884 Apr 30 21:26:32.082765 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1868/3830] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:31 2022] POST /compute/v2.1/servers => generated 74 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:32.163091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5abb7d99-0b33-426c-93ca-238189477445 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-342403438", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "max_count": 0}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:32.173888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5abb7d99-0b33-426c-93ca-238189477445 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:32.176953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5abb7d99-0b33-426c-93ca-238189477445 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016610 Apr 30 21:26:32.177602 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1963/3831] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:26:32.182128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:32.203117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:32.224387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:32.225842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:32.229791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:32.230931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:32.250636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:32.251286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:32.280477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:32.281058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:32.283947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:32.284433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:33.137535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:33.146202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:33.151953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:33.159337 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70d7f0c7-ddbc-451e-b1f6-d48b1e96b288 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.982455 Apr 30 21:26:33.160063 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1869/3832] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:32 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:33.164909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9d73de5-98fc-416a-94d9-0e4fad53af5c tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2117400254", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "max_count": 2.5}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:33.171148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9d73de5-98fc-416a-94d9-0e4fad53af5c tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:33.175199 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9d73de5-98fc-416a-94d9-0e4fad53af5c tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014053 Apr 30 21:26:33.176153 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1870/3833] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:26:33.239886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ec9ae8f-18e5-465c-8c79-4137e4b1a7df tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1134844280", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 0}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:33.254382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ec9ae8f-18e5-465c-8c79-4137e4b1a7df tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:33.258158 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ec9ae8f-18e5-465c-8c79-4137e4b1a7df tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019989 Apr 30 21:26:33.258158 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1871/3834] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:33 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:26:33.333394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5cfca063-3da9-4919-ba35-fd77946ccf23 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-249937478", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 2.5}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:33.335092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5cfca063-3da9-4919-ba35-fd77946ccf23 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:33.336113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5cfca063-3da9-4919-ba35-fd77946ccf23 tempest-MultipleCreateNegativeTestJSON-1711280017 tempest-MultipleCreateNegativeTestJSON-1711280017-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008204 Apr 30 21:26:33.336849 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1872/3835] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:26:33.396357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:33.415008 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dcd8ebb0-2f24-414d-a69e-72cbfe26e0d0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 1.169794 Apr 30 21:26:33.421472 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1964/3836] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:32 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:34.184568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:34.185838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:34.192855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:34.193542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:34.196710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:34.196710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:34.442342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:34.443075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:34.451865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:34.452799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:34.453909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:34.454455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:34.464317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:34.473922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:34.482082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:34.482082 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23301f70-e652-4c22-8861-1c74dcc115f8 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.300118 Apr 30 21:26:34.482082 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1873/3837] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:34 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:34.706500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:34.717234 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a22ca78b-beed-4c6b-a852-30d555ee0a7b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.279065 Apr 30 21:26:34.723809 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1965/3838] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:34 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:35.498120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:35.499401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:35.506710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:35.507517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:35.508399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:35.508944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:35.698191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:35.708702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:35.710597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:35.723704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-519ea81f-b03a-49db-8070-5b00de98eecf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.218705 Apr 30 21:26:35.723704 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1874/3839] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:35 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:35.735520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:35.736272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:35.743724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:35.744315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:35.745580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:35.746120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:35.899762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:35.908244 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-134b8205-c6ef-472c-a9bc-2a74d92c9eb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.176788 Apr 30 21:26:35.908831 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1966/3840] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:35 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:36.731685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:36.732533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:36.740037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:36.740529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:36.741566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:36.742427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:36.925388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:36.926036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:36.935084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:36.935815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:36.936784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:36.937398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:36.960578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:36.970222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:36.972024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:36.973498 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4097eb2d-808d-4e78-a4fa-fbacf2660b68 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.246099 Apr 30 21:26:36.974289 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1875/3841] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:36 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:37.190884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:37.203358 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e0c2da35-6b18-4a4e-aae1-aafb07574a7a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.281935 Apr 30 21:26:37.205677 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1967/3842] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:36 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:37.994124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:37.995686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:38.005457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:38.006171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:38.007148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:38.007764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:38.226262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:38.229244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:38.239305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:38.240045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:38.241136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:38.241587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:38.474685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:38.485038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:38.486937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:38.488454 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-037af3ed-2101-46cf-b4be-214e29d3bbd3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.499978 Apr 30 21:26:38.500950 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1876/3843] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:37 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:38.560455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:38.568023 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da8e4027-9c9b-47f9-8e1c-3b11e2b426d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.350982 Apr 30 21:26:38.568604 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1968/3844] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:38 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:39.507890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:39.508553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:39.516596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:39.517350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:39.518198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:39.518730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:39.539404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3d7aa27a-7f6e-4561-96ea-a90904571aa4 req-52904c66-327c-4abe-950f-835a94767bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "name": "network-vif-plugged", "status": "completed", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:39.554923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3d7aa27a-7f6e-4561-96ea-a90904571aa4 req-52904c66-327c-4abe-950f-835a94767bc8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:39.554923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3d7aa27a-7f6e-4561-96ea-a90904571aa4 req-52904c66-327c-4abe-950f-835a94767bc8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:39.565505 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3d7aa27a-7f6e-4561-96ea-a90904571aa4 req-52904c66-327c-4abe-950f-835a94767bc8 service nova] Creating event network-vif-plugged:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch2-master-1 Apr 30 21:26:39.570801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3d7aa27a-7f6e-4561-96ea-a90904571aa4 req-52904c66-327c-4abe-950f-835a94767bc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037640 Apr 30 21:26:39.574742 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1969/3845] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:26:39.596802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:39.597867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:39.607107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:39.612804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:39.612804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:39.612804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:39.907890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:39.916488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:39.919387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:39.920895 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-615d37e2-d806-4783-973a-8eb920e284b4 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.417204 Apr 30 21:26:39.922047 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1877/3846] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:39 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:40.011102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:40.020120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7cf7976-5643-4852-be21-959fa1bbe31a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.428990 Apr 30 21:26:40.029731 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1970/3847] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:39 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:40.940666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:40.942094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:40.949560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:40.951042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:40.952077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:40.952691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:41.036541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:41.037316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:41.045329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:41.045848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:41.046659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:41.047108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:41.627423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:41.636388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:41.638794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:41.640079 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-58fff0dc-31bc-44fe-b833-6aa720cb8972 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.703928 Apr 30 21:26:41.640730 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1878/3848] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:40 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:26:41.656315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:41.664233 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9f866cae-246e-4f8b-901b-e2b52e4057f1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.631592 Apr 30 21:26:41.664921 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1971/3849] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:41 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:42.660712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:42.662243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:42.672521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:42.673074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:42.673981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:42.674492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:42.682757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:42.684097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:42.703839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:42.704662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:42.708274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:42.710504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:43.125898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:43.126579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:43.142708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:43.144694 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-837d5143-1071-4c18-afeb-9a11a4ee3310 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.463900 Apr 30 21:26:43.147598 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1972/3850] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:42 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:43.148421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:43.149963 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98676eb4-441e-4484-89ec-acfed7ee15d3 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1728 microversion: 2.20 time: 0.494286 Apr 30 21:26:43.151121 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1879/3851] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:42 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1728 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:26:44.176675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:44.179948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:44.181307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:44.183492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:44.207820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:44.208693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:44.209386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:44.210098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:44.211864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:44.212934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:44.213692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:44.214410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.080891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:45.094807 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5264a0c5-2f16-4dbc-bad5-f485f56c8d83 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.923215 Apr 30 21:26:45.095657 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1880/3852] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:44 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:45.108507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:45.115058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb18fb76-e08c-4e60-ae71-b311c1b21f29 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:45.116325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb18fb76-e08c-4e60-ae71-b311c1b21f29 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:45.120639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:45.123545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:45.124805 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92d07052-08c5-4e3f-8fbd-95d19c42e110 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1715 microversion: 2.20 time: 0.958361 Apr 30 21:26:45.127699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb18fb76-e08c-4e60-ae71-b311c1b21f29 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.127699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb18fb76-e08c-4e60-ae71-b311c1b21f29 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.128463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb18fb76-e08c-4e60-ae71-b311c1b21f29 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.129079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb18fb76-e08c-4e60-ae71-b311c1b21f29 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.130151 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1973/3853] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:26:44 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1715 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:26:45.229153 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb18fb76-e08c-4e60-ae71-b311c1b21f29 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4/ips" status: 200 len: 148 microversion: 2.1 time: 0.129832 Apr 30 21:26:45.232904 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1881/3854] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:26:45 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4/ips => generated 148 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:45.244283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28cf7446-872a-4b61-8092-677879a5220a"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:45.248793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:45.263839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.264853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.266045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.266668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.437489 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Invalid volume: volume 28cf7446-872a-4b61-8092-677879a5220a is already attached to instances: 3981cebe-916e-45b7-a15c-a2639be85842 Apr 30 21:26:45.441718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 400 to user: Invalid volume: volume 28cf7446-872a-4b61-8092-677879a5220a is already attached to instances: 3981cebe-916e-45b7-a15c-a2639be85842 {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:45.441718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3079a5d-1678-4b47-bec7-8885be8c1852 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.200224 Apr 30 21:26:45.441718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1974/3855] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:26:45 2022] POST /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4/os-volume_attachments => generated 174 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 21:26:45.456336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:45.459192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:45.466567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.467769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.471197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.471197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.526408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:26:45.939938 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b5227aa8-c1ec-4a7a-8822-3450d944171c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 204 len: 0 microversion: 2.1 time: 0.493573 Apr 30 21:26:45.940995 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1882/3856] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:26:45 2022] DELETE /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:26:45.952334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:45.953371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:45.965022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.965187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:45.966816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:45.967274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:46.180927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1202673650", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:46.314749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] validate_networks() for [('acf946d8-f627-421b-bd28-a9c0e5235ab2', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:26:46.520693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:46.536801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3684a19c-d20c-4e93-b1ba-771164ca9fd3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1679 microversion: 2.1 time: 0.591545 Apr 30 21:26:46.552370 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1975/3857] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:45 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1679 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:46.564869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:46.565829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:46.581876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:46.585120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:46.586365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:46.590143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:46.971547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:46.993056 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2e250651-c221-4fd8-bdf7-0c7273f898b6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.439134 Apr 30 21:26:46.995008 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1976/3858] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:46 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:47.375770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:26:47.376805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:26:47.378083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:26:47.378799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:26:47.379460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:26:47.391000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:47.391767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:47.392985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:47.393670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:47.484443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Getting quotas for project acd535df3826485d8472597a6258a56c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:26:47.507091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Getting quotas for user 582d05a237ba4a1a95ba93474fd4a978 and project acd535df3826485d8472597a6258a56c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:26:47.526008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:26:47.531113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:26:47.560008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:47.560620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:47.575206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:47.575896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:47.580737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:47.580737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:47.734628 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32053ff1-e856-44db-a228-10b3362081ce tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.784212 Apr 30 21:26:47.735539 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1883/3859] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:26:47.751034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1cda919-f085-422b-83e0-9d8123c5bca2 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:47.751979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d1cda919-f085-422b-83e0-9d8123c5bca2 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:47.880819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d1cda919-f085-422b-83e0-9d8123c5bca2 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:47.891064 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d1cda919-f085-422b-83e0-9d8123c5bca2 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1223 microversion: 2.1 time: 0.146299 Apr 30 21:26:47.893595 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1884/3860] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:47 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:48.017934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:48.019135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:48.042784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:48.045410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:48.046584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:48.050537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:48.228608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:48.244659 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6ae9bae1-c0f5-4056-bdac-097f0e8152f4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1679 microversion: 2.1 time: 0.688514 Apr 30 21:26:48.245278 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1977/3861] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:47 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1679 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:48.376165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:48.384002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-41c55de4-50ee-4164-96b4-0ca9e56bfe08 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.375281 Apr 30 21:26:48.401772 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1885/3862] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:48 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:48.910765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9b1d1ac-af2d-470d-baf1-c3b11edd08ec tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:48.911265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9b1d1ac-af2d-470d-baf1-c3b11edd08ec tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:49.032112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b9b1d1ac-af2d-470d-baf1-c3b11edd08ec tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:49.042741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9b1d1ac-af2d-470d-baf1-c3b11edd08ec tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1223 microversion: 2.1 time: 0.136191 Apr 30 21:26:49.050222 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1978/3863] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:48 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:49.198515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e5cfe715-1ade-4acc-b5fc-7866e2926ad0 req-d8a0e827-5220-497a-94bd-f8580d44e35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4", "name": "network-vif-deleted", "tag": "54ba9216-14d1-48d9-91ae-2c676c6c24ca"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:49.208096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e5cfe715-1ade-4acc-b5fc-7866e2926ad0 req-d8a0e827-5220-497a-94bd-f8580d44e35f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:49.208921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e5cfe715-1ade-4acc-b5fc-7866e2926ad0 req-d8a0e827-5220-497a-94bd-f8580d44e35f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:49.224289 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e5cfe715-1ade-4acc-b5fc-7866e2926ad0 req-d8a0e827-5220-497a-94bd-f8580d44e35f service nova] Creating event network-vif-deleted:54ba9216-14d1-48d9-91ae-2c676c6c24ca for instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 on nch1-master-1 Apr 30 21:26:49.246077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e5cfe715-1ade-4acc-b5fc-7866e2926ad0 req-d8a0e827-5220-497a-94bd-f8580d44e35f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047065 Apr 30 21:26:49.256966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1886/3864] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:49.262848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:49.263737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:49.273057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:49.276944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:49.278797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:49.283427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:49.403289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:49.404561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:49.406176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:49.423150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:49.423620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:49.424439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:49.424893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:49.426862 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6cc008a-8e31-4069-b739-bac1e8e02a37 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1612 microversion: 2.1 time: 0.168337 Apr 30 21:26:49.427981 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1979/3865] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:49 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1612 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:49.643761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:49.663211 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a06f8a21-1989-47b6-8ec1-161c1c28b6ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.265016 Apr 30 21:26:49.664052 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1887/3866] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:49 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:50.063433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:50.063433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:50.072151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:50.073097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:50.074322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:50.076861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:50.230365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:50.239160 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-33f8a95d-daa1-4e2a-bec5-c393de77abea tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1275 microversion: 2.1 time: 0.183085 Apr 30 21:26:50.249892 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1980/3867] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:50 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:50.446744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:50.465521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:50.477341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:50.479850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:50.483914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:50.484657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:50.580826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:50.582079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:50.582939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lazy-loading 'fault' on Instance uuid ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:26:50.683084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:50.684074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:50.702395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:50.702862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:50.708706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:50.710359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:50.711395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:50.719270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1eb12403-0fed-48b0-a89b-b9af482dc642 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 200 len: 1331 microversion: 2.1 time: 0.277898 Apr 30 21:26:50.734100 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1888/3868] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:50 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 1331 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:51.258854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:51.259608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:51.269595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:51.270332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:51.276801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:51.276801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:51.436807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:51.448781 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4fbfba6f-e2f0-4bd7-b50d-05ce93fc9f2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1513 microversion: 2.1 time: 0.769639 Apr 30 21:26:51.453993 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1981/3869] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:50 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1513 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:51.499474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:51.508914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2258ee35-a26c-4ec0-8f49-e57ec3ef1c80 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1281 microversion: 2.1 time: 0.254072 Apr 30 21:26:51.515576 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1889/3870] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:51 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1281 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:51.747453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:51.748413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:51.766474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:51.769899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:51.771798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:51.773832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:51.819978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 could not be found. Apr 30 21:26:51.820102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:26:51.820974 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-61f3a341-f89a-4a86-a4f8-4fb6020b60e6 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 404 len: 111 microversion: 2.1 time: 0.080894 Apr 30 21:26:51.825346 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1982/3871] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:51 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:26:51.831208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03b2a5cd-e01d-4159-bafc-a7c8641bcb85 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '.version_select at 0x7fdc209c2940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:51.948627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-03b2a5cd-e01d-4159-bafc-a7c8641bcb85 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-556036263" status: 202 len: 0 microversion: 2.1 time: 0.122269 Apr 30 21:26:51.951070 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1890/3872] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:26:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-556036263 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:26:52.484796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:52.489893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:52.515621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:52.516088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:52.516896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:52.517517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:52.530516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:52.535172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:52.553653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:52.558242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:52.558242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:52.558242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.226901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:53.239997 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-27bcceab-32a6-4ca7-9f7c-a1415fda62a7 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1323 microversion: 2.1 time: 0.716872 Apr 30 21:26:53.252214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:53.254804 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1891/3873] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:52 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1323 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:53.263033 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8bd28815-aa5f-40fa-8ae7-5a50e21634cd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1490 microversion: 2.1 time: 0.798961 Apr 30 21:26:53.263647 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1983/3874] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:52 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1490 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:53.289729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d98ba896-443f-40d4-9ade-624589f198a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:53.291122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d98ba896-443f-40d4-9ade-624589f198a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:53.303928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d98ba896-443f-40d4-9ade-624589f198a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.306434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d98ba896-443f-40d4-9ade-624589f198a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.307576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d98ba896-443f-40d4-9ade-624589f198a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.308187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d98ba896-443f-40d4-9ade-624589f198a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.370250 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d98ba896-443f-40d4-9ade-624589f198a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 200 len: 177 microversion: 2.1 time: 0.084840 Apr 30 21:26:53.373891 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1892/3875] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:26:53 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 177 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:53.380553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:53.381629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:53.388464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.389091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.390057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.390604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.649956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:53.660800 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ba8160d1-c1b4-4dc7-afa1-3956bba59f00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.284518 Apr 30 21:26:53.664175 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1984/3876] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:53 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:53.684035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:53.685583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:53.700567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.700567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.700567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.700567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.823598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:53.825164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:53.837993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.838731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.839701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.840186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.913214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:53.929177 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6fd7c21f-8037-4ae7-a958-67a272f6e21e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.249675 Apr 30 21:26:53.932921 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1893/3877] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:53 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:53.969842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:53.971128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:53.978391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.979630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.981370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:53.982320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:53.989221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lazy-loading 'services' on Instance uuid 3981cebe-916e-45b7-a15c-a2639be85842 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:26:54.216814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:54.230789 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49257ee4-eaf1-4330-9891-f6080f2b0956 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.260372 Apr 30 21:26:54.230789 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1894/3878] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:53 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:54.245505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:54.246322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:54.254859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:54.255426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:54.256370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:54.257118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:54.275310 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments/28cf7446-872a-4b61-8092-677879a5220a" status: 202 len: 0 microversion: 2.1 time: 0.456231 Apr 30 21:26:54.276492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1985/3879] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:26:53 2022] DELETE /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments/28cf7446-872a-4b61-8092-677879a5220a => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:26:54.296755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:54.298476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:54.313293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:54.313958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:54.314638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:54.316172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:54.598282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:54.612223 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f6a530f1-9c44-44bf-8e00-6aa609a3ec1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.375421 Apr 30 21:26:54.613346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1895/3880] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:54 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:54.618393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-491f71f3-90d2-4f28-9d2d-6d661976a786 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:54.619860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-491f71f3-90d2-4f28-9d2d-6d661976a786 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:54.620425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:54.627186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-491f71f3-90d2-4f28-9d2d-6d661976a786 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:54.631143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-491f71f3-90d2-4f28-9d2d-6d661976a786 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:54.631143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-491f71f3-90d2-4f28-9d2d-6d661976a786 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:54.631143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-491f71f3-90d2-4f28-9d2d-6d661976a786 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:54.638487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-732dbe9c-b9da-4d5b-b24d-e47620abb75d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1323 microversion: 2.1 time: 0.360614 Apr 30 21:26:54.640365 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1986/3881] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:54 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:54.648521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d1a84bc0-513a-47dd-b11e-166d064efbd9 req-11594e99-d80a-4e74-9600-84820a8aa009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c395141-111d-4dfd-ace8-178b59574e50", "tag": "c86d6076-6753-4ec2-8787-d007df62c17c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:54.662204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d1a84bc0-513a-47dd-b11e-166d064efbd9 req-11594e99-d80a-4e74-9600-84820a8aa009 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:54.664349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d1a84bc0-513a-47dd-b11e-166d064efbd9 req-11594e99-d80a-4e74-9600-84820a8aa009 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:54.686514 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d1a84bc0-513a-47dd-b11e-166d064efbd9 req-11594e99-d80a-4e74-9600-84820a8aa009 service nova] Creating event network-changed:c86d6076-6753-4ec2-8787-d007df62c17c for instance 6c395141-111d-4dfd-ace8-178b59574e50 on nch2-master-1 Apr 30 21:26:54.691813 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-491f71f3-90d2-4f28-9d2d-6d661976a786 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077179 Apr 30 21:26:54.693738 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1896/3882] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:26:54 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:54.698220 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d1a84bc0-513a-47dd-b11e-166d064efbd9 req-11594e99-d80a-4e74-9600-84820a8aa009 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056003 Apr 30 21:26:54.699065 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1987/3883] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:54.767440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1071605718", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "6d21022d-393a-4eff-ba51-560f37353f44"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:54.868951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] validate_networks() for [('6d21022d-393a-4eff-ba51-560f37353f44', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:26:55.517267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:26:55.517988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:26:55.525468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:26:55.525468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:26:55.525468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:26:55.529909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.530516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.531343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.532071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.553084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:26:55.559369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for user 20b4082fa07249e2b6dfb9b4506ab398 and project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:26:55.573033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:26:55.575455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:26:55.657134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:55.658113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:55.664887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.665529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.666194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.666641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.723245 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97447f70-5ee4-42bd-b556-443bf9d7b858 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960835 Apr 30 21:26:55.725746 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1897/3884] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:26:55.740995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3c2cfe71-3d05-4191-954d-9220ce704350 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:55.742725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3c2cfe71-3d05-4191-954d-9220ce704350 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:55.758092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c2cfe71-3d05-4191-954d-9220ce704350 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.758092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c2cfe71-3d05-4191-954d-9220ce704350 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.758092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c2cfe71-3d05-4191-954d-9220ce704350 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.758092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c2cfe71-3d05-4191-954d-9220ce704350 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.789789 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3c2cfe71-3d05-4191-954d-9220ce704350 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061667 Apr 30 21:26:55.790922 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1898/3885] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:26:55 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:26:55.796860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-40e06986-21f0-4527-b3ce-40a022ef15c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:55.797772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-40e06986-21f0-4527-b3ce-40a022ef15c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:55.909413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-40e06986-21f0-4527-b3ce-40a022ef15c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:55.920777 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-40e06986-21f0-4527-b3ce-40a022ef15c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1215 microversion: 2.1 time: 0.128433 Apr 30 21:26:55.922046 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1899/3886] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:55 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:55.927670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:55.928388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:55.934894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:55.941489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.941489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.941489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:55.943735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:55.947376 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f32ac14f-8eb0-4ca0-b5b1-1769dd998ccf tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1323 microversion: 2.1 time: 0.294405 Apr 30 21:26:55.947376 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1988/3887] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:55 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1323 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:55.992456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:26:56.381316 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f3f74d6-8783-4e98-b065-33d695f9511a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 204 len: 0 microversion: 2.1 time: 0.457709 Apr 30 21:26:56.382151 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1900/3888] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:26:55 2022] DELETE /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:26:56.390988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:56.391610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:56.397881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:56.398560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:56.399368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:56.399974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:56.939042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:56.939891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:56.946778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:56.947329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:56.948176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:56.948688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:56.975848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:56.983577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1265c999-c490-457a-a464-13394087c98f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1681 microversion: 2.1 time: 0.597121 Apr 30 21:26:56.992187 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1989/3889] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:56 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1681 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:56.996599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:56.997262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:57.004250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:57.004712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:57.005992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:57.006448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:57.024514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:57.035019 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4c9fe862-560c-45de-a152-a9e86cbc96ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1219 microversion: 2.1 time: 0.100191 Apr 30 21:26:57.036821 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1901/3890] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:56 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:57.262357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:57.277293 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-038a2577-de1e-4592-b2f9-c9889e5c60b3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1323 microversion: 2.1 time: 0.285049 Apr 30 21:26:57.278929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1990/3891] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:56 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:58.006572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:58.007177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:58.013940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:58.014403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:58.015192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:58.015638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:58.055021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:58.055583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:58.063506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:58.063969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:58.068966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:58.068966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:58.202932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:58.210577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d1b2ad9-776d-4b7d-b451-2218c49b8507 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1267 microversion: 2.1 time: 0.160560 Apr 30 21:26:58.211452 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1991/3892] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:58 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:58.296696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:58.297327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:58.303384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:58.303850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:58.304643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:58.305095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:58.557583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:58.568978 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c28c7f95-3516-4b52-8fae-662cf5a6c2fe tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1681 microversion: 2.1 time: 0.566335 Apr 30 21:26:58.577414 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1902/3893] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:58 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1681 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:58.782936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:58.791296 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-39180be1-6fca-4a86-96cb-97169d8c993a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1323 microversion: 2.1 time: 0.499824 Apr 30 21:26:58.791870 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1992/3894] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:58 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1323 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:26:59.228438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:59.229133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:59.236804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:59.237476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:59.238712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:59.239764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:59.369059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:26:59.386251 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-129fa645-e59b-46db-b9ac-de76e238bdf4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1273 microversion: 2.1 time: 0.161559 Apr 30 21:26:59.387081 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1903/3895] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:59 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:26:59.586137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:59.587069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:59.595255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:59.595813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:59.596702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:59.597399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:59.774199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2d9072f9-7d9b-49e9-bc37-6b8279253fe3 req-d24c1625-9d81-47bf-bb2b-649738471b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c395141-111d-4dfd-ace8-178b59574e50", "name": "network-vif-plugged", "status": "completed", "tag": "c86d6076-6753-4ec2-8787-d007df62c17c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:26:59.785858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d9072f9-7d9b-49e9-bc37-6b8279253fe3 req-d24c1625-9d81-47bf-bb2b-649738471b82 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:59.785858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d9072f9-7d9b-49e9-bc37-6b8279253fe3 req-d24c1625-9d81-47bf-bb2b-649738471b82 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:59.798539 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2d9072f9-7d9b-49e9-bc37-6b8279253fe3 req-d24c1625-9d81-47bf-bb2b-649738471b82 service nova] Creating event network-vif-plugged:c86d6076-6753-4ec2-8787-d007df62c17c for instance 6c395141-111d-4dfd-ace8-178b59574e50 on nch2-master-1 Apr 30 21:26:59.803736 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2d9072f9-7d9b-49e9-bc37-6b8279253fe3 req-d24c1625-9d81-47bf-bb2b-649738471b82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033881 Apr 30 21:26:59.804882 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1904/3896] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:26:59.816478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:26:59.817521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:26:59.826454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:59.827211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:26:59.828239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:26:59.828892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:00.289378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:00.298159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-83bc0341-66f7-4e07-a662-ab7ff59e9219 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1681 microversion: 2.1 time: 0.716182 Apr 30 21:27:00.299036 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1993/3897] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:59 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1681 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:00.404344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:00.405565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:00.412748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:00.413613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:00.414910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:00.415370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:00.593012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:00.605172 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9d8d2f9a-78d0-4bfd-a4ec-c6da76350771 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1323 microversion: 2.1 time: 0.798549 Apr 30 21:27:00.620379 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1905/3898] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:26:59 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1323 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:00.946913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:00.954913 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a95232f6-1fbc-4758-b7b9-f21678dadf79 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.555345 Apr 30 21:27:00.955914 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1994/3899] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:00 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:01.064787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-86797e80-73bb-4ea9-affb-0df19a8daed9 req-7b04cf06-12d6-49ae-b16b-ae227849d052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3981cebe-916e-45b7-a15c-a2639be85842", "name": "network-vif-deleted", "tag": "9f34796a-fd6b-425b-aaf7-911bec70b97e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:01.072957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-86797e80-73bb-4ea9-affb-0df19a8daed9 req-7b04cf06-12d6-49ae-b16b-ae227849d052 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:01.073416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-86797e80-73bb-4ea9-affb-0df19a8daed9 req-7b04cf06-12d6-49ae-b16b-ae227849d052 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:01.085234 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-86797e80-73bb-4ea9-affb-0df19a8daed9 req-7b04cf06-12d6-49ae-b16b-ae227849d052 service nova] Creating event network-vif-deleted:9f34796a-fd6b-425b-aaf7-911bec70b97e for instance 3981cebe-916e-45b7-a15c-a2639be85842 on nch1-master-1 Apr 30 21:27:01.090754 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-86797e80-73bb-4ea9-affb-0df19a8daed9 req-7b04cf06-12d6-49ae-b16b-ae227849d052 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028962 Apr 30 21:27:01.091347 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1906/3900] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:01.326396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:01.326396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:01.339966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:01.341331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:01.342187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:01.342626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:01.467080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:01.475479 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fbc8a548-9ae7-4e29-9e2f-750a71895f5e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 200 len: 1327 microversion: 2.1 time: 0.158843 Apr 30 21:27:01.476079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1995/3901] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:01 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:01.627357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:01.628294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:01.637082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:01.638187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:01.639240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:01.640157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:01.978581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:01.984226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:01.998364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:01.999654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:02.000839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:02.002152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:02.053460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:02.069188 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ddc822c-8221-4038-80dd-df957da5f296 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1323 microversion: 2.1 time: 0.448059 Apr 30 21:27:02.073801 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1907/3902] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:01 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:02.452879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:02.461991 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-25874c69-1133-4e34-8dd7-6b4728350786 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.492665 Apr 30 21:27:02.474602 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1996/3903] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:01 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:02.500933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:02.501850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:02.523550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:02.526697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:02.530869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:02.532958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:02.572398 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 3981cebe-916e-45b7-a15c-a2639be85842 could not be found. Apr 30 21:27:02.573032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 3981cebe-916e-45b7-a15c-a2639be85842 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:02.576741 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b6cd4b16-348e-4592-9605-a7af52d6c127 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 404 len: 111 microversion: 2.1 time: 0.085343 Apr 30 21:27:02.578654 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1908/3904] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:02 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:27:02.587080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3e23a0a8-e5be-49f7-8c15-3abe19b8b343 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '.version_select at 0x7fdc26356280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:02.664187 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3e23a0a8-e5be-49f7-8c15-3abe19b8b343 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1591866211" status: 202 len: 0 microversion: 2.1 time: 0.081471 Apr 30 21:27:02.666559 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1997/3905] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1591866211 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:27:03.089636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:03.090297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:03.104074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:03.104833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:03.106064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:03.106677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:03.481978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:03.482754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:03.491599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:03.492299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:03.493469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:03.494044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:03.717745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:03.727854 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d3cfc215-3fe2-454c-b066-2a3ea8ba157a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1519 microversion: 2.1 time: 0.643204 Apr 30 21:27:03.729664 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1909/3906] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:03 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1519 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:03.753574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:03.755922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:03.790338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:03.791236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:03.793582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:03.794565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:03.844365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lazy-loading 'flavor' on Instance uuid 6c395141-111d-4dfd-ace8-178b59574e50 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:27:03.909602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:03.923472 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe3836c9-0b03-4d4b-b85e-d6ddf320d1f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.447020 Apr 30 21:27:03.925096 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1998/3907] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:03 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:03.930828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f4806d4c-a7c4-4599-89f0-408f149e30e9 req-0eac49ac-e9d6-4551-a34e-7c655c1e572a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92194639-28d0-4a67-a51e-1179fd33a2fa", "tag": "bc5636f2-cf40-44f0-9964-ab84de7da2a8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:03.948439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f4806d4c-a7c4-4599-89f0-408f149e30e9 req-0eac49ac-e9d6-4551-a34e-7c655c1e572a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:03.952512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f4806d4c-a7c4-4599-89f0-408f149e30e9 req-0eac49ac-e9d6-4551-a34e-7c655c1e572a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:03.980935 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f4806d4c-a7c4-4599-89f0-408f149e30e9 req-0eac49ac-e9d6-4551-a34e-7c655c1e572a service nova] Creating event network-changed:bc5636f2-cf40-44f0-9964-ab84de7da2a8 for instance 92194639-28d0-4a67-a51e-1179fd33a2fa on nch2-master-1 Apr 30 21:27:03.989455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f4806d4c-a7c4-4599-89f0-408f149e30e9 req-0eac49ac-e9d6-4551-a34e-7c655c1e572a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063032 Apr 30 21:27:03.990106 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 1999/3908] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:04.271667 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14a2072f-87cd-4693-b7e3-ad7818b2e8e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action" status: 200 len: 32 microversion: 2.1 time: 0.525833 Apr 30 21:27:04.275002 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1910/3909] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:03 2022] POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action => generated 32 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:04.290234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:04.291224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:04.305033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:04.305299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:04.307014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:04.308916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:04.772494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:04.790745 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b48682c-39fa-42c5-87a5-d8cbbbf87562 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.509487 Apr 30 21:27:04.791712 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2000/3910] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:04 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:04.948923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:04.950303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:04.977821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:04.978276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:04.979125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:04.979579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:05.368096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08e21782-2dd9-4bed-b1a4-cf3a91691750 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: .version_select at 0x7fdc20403670>, body: {"keypair": {"name": "tempest-keypair-836872217"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:05.390488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-08e21782-2dd9-4bed-b1a4-cf3a91691750 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:27:05.397001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-08e21782-2dd9-4bed-b1a4-cf3a91691750 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:27:05.476890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:05.489922 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-07121d35-a8b4-4771-ae75-60cba94f269f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.549687 Apr 30 21:27:05.490874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1911/3911] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:04 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:05.813290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:05.826114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:05.832522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:05.832994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:05.833817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:05.834275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:05.843771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-08e21782-2dd9-4bed-b1a4-cf3a91691750 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:27:05.866429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-08e21782-2dd9-4bed-b1a4-cf3a91691750 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:27:05.888650 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08e21782-2dd9-4bed-b1a4-cf3a91691750 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.525882 Apr 30 21:27:05.894267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2001/3912] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:27:05 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:06.017178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:06.025380 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ddf0b6b8-183c-4d94-95aa-3f50220d29ae tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.220082 Apr 30 21:27:06.026388 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1912/3913] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:05 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:06.510272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:06.511847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:06.535971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:06.537099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:06.541264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:06.543781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:07.047740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:07.051640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:07.063803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:07.065986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:07.069102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:07.069910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:07.078762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:07.087005 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6d541de-77c6-49e0-bc46-de772096bc60 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.583861 Apr 30 21:27:07.087604 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2002/3914] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:06 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:07.365663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:07.383818 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f988f622-6552-4c31-9245-b8a067ae75e4 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.337184 Apr 30 21:27:07.383818 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1913/3915] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:07 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:08.105049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:08.106577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:08.113858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:08.114320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:08.115161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:08.115859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:08.376708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:08.384201 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0878d8f4-f175-4f82-b0b5-bef9f71679d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.282629 Apr 30 21:27:08.384809 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2003/3916] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:08 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:08.399617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:08.400246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:08.408910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:08.409371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:08.410342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:08.410946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:08.662538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:08.671192 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e69064c-859a-4941-8794-869bb6463225 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.275456 Apr 30 21:27:08.672102 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1914/3917] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:08 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:09.402616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:09.405081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:09.417001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:09.417894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:09.418594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:09.419046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:09.697712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:09.701080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:09.740055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:09.748684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:09.750270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:09.751521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:09.761479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:09.769302 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0e92aaee-9d48-4ea1-ba44-281c23f8e235 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.371988 Apr 30 21:27:09.770265 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2004/3918] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:09 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:09.877466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9ef4b9d4-3f92-4c2a-9224-370b01dd5fb1 req-164a83cf-cf05-4d88-bb28-467428e2bd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92194639-28d0-4a67-a51e-1179fd33a2fa", "name": "network-vif-plugged", "status": "completed", "tag": "bc5636f2-cf40-44f0-9964-ab84de7da2a8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:09.893828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9ef4b9d4-3f92-4c2a-9224-370b01dd5fb1 req-164a83cf-cf05-4d88-bb28-467428e2bd7d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:09.895393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9ef4b9d4-3f92-4c2a-9224-370b01dd5fb1 req-164a83cf-cf05-4d88-bb28-467428e2bd7d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:09.912642 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9ef4b9d4-3f92-4c2a-9224-370b01dd5fb1 req-164a83cf-cf05-4d88-bb28-467428e2bd7d service nova] Creating event network-vif-plugged:bc5636f2-cf40-44f0-9964-ab84de7da2a8 for instance 92194639-28d0-4a67-a51e-1179fd33a2fa on nch2-master-1 Apr 30 21:27:09.919277 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9ef4b9d4-3f92-4c2a-9224-370b01dd5fb1 req-164a83cf-cf05-4d88-bb28-467428e2bd7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045327 Apr 30 21:27:09.920258 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2005/3919] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:27:10.135952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:10.144238 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e8a2c34f-394c-49b7-8005-c3510177f5cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.458394 Apr 30 21:27:10.144830 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1915/3920] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:09 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:10.371455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1555906246", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f0cca1-4180-4eed-af9d-38f99c4f5357"}], "security_groups": [{"name": "tempest-securitygroup--1582662495"}], "key_name": "tempest-keypair-836872217", "user_data": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:10.520120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] validate_networks() for [('b4f0cca1-4180-4eed-af9d-38f99c4f5357', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:27:10.786217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:10.786850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:10.794400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:10.794872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:10.795734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:10.796371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:11.020914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:11.032897 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bef4773e-eefd-4015-ae8e-2e99ea6597f3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1315 microversion: 2.1 time: 0.246960 Apr 30 21:27:11.032897 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1916/3921] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:10 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:11.112095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:27:11.112530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:27:11.113007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:27:11.113421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:27:11.113878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:27:11.122913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:11.124690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:11.124690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:11.124690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:11.141254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:27:11.146578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:27:11.162300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:11.163175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:11.164332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:27:11.167133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:27:11.170426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:11.171083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:11.171875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:11.172330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:11.350293 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-604c998d-b8a8-4a27-952b-c05676893b00 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.984464 Apr 30 21:27:11.351734 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2006/3922] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:27:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:27:11.365569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9fd14ad5-c7fd-423e-b056-c1403ec5ed22 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:11.367244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9fd14ad5-c7fd-423e-b056-c1403ec5ed22 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:11.426130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:11.436656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d74e2075-e15c-45e1-9313-cfe596e5ffb0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.278080 Apr 30 21:27:11.442072 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1917/3923] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:11 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:11.475663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9fd14ad5-c7fd-423e-b056-c1403ec5ed22 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:11.481395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9fd14ad5-c7fd-423e-b056-c1403ec5ed22 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1241 microversion: 2.1 time: 0.121944 Apr 30 21:27:11.483388 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2007/3924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:11 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:12.048544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:12.050048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:12.066588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.067854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.069603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.070480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.463622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:12.463622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:12.477653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.477653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.477653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.477946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.750671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:12.763796 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e704d695-657f-4757-b342-3fa32b5926a9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1503 microversion: 2.1 time: 0.717673 Apr 30 21:27:12.765465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1918/3925] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:12 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1503 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:12.774101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:12.779093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:12.793218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.793745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.795111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.796053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.872665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:12.882504 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89855cd0-8afa-44a3-ba1c-067e5db162d0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.423842 Apr 30 21:27:12.885790 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2008/3926] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:12 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:12.891123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2a0964f-f5b9-42ef-a043-4bbab202d119 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:12.899833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2a0964f-f5b9-42ef-a043-4bbab202d119 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:12.910132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0964f-f5b9-42ef-a043-4bbab202d119 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.912111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0964f-f5b9-42ef-a043-4bbab202d119 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.912111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0964f-f5b9-42ef-a043-4bbab202d119 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:12.912643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a0964f-f5b9-42ef-a043-4bbab202d119 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:12.985890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:12.986484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2a0964f-f5b9-42ef-a043-4bbab202d119 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.098197 Apr 30 21:27:12.987269 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2009/3927] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:12 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:13.011657 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9d210b31-58ae-44d4-a9a8-19d8bd641b67 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1245 microversion: 2.1 time: 0.243066 Apr 30 21:27:13.012958 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1919/3928] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:12 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1245 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:13.906800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:13.910631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:13.928378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:13.929320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:13.939307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:13.940134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:13.998321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9408b491-74f9-4447-8047-f25b23c5cb03 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:14.001902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9408b491-74f9-4447-8047-f25b23c5cb03 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:14.009447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9408b491-74f9-4447-8047-f25b23c5cb03 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:14.009944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9408b491-74f9-4447-8047-f25b23c5cb03 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:14.010740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9408b491-74f9-4447-8047-f25b23c5cb03 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:14.011750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9408b491-74f9-4447-8047-f25b23c5cb03 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:14.052028 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9408b491-74f9-4447-8047-f25b23c5cb03 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.058297 Apr 30 21:27:14.055371 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1920/3929] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:13 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:27:14.058310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:14.059106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:14.068052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:14.068636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:14.069648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:14.070196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:14.232788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:14.244333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4da0c3d7-50d6-4ec9-a690-07e3e1b2fd61 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1293 microversion: 2.1 time: 0.189673 Apr 30 21:27:14.247211 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1921/3930] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:14 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:14.364105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:14.374941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-492e26cb-c454-413f-9934-d079a6add9f9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.476478 Apr 30 21:27:14.377798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2010/3931] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:13 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:15.071262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d6223d0-695d-4900-8b89-4d0a7287c7c7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:15.072896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5d6223d0-695d-4900-8b89-4d0a7287c7c7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:15.085176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6223d0-695d-4900-8b89-4d0a7287c7c7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:15.086261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6223d0-695d-4900-8b89-4d0a7287c7c7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:15.087196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6223d0-695d-4900-8b89-4d0a7287c7c7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:15.087874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6223d0-695d-4900-8b89-4d0a7287c7c7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:15.137544 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5d6223d0-695d-4900-8b89-4d0a7287c7c7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.076560 Apr 30 21:27:15.138762 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1922/3932] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:15 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:15.265837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:15.267022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:15.292986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:15.292986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:15.292986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:15.292986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:15.361787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:15.370791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-790a560f-85f3-4949-8ad8-4212fff7a3b9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1299 microversion: 2.1 time: 0.109881 Apr 30 21:27:15.371474 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2011/3933] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:15 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:15.393417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:15.395311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:15.402825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:15.403576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:15.404635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:15.405305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:15.703999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:15.714595 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f7aa6893-5aee-421b-b662-5e401329e80c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.325198 Apr 30 21:27:15.715526 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1923/3934] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:15 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:16.148998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cdfcef35-3d73-4fe7-8eb3-4bdbb11616d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:16.150546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cdfcef35-3d73-4fe7-8eb3-4bdbb11616d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:16.157748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdfcef35-3d73-4fe7-8eb3-4bdbb11616d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.158245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdfcef35-3d73-4fe7-8eb3-4bdbb11616d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.159044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdfcef35-3d73-4fe7-8eb3-4bdbb11616d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.159523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cdfcef35-3d73-4fe7-8eb3-4bdbb11616d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.203468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cdfcef35-3d73-4fe7-8eb3-4bdbb11616d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.058433 Apr 30 21:27:16.204126 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2012/3935] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:16 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:27:16.293548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11c927db-146a-4a70-9681-7858905ff0f2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:16.295095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11c927db-146a-4a70-9681-7858905ff0f2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:16.303269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c927db-146a-4a70-9681-7858905ff0f2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.304006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c927db-146a-4a70-9681-7858905ff0f2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.305023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c927db-146a-4a70-9681-7858905ff0f2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.305699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c927db-146a-4a70-9681-7858905ff0f2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.337816 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11c927db-146a-4a70-9681-7858905ff0f2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049438 Apr 30 21:27:16.338672 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1924/3936] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Apr 30 21:27:16 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:16.389353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:16.390165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:16.405104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.407889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.413839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.413839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.453140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:16.453658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:16.463002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.467014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.468463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.468463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.509912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:27:16.871735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:16.891260 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e76f9059-9710-462c-ad56-d2f88a8f9822 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 204 len: 0 microversion: 2.20 time: 0.440616 Apr 30 21:27:16.891599 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1925/3937] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:27:16 2022] DELETE /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:27:16.899882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:16.899882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:16.906829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff330bb5-c410-4ac0-a6f4-b3ac697a15d4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.521656 Apr 30 21:27:16.908398 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2013/3938] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:16 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:16.913662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:16.914961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:16.922505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.923365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.924334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.924940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.929740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.930236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:16.931043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:16.931665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:17.442434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:17.453600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:17.458117 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fca809a2-6e09-46db-b7d5-9f78955df3a0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.560477 Apr 30 21:27:17.458117 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1926/3939] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:16 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:17.467570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dbbf1098-ba59-4fb3-adef-bf5754d74e2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:17.468546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dbbf1098-ba59-4fb3-adef-bf5754d74e2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:17.476760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbbf1098-ba59-4fb3-adef-bf5754d74e2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:17.477391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbbf1098-ba59-4fb3-adef-bf5754d74e2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:17.478554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbbf1098-ba59-4fb3-adef-bf5754d74e2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:17.479287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbbf1098-ba59-4fb3-adef-bf5754d74e2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:17.486933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:17.493283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:17.496921 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d24fc67-8160-40b6-a1bd-5d71f5d19799 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.587310 Apr 30 21:27:17.499596 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2014/3940] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:16 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:27:17.651038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1a47e95e-8f8e-40c2-b9cb-e6768b4156eb req-81107e71-8a93-454b-a386-ff23e7e54042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2823b0-27c1-4215-ad94-59d3ac52878b", "tag": "5ae4997a-23c9-4100-b43d-7af15bd66801"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:17.664630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1a47e95e-8f8e-40c2-b9cb-e6768b4156eb req-81107e71-8a93-454b-a386-ff23e7e54042 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:17.665323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1a47e95e-8f8e-40c2-b9cb-e6768b4156eb req-81107e71-8a93-454b-a386-ff23e7e54042 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:17.709002 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1a47e95e-8f8e-40c2-b9cb-e6768b4156eb req-81107e71-8a93-454b-a386-ff23e7e54042 service nova] Creating event network-changed:5ae4997a-23c9-4100-b43d-7af15bd66801 for instance 5f2823b0-27c1-4215-ad94-59d3ac52878b on nch1-master-1 Apr 30 21:27:17.722996 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1a47e95e-8f8e-40c2-b9cb-e6768b4156eb req-81107e71-8a93-454b-a386-ff23e7e54042 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078983 Apr 30 21:27:17.727741 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2015/3941] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:27:17.929061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:17.933141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:17.946143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:17.947032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:17.948184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:17.958120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:18.101322 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dbbf1098-ba59-4fb3-adef-bf5754d74e2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.644276 Apr 30 21:27:18.102539 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1927/3942] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:17 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:18.349164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:18.357395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7510c688-2775-441c-b26f-bca6b9a462b1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.436239 Apr 30 21:27:18.368606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2016/3943] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:17 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:18.481189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:18.482994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:18.496254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:18.496254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:18.497308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:18.498052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:18.524599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:18.525397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:18.537709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:18.546041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:18.549240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:18.549706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:19.069730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:19.084579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:19.095622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:19.097300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:19.105911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b3e69bc-8084-410e-a8e1-0e4a508f1aa5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.624242 Apr 30 21:27:19.106718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc509a88-2523-4027-a704-7a8c803831e0 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1721 microversion: 2.20 time: 0.585696 Apr 30 21:27:19.106967 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1928/3944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:18 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:19.119722 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2017/3945] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:18 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1721 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:27:19.124921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-150f23b0-bb19-40bd-bed4-005a3c246ff3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:19.142536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-150f23b0-bb19-40bd-bed4-005a3c246ff3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:19.142536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f23b0-bb19-40bd-bed4-005a3c246ff3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:19.142536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f23b0-bb19-40bd-bed4-005a3c246ff3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:19.143532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f23b0-bb19-40bd-bed4-005a3c246ff3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:19.143654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f23b0-bb19-40bd-bed4-005a3c246ff3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:19.200513 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-150f23b0-bb19-40bd-bed4-005a3c246ff3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.083499 Apr 30 21:27:19.201341 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1929/3946] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:19 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:19.375933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:19.376554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:19.386072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:19.388273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:19.391681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:19.392355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:19.902290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:19.912531 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-68a86e80-8188-4fb5-b0b1-f21cf3e33ebf tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.540472 Apr 30 21:27:19.917675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2018/3947] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:19 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:20.126310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:20.127606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:20.128784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:20.129483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:20.140566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.148335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:20.148335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.148553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.148673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:20.148759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:20.148759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.148759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:20.268677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:20.277724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:20.281103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:20.287230 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b4e0ac2-5563-4100-b58e-fd366e81dfbf tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1655 microversion: 2.20 time: 0.162497 Apr 30 21:27:20.298334 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2019/3948] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:20 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:27:20.308771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c80bc87-ef87-4abe-bb5f-3bc860e91864 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:20.310134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c80bc87-ef87-4abe-bb5f-3bc860e91864 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:20.316625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c80bc87-ef87-4abe-bb5f-3bc860e91864 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.317371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c80bc87-ef87-4abe-bb5f-3bc860e91864 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:20.318420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c80bc87-ef87-4abe-bb5f-3bc860e91864 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.319082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c80bc87-ef87-4abe-bb5f-3bc860e91864 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:20.364788 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c80bc87-ef87-4abe-bb5f-3bc860e91864 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.064760 Apr 30 21:27:20.366395 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2020/3949] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:20 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:20.751915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:20.760006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2275f540-e05c-49e1-a1b3-0e2eaac4f021 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.638025 Apr 30 21:27:20.766591 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1930/3950] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:20 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:20.937085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:20.939871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:20.959144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.960391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:20.962977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:20.964878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:21.317677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:21.320065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:21.360986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:21.362211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:21.363504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:21.364111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:21.472805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:21.483248 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e69677dd-2778-49de-809b-f9718c078ee9 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.554071 Apr 30 21:27:21.486767 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2021/3951] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:20 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:21.503476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-32d8c6dd-bfbd-40dc-87ee-1229793e18e9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:21.512297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-32d8c6dd-bfbd-40dc-87ee-1229793e18e9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:21.519641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32d8c6dd-bfbd-40dc-87ee-1229793e18e9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:21.524903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32d8c6dd-bfbd-40dc-87ee-1229793e18e9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:21.543361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32d8c6dd-bfbd-40dc-87ee-1229793e18e9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:21.544348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32d8c6dd-bfbd-40dc-87ee-1229793e18e9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:21.555741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:21.570807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:21.574491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:21.578096 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7b6e8df-92ce-4415-9d5a-ac41fe5b6838 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1655 microversion: 2.20 time: 0.271829 Apr 30 21:27:21.580041 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1931/3952] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:21 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1655 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:27:21.596611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d377dfc2-580c-400e-a644-c95879faaf4e req-b7586fcf-1020-4584-9e40-d3a64c294669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45384b3-9650-4bdb-ac27-d291062e84b5", "name": "network-vif-deleted", "tag": "a7573128-4b05-4280-bcc7-74239c0b44b6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:21.630380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d377dfc2-580c-400e-a644-c95879faaf4e req-b7586fcf-1020-4584-9e40-d3a64c294669 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:21.630987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d377dfc2-580c-400e-a644-c95879faaf4e req-b7586fcf-1020-4584-9e40-d3a64c294669 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:21.676146 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d377dfc2-580c-400e-a644-c95879faaf4e req-b7586fcf-1020-4584-9e40-d3a64c294669 service nova] Creating event network-vif-deleted:a7573128-4b05-4280-bcc7-74239c0b44b6 for instance b45384b3-9650-4bdb-ac27-d291062e84b5 on nch2-master-1 Apr 30 21:27:21.688698 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-32d8c6dd-bfbd-40dc-87ee-1229793e18e9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.199420 Apr 30 21:27:21.689368 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2022/3953] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:21 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:21.694899 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d377dfc2-580c-400e-a644-c95879faaf4e req-b7586fcf-1020-4584-9e40-d3a64c294669 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112202 Apr 30 21:27:21.699812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1932/3954] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:21.787669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:21.799274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:21.822630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:21.826154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:21.827465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:21.830394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.297727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:22.306222 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-779304d0-9f8d-40ab-9e3e-f938b0d58c65 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.526534 Apr 30 21:27:22.307031 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2023/3955] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:21 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:22.511402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:22.513084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:22.532274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:22.533825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.537004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:22.540921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.597212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:22.597923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:22.611895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:22.611895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.621617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:22.623898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.690185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:22.690841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.691322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lazy-loading 'fault' on Instance uuid b45384b3-9650-4bdb-ac27-d291062e84b5 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:27:22.832660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:22.855759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:22.858069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65bedbcb4d094160a9a9fc3b6ba6f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:22.862641 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a1cb359b-43bd-4ee8-a2f0-b310dafcf5d2 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 200 len: 1371 microversion: 2.20 time: 0.266551 Apr 30 21:27:22.862641 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2024/3956] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:22 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:27:22.868390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ef6be74-154e-4884-a058-98e7084984da tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:22.873791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ef6be74-154e-4884-a058-98e7084984da tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:22.885174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef6be74-154e-4884-a058-98e7084984da tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:22.887244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef6be74-154e-4884-a058-98e7084984da tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.888259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef6be74-154e-4884-a058-98e7084984da tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:22.888923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef6be74-154e-4884-a058-98e7084984da tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:22.907920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:22.918414 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a834e39e-9f38-4a2c-839b-6e1a23ce4a1c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.419109 Apr 30 21:27:22.922737 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1933/3957] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:22 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:22.941907 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ef6be74-154e-4884-a058-98e7084984da tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.076187 Apr 30 21:27:22.941907 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2025/3958] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:22 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:23.337158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:23.338298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:23.374872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.375358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:23.379713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.380102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:23.669400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:23.687444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e103689c-4aeb-4dd5-9d59-473a57d475e6 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.363802 Apr 30 21:27:23.687444 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1934/3959] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:23 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:23.880718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:23.885087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:23.902286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.902756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:23.903576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.904028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:23.940035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:23.941313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:23.947367 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] HTTP exception thrown: Instance b45384b3-9650-4bdb-ac27-d291062e84b5 could not be found. Apr 30 21:27:23.949481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Returning 404 to user: Instance b45384b3-9650-4bdb-ac27-d291062e84b5 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:23.950749 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59a092a6-1859-4f7b-9deb-e35ee0377dd1 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 404 len: 111 microversion: 2.20 time: 0.076103 Apr 30 21:27:23.952346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.956142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:23.956293 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2026/3960] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:23 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:27:23.958365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.959997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:23.961470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-914a847b-5841-4413-a2b4-3f1e19a8c2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:23.962480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-914a847b-5841-4413-a2b4-3f1e19a8c2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:23.969782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914a847b-5841-4413-a2b4-3f1e19a8c2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.970354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914a847b-5841-4413-a2b4-3f1e19a8c2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:23.971230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914a847b-5841-4413-a2b4-3f1e19a8c2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:23.971685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-914a847b-5841-4413-a2b4-3f1e19a8c2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:24.044124 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-914a847b-5841-4413-a2b4-3f1e19a8c2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.086564 Apr 30 21:27:24.044854 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2027/3961] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:23 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:24.053409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c01fc268-678f-4808-a2c5-f15bedf7f450 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '.version_select at 0x7fdc262f6ee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:24.175915 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c01fc268-678f-4808-a2c5-f15bedf7f450 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-956615821" status: 204 len: 0 microversion: 2.20 time: 0.129681 Apr 30 21:27:24.176566 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2028/3962] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Apr 30 21:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-956615821 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:27:24.354489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1132540364", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "836d0142-2dff-47f1-b755-65329382d235"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:24.438858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] validate_networks() for [('836d0142-2dff-47f1-b755-65329382d235', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:27:24.587985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:24.604130 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6de4b850-dddc-430a-8a34-6bc3e1bba0bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.668559 Apr 30 21:27:24.605368 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1935/3963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:23 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:24.700775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:24.702309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:24.709885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:24.710895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:24.712007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:24.712767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:24.982164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:24.986855 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-630d91c2-c1e5-469a-9413-a2797b7d72cb tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.290242 Apr 30 21:27:24.987441 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1936/3964] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:24 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:25.058674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-efb8bc36-5512-42f4-a0d4-c16923222015 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:25.060055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-efb8bc36-5512-42f4-a0d4-c16923222015 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:25.067429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efb8bc36-5512-42f4-a0d4-c16923222015 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.068182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efb8bc36-5512-42f4-a0d4-c16923222015 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.069243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efb8bc36-5512-42f4-a0d4-c16923222015 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.073173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efb8bc36-5512-42f4-a0d4-c16923222015 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.116832 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-efb8bc36-5512-42f4-a0d4-c16923222015 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 14 microversion: 2.1 time: 0.064227 Apr 30 21:27:25.121434 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1937/3965] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:25 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 21:27:25.147675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:27:25.148169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:27:25.148722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:27:25.149188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:27:25.149801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:27:25.160717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.161179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.162887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.163884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.187653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Getting quotas for project 8bbf68d01a624b91b6751596b4a0a480. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:27:25.193789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Getting quotas for user 463a0fb1322c4927abb500bfbd05f95f and project 8bbf68d01a624b91b6751596b4a0a480. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:27:25.207683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Going to run 3 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:27:25.210152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:27:25.361850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=9db9572f-4802-453c-bf76-4326801c918a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:27:25.487847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=670436c6-9564-4218-92f5-de0ea762e493,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:27:25.621794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:25.622579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:25.634983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.635572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.636401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.636849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.657989 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-04f270e1-6cbe-4d92-80bc-c96888b5b7be tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476627 Apr 30 21:27:25.658831 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2029/3966] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:27:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:27:25.670000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:25.673620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:25.675147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:27:25.742785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.743630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.744051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:25.744491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:25.789594 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8732238d-ba56-45a7-a9bd-06828f8b40fc tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.122565 Apr 30 21:27:25.793957 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2030/3967] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:27:25 2022] GET /compute/v2.1/servers => generated 1018 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:25.801871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a94b8718-f57a-4adb-8a6b-c088f0acc589 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:25.809259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a94b8718-f57a-4adb-8a6b-c088f0acc589 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:25.938651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:25.941716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a94b8718-f57a-4adb-8a6b-c088f0acc589 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:25.954632 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-747fc95b-8226-4553-9124-1fe64fe70223 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.336872 Apr 30 21:27:25.955903 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a94b8718-f57a-4adb-8a6b-c088f0acc589 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1223 microversion: 2.1 time: 0.157866 Apr 30 21:27:25.956784 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1938/3968] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:25 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:25.958161 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2031/3969] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:25 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1223 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:26.008231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:26.009343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:26.016820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.017286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.018121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.018708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.136141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2a78f8a-d9d3-4833-b8ff-fcc4672ab39d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:26.143034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2a78f8a-d9d3-4833-b8ff-fcc4672ab39d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:26.183322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a78f8a-d9d3-4833-b8ff-fcc4672ab39d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.183987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a78f8a-d9d3-4833-b8ff-fcc4672ab39d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.186427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a78f8a-d9d3-4833-b8ff-fcc4672ab39d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.186961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2a78f8a-d9d3-4833-b8ff-fcc4672ab39d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.236916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:26.246307 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2a78f8a-d9d3-4833-b8ff-fcc4672ab39d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action" status: 200 len: 8208 microversion: 2.1 time: 0.120939 Apr 30 21:27:26.247002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b12e46b8-4b50-4d29-8b5b-925b4e8defff tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.246239 Apr 30 21:27:26.247229 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2032/3970] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:26 2022] POST /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa/action => generated 8208 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:26.248095 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1939/3971] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:25 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:26.259206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:26.260113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:26.283026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.283491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.284293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.284736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.349791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8b13068f-5e12-48f1-a78e-f3d7f3cb570f req-31dcea40-5549-41bf-a769-456bcf72afcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f2823b0-27c1-4215-ad94-59d3ac52878b", "name": "network-vif-plugged", "status": "completed", "tag": "5ae4997a-23c9-4100-b43d-7af15bd66801"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:26.363165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8b13068f-5e12-48f1-a78e-f3d7f3cb570f req-31dcea40-5549-41bf-a769-456bcf72afcb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.366303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8b13068f-5e12-48f1-a78e-f3d7f3cb570f req-31dcea40-5549-41bf-a769-456bcf72afcb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.391906 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8b13068f-5e12-48f1-a78e-f3d7f3cb570f req-31dcea40-5549-41bf-a769-456bcf72afcb service nova] Creating event network-vif-plugged:5ae4997a-23c9-4100-b43d-7af15bd66801 for instance 5f2823b0-27c1-4215-ad94-59d3ac52878b on nch1-master-1 Apr 30 21:27:26.403720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8b13068f-5e12-48f1-a78e-f3d7f3cb570f req-31dcea40-5549-41bf-a769-456bcf72afcb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057493 Apr 30 21:27:26.405963 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1940/3972] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:27:26.494677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:26.507862 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-32cca070-fb5b-4ade-9ef4-9ff54cea1d2e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.249363 Apr 30 21:27:26.509919 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2033/3973] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:26.533222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:26.533953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:26.543279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.543768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.544847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.545185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.722121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:26.730672 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd9a804e-d2d5-4093-afea-79a95d7085a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.201608 Apr 30 21:27:26.731248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1941/3974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:26.747643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:26.748941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:26.755460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.755988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.756832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.757345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.965323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:26.972486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f912e062-abcf-4109-a43f-912ddaba9fad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:26.973113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f912e062-abcf-4109-a43f-912ddaba9fad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:26.982182 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c29c73c4-07f8-41c4-9801-0271e436e2ff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.239052 Apr 30 21:27:26.982791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2034/3975] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:26.988691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:26.989602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:26.997882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:26.998547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:26.999450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.000171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.054700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f912e062-abcf-4109-a43f-912ddaba9fad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:27.066106 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f912e062-abcf-4109-a43f-912ddaba9fad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1223 microversion: 2.1 time: 0.097247 Apr 30 21:27:27.066699 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1942/3976] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:26 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:27.072412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:27.073643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:27.080231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.080597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.081386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.081883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.298112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:27.308557 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41e238e8-6147-48c4-804c-7921645b0d15 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1367 microversion: 2.1 time: 0.323874 Apr 30 21:27:27.309461 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2035/3977] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:26 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:27.309582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:27.315114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:27.315737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:27.317767 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a9c5b31c-c7f5-46df-80d5-bd5c49cece75 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.249839 Apr 30 21:27:27.318956 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1943/3978] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:27 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:27.322368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.323619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.330820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.330820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.345689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:27.346308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:27.352555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.353825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.353825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.354367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.462631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:27.472493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-302ffbea-aa37-44c0-bfae-8b7838c58738 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.159926 Apr 30 21:27:27.472493 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2036/3979] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:27 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:27.642989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Locking {{(pid=130670) lock /opt/stack/nova/nova/compute/api.py:4698}} Apr 30 21:27:27.863376 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-676a090b-f9bb-44aa-94f2-0856d16848e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.521465 Apr 30 21:27:27.864217 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1944/3980] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:27 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:27:27.872992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:27.873676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:27.882624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.885903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:27.886940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:27.887743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.084596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8ba2f92-a0cb-49a6-910e-65656687cdcb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:28.085460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8ba2f92-a0cb-49a6-910e-65656687cdcb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:28.174541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b8ba2f92-a0cb-49a6-910e-65656687cdcb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:28.188173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8ba2f92-a0cb-49a6-910e-65656687cdcb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1223 microversion: 2.1 time: 0.108074 Apr 30 21:27:28.189484 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1945/3981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:28 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:28.240365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:28.248700 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4016a699-8d8c-499a-ad48-84a78738d060 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.380191 Apr 30 21:27:28.249286 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2037/3982] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:27 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:28.272973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ad300b7-cc94-40a3-9295-d28812d761a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:28.285011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ad300b7-cc94-40a3-9295-d28812d761a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.286035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ad300b7-cc94-40a3-9295-d28812d761a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.325983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:28.327468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:28.333669 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-0ad300b7-cc94-40a3-9295-d28812d761a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] HTTP exception thrown: Instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 is locked Apr 30 21:27:28.335038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ad300b7-cc94-40a3-9295-d28812d761a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Returning 409 to user: Instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 is locked {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:28.337322 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0ad300b7-cc94-40a3-9295-d28812d761a3 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 409 len: 107 microversion: 2.1 time: 0.068030 Apr 30 21:27:28.339016 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1946/3983] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:28 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 107 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:27:28.339795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.340258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.341055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.342792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.348124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:28.349402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:28.358087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.360088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.360088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.360784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.525144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:28.543893 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-32c60b5e-57b4-43c5-ac32-38be185038a4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1557 microversion: 2.1 time: 0.222409 Apr 30 21:27:28.554354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2038/3984] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:28 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1557 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:28.560450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:28.563003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Unlocking {{(pid=130670) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 30 21:27:28.565599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:28.572767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.577438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.578533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.579219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.835341 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f944e947-516d-4265-bde6-5d18c8f87ad6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.492245 Apr 30 21:27:28.841194 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1947/3985] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:28 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:27:28.847211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-52babab3-26ee-476e-8268-68a3b800740c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:28.847725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-52babab3-26ee-476e-8268-68a3b800740c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:28.855727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52babab3-26ee-476e-8268-68a3b800740c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.856441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52babab3-26ee-476e-8268-68a3b800740c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:28.857422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52babab3-26ee-476e-8268-68a3b800740c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:28.858101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52babab3-26ee-476e-8268-68a3b800740c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:29.043578 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-52babab3-26ee-476e-8268-68a3b800740c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200853 Apr 30 21:27:29.046054 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1948/3986] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:27:28 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:29.054388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c78b54b8-93ba-493b-9289-42d427d9b3dc tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:29.061540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c78b54b8-93ba-493b-9289-42d427d9b3dc tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:29.062361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c78b54b8-93ba-493b-9289-42d427d9b3dc tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:29.101975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c78b54b8-93ba-493b-9289-42d427d9b3dc tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Going to try to stop instance {{(pid=130670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:27:29.278527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:29.287922 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0683acbb-5093-41e9-a8ab-101e7cc0c547 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.732413 Apr 30 21:27:29.288517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2039/3987] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:28 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:29.302357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:29.302987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:29.317664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:29.317664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:29.317664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:29.317664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:29.440521 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c78b54b8-93ba-493b-9289-42d427d9b3dc tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.392939 Apr 30 21:27:29.441136 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1949/3988] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:29 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:27:29.464586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:29.466169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:29.480510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:29.481247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:29.482123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:29.482605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:29.488754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:29.496890 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f992a7f-13ca-435c-a049-3450192cfc5e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1227 microversion: 2.1 time: 0.198244 Apr 30 21:27:29.497495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2040/3989] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:29 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1227 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:29.883152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:29.893047 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad02a433-fa24-4c49-b2b2-3a963388dde4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.436659 Apr 30 21:27:29.893640 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1950/3990] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:29 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:30.305567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:30.306226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:30.314959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:30.315565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:30.316453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:30.317159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:30.579423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-42d39a29-4da0-41ee-a32c-32d14acff800 req-ad84ede6-4f2d-425d-95dd-a15434d51cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2823b0-27c1-4215-ad94-59d3ac52878b", "tag": "5ae4997a-23c9-4100-b43d-7af15bd66801"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:30.588079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-42d39a29-4da0-41ee-a32c-32d14acff800 req-ad84ede6-4f2d-425d-95dd-a15434d51cc2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:30.588812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-42d39a29-4da0-41ee-a32c-32d14acff800 req-ad84ede6-4f2d-425d-95dd-a15434d51cc2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:30.600880 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-42d39a29-4da0-41ee-a32c-32d14acff800 req-ad84ede6-4f2d-425d-95dd-a15434d51cc2 service nova] Creating event network-changed:5ae4997a-23c9-4100-b43d-7af15bd66801 for instance 5f2823b0-27c1-4215-ad94-59d3ac52878b on nch1-master-1 Apr 30 21:27:30.606404 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-42d39a29-4da0-41ee-a32c-32d14acff800 req-ad84ede6-4f2d-425d-95dd-a15434d51cc2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123573 Apr 30 21:27:30.611378 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1951/3991] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:27:30.617066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:30.618142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:30.626216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:30.626899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:30.627891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:30.628622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:30.809003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:30.824774 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4072fa2-f433-4efd-a0d2-ada013b583ad tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1283 microversion: 2.1 time: 0.211844 Apr 30 21:27:30.827697 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1952/3992] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:30 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1283 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:30.918460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:30.919802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:30.930831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:30.932714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:30.936044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:30.937280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:30.937898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:30.939913 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c745014-f433-466d-8c79-867e2abf3bfe tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.639157 Apr 30 21:27:30.941141 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2041/3993] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:30 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:31.751032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:31.764088 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-62aded23-531c-4f8e-877e-8da2ffe15e93 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.854169 Apr 30 21:27:31.775397 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1953/3994] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:30 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:31.845784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:31.846865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:31.857991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:31.859981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:31.864195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:31.864899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:31.961841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:31.965173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:31.972793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:31.973266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:31.975429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:31.976105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:32.084522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:32.092955 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a4d3a79-5e30-4f96-9a31-00c9e7f05365 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1281 microversion: 2.1 time: 0.251151 Apr 30 21:27:32.093633 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2042/3995] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:31 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:32.435287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:32.443683 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f63378b7-ac96-405d-987a-21c4a6b5ec57 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.489431 Apr 30 21:27:32.444890 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1954/3996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:31 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:32.783428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:32.784051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:32.790279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:32.790734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:32.791810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:32.792268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:33.110796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:33.111527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:33.118482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:33.119030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:33.120472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:33.120922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:33.252894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:33.261426 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-505ab9b7-d9b3-4019-8bdc-245e8b66fab5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1281 microversion: 2.1 time: 0.154457 Apr 30 21:27:33.263346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1955/3997] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:33 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:33.324774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:33.331454 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-10aa485b-96ae-49c3-81b5-0d937e49cef1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.551957 Apr 30 21:27:33.332053 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2043/3998] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:32 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:33.460603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:33.461238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:33.468473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:33.469151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:33.470213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:33.470828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:33.890251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:33.898796 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b3ce18f-b3b8-427b-bb76-3f5e3baf1add tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.441989 Apr 30 21:27:33.903116 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1956/3999] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:33 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:34.282462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:34.285494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:34.293622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:34.294199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:34.295079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:34.295807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:34.348550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:34.349958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:34.362109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:34.367331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:34.368422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:34.369043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:34.862423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:34.905690 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b672fbda-b601-4c8f-bd43-3976eaa66f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.548489 Apr 30 21:27:34.905690 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1957/4000] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:34 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:34.906100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:34.914263 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-baf94cc5-a809-4b73-825f-184cbfc25acb tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.637920 Apr 30 21:27:34.916069 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2044/4001] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:34 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:34.926245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:34.926245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:34.934033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:34.934503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:34.935618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:34.936070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:35.485455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:35.494388 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-689dca95-e7ee-4740-8b79-254ebd26e397 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.578014 Apr 30 21:27:35.495638 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1958/4002] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:34 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:35.911333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-64e71d1a-d747-47ff-ba8f-8e4911aace32 req-20d99303-fdf2-4bcb-8d06-eae6a0f8dadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9db9572f-4802-453c-bf76-4326801c918a", "tag": "2747b26e-0417-4d87-aa95-9b80ce250cc6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:35.921799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:35.923884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:35.934596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:35.935062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:35.936082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:35.937250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:35.953450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-64e71d1a-d747-47ff-ba8f-8e4911aace32 req-20d99303-fdf2-4bcb-8d06-eae6a0f8dadd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:35.954532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-64e71d1a-d747-47ff-ba8f-8e4911aace32 req-20d99303-fdf2-4bcb-8d06-eae6a0f8dadd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:35.999178 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-64e71d1a-d747-47ff-ba8f-8e4911aace32 req-20d99303-fdf2-4bcb-8d06-eae6a0f8dadd service nova] Creating event network-changed:2747b26e-0417-4d87-aa95-9b80ce250cc6 for instance 9db9572f-4802-453c-bf76-4326801c918a on nch1-master-1 Apr 30 21:27:36.012081 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-64e71d1a-d747-47ff-ba8f-8e4911aace32 req-20d99303-fdf2-4bcb-8d06-eae6a0f8dadd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104190 Apr 30 21:27:36.015191 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2045/4003] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:36.021720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:36.022733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:36.040385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.043899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.043899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.044465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.570371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:36.586332 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae1817c0-4dd2-4cdf-9c8b-e1c1d1e78a99 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.668399 Apr 30 21:27:36.599322 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1959/4004] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:35 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:36.621689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:36.627114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:36.630262 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2f8e2d1-5c0a-4950-b710-654935dd0b0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.613935 Apr 30 21:27:36.631352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:36.632117 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2046/4005] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:36 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:36.643411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.644238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.645970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.646689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.652135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:36.655044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:36.670599 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] HTTP exception thrown: Instance b45384b3-9650-4bdb-ac27-d291062e84b5 could not be found. Apr 30 21:27:36.671207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Returning 404 to user: Instance b45384b3-9650-4bdb-ac27-d291062e84b5 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:36.672359 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b9a85bb4-1b6e-4b45-9fc1-91baee316af5 tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 404 len: 111 microversion: 2.20 time: 0.059131 Apr 30 21:27:36.674411 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1960/4006] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:27:36 2022] DELETE /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:27:36.682691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.683261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.683984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:36.684200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.684724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.684852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: b45384b3-9650-4bdb-ac27-d291062e84b5] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:36.719824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.720290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.726096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:36.730532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:36.776507 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] HTTP exception thrown: Instance b45384b3-9650-4bdb-ac27-d291062e84b5 could not be found. Apr 30 21:27:36.780674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Returning 404 to user: Instance b45384b3-9650-4bdb-ac27-d291062e84b5 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:36.781602 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b30cedd7-72ba-4c9c-a77b-7dae9007760c tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5" status: 404 len: 111 microversion: 2.20 time: 0.103180 Apr 30 21:27:36.783478 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1961/4007] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:36 2022] GET /compute/v2.1/servers/b45384b3-9650-4bdb-ac27-d291062e84b5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:27:37.467898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:37.480406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92558752-1c53-4c97-94d0-faf339199884 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.845034 Apr 30 21:27:37.481010 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2047/4008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:36 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:37.604913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:37.605904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:37.614732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:37.616101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:37.617131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:37.617777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:37.651009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:37.651780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:37.667981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:37.669008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:37.671649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:37.672265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:38.305428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:38.312619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:38.317183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-933ee428-b2ef-493b-b5e2-7e5ab28a88d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.714147 Apr 30 21:27:38.317570 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f68ad361-0ef7-41cd-a57b-3774c5f14946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.672631 Apr 30 21:27:38.318841 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2048/4009] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:37 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:38.324948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f37d78e0-3a91-4087-b8f2-bdceb33fda71 req-d6ea54d6-4849-407a-ae20-2dec2c508e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "670436c6-9564-4218-92f5-de0ea762e493", "tag": "42b1915a-8e8a-4c31-b642-d8565317d5b3"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:38.326931 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1962/4010] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:37 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:38.334891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f37d78e0-3a91-4087-b8f2-bdceb33fda71 req-d6ea54d6-4849-407a-ae20-2dec2c508e56 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:38.335468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f37d78e0-3a91-4087-b8f2-bdceb33fda71 req-d6ea54d6-4849-407a-ae20-2dec2c508e56 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:38.349104 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f37d78e0-3a91-4087-b8f2-bdceb33fda71 req-d6ea54d6-4849-407a-ae20-2dec2c508e56 service nova] Creating event network-changed:42b1915a-8e8a-4c31-b642-d8565317d5b3 for instance 670436c6-9564-4218-92f5-de0ea762e493 on nch2-master-1 Apr 30 21:27:38.355115 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f37d78e0-3a91-4087-b8f2-bdceb33fda71 req-d6ea54d6-4849-407a-ae20-2dec2c508e56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033782 Apr 30 21:27:38.355844 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2049/4011] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:38.497055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:38.498084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:38.504979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:38.506083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:38.507179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:38.507897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:38.838020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:38.851104 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-700950ac-8f39-4513-afe7-8c1b86fc3c53 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.358360 Apr 30 21:27:38.851696 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1963/4012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:38 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:39.334602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:39.335230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:39.335903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:39.336613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:39.342196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:39.342968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:39.345543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:39.345721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:39.346051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:39.346219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:39.347044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:39.347496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:39.581746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:39.581938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:39.595020 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-833bbb3a-b5d3-47e8-9584-c75b58c26c7b tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.263938 Apr 30 21:27:39.606356 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2050/4013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:39 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:39.612517 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e950ef68-ba9f-4fa4-86d8-345a3f063df7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.281809 Apr 30 21:27:39.621584 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1964/4014] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:39 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:39.870940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:39.871725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:39.886474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:39.887152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:39.888337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:39.888960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:40.119151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:40.129233 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16d46975-ac57-4316-ba42-4dae5359ac52 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.264738 Apr 30 21:27:40.130060 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2051/4015] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:39 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:40.387859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6ce6281f-924c-4701-97a5-8f67194922c8 req-d9c7f198-7056-44cf-b07e-4898a51a7287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7086f5e-1fd3-45d1-837b-58e964bb0c98", "tag": "7beb9238-c6dd-4ea2-8f64-8c495c1659d7"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:40.395917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ce6281f-924c-4701-97a5-8f67194922c8 req-d9c7f198-7056-44cf-b07e-4898a51a7287 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:40.396370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6ce6281f-924c-4701-97a5-8f67194922c8 req-d9c7f198-7056-44cf-b07e-4898a51a7287 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:40.409840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6ce6281f-924c-4701-97a5-8f67194922c8 req-d9c7f198-7056-44cf-b07e-4898a51a7287 service nova] Creating event network-changed:7beb9238-c6dd-4ea2-8f64-8c495c1659d7 for instance a7086f5e-1fd3-45d1-837b-58e964bb0c98 on nch1-master-1 Apr 30 21:27:40.415570 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6ce6281f-924c-4701-97a5-8f67194922c8 req-d9c7f198-7056-44cf-b07e-4898a51a7287 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 Apr 30 21:27:40.417452 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1965/4016] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:40.616236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:40.617051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:40.624752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:40.625208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:40.626915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:40.626915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:40.638989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:40.639690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:40.646165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:40.646625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:40.648604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:40.648604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:40.884319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:40.902256 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ca86f9f-b1f4-4255-b3aa-c27b352fcde2 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.289571 Apr 30 21:27:40.904054 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2052/4017] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:40 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:40.918119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:40.930179 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a84557bb-871a-4eeb-9848-e7161b963181 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.297112 Apr 30 21:27:40.932015 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1966/4018] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:40 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:41.152879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:41.153604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:41.163858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:41.165320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:41.167147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:41.170370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:41.506484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:41.518250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-51d18bc6-9c8a-4cc1-b58e-bf8566f506e9 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1525 microversion: 2.1 time: 0.368225 Apr 30 21:27:41.519602 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2053/4019] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:41 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1525 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:41.925623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:41.927792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:41.942442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:41.949300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:41.950956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:41.959554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:41.960845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:41.961306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:41.967206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:41.967672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:41.968470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:41.972576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:42.221285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:42.231548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:42.239963 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a87a130c-a9be-4c02-9fd7-ed91c7db5ba7 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.322330 Apr 30 21:27:42.240561 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1967/4020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:41 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:42.241714 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08020b96-1b2f-485a-a73e-036b1cb801ab tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1656 microversion: 2.1 time: 0.295944 Apr 30 21:27:42.242634 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2054/4021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:41 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1656 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:42.252879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0697112d-9e8d-453c-82cc-b89ffcaa1c73 req-0f499575-a4e7-433a-acf3-1f024a5ef808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db9572f-4802-453c-bf76-4326801c918a", "name": "network-vif-plugged", "status": "completed", "tag": "2747b26e-0417-4d87-aa95-9b80ce250cc6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:42.259318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f1751a74-4abb-46e0-9b8b-53a4fb68c6ef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:42.270625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0697112d-9e8d-453c-82cc-b89ffcaa1c73 req-0f499575-a4e7-433a-acf3-1f024a5ef808 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:42.274073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0697112d-9e8d-453c-82cc-b89ffcaa1c73 req-0f499575-a4e7-433a-acf3-1f024a5ef808 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:42.276509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f1751a74-4abb-46e0-9b8b-53a4fb68c6ef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:42.277078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f1751a74-4abb-46e0-9b8b-53a4fb68c6ef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:42.288293 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0697112d-9e8d-453c-82cc-b89ffcaa1c73 req-0f499575-a4e7-433a-acf3-1f024a5ef808 service nova] Creating event network-vif-plugged:2747b26e-0417-4d87-aa95-9b80ce250cc6 for instance 9db9572f-4802-453c-bf76-4326801c918a on nch1-master-1 Apr 30 21:27:42.294283 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0697112d-9e8d-453c-82cc-b89ffcaa1c73 req-0f499575-a4e7-433a-acf3-1f024a5ef808 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052227 Apr 30 21:27:42.297093 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1968/4022] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:42.306792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f1751a74-4abb-46e0-9b8b-53a4fb68c6ef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Going to try to start instance {{(pid=130671) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 30 21:27:42.538304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:42.539022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:42.546888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:42.547590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:42.548597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:42.549218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:42.572329 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f1751a74-4abb-46e0-9b8b-53a4fb68c6ef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.315381 Apr 30 21:27:42.574039 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2055/4023] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:42 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:27:42.599184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:42.599184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:42.606154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:42.606855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:42.607913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:42.608585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:42.812057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:42.821678 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a229877-084f-47fe-9409-be428b3abfc3 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1505 microversion: 2.1 time: 0.287799 Apr 30 21:27:42.834775 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1969/4024] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:42 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:42.840196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc0384d6-82f8-4a71-a720-09c159ab6f4d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'create', calling method: .version_select at 0x7fdc262063a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1606908257", "description": "tempest-description-2097124185"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:42.912252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:42.921868 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-63000bfd-58c9-45ed-9a30-3d97d9de0331 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1665 microversion: 2.1 time: 0.334003 Apr 30 21:27:42.922510 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2056/4025] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:42 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1665 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:43.257202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:43.258673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:43.267386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:43.280972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:43.288261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:43.288261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:43.514289 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc0384d6-82f8-4a71-a720-09c159ab6f4d tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.678116 Apr 30 21:27:43.521173 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1970/4026] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Apr 30 21:27:42 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:43.528207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1606908257"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:43.532083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:43.536808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:43.537272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:43.538095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:43.538596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:43.576528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:43.584498 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19d517b0-409a-4d2f-a738-90eee6014946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.331286 Apr 30 21:27:43.585412 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2057/4027] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:43 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:43.696636 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.network.security_group_api [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Adding security group 1b389b72-04cb-4fcf-b8da-7b1d9d88017e to port c86d6076-6753-4ec2-8787-d007df62c17c Apr 30 21:27:43.942375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:43.943556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:43.958522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:43.964886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:43.964886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:43.965634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:44.503011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:44.522377 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ec1edbb-f15d-455f-8c30-805022a339a7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1665 microversion: 2.1 time: 0.586049 Apr 30 21:27:44.529160 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2058/4028] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:43 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1665 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:44.535995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-88cfee66-1550-4fd2-8cd9-022361c30fba req-b9071bb3-c122-48ad-856f-e5bc404af3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670436c6-9564-4218-92f5-de0ea762e493", "name": "network-vif-plugged", "status": "completed", "tag": "42b1915a-8e8a-4c31-b642-d8565317d5b3"}, {"server_uuid": "a7086f5e-1fd3-45d1-837b-58e964bb0c98", "name": "network-vif-plugged", "status": "completed", "tag": "7beb9238-c6dd-4ea2-8f64-8c495c1659d7"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:44.547808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-88cfee66-1550-4fd2-8cd9-022361c30fba req-b9071bb3-c122-48ad-856f-e5bc404af3ec service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:44.549636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-88cfee66-1550-4fd2-8cd9-022361c30fba req-b9071bb3-c122-48ad-856f-e5bc404af3ec service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:44.581120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-88cfee66-1550-4fd2-8cd9-022361c30fba req-b9071bb3-c122-48ad-856f-e5bc404af3ec service nova] Creating event network-vif-plugged:42b1915a-8e8a-4c31-b642-d8565317d5b3 for instance 670436c6-9564-4218-92f5-de0ea762e493 on nch2-master-1 Apr 30 21:27:44.581708 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-88cfee66-1550-4fd2-8cd9-022361c30fba req-b9071bb3-c122-48ad-856f-e5bc404af3ec service nova] Creating event network-vif-plugged:7beb9238-c6dd-4ea2-8f64-8c495c1659d7 for instance a7086f5e-1fd3-45d1-837b-58e964bb0c98 on nch1-master-1 Apr 30 21:27:44.591468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-88cfee66-1550-4fd2-8cd9-022361c30fba req-b9071bb3-c122-48ad-856f-e5bc404af3ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061085 Apr 30 21:27:44.592539 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2059/4029] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:44.605651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:44.613485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:44.615303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:44.616068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:44.617584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:44.618368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:44.713500 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b1ff3e2-f85b-4478-8ced-4da4f60d1979 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action" status: 202 len: 0 microversion: 2.1 time: 1.189750 Apr 30 21:27:44.715976 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1971/4030] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:43 2022] POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action => generated 0 bytes in 1193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:27:44.723768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1606908257"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:44.724510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:44.732704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:44.733406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:44.738165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:44.738165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:45.102251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:45.110776 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a9dd8fe1-b70e-4cab-8d6a-155539a8259d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.512242 Apr 30 21:27:45.111627 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2060/4031] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:44 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:45.126479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8f3df3c5-6777-48e8-b3cb-0bc8f2261bcc req-fd74176a-cc5a-47f0-8b0a-c8ac37792d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c395141-111d-4dfd-ace8-178b59574e50", "tag": "c86d6076-6753-4ec2-8787-d007df62c17c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:45.135264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8f3df3c5-6777-48e8-b3cb-0bc8f2261bcc req-fd74176a-cc5a-47f0-8b0a-c8ac37792d46 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:45.136061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8f3df3c5-6777-48e8-b3cb-0bc8f2261bcc req-fd74176a-cc5a-47f0-8b0a-c8ac37792d46 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:45.145854 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.network.security_group_api [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Removing security group 1b389b72-04cb-4fcf-b8da-7b1d9d88017e from port c86d6076-6753-4ec2-8787-d007df62c17c Apr 30 21:27:45.152384 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8f3df3c5-6777-48e8-b3cb-0bc8f2261bcc req-fd74176a-cc5a-47f0-8b0a-c8ac37792d46 service nova] Creating event network-changed:c86d6076-6753-4ec2-8787-d007df62c17c for instance 6c395141-111d-4dfd-ace8-178b59574e50 on nch2-master-1 Apr 30 21:27:45.158942 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8f3df3c5-6777-48e8-b3cb-0bc8f2261bcc req-fd74176a-cc5a-47f0-8b0a-c8ac37792d46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036510 Apr 30 21:27:45.174978 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2061/4032] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:45.542706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:45.543453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:45.556784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:45.557276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:45.559282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:45.559749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:45.720316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:45.729547 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6752f7b9-628e-457c-95e2-8244a9c64766 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.192685 Apr 30 21:27:45.735115 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2062/4033] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:45 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:45.750315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:45.750937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:45.757219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:45.757736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:45.758749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:45.759201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:45.871911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fe50577-78e6-471f-8a4d-39a2ae311746 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action" status: 202 len: 0 microversion: 2.1 time: 1.152097 Apr 30 21:27:45.873181 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1972/4034] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:44 2022] POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:27:45.892682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e32dd271-78b7-4ecd-8d9d-a35980b95601 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'create', calling method: .version_select at 0x7fdc2624d4c0>, body: {"pool": null} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:46.357529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:46.372866 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da8b13fc-874f-45f1-8cb1-3360c5f8669e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.626339 Apr 30 21:27:46.376380 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2063/4035] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:45 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:27:46.390470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:46.391101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:46.425512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:46.426389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:46.428361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:46.428361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:46.834033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:46.842406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eab7a435-5ec9-489e-85c9-e091cba2a946 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1323 microversion: 2.1 time: 0.467903 Apr 30 21:27:46.843271 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2064/4036] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:46 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:46.848191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:46.849033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:46.858478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:46.859171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:46.860317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:46.860985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.093596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Unlocking {{(pid=130671) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 30 21:27:47.332021 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45b3bfa8-cf48-4738-bd1d-d816c36dd9e7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.487403 Apr 30 21:27:47.334627 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2065/4037] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:46 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:27:47.337369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:47.338659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:47.345097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.346383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.347282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.347983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.366224 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] HTTP exception thrown: Instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 could not be found. Apr 30 21:27:47.367087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Returning 404 to user: Instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:47.367947 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1161e5c3-58f9-4af8-bf11-a0023041659e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 404 len: 111 microversion: 2.20 time: 0.034339 Apr 30 21:27:47.368701 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2066/4038] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:27:47 2022] DELETE /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:27:47.374663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9d979e04-57f3-4685-91a1-c0ef37c84fc2 req-c99b94c5-224a-42dc-a02f-55eb5b87f53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c395141-111d-4dfd-ace8-178b59574e50", "tag": "c86d6076-6753-4ec2-8787-d007df62c17c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:47.382979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9d979e04-57f3-4685-91a1-c0ef37c84fc2 req-c99b94c5-224a-42dc-a02f-55eb5b87f53b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.383445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9d979e04-57f3-4685-91a1-c0ef37c84fc2 req-c99b94c5-224a-42dc-a02f-55eb5b87f53b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.396487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9d979e04-57f3-4685-91a1-c0ef37c84fc2 req-c99b94c5-224a-42dc-a02f-55eb5b87f53b service nova] Creating event network-changed:c86d6076-6753-4ec2-8787-d007df62c17c for instance 6c395141-111d-4dfd-ace8-178b59574e50 on nch2-master-1 Apr 30 21:27:47.403362 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9d979e04-57f3-4685-91a1-c0ef37c84fc2 req-c99b94c5-224a-42dc-a02f-55eb5b87f53b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032676 Apr 30 21:27:47.404553 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2067/4039] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:47.409917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:47.416413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:47.418114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.418637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.419500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.420020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.781232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:47.793265 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-082fe34a-ca1c-475f-a310-d799a968ad05 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.387307 Apr 30 21:27:47.794876 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2068/4040] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:47 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:47.811681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:47.812565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] [instance: 5651c8e3-b1ff-47a2-ac15-e68594650b70] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:47.819271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.819949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.820898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.821507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.838585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] HTTP exception thrown: Instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 could not be found. Apr 30 21:27:47.839783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] Returning 404 to user: Instance 5651c8e3-b1ff-47a2-ac15-e68594650b70 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:47.840947 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-781ccadb-f9f2-42a3-bbf4-f69a036acc0e tempest-AttachVolumeShelveTestJSON-2129222160 tempest-AttachVolumeShelveTestJSON-2129222160-project] 10.222.0.23 "GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70" status: 404 len: 111 microversion: 2.20 time: 0.033430 Apr 30 21:27:47.841592 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2069/4041] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:27:47 2022] GET /compute/v2.1/servers/5651c8e3-b1ff-47a2-ac15-e68594650b70 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:27:47.846422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:47.847231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:47.854174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.855128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:47.856296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:47.856731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:48.238522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:48.248291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce7bcb74-f86f-4900-8f7f-c3daf1bc4caa tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.405422 Apr 30 21:27:48.254086 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2070/4042] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:47 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:48.264503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:48.265547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:48.272244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:48.273351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:48.274390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:48.275092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:49.194087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:49.205249 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3c5dde1-26aa-4d50-8497-b5e286150687 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 200 len: 1516 microversion: 2.1 time: 0.948191 Apr 30 21:27:49.220344 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2071/4043] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:48 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 1516 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:49.235188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:49.242460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:49.255579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:49.256271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:49.258515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:49.259143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:49.589224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:49.604453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-61dcf35d-ffa4-4ba4-b248-c9c60bb41f40 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.381513 Apr 30 21:27:49.616959 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2072/4044] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:49 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:49.630585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:49.631592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:49.646092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:49.646640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:49.647930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:49.649152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:50.105294 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e32dd271-78b7-4ecd-8d9d-a35980b95601 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.226395 Apr 30 21:27:50.106333 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1973/4045] 10.222.0.23 () {60 vars in 1169 bytes} [Sat Apr 30 21:27:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:27:50.110697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:50.112267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe1793c1-dd50-489b-bdaa-94e23ae8c869 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:50.113274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fe1793c1-dd50-489b-bdaa-94e23ae8c869 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:50.124570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe1793c1-dd50-489b-bdaa-94e23ae8c869 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:50.125428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe1793c1-dd50-489b-bdaa-94e23ae8c869 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:50.126760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe1793c1-dd50-489b-bdaa-94e23ae8c869 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:50.128264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe1793c1-dd50-489b-bdaa-94e23ae8c869 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:50.129231 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-157ba9ec-d475-423e-afc8-92784e65a3ba tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 200 len: 1517 microversion: 2.1 time: 0.506543 Apr 30 21:27:50.129844 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2073/4046] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:49 2022] GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 1517 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:50.136343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.20"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:50.139001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:50.163832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:50.165098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:50.169122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:50.176472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:50.241046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Acquired lock "refresh_cache-6c395141-111d-4dfd-ace8-178b59574e50" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:27:50.399674 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fe1793c1-dd50-489b-bdaa-94e23ae8c869 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.291200 Apr 30 21:27:50.405263 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1974/4047] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:50 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:27:50.413195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:50.414294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:50.425516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:50.427155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:50.432115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:50.432115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:51.229660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:51.245326 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6289ca6d-f66c-4705-b76d-5fbc7c41aae0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a" status: 200 len: 1516 microversion: 2.1 time: 0.836036 Apr 30 21:27:51.246981 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1975/4048] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:50 2022] GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a => generated 1516 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:51.254467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:51.256240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:51.266724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:51.268228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:51.270609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:51.271421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:52.315272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:52.327050 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-84254de7-f542-45ee-95af-f713f2af81d2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1654 microversion: 2.1 time: 1.078663 Apr 30 21:27:52.327795 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1976/4049] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:51 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1654 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:52.333140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:52.333877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:52.341844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:52.342584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:52.343662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:52.344432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:52.374315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:27:52.843126 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23871778-74cf-48b5-8a3b-8505e66ed57a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a" status: 204 len: 0 microversion: 2.1 time: 0.513860 Apr 30 21:27:52.843871 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1977/4050] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:27:52 2022] DELETE /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:27:53.004722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-724906735", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "7e81ddd4-affa-44b2-8c19-2f3206891e74"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:53.101012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] validate_networks() for [('7e81ddd4-affa-44b2-8c19-2f3206891e74', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:27:53.850359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Building network info cache for instance {{(pid=130671) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:27:54.652303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:27:54.653184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:27:54.653184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:27:54.653392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:27:54.658959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:27:54.680806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:54.682626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:54.683463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:54.684504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:54.714125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Getting quotas for project 426405d77bbc4e24adcbe789ba3f42f2. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:27:54.721665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Getting quotas for user 3383f0c2b1874b15b38dea61e4b8e498 and project 426405d77bbc4e24adcbe789ba3f42f2. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:27:54.739484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:27:54.741962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:27:54.929570 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4bf4ffe6-fc43-4b4b-8013-68e86166bb6f tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.079287 Apr 30 21:27:54.934199 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1978/4051] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:27:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:27:54.942405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8226285-3ea0-4546-b0b6-a6cd09e7180d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:54.942964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8226285-3ea0-4546-b0b6-a6cd09e7180d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:54.955253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8226285-3ea0-4546-b0b6-a6cd09e7180d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:54.964552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8226285-3ea0-4546-b0b6-a6cd09e7180d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:54.964552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8226285-3ea0-4546-b0b6-a6cd09e7180d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:54.964552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8226285-3ea0-4546-b0b6-a6cd09e7180d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:55.284143 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8226285-3ea0-4546-b0b6-a6cd09e7180d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.351888 Apr 30 21:27:55.284793 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1979/4052] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:54 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:27:55.294834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:55.295537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:55.316358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:55.316829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:55.317628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:55.318102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:55.830985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:55.841654 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d34201ec-40c5-461e-975f-42420f5e060c tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a" status: 200 len: 1522 microversion: 2.1 time: 0.555639 Apr 30 21:27:55.842279 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1980/4053] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:55 2022] GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:55.851855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cd7bb4e7-6a6e-47d7-a19e-605fc90092ef req-f662e67f-df25-4aa5-b998-91a7cb43a423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c395141-111d-4dfd-ace8-178b59574e50", "tag": "c86d6076-6753-4ec2-8787-d007df62c17c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:55.859738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Updating instance_info_cache with network_info: [{"id": "c86d6076-6753-4ec2-8787-d007df62c17c", "address": "fa:16:3e:2d:a2:67", "network": {"id": "acf946d8-f627-421b-bd28-a9c0e5235ab2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2009193393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "acd535df3826485d8472597a6258a56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc86d6076-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130671) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:27:55.874869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cd7bb4e7-6a6e-47d7-a19e-605fc90092ef req-f662e67f-df25-4aa5-b998-91a7cb43a423 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:55.875324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cd7bb4e7-6a6e-47d7-a19e-605fc90092ef req-f662e67f-df25-4aa5-b998-91a7cb43a423 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:55.889681 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cd7bb4e7-6a6e-47d7-a19e-605fc90092ef req-f662e67f-df25-4aa5-b998-91a7cb43a423 service nova] Creating event network-changed:c86d6076-6753-4ec2-8787-d007df62c17c for instance 6c395141-111d-4dfd-ace8-178b59574e50 on nch2-master-1 Apr 30 21:27:55.895286 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cd7bb4e7-6a6e-47d7-a19e-605fc90092ef req-f662e67f-df25-4aa5-b998-91a7cb43a423 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051434 Apr 30 21:27:55.895948 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1981/4054] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:55.908656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-26b8cf7c-6ea5-4907-960c-19b355853abc tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:55.910637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-26b8cf7c-6ea5-4907-960c-19b355853abc tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:55.950273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Releasing lock "refresh_cache-6c395141-111d-4dfd-ace8-178b59574e50" {{(pid=130671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:27:55.951404 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f78522f-2a3a-4209-a8f9-66ebee0d0274 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action" status: 202 len: 0 microversion: 2.1 time: 5.820500 Apr 30 21:27:55.952146 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2074/4055] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:50 2022] POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action => generated 0 bytes in 5822 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:27:55.960918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:55.961629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:55.969107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:55.969641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:55.970691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:55.971146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:56.008352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-26b8cf7c-6ea5-4907-960c-19b355853abc tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:56.015622 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-26b8cf7c-6ea5-4907-960c-19b355853abc tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1213 microversion: 2.1 time: 0.118237 Apr 30 21:27:56.016642 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1982/4056] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:55 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:56.022533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.20"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:56.529744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:56.537698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:56.538187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:56.539254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:56.547619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:56.568048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:56.584837 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca740728-c9aa-4fbd-afad-12bafd12a820 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.627429 Apr 30 21:27:56.586710 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2075/4057] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:55 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:56.623547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:56.624417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:56.639200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:56.646629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:56.650757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:56.651387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:57.529314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Acquired lock "refresh_cache-6c395141-111d-4dfd-ace8-178b59574e50" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:27:57.546896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:57.558618 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b2c39d38-f453-4b44-8f5e-b60de50be7a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.959976 Apr 30 21:27:57.569995 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2076/4058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:56 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:57.569995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:57.569995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:57.580846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:57.581953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:57.583477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:57.584263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:57.620939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:57.621399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:57.621883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lazy-loading 'fault' on Instance uuid 9db9572f-4802-453c-bf76-4326801c918a {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:27:57.729695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:57.736557 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f78ec777-02f4-4d62-adec-753db2160468 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a" status: 200 len: 1313 microversion: 2.1 time: 0.173371 Apr 30 21:27:57.737136 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2077/4059] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:57 2022] GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:57.750301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:57.750919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:57.756916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:57.757376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:57.758202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:57.758645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:57.907290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:57.921799 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1be583f3-7330-432c-92b1-18e3fe260f03 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1265 microversion: 2.1 time: 0.173340 Apr 30 21:27:57.921799 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2078/4060] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:57 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:57.925538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:57.926385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:57.932829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:57.933289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:57.934114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:57.934567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:58.289463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:58.301419 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8366721a-433a-4bb7-8fc0-f2092a9f05b4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.379485 Apr 30 21:27:58.302399 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2079/4061] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:57 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:58.308505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-17cb8fd8-0e0b-4ce2-b4cd-700a21bc2d29 req-cd9711b5-ad11-4e04-9f71-849062d6f89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db9572f-4802-453c-bf76-4326801c918a", "name": "network-vif-deleted", "tag": "2747b26e-0417-4d87-aa95-9b80ce250cc6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:27:58.321194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-17cb8fd8-0e0b-4ce2-b4cd-700a21bc2d29 req-cd9711b5-ad11-4e04-9f71-849062d6f89f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:58.322467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-17cb8fd8-0e0b-4ce2-b4cd-700a21bc2d29 req-cd9711b5-ad11-4e04-9f71-849062d6f89f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:58.337612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-17cb8fd8-0e0b-4ce2-b4cd-700a21bc2d29 req-cd9711b5-ad11-4e04-9f71-849062d6f89f service nova] Creating event network-vif-deleted:2747b26e-0417-4d87-aa95-9b80ce250cc6 for instance 9db9572f-4802-453c-bf76-4326801c918a on nch1-master-1 Apr 30 21:27:58.343261 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-17cb8fd8-0e0b-4ce2-b4cd-700a21bc2d29 req-cd9711b5-ad11-4e04-9f71-849062d6f89f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039175 Apr 30 21:27:58.345220 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2080/4062] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:27:58.351073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:58.351899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:58.360825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:58.361377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:58.362291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:58.362862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:58.806691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:58.818731 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b818a4f0-9684-462f-8bcb-326a67969666 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.472141 Apr 30 21:27:58.819480 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2081/4063] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:58 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:58.826007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:58.827244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:58.840020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:58.842846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:58.842846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:58.842846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:58.859280 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] HTTP exception thrown: Instance 9db9572f-4802-453c-bf76-4326801c918a could not be found. Apr 30 21:27:58.859888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 404 to user: Instance 9db9572f-4802-453c-bf76-4326801c918a could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:27:58.860740 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-728c94d4-e181-4f74-8225-d6d0565350c5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a" status: 404 len: 111 microversion: 2.1 time: 0.038431 Apr 30 21:27:58.861490 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2082/4064] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:58 2022] GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:27:58.872060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:58.872915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:58.880873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:58.881620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:58.882473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:58.882918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df822537-9f34-4665-9a2e-03b82d84a9e2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.455914 Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2083/4065] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:58 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:59.523508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:59.527351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Building network info cache for instance {{(pid=130670) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b41ee9df-aef7-4cc1-906b-796c1fc94ef5 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.160508 Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2084/4066] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:27:59 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:59.528031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:59.658018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:27:59.674518 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-979e2740-8726-4369-8ebf-44a9442fed8d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1271 microversion: 2.1 time: 0.184333 Apr 30 21:27:59.675394 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2085/4067] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:59 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:27:59.680136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:27:59.681621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:27:59.699562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:59.701103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:27:59.702830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:27:59.703300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:00.124623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:00.135558 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a99f29d-d246-47dc-87f4-e164fdf8de00 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.458969 Apr 30 21:28:00.148596 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2086/4068] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:27:59 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:00.157324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-51215d4b-a12f-47e6-a341-d7bd387769fa tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:00.159041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-51215d4b-a12f-47e6-a341-d7bd387769fa tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:00.160136 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-51215d4b-a12f-47e6-a341-d7bd387769fa tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017678 Apr 30 21:28:00.181848 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2087/4069] 10.222.0.23 () {58 vars in 1181 bytes} [Sat Apr 30 21:28:00 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:28:00.187392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:00.191515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:00.192795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:00.200299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:00.201006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:00.202097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:00.202744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:00.234655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:28:00.267191 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4280d352-cc71-4351-bd16-d650f75f7b55 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.083589 Apr 30 21:28:00.285680 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2088/4070] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:28:00 2022] GET /compute/v2.1/servers => generated 683 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:00.296997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:00.300797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:00.301038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.servers [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Removing options 'limit' from query {{(pid=130671) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 30 21:28:00.301649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:00.307426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:00.307933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:00.309431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:00.309431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:00.341803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:28:00.381389 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ba41080-fcfe-401a-bd8c-cb92d5600e85 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.088778 Apr 30 21:28:00.382825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2089/4071] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Apr 30 21:28:00 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:00.400257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-40a588c6-f1e8-4eec-8ed3-e374e1b92a0d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:00.401738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-40a588c6-f1e8-4eec-8ed3-e374e1b92a0d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:00.402610 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-40a588c6-f1e8-4eec-8ed3-e374e1b92a0d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010988 Apr 30 21:28:00.403641 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2090/4072] 10.222.0.23 () {58 vars in 1141 bytes} [Sat Apr 30 21:28:00 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:28:00.631149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Updating instance_info_cache with network_info: [{"id": "c86d6076-6753-4ec2-8787-d007df62c17c", "address": "fa:16:3e:2d:a2:67", "network": {"id": "acf946d8-f627-421b-bd28-a9c0e5235ab2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2009193393-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "acd535df3826485d8472597a6258a56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc86d6076-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130670) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:28:00.653906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Action: 'create', calling method: .version_select at 0x7fdc13dab310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1689545878", "metadata": {"Type": "work"}}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:00.802528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Releasing lock "refresh_cache-6c395141-111d-4dfd-ace8-178b59574e50" {{(pid=130670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:28:00.805103 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bf0b59d3-c37c-4405-85d4-4dd5aac881b5 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action" status: 202 len: 0 microversion: 2.1 time: 4.786984 Apr 30 21:28:00.806285 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1983/4073] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:27:56 2022] POST /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50/action => generated 0 bytes in 4789 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 30 21:28:00.811792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-dfe085cb-c93d-4c72-a15b-61928481cfb5 req-3f612495-f198-4771-a95c-4e56c2bd7556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c395141-111d-4dfd-ace8-178b59574e50", "tag": "c86d6076-6753-4ec2-8787-d007df62c17c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:00.835732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dfe085cb-c93d-4c72-a15b-61928481cfb5 req-3f612495-f198-4771-a95c-4e56c2bd7556 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:00.838068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-dfe085cb-c93d-4c72-a15b-61928481cfb5 req-3f612495-f198-4771-a95c-4e56c2bd7556 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:00.851216 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-dfe085cb-c93d-4c72-a15b-61928481cfb5 req-3f612495-f198-4771-a95c-4e56c2bd7556 service nova] Creating event network-changed:c86d6076-6753-4ec2-8787-d007df62c17c for instance 6c395141-111d-4dfd-ace8-178b59574e50 on nch2-master-1 Apr 30 21:28:00.857921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-dfe085cb-c93d-4c72-a15b-61928481cfb5 req-3f612495-f198-4771-a95c-4e56c2bd7556 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050223 Apr 30 21:28:00.863652 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1984/4074] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:00.879725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d9f5676-e0a2-4855-90b5-a107d0ad5a0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:00.881933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d9f5676-e0a2-4855-90b5-a107d0ad5a0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:00.882976 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d9f5676-e0a2-4855-90b5-a107d0ad5a0e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017869 Apr 30 21:28:00.886089 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1985/4075] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:28:00 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:28:00.901900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:00.905119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:00.933812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:00.933812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:00.933812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:00.933812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:01.597733 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 1.193046 Apr 30 21:28:01.598410 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2091/4076] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:28:00 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 1194 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 21:28:01.603769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f296f600-f15e-4880-90a8-7903732236a2 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '.version_select at 0x7fdc211aa3a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:01.921005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:01.932522 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-65eb2de9-7a28-4110-89b4-96f05e33b467 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1313 microversion: 2.1 time: 1.044526 Apr 30 21:28:01.938749 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1986/4077] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:00 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1313 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:01.948418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-523fe5e1-a7f5-4ec8-adc0-1271ca2e8e21 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:01.952669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-523fe5e1-a7f5-4ec8-adc0-1271ca2e8e21 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:01.953795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-523fe5e1-a7f5-4ec8-adc0-1271ca2e8e21 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:01.961332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.compute.servers [None req-523fe5e1-a7f5-4ec8-adc0-1271ca2e8e21 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Flavor 'non_existing_flavor' could not be found {{(pid=130670) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Apr 30 21:28:01.964540 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-523fe5e1-a7f5-4ec8-adc0-1271ca2e8e21 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023407 Apr 30 21:28:01.965360 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1987/4078] 10.222.0.23 () {58 vars in 1177 bytes} [Sat Apr 30 21:28:01 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:28:01.972018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49c18bde-0c4b-4919-a119-67ad5847652d tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc213f40d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:02.037470 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49c18bde-0c4b-4919-a119-67ad5847652d tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.068992 Apr 30 21:28:02.037470 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1988/4079] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:01 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:02.043178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:02.049504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:02.050734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:02.058817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.059509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.060724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.061419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.197155 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de561315-8fd5-4873-8d95-e8b3a56aacd9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.157771 Apr 30 21:28:02.203709 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1989/4080] 10.222.0.23 () {58 vars in 1173 bytes} [Sat Apr 30 21:28:02 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:28:02.211116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:02.215707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:02.216736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:02.222667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.223238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.224138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.224648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.325579 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-efef723e-a5c1-4658-9062-1fe8afa214cd tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.120293 Apr 30 21:28:02.326214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1990/4081] 10.222.0.23 () {58 vars in 1183 bytes} [Sat Apr 30 21:28:02 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:28:02.341054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:02.346726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:02.347886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:02.370249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.371030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.384028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.384622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.420752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:28:02.473609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:02.482719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.483185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.939374 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-84413c29-ea3a-45fd-a376-1bb39a3c95ce tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.605698 Apr 30 21:28:02.940769 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1991/4082] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:28:02 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:02.958063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:02.958063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:02.964511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.965012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:02.965881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:02.966338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:03.366477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:03.379037 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-339f4e7a-26ca-4270-8af4-9e919ded9155 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1313 microversion: 2.1 time: 0.426160 Apr 30 21:28:03.383067 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1992/4083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:02 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:03.397683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55b67ce9-9d30-4dbc-b626-a63e6f50481e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:03.412974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-55b67ce9-9d30-4dbc-b626-a63e6f50481e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:03.417535 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55b67ce9-9d30-4dbc-b626-a63e6f50481e tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.036531 Apr 30 21:28:03.418588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1993/4084] 10.222.0.23 () {58 vars in 1177 bytes} [Sat Apr 30 21:28:03 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:28:03.429635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b5e2fc6f-f712-426e-8e42-63fbb4386765 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc200c5d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:03.483274 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b5e2fc6f-f712-426e-8e42-63fbb4386765 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 347 microversion: 2.1 time: 0.057452 Apr 30 21:28:03.484220 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1994/4085] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:03 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 347 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:03.495350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:03.504839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:03.504839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Searching by: {'deleted': False, 'project_id': '8bbf68d01a624b91b6751596b4a0a480'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:03.508613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:03.509340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:03.511947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:03.512498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:03.546579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:28:03.608915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-790be889-be62-4a67-8bcf-12786d0d15a9 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.122151 Apr 30 21:28:03.613316 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1995/4086] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:28:03 2022] GET /compute/v2.1/servers => generated 683 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:03.619886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94cc73cc-5365-43a7-be9b-07d980df19c9 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc200c5d30>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:03.710073 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94cc73cc-5365-43a7-be9b-07d980df19c9 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 347 microversion: 2.1 time: 0.094827 Apr 30 21:28:03.711366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1996/4087] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:03 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:03.729476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-eac87729-a234-470d-b45e-31b31ac186ed req-f2c8347e-442b-491b-96f8-9231c67b84e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f211fea-c08c-4f08-92bd-948dc20d7503", "tag": "1f4956c6-627d-4ad7-bf44-18b887214d7a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:03.748661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-eac87729-a234-470d-b45e-31b31ac186ed req-f2c8347e-442b-491b-96f8-9231c67b84e6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:03.748661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-eac87729-a234-470d-b45e-31b31ac186ed req-f2c8347e-442b-491b-96f8-9231c67b84e6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:03.756909 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-eac87729-a234-470d-b45e-31b31ac186ed req-f2c8347e-442b-491b-96f8-9231c67b84e6 service nova] Creating event network-changed:1f4956c6-627d-4ad7-bf44-18b887214d7a for instance 9f211fea-c08c-4f08-92bd-948dc20d7503 on nch2-master-1 Apr 30 21:28:03.779563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-eac87729-a234-470d-b45e-31b31ac186ed req-f2c8347e-442b-491b-96f8-9231c67b84e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052700 Apr 30 21:28:03.783349 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1997/4088] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:03.797392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:03.798906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:03.812956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:03.813801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:03.819398 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f296f600-f15e-4880-90a8-7903732236a2 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/3cee25a3-75f1-487f-b062-e7af60932163" status: 202 len: 0 microversion: 2.1 time: 2.219924 Apr 30 21:28:03.825639 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2092/4089] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:28:01 2022] DELETE /compute/v2.1/os-floating-ips/3cee25a3-75f1-487f-b062-e7af60932163 => generated 0 bytes in 2223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:28:03.832313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cbc47a39-1b63-41b3-86ec-a57f90987d65 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc26190e50>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:03.836540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:03.837458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:03.860651 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] HTTP exception thrown: Instance 9db9572f-4802-453c-bf76-4326801c918a could not be found. Apr 30 21:28:03.861539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 404 to user: Instance 9db9572f-4802-453c-bf76-4326801c918a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:03.862645 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97eed519-a43f-45b5-a352-ef83830d7e1a tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a" status: 404 len: 111 microversion: 2.1 time: 0.074752 Apr 30 21:28:03.863460 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1998/4090] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:03 2022] DELETE /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:03.869836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03f3429d-c02f-43cb-894b-82a41b008511 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '.version_select at 0x7fdc2074e820>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:04.187116 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cbc47a39-1b63-41b3-86ec-a57f90987d65 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 202 len: 0 microversion: 2.1 time: 0.359708 Apr 30 21:28:04.193055 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2093/4091] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:28:03 2022] DELETE /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:28:04.200026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:04.206294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:04.209672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.210368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.211359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.212646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.262914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:04.495620 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-03f3429d-c02f-43cb-894b-82a41b008511 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1b389b72-04cb-4fcf-b8da-7b1d9d88017e" status: 202 len: 0 microversion: 2.1 time: 0.630797 Apr 30 21:28:04.496523 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 1999/4092] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:28:03 2022] DELETE /compute/v2.1/os-security-groups/1b389b72-04cb-4fcf-b8da-7b1d9d88017e => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:28:04.501123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c141b01b-4e1e-4f0b-a269-6f8fb3936c1d tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc20fe4dc0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:04.594602 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c141b01b-4e1e-4f0b-a269-6f8fb3936c1d tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.096625 Apr 30 21:28:04.595838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2000/4093] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:04 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:04.605288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:04.606064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:04.613524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.614272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.616403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.616645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.671397 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b29d560e-11eb-4d79-9810-8ca1ac61463d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "DELETE /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 204 len: 0 microversion: 2.1 time: 0.476412 Apr 30 21:28:04.674281 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2094/4094] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:04 2022] DELETE /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:28:04.680798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:04.681405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:04.698499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.701905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.707291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.707291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.789893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:04.834859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:04.844916 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-761e96d9-3ede-4dfa-9324-9e362bb1a50d tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1313 microversion: 2.1 time: 0.246824 Apr 30 21:28:04.846223 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2001/4095] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:04 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:04.859468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:04.860373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:04.869064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.875195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.875195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:04.875195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:04.907936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:05.231195 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-64d5891e-726e-4dab-87db-ac4937d6126a tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 204 len: 0 microversion: 2.1 time: 0.557176 Apr 30 21:28:05.232585 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2bdd21d7-3c18-487e-bb1b-1c05a2cebc99 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 204 len: 0 microversion: 2.1 time: 0.384085 Apr 30 21:28:05.233264 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2002/4096] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:04 2022] DELETE /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:28:05.238151 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2095/4097] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:04 2022] DELETE /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:28:05.244660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:05.245441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 9db9572f-4802-453c-bf76-4326801c918a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:05.248130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:05.249062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:05.254666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.259117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.259117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.260318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.276102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.276578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.277391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.281934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.309679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] HTTP exception thrown: Instance 9db9572f-4802-453c-bf76-4326801c918a could not be found. Apr 30 21:28:05.311552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 404 to user: Instance 9db9572f-4802-453c-bf76-4326801c918a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:05.312691 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a3d340fe-61fb-4a62-93ac-ec8c705e1826 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a" status: 404 len: 111 microversion: 2.1 time: 0.074795 Apr 30 21:28:05.314184 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2003/4098] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:05 2022] GET /compute/v2.1/servers/9db9572f-4802-453c-bf76-4326801c918a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:05.329880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:05.339570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:05.340545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.341346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.342675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.343296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.800440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:05.804436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:05.812921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-315f4c01-6216-4e5d-a251-13b2015732ea tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 200 len: 1523 microversion: 2.1 time: 0.489909 Apr 30 21:28:05.814828 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2004/4099] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:05 2022] GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 1523 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:05.818734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e13b4756-4cfa-4cc6-8a95-07b13023a117 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc26206550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:05.856630 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac07e9d3-88eb-4829-b848-138a35486e24 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1511 microversion: 2.1 time: 0.614292 Apr 30 21:28:05.861228 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2096/4100] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:05 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1511 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:05.875299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5a573a5-636a-421a-a55c-782968a97e71 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:05.879380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5a573a5-636a-421a-a55c-782968a97e71 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:05.887310 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e13b4756-4cfa-4cc6-8a95-07b13023a117 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.072069 Apr 30 21:28:05.888476 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2005/4101] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:05 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:05.893609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:05.894556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:05.900222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5a573a5-636a-421a-a55c-782968a97e71 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.900732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5a573a5-636a-421a-a55c-782968a97e71 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.901903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5a573a5-636a-421a-a55c-782968a97e71 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.902359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5a573a5-636a-421a-a55c-782968a97e71 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.903456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.904103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.905061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:05.905670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:05.949930 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5a573a5-636a-421a-a55c-782968a97e71 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/ips" status: 200 len: 150 microversion: 2.1 time: 0.074009 Apr 30 21:28:05.956319 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2097/4102] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:28:05 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:06.295139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:06.308955 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a68144eb-df31-4221-a88d-acb2f5c4f2ef tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1313 microversion: 2.1 time: 0.418895 Apr 30 21:28:06.312353 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2006/4103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:05 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:06.837145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:06.838204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:06.846128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:06.846629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:06.847443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:06.847909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:06.878474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:06.884162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:06.895119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:06.896015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:06.897250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:06.897844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:07.351367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:07.359477 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-68e878b5-4e54-4617-a15c-b6c5ce77b0a8 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 200 len: 1523 microversion: 2.1 time: 0.526690 Apr 30 21:28:07.360196 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2098/4104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:06 2022] GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 1523 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:07.369008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7a814c78-383b-439e-bb2c-5c8ae85bb5ef tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc205d4f70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:07.372803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:07.382142 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68ae834d-c272-45ee-b103-a7758672e9ba tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1511 microversion: 2.1 time: 0.508694 Apr 30 21:28:07.393145 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2007/4105] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:06 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:07.398388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:07.399142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:07.406819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:07.407427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:07.408633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:07.409150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:07.435729 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7a814c78-383b-439e-bb2c-5c8ae85bb5ef tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.074356 Apr 30 21:28:07.437258 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2099/4106] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:07 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:07.818500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:07.828603 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02b564c1-cd77-40b8-869e-4cc85b44c0d7 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1313 microversion: 2.1 time: 0.443858 Apr 30 21:28:07.829632 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2008/4107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:07 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:08.387629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:08.389295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:08.394814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7be52408-0a2b-4947-b0ab-f96621a7f27c req-052b8183-3111-4bd8-be6b-86d2e35456bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7086f5e-1fd3-45d1-837b-58e964bb0c98", "name": "network-vif-deleted", "tag": "7beb9238-c6dd-4ea2-8f64-8c495c1659d7"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:08.409395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7be52408-0a2b-4947-b0ab-f96621a7f27c req-052b8183-3111-4bd8-be6b-86d2e35456bc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:08.409922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7be52408-0a2b-4947-b0ab-f96621a7f27c req-052b8183-3111-4bd8-be6b-86d2e35456bc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:08.411511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:08.412778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:08.414166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:08.418335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:08.434573 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7be52408-0a2b-4947-b0ab-f96621a7f27c req-052b8183-3111-4bd8-be6b-86d2e35456bc service nova] Creating event network-vif-deleted:7beb9238-c6dd-4ea2-8f64-8c495c1659d7 for instance a7086f5e-1fd3-45d1-837b-58e964bb0c98 on nch1-master-1 Apr 30 21:28:08.451267 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7be52408-0a2b-4947-b0ab-f96621a7f27c req-052b8183-3111-4bd8-be6b-86d2e35456bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060308 Apr 30 21:28:08.452192 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2009/4108] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:08.457377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:08.458120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:08.465238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:08.465496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:08.466529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:08.467175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:08.979119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:08.993732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:08.999746 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-455933bc-26cb-451c-8d5d-dd7b99229032 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 200 len: 1523 microversion: 2.1 time: 0.622072 Apr 30 21:28:09.001042 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2100/4109] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:08 2022] GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 1523 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:09.004273 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-814d684e-378d-4ad3-a09e-f8e304d64f4f tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1511 microversion: 2.1 time: 0.550856 Apr 30 21:28:09.004861 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2010/4110] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:08 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:09.010671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d6294415-1e48-4095-947f-8254ed7a3261 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc13d60940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:09.020723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f41c7c8-f686-4ee6-9456-ce2b755ded8d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:09.025285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:09.038029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:09.038029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:09.038535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:09.038978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:09.088249 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d6294415-1e48-4095-947f-8254ed7a3261 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.085094 Apr 30 21:28:09.089017 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2101/4111] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:09 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:09.095681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:09.096429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:09.104472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:09.105258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:09.106805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:09.107524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:09.421715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:09.429299 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-966763b8-d204-40e6-9d80-8a23b4c3214b tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1313 microversion: 2.1 time: 0.339085 Apr 30 21:28:09.429889 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2102/4112] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:09 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:10.001273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5416b320-f50f-4b02-ba55-33fa1ef22346 req-142e067c-3e70-437b-ba75-47a5565f06d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f211fea-c08c-4f08-92bd-948dc20d7503", "name": "network-vif-plugged", "status": "completed", "tag": "1f4956c6-627d-4ad7-bf44-18b887214d7a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:10.015225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5416b320-f50f-4b02-ba55-33fa1ef22346 req-142e067c-3e70-437b-ba75-47a5565f06d2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.016014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5416b320-f50f-4b02-ba55-33fa1ef22346 req-142e067c-3e70-437b-ba75-47a5565f06d2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:10.054869 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5416b320-f50f-4b02-ba55-33fa1ef22346 req-142e067c-3e70-437b-ba75-47a5565f06d2 service nova] Creating event network-vif-plugged:1f4956c6-627d-4ad7-bf44-18b887214d7a for instance 9f211fea-c08c-4f08-92bd-948dc20d7503 on nch2-master-1 Apr 30 21:28:10.062305 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5416b320-f50f-4b02-ba55-33fa1ef22346 req-142e067c-3e70-437b-ba75-47a5565f06d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066013 Apr 30 21:28:10.065289 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2103/4113] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:10.068819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:10.069842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:10.078530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.079365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:10.080432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.081093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:10.381400 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.375289 Apr 30 21:28:10.386788 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2011/4114] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:28:09 2022] POST /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments => generated 194 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:10.388557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:10.390012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:10.397198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.397659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:10.398632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.399682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:10.519218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:10.528220 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cfcf59b8-a015-4167-84b2-4d8be452e7ca tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 200 len: 1481 microversion: 2.1 time: 0.463535 Apr 30 21:28:10.530755 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2104/4115] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:10 2022] GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 1481 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:10.536581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b446f151-7ee4-45a7-8866-d2e9f5370f38 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc261af940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:10.603197 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b446f151-7ee4-45a7-8866-d2e9f5370f38 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.069152 Apr 30 21:28:10.603197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2105/4116] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:10 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:10.608380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f0e67b27-5c63-4a9c-97b3-ffd43f0d0c6e req-c4ece344-32a3-4fd6-975c-b2a82d2b78ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670436c6-9564-4218-92f5-de0ea762e493", "name": "network-vif-deleted", "tag": "42b1915a-8e8a-4c31-b642-d8565317d5b3"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:10.636793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f0e67b27-5c63-4a9c-97b3-ffd43f0d0c6e req-c4ece344-32a3-4fd6-975c-b2a82d2b78ea service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.637399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f0e67b27-5c63-4a9c-97b3-ffd43f0d0c6e req-c4ece344-32a3-4fd6-975c-b2a82d2b78ea service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:10.652214 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f0e67b27-5c63-4a9c-97b3-ffd43f0d0c6e req-c4ece344-32a3-4fd6-975c-b2a82d2b78ea service nova] Creating event network-vif-deleted:42b1915a-8e8a-4c31-b642-d8565317d5b3 for instance 670436c6-9564-4218-92f5-de0ea762e493 on nch2-master-1 Apr 30 21:28:10.657941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f0e67b27-5c63-4a9c-97b3-ffd43f0d0c6e req-c4ece344-32a3-4fd6-975c-b2a82d2b78ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053269 Apr 30 21:28:10.663884 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2106/4117] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:10.670954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:10.671963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:10.679526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.681833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:10.681833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:10.682647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:11.210936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:11.218986 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5a0de63-d95b-4dd9-821a-bd13857769e0 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1511 microversion: 2.1 time: 0.835425 Apr 30 21:28:11.221638 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2012/4118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:10 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1511 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:11.317624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:11.327096 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71758f12-f14e-4283-9d16-38952356d9f6 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1313 microversion: 2.1 time: 0.660003 Apr 30 21:28:11.327928 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2107/4119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:10 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:11.555357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:11.557897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:11.576345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:11.576920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:11.577903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:11.578618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:11.618421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77185741-35d9-41f5-8eb3-2afd2c3e94c8 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc13dab550>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:11.627821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:11.628281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:11.628735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lazy-loading 'fault' on Instance uuid 670436c6-9564-4218-92f5-de0ea762e493 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:28:11.692587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77185741-35d9-41f5-8eb3-2afd2c3e94c8 tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.077992 Apr 30 21:28:11.693176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2108/4120] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:11 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:11.807360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a0fb1322c4927abb500bfbd05f95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf68d01a624b91b6751596b4a0a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:11.815512 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a6114362-9070-48b1-a862-b12778649cc0 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 200 len: 1313 microversion: 2.1 time: 0.274714 Apr 30 21:28:11.825504 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2013/4121] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:11 2022] GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:11.971252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4d289864-32bb-422a-a1ad-3bd1eaf0f239 req-25fdb876-fdaf-4bdd-a49f-c22fedc57947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c395141-111d-4dfd-ace8-178b59574e50", "name": "network-vif-deleted", "tag": "c86d6076-6753-4ec2-8787-d007df62c17c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:11.984703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d289864-32bb-422a-a1ad-3bd1eaf0f239 req-25fdb876-fdaf-4bdd-a49f-c22fedc57947 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:11.986224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d289864-32bb-422a-a1ad-3bd1eaf0f239 req-25fdb876-fdaf-4bdd-a49f-c22fedc57947 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.005095 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4d289864-32bb-422a-a1ad-3bd1eaf0f239 req-25fdb876-fdaf-4bdd-a49f-c22fedc57947 service nova] Creating event network-vif-deleted:c86d6076-6753-4ec2-8787-d007df62c17c for instance 6c395141-111d-4dfd-ace8-178b59574e50 on nch2-master-1 Apr 30 21:28:12.012052 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4d289864-32bb-422a-a1ad-3bd1eaf0f239 req-25fdb876-fdaf-4bdd-a49f-c22fedc57947 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044479 Apr 30 21:28:12.012684 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2109/4122] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:12.237893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:12.239301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:12.248830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.249687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.251006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.251685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.356559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:12.358106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:12.364179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582d05a237ba4a1a95ba93474fd4a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd535df3826485d8472597a6258a56c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:12.373581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.377258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.378822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.380439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.390061 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a9a77780-dae0-44c1-82b1-1e8b95b19566 tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 200 len: 1294 microversion: 2.1 time: 0.156068 Apr 30 21:28:12.391804 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2014/4123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:12 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:12.664121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:12.672075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5d7c8b0c-9270-4a1d-9445-5f3256028cff tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1496 microversion: 2.1 time: 0.329520 Apr 30 21:28:12.672652 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2110/4124] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:12 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1496 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:12.706780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e31f4c8-98a6-4fe5-b7d1-d0587923d21a tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc2072c280>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:12.841342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e31f4c8-98a6-4fe5-b7d1-d0587923d21a tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 200 len: 346 microversion: 2.1 time: 0.129853 Apr 30 21:28:12.841342 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2015/4125] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:12 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:12.842453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:12.844281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: 670436c6-9564-4218-92f5-de0ea762e493] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:12.851869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.853400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.854653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.855354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.874625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] HTTP exception thrown: Instance 670436c6-9564-4218-92f5-de0ea762e493 could not be found. Apr 30 21:28:12.875362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 404 to user: Instance 670436c6-9564-4218-92f5-de0ea762e493 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:12.876314 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0eab958d-1e99-45e8-ac75-fc192de93585 tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493" status: 404 len: 111 microversion: 2.1 time: 0.044603 Apr 30 21:28:12.877750 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2111/4126] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:12 2022] GET /compute/v2.1/servers/670436c6-9564-4218-92f5-de0ea762e493 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:12.887933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:12.888896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] [instance: a7086f5e-1fd3-45d1-837b-58e964bb0c98] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:12.897391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.899315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.899563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:12.900097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:12.922335 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] HTTP exception thrown: Instance a7086f5e-1fd3-45d1-837b-58e964bb0c98 could not be found. Apr 30 21:28:12.927706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] Returning 404 to user: Instance a7086f5e-1fd3-45d1-837b-58e964bb0c98 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:12.927706 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-965c219f-b0f4-40fb-a948-1ebc8e852d9d tempest-ListServersNegativeTestJSON-1439730426 tempest-ListServersNegativeTestJSON-1439730426-project] 10.222.0.23 "GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98" status: 404 len: 111 microversion: 2.1 time: 0.042396 Apr 30 21:28:12.927706 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2016/4127] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:12 2022] GET /compute/v2.1/servers/a7086f5e-1fd3-45d1-837b-58e964bb0c98 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:13.408647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:13.409345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] [instance: 6c395141-111d-4dfd-ace8-178b59574e50] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:13.416955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:13.417792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:13.418857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:13.419535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:13.445325 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] HTTP exception thrown: Instance 6c395141-111d-4dfd-ace8-178b59574e50 could not be found. Apr 30 21:28:13.446963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] Returning 404 to user: Instance 6c395141-111d-4dfd-ace8-178b59574e50 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:13.448076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5893eeb1-9850-477b-bf42-97a7fbf58d4c tempest-ServerRescueTestJSONUnderV235-1327504385 tempest-ServerRescueTestJSONUnderV235-1327504385-project] 10.222.0.23 "GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50" status: 404 len: 111 microversion: 2.1 time: 0.043469 Apr 30 21:28:13.457647 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2112/4128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:13 2022] GET /compute/v2.1/servers/6c395141-111d-4dfd-ace8-178b59574e50 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:28:13.847238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a204bb25-c0b5-44ed-9715-e0ed2a08d41c tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Calling method '.version_select at 0x7fdc2613bf70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:13.931546 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a204bb25-c0b5-44ed-9715-e0ed2a08d41c tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] HTTP exception thrown: Volume eaadabac-c80f-4a79-8d6c-4e6fd42b613a could not be found. Apr 30 21:28:13.933563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a204bb25-c0b5-44ed-9715-e0ed2a08d41c tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] Returning 404 to user: Volume eaadabac-c80f-4a79-8d6c-4e6fd42b613a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:13.935105 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a204bb25-c0b5-44ed-9715-e0ed2a08d41c tempest-VolumesGetTestJSON-362554649 tempest-VolumesGetTestJSON-362554649-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a" status: 404 len: 109 microversion: 2.1 time: 0.091806 Apr 30 21:28:13.936930 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2017/4129] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:28:13 2022] GET /compute/v2.1/os-volumes/eaadabac-c80f-4a79-8d6c-4e6fd42b613a => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:14.924928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f41c7c8-f686-4ee6-9456-ce2b755ded8d"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:14.926806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:14.968952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:14.969881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:14.971664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:14.973493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:15.160080 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Invalid volume: volume 5f41c7c8-f686-4ee6-9456-ce2b755ded8d is already attached to instances: 5f2823b0-27c1-4215-ad94-59d3ac52878b Apr 30 21:28:15.160717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 400 to user: Invalid volume: volume 5f41c7c8-f686-4ee6-9456-ce2b755ded8d is already attached to instances: 5f2823b0-27c1-4215-ad94-59d3ac52878b {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:15.162042 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db29fb52-4f27-46ae-b66b-76a0efc741e4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.245209 Apr 30 21:28:15.162898 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2113/4130] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:28:14 2022] POST /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments => generated 174 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:28:15.241203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:15.242339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:15.253586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:15.254367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:15.255524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:15.256190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:15.358921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lazy-loading 'services' on Instance uuid 5f2823b0-27c1-4215-ad94-59d3ac52878b {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:28:15.669561 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments/5f41c7c8-f686-4ee6-9456-ce2b755ded8d" status: 202 len: 0 microversion: 2.1 time: 0.437796 Apr 30 21:28:15.682920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4626d9fc-ca4a-448b-b637-4bdcf35b5cf1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:15.685265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4626d9fc-ca4a-448b-b637-4bdcf35b5cf1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:15.693401 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2018/4131] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:28:15 2022] DELETE /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments/5f41c7c8-f686-4ee6-9456-ce2b755ded8d => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:28:15.704677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4626d9fc-ca4a-448b-b637-4bdcf35b5cf1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:15.707512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4626d9fc-ca4a-448b-b637-4bdcf35b5cf1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:15.708419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4626d9fc-ca4a-448b-b637-4bdcf35b5cf1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:15.711054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4626d9fc-ca4a-448b-b637-4bdcf35b5cf1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:15.780856 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4626d9fc-ca4a-448b-b637-4bdcf35b5cf1 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104619 Apr 30 21:28:15.782145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2114/4132] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:28:15 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:16.794946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11cafda2-3597-4ebc-ae2f-86caee29cfa4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:16.797202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11cafda2-3597-4ebc-ae2f-86caee29cfa4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:16.840758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11cafda2-3597-4ebc-ae2f-86caee29cfa4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:16.847683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11cafda2-3597-4ebc-ae2f-86caee29cfa4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:16.849030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11cafda2-3597-4ebc-ae2f-86caee29cfa4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:16.852820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11cafda2-3597-4ebc-ae2f-86caee29cfa4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:16.950482 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11cafda2-3597-4ebc-ae2f-86caee29cfa4 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154710 Apr 30 21:28:16.950482 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2019/4133] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:28:16 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:17.957114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a936d3c5-3980-4cfc-ad86-a4268c576814 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:17.960174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a936d3c5-3980-4cfc-ad86-a4268c576814 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:17.973351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a936d3c5-3980-4cfc-ad86-a4268c576814 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:17.973945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a936d3c5-3980-4cfc-ad86-a4268c576814 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:17.975218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a936d3c5-3980-4cfc-ad86-a4268c576814 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:17.977655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a936d3c5-3980-4cfc-ad86-a4268c576814 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:18.057500 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a936d3c5-3980-4cfc-ad86-a4268c576814 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104511 Apr 30 21:28:18.059945 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2115/4134] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:28:17 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:28:18.179461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:18.180681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:18.191158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:18.192357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:18.193143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:18.195178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:18.304442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:18.739687 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-473aeede-3295-4510-aeed-e8a5bcb15999 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 204 len: 0 microversion: 2.1 time: 0.563774 Apr 30 21:28:18.742947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2020/4135] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:18 2022] DELETE /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:28:18.749592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:18.750400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:18.772500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:18.772500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:18.772500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:18.772500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:18.850451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:18.851299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:18.868114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:18.875689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:18.878113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:18.878641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:18.929219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:19.241960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:19.245693 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e980432b-3220-4e63-9fce-df9568795a8b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1682 microversion: 2.1 time: 0.500203 Apr 30 21:28:19.246883 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2116/4136] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:18 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1682 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:19.415641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96e203bb-9d71-40af-b117-bb4be7398716 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 204 len: 0 microversion: 2.1 time: 0.569889 Apr 30 21:28:19.423193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:19.423453 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2021/4137] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:18 2022] DELETE /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:28:19.424255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:19.430858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:19.431317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:19.432595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:19.433059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:19.781338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:19.793137 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea024af7-a260-4a43-b84f-e4b43c6ca71c tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1502 microversion: 2.1 time: 0.373747 Apr 30 21:28:19.794206 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2117/4138] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:19 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:20.265371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:20.266231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:20.276785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:20.277543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:20.278598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:20.281416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:20.697220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:20.709569 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b179af11-c2fc-418f-96a5-1331d6e5f779 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1682 microversion: 2.1 time: 0.449793 Apr 30 21:28:20.710739 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2022/4139] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:20 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1682 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:20.812702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:20.814189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:20.824577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:20.825730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:20.826654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:20.827644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:21.354905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:21.363935 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a65daa0-a841-4443-8a2d-89d4aa211b37 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1502 microversion: 2.1 time: 0.556937 Apr 30 21:28:21.364722 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2118/4140] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:20 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1502 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:21.728088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:21.729441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:21.736457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:21.737004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:21.737905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:21.738432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:22.082355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:22.114967 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5227286-b595-4a51-b7fd-62321b03426f tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1682 microversion: 2.1 time: 0.390305 Apr 30 21:28:22.117581 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2023/4141] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:21 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1682 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:22.322779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1889204756", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "63413cf0-7b82-429b-a889-4c8044c3572d"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:22.381071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:22.381907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:22.390956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:22.393346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:22.394970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:22.396081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:22.422911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] validate_networks() for [('63413cf0-7b82-429b-a889-4c8044c3572d', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:28:22.977308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383f0c2b1874b15b38dea61e4b8e498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426405d77bbc4e24adcbe789ba3f42f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:22.987340 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-929e9f7f-e50c-4230-a36f-af92cf194f35 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 200 len: 1460 microversion: 2.1 time: 0.610949 Apr 30 21:28:22.987946 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2024/4142] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:22 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 1460 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:22.992895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f94ff907-657f-48c4-81d9-e8e1d2031e0f req-360c7123-c3f4-41aa-b2a0-40b491ca5ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f211fea-c08c-4f08-92bd-948dc20d7503", "name": "network-vif-deleted", "tag": "1f4956c6-627d-4ad7-bf44-18b887214d7a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:23.001179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f94ff907-657f-48c4-81d9-e8e1d2031e0f req-360c7123-c3f4-41aa-b2a0-40b491ca5ecd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:23.003088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f94ff907-657f-48c4-81d9-e8e1d2031e0f req-360c7123-c3f4-41aa-b2a0-40b491ca5ecd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:23.013946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f94ff907-657f-48c4-81d9-e8e1d2031e0f req-360c7123-c3f4-41aa-b2a0-40b491ca5ecd service nova] Creating event network-vif-deleted:1f4956c6-627d-4ad7-bf44-18b887214d7a for instance 9f211fea-c08c-4f08-92bd-948dc20d7503 on nch2-master-1 Apr 30 21:28:23.018573 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f94ff907-657f-48c4-81d9-e8e1d2031e0f req-360c7123-c3f4-41aa-b2a0-40b491ca5ecd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029337 Apr 30 21:28:23.019168 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2025/4143] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:23.191940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1603162", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": "none"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:23.256424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:28:23.257012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:28:23.257628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:28:23.258189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:28:23.258618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:28:23.268921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:23.269391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:23.270438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:23.271098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:23.292539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Getting quotas for project cdf6569dac6e40749091f906a707d7a1. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:23.298558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Getting quotas for user 9b5bf2d0e148477a9a233d03bd8989dc and project cdf6569dac6e40749091f906a707d7a1. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:23.330370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:28:23.333278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:28:23.497345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:28:23.497950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:28:23.498375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:28:23.498797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:28:23.505961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:28:23.509553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:23.509941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:23.510761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:23.511207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:23.550732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e441695-1cb0-4948-976e-41a06f9fabaf tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.529229 Apr 30 21:28:23.560070 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2026/4144] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:28:23.562878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Getting quotas for project a036fe856ad94ef98ff000ee43a9b599. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:23.565470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:23.568851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:23.574861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Getting quotas for user 1649221dd0a749b0ac9762baa57815fd and project a036fe856ad94ef98ff000ee43a9b599. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:23.584661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:23.585218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:23.586274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:23.590174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:23.605210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Going to run 2 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:28:23.607912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 3f94f699-f51b-4e21-b7d9-f157c1af6c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:28:23.748865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:23.761068 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dd12138f-dad0-45e3-b404-01975837091a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1614 microversion: 2.1 time: 0.204329 Apr 30 21:28:23.761665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2027/4145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:23 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1614 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:23.775134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1c8ecadd-7898-41df-9d9f-6f5dbde41415 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:23.775518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c8ecadd-7898-41df-9d9f-6f5dbde41415 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:23.818008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=3f94f699-f51b-4e21-b7d9-f157c1af6c20,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:28:23.862860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1c8ecadd-7898-41df-9d9f-6f5dbde41415 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:23.871505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1c8ecadd-7898-41df-9d9f-6f5dbde41415 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:23.873033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1c8ecadd-7898-41df-9d9f-6f5dbde41415 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:23.874212 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1c8ecadd-7898-41df-9d9f-6f5dbde41415 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1275 microversion: 2.54 time: 0.111563 Apr 30 21:28:23.875295 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2028/4146] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:23 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:23.983210 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-00710ecc-54ec-4d8c-bc8a-a0cfa06efc08 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.856155 Apr 30 21:28:23.996905 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2119/4147] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:28:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:28:24.000915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:24.005337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:24.006009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:24.007264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] [instance: 9f211fea-c08c-4f08-92bd-948dc20d7503] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:24.009334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Searching by: {'deleted': False, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:24.023541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:24.024200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:24.025272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:24.025917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:24.046494 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] HTTP exception thrown: Instance 9f211fea-c08c-4f08-92bd-948dc20d7503 could not be found. Apr 30 21:28:24.047536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] Returning 404 to user: Instance 9f211fea-c08c-4f08-92bd-948dc20d7503 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:24.048814 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d241acbf-248f-4b84-9189-9350128ac6c4 tempest-VolumesActionsTest-1155069277 tempest-VolumesActionsTest-1155069277-project] 10.222.0.23 "GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503" status: 404 len: 111 microversion: 2.1 time: 0.048384 Apr 30 21:28:24.060177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2120/4148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:23 2022] GET /compute/v2.1/servers/9f211fea-c08c-4f08-92bd-948dc20d7503 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:28:24.097696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:24.100277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:24.101140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:24.102188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:24.161262 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e2b2aad-b1b4-45e0-915c-3832cf8960e7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.166245 Apr 30 21:28:24.165364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2029/4149] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:28:23 2022] GET /compute/v2.1/servers => generated 677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:24.179070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac71e5ce-2516-4bb1-8bca-b61a0d7a8c85 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:24.179922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ac71e5ce-2516-4bb1-8bca-b61a0d7a8c85 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:24.337098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac71e5ce-2516-4bb1-8bca-b61a0d7a8c85 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:24.357140 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac71e5ce-2516-4bb1-8bca-b61a0d7a8c85 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1220 microversion: 2.1 time: 0.183645 Apr 30 21:28:24.362762 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2121/4150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:24 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1220 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:24.779635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:24.780266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:24.791194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:24.791660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:24.794064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:24.797184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:24.860970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:24.861798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:24.862559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lazy-loading 'fault' on Instance uuid 5f2823b0-27c1-4215-ad94-59d3ac52878b {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:28:24.893452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6fe1985f-06fe-469e-b577-d53d6829c7df tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:24.894891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6fe1985f-06fe-469e-b577-d53d6829c7df tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:25.149206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6fe1985f-06fe-469e-b577-d53d6829c7df tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:25.180151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6fe1985f-06fe-469e-b577-d53d6829c7df tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:25.185876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6fe1985f-06fe-469e-b577-d53d6829c7df tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:25.187916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:25.193971 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6fe1985f-06fe-469e-b577-d53d6829c7df tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1275 microversion: 2.54 time: 0.303737 Apr 30 21:28:25.201172 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-323128a9-11fc-46d6-819c-79af88350299 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 200 len: 1331 microversion: 2.1 time: 0.424897 Apr 30 21:28:25.201811 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2030/4151] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:24 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 1331 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:25.218260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2122/4152] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:24 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:28:25.224689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-fead4419-625a-4608-bf8b-58a330bc29ba req-e863b180-d0d4-477c-adfb-cbe03971d1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f2823b0-27c1-4215-ad94-59d3ac52878b", "name": "network-vif-deleted", "tag": "5ae4997a-23c9-4100-b43d-7af15bd66801"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:25.243199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fead4419-625a-4608-bf8b-58a330bc29ba req-e863b180-d0d4-477c-adfb-cbe03971d1db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:25.243839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fead4419-625a-4608-bf8b-58a330bc29ba req-e863b180-d0d4-477c-adfb-cbe03971d1db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:25.269327 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-fead4419-625a-4608-bf8b-58a330bc29ba req-e863b180-d0d4-477c-adfb-cbe03971d1db service nova] Creating event network-vif-deleted:5ae4997a-23c9-4100-b43d-7af15bd66801 for instance 5f2823b0-27c1-4215-ad94-59d3ac52878b on nch1-master-1 Apr 30 21:28:25.281307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-fead4419-625a-4608-bf8b-58a330bc29ba req-e863b180-d0d4-477c-adfb-cbe03971d1db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076736 Apr 30 21:28:25.283932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2031/4153] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:25.378226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5a89bfa6-b5bf-4ece-b403-3a2045c0d830 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:25.378861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5a89bfa6-b5bf-4ece-b403-3a2045c0d830 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:25.507244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5a89bfa6-b5bf-4ece-b403-3a2045c0d830 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:25.519522 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5a89bfa6-b5bf-4ece-b403-3a2045c0d830 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1220 microversion: 2.1 time: 0.145216 Apr 30 21:28:25.520418 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2123/4154] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:25 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1220 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:26.217928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:26.218731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:26.225328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:26.226400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:26.232044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.232500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.233260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.233394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.233715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.234052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.234928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.235485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.268620 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 5f2823b0-27c1-4215-ad94-59d3ac52878b could not be found. Apr 30 21:28:26.269523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 5f2823b0-27c1-4215-ad94-59d3ac52878b could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:26.270573 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f54357cf-0d76-430b-9959-cab7c0d635c5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 404 len: 111 microversion: 2.1 time: 0.049225 Apr 30 21:28:26.271140 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2124/4155] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:26 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:28:26.281981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-62850523-30c3-40b9-bb16-fe7eb8e07f8c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '.version_select at 0x7fdc13d25670>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:26.352917 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-62850523-30c3-40b9-bb16-fe7eb8e07f8c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836872217" status: 202 len: 0 microversion: 2.1 time: 0.077075 Apr 30 21:28:26.353648 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2125/4156] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:28:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836872217 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:28:26.358921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b917a31e-f658-4583-a8b0-6742fe7585af tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:26.359216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:26.360267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b917a31e-f658-4583-a8b0-6742fe7585af tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:26.367179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b917a31e-f658-4583-a8b0-6742fe7585af tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.367904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b917a31e-f658-4583-a8b0-6742fe7585af tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.368858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b917a31e-f658-4583-a8b0-6742fe7585af tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.369462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b917a31e-f658-4583-a8b0-6742fe7585af tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.394013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:26.400734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:26.402188 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-090e2771-2ce5-46e9-a4e2-6c26177494f0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1327 microversion: 2.54 time: 0.188782 Apr 30 21:28:26.404545 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2032/4157] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:26 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1327 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:26.537223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1911c54d-6231-4d88-ac9c-dd3c508310fd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:26.538029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1911c54d-6231-4d88-ac9c-dd3c508310fd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:26.614065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b917a31e-f658-4583-a8b0-6742fe7585af tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.258855 Apr 30 21:28:26.615087 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2126/4158] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:28:26 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:28:26.629771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:26.635857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:26.640142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1911c54d-6231-4d88-ac9c-dd3c508310fd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:26.652455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.652916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.653703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.655385 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1911c54d-6231-4d88-ac9c-dd3c508310fd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1220 microversion: 2.1 time: 0.121807 Apr 30 21:28:26.656494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.656812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2033/4159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:26 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:26.679465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f39b92b9-cf9e-40c5-a639-25f97a9c66a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:26.680616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f39b92b9-cf9e-40c5-a639-25f97a9c66a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:26.699108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f39b92b9-cf9e-40c5-a639-25f97a9c66a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.699844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f39b92b9-cf9e-40c5-a639-25f97a9c66a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.700834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f39b92b9-cf9e-40c5-a639-25f97a9c66a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.702094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f39b92b9-cf9e-40c5-a639-25f97a9c66a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.781406 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f39b92b9-cf9e-40c5-a639-25f97a9c66a6 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "POST /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f/action" status: 200 len: 32491 microversion: 2.42 time: 0.118831 Apr 30 21:28:26.782680 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2034/4160] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:28:26 2022] POST /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f/action => generated 32491 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:28:26.793672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:26.798200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:26.832785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.833912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.837149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:26.839123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:26.915903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:26.990391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:26.999633 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35093f57-db15-4674-8e92-188830e5670c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1671 microversion: 2.1 time: 0.378631 Apr 30 21:28:27.000217 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2127/4161] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1671 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:27.424566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:27.425228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:27.432982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:27.433440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:27.434400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:27.434874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:27.464912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-36185bd8-3197-4809-911e-b624511c8594 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 204 len: 0 microversion: 2.42 time: 0.675882 Apr 30 21:28:27.467570 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2035/4162] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:28:26 2022] DELETE /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:28:27.479313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:27.479803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:27.490875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:27.491404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:27.492808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:27.493512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:27.511767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:27.527971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:27.541370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:27.546220 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-63c298d0-889d-44df-a12d-06d946438eda tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1333 microversion: 2.54 time: 0.125785 Apr 30 21:28:27.551179 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2128/4163] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:27 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:28:27.611765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-58fe0993-bd03-4bf2-8e54-44353b6ce33a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: .version_select at 0x7fdc13d25e50>, body: {"keypair": {"name": "tempest-keypair-67356959"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:27.627264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-58fe0993-bd03-4bf2-8e54-44353b6ce33a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:27.633173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-58fe0993-bd03-4bf2-8e54-44353b6ce33a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:27.952536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:27.962752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:27.964270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:27.965778 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5be85b90-b993-4ff7-afc9-a807079a826e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2958 microversion: 2.42 time: 0.494909 Apr 30 21:28:27.966340 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2036/4164] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:27 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2958 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:28:27.970777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:27.971605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:27.978535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:27.979225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:27.980013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:27.980460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:28.093314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:28.100010 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d50f084c-9188-459a-b99d-f6aca2e5dcb0 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1272 microversion: 2.1 time: 0.132650 Apr 30 21:28:28.100793 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2037/4165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:27 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:28.106444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:28.107249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:28.113649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:28.116596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:28.116596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:28.116596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:28.138498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-58fe0993-bd03-4bf2-8e54-44353b6ce33a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:28.155738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-58fe0993-bd03-4bf2-8e54-44353b6ce33a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:28.189526 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-58fe0993-bd03-4bf2-8e54-44353b6ce33a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.582081 Apr 30 21:28:28.193016 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2129/4166] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:28:27 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:28.572051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:28.572632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:28.584691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:28.585423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:28.588046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:28.588663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:28.902673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:28.919529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:28.922993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:28.925995 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55bdc5b4-b2e4-4e0d-a135-23117c95cc0b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1333 microversion: 2.54 time: 0.359070 Apr 30 21:28:28.934707 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2130/4167] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:28 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1333 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:28:28.996487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:28.997341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:29.006996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:29.008282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:29.009396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:29.010033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:29.013002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:29.022479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a2276d39-2f61-42ec-b5c8-ea4756aa00d5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1671 microversion: 2.1 time: 0.919653 Apr 30 21:28:29.023092 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2038/4168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:28 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1671 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:29.118704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:29.119528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:29.129988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:29.131514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:29.135181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:29.136358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:29.476022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:29.493433 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11368a6a-af7b-448c-b43b-8891e73d4abc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1272 microversion: 2.1 time: 0.372529 Apr 30 21:28:29.495966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2039/4169] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:29 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:29.768147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:29.777863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:29.786856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:29.788512 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bc277104-e0aa-453a-9ffb-8db86a8e949e tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2958 microversion: 2.42 time: 0.805366 Apr 30 21:28:29.801785 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2131/4170] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:28 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2958 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:29.947305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:29.948313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:29.966459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:29.970829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:29.973506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:29.987467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:30.048966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:30.048966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:30.052164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:30.052633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:30.053438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:30.053915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:30.271813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:30.281643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:30.288295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:30.290337 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d4ea5bfc-9264-44f0-9328-f06b59ce683a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1354 microversion: 2.54 time: 0.348260 Apr 30 21:28:30.291465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2040/4171] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:29 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1354 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:30.313610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-084d8cc9-124c-4d29-88a8-e36efaecb18f tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Action: 'create', calling method: .version_select at 0x7fdc2010e1f0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1106407419"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:30.339149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-084d8cc9-124c-4d29-88a8-e36efaecb18f tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Getting quotas for project cdf6569dac6e40749091f906a707d7a1. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:30.345458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-084d8cc9-124c-4d29-88a8-e36efaecb18f tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Getting quotas for user 9b5bf2d0e148477a9a233d03bd8989dc and project cdf6569dac6e40749091f906a707d7a1. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:30.730075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:30.743978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fb9414a2-7ebe-4a40-a0a5-18b6596f5515 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1676 microversion: 2.1 time: 0.703848 Apr 30 21:28:30.749447 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2132/4172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:30 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1676 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:30.769202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:30.771155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:30.822842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:30.823326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:30.824157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:30.824611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:30.880913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-084d8cc9-124c-4d29-88a8-e36efaecb18f tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Getting quotas for project cdf6569dac6e40749091f906a707d7a1. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:30.894878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-084d8cc9-124c-4d29-88a8-e36efaecb18f tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Getting quotas for user 9b5bf2d0e148477a9a233d03bd8989dc and project cdf6569dac6e40749091f906a707d7a1. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:30.923243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-084d8cc9-124c-4d29-88a8-e36efaecb18f tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.54 time: 0.609670 Apr 30 21:28:30.928135 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2041/4173] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Apr 30 21:28:30 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 615 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:28:30.931344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:30.931977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:30.939338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:30.939802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:30.940662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:30.941109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.042564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:31.056531 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fab545bb-6c16-43f8-9515-fd78f8c741c7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1278 microversion: 2.1 time: 0.305181 Apr 30 21:28:31.057928 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2133/4174] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:30 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:31.074890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1106407419", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:31.078324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:31.086153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.088505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.088505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.088505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.198595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:28:31.199039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:28:31.199536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:28:31.199946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:28:31.200370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:28:31.535519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:31.550498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:31.552009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:31.553255 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-888871b2-fd17-4182-9045-91bb49494579 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2958 microversion: 2.42 time: 0.627462 Apr 30 21:28:31.568821 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2042/4175] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:30 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2958 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:31.655479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:31.667937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.672046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.674520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.675997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.712373 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c7f3738-4c38-4f85-aede-2e2477de40af tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "POST /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77/action" status: 202 len: 1137 microversion: 2.54 time: 0.642423 Apr 30 21:28:31.713272 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2134/4176] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Apr 30 21:28:31 2022] POST /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77/action => generated 1137 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 30 21:28:31.728823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:31.729796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:31.736297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.736960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.737727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.739232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.767985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:31.768623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:31.780894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.781505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.782257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:31.782714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:31.917218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:31.926360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:31.927847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:31.929902 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82561c01-cad8-44ae-80f6-ae6402bc772d tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.204366 Apr 30 21:28:31.930754 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2043/4177] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:31 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:31.940925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-498404598", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f0cca1-4180-4eed-af9d-38f99c4f5357"}], "security_groups": [{"name": "tempest-securitygroup--968671680"}], "key_name": "tempest-keypair-67356959", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:32.323232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] validate_networks() for [('b4f0cca1-4180-4eed-af9d-38f99c4f5357', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:28:32.326712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:32.334533 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d6bb4d79-69fa-4aba-9756-4a3406c90639 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1676 microversion: 2.1 time: 0.571452 Apr 30 21:28:32.335230 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2135/4178] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:31 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1676 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:32.340644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:32.341537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:32.348112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:32.348661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:32.349704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:32.350183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:32.891985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:32.904135 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f118fd4e-89f3-4944-9b24-f2ed1b89914c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1278 microversion: 2.1 time: 0.566827 Apr 30 21:28:32.907715 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2136/4179] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:32 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1278 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:32.921561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:32.922807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:32.931384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:32.932822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:32.934134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:32.934939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:33.599186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:33.620854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:33.626436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:33.628669 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6609e7a9-5533-4b86-bbf9-ca1a73eb8079 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2937 microversion: 2.42 time: 0.721447 Apr 30 21:28:33.630931 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2137/4180] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:32 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2937 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:33.640743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:33.668455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:33.686723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:33.687191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:33.688154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:33.688808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:34.035875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:34.051956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:34.056178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:34.059297 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df21d742-f2d0-4720-b822-16454387d7b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.427092 Apr 30 21:28:34.071145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2138/4181] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:33 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:34.078755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:34.080135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:34.088893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:34.089935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:34.091142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:34.091758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:34.762210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:34.788764 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1be6e33d-75a5-4d69-9fa4-f53312efc4fd tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1676 microversion: 2.1 time: 0.713920 Apr 30 21:28:34.795703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2139/4182] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:34 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1676 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:34.803936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:34.807974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:28:34.808493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:28:34.808893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:28:34.809390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:28:34.809852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:28:34.812679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:34.830020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:34.830535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:34.831465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:34.831931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:34.833499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:34.834383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:34.835173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:34.836587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:34.892840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:34.903890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Getting quotas for user 9cc9b55d852942538c3ad8f317dcd73e and project 54ceedad6e134d94ac8758f8385a47e0. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:34.940896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:28:34.943282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:28:35.089686 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9b363cf0-9757-45e6-a10e-28498809b144 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.157489 Apr 30 21:28:35.096471 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2044/4183] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:28:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 3165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:28:35.121490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3bdbcaa1-6866-4a5a-ac16-0d6ce3f5a080 req-e96f68f9-f4d9-434a-a2e3-09630d8941d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-unplugged", "status": "completed", "tag": "b222076d-c1a2-4c03-8c2a-48a53d5a9274"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:35.136583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3bdbcaa1-6866-4a5a-ac16-0d6ce3f5a080 req-e96f68f9-f4d9-434a-a2e3-09630d8941d0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.137507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3bdbcaa1-6866-4a5a-ac16-0d6ce3f5a080 req-e96f68f9-f4d9-434a-a2e3-09630d8941d0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.151385 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3bdbcaa1-6866-4a5a-ac16-0d6ce3f5a080 req-e96f68f9-f4d9-434a-a2e3-09630d8941d0 service nova] Creating event network-vif-unplugged:b222076d-c1a2-4c03-8c2a-48a53d5a9274 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:35.157359 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3bdbcaa1-6866-4a5a-ac16-0d6ce3f5a080 req-e96f68f9-f4d9-434a-a2e3-09630d8941d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059315 Apr 30 21:28:35.158661 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2045/4184] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:35.166077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:35.167316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:35.176247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.177155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.179311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.179965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.222062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.236481 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53510a81-659f-43b2-828e-431b7c3b3ae7 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 0.435964 Apr 30 21:28:35.237406 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2140/4185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:34 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:35.244281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:35.245661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:35.253496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.254856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.255857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.256532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.428511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.437242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.451373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.453507 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b09b1fc0-4992-4669-9117-12cfbcfe7062 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.214734 Apr 30 21:28:35.454752 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2141/4186] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:35 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:35.459533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f0fc00d-3390-44a7-8449-c86721a3961a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:35.460386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8f0fc00d-3390-44a7-8449-c86721a3961a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:35.676346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f0fc00d-3390-44a7-8449-c86721a3961a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.684381 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f0fc00d-3390-44a7-8449-c86721a3961a tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1239 microversion: 2.1 time: 0.228370 Apr 30 21:28:35.684967 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2142/4187] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:35 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1239 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:35.761650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5229bc4b-05a5-403c-840c-01f0a6d88fb0 req-42e6d8fa-f866-40d6-810a-af6a596d9624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-deleted", "tag": "ee2823b4-cb37-40e4-9569-718e828d60c1"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:35.775751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5229bc4b-05a5-403c-840c-01f0a6d88fb0 req-42e6d8fa-f866-40d6-810a-af6a596d9624 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.776542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5229bc4b-05a5-403c-840c-01f0a6d88fb0 req-42e6d8fa-f866-40d6-810a-af6a596d9624 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.794144 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5229bc4b-05a5-403c-840c-01f0a6d88fb0 req-42e6d8fa-f866-40d6-810a-af6a596d9624 service nova] Creating event network-vif-deleted:ee2823b4-cb37-40e4-9569-718e828d60c1 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:35.801172 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5229bc4b-05a5-403c-840c-01f0a6d88fb0 req-42e6d8fa-f866-40d6-810a-af6a596d9624 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044916 Apr 30 21:28:35.803091 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2143/4188] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:35.815189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:35.816569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:35.840797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.849813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.851871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.853556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:35.854336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:35.857605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.867047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:35.881589 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc7872e6-30ae-4588-92c0-70cce9ef4eca tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2916 microversion: 2.42 time: 0.717593 Apr 30 21:28:35.883486 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2046/4189] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:35 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2916 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:36.258092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:36.259304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:36.271262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:36.272157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:36.280042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:36.280900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:36.497227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:36.505695 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26e4399d-ca0c-4614-82e9-c5555e7dfa2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.696291 Apr 30 21:28:36.518690 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2144/4190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:35 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:36.534143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:36.534827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:36.549972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:36.553145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:36.553145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:36.553145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:36.744740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:36.775614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:36.778832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:36.781425 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90bbed84-01a9-4038-86d9-20cfcc78967c tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.261374 Apr 30 21:28:36.784309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2145/4191] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:36 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:36.791533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:36.793125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:36.811863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:36.811863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:36.811863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:36.811863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:37.395930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:37.411430 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0c70447-9c1a-4e6f-b5a0-781082dd9190 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1243 microversion: 2.1 time: 0.624593 Apr 30 21:28:37.418462 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2146/4192] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:36 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1243 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:37.428756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:37.430984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:37.432219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:37.440466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:37.441365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:37.441889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:37.442394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:37.442742 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e3bbaec1-596f-412c-9d71-17b720f432cb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 1.191696 Apr 30 21:28:37.443832 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2047/4193] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:36 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:37.450795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-f946c219-de92-4252-9b6e-3c6d4df43dee req-12be8f77-6fd4-460a-bdde-3917c4f5fd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-unplugged", "status": "completed", "tag": "b7b29b71-981b-4ddd-b8fa-c4dc14de585e"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-unplugged", "status": "completed", "tag": "cdb35a6b-139d-435e-9c32-4c2cc700c91d"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-unplugged", "status": "completed", "tag": "c4baf2f0-f599-4e18-a1c9-15315a90ac2d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:37.459860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f946c219-de92-4252-9b6e-3c6d4df43dee req-12be8f77-6fd4-460a-bdde-3917c4f5fd3c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:37.460505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-f946c219-de92-4252-9b6e-3c6d4df43dee req-12be8f77-6fd4-460a-bdde-3917c4f5fd3c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:37.473074 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f946c219-de92-4252-9b6e-3c6d4df43dee req-12be8f77-6fd4-460a-bdde-3917c4f5fd3c service nova] Creating event network-vif-unplugged:b7b29b71-981b-4ddd-b8fa-c4dc14de585e for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:37.473740 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f946c219-de92-4252-9b6e-3c6d4df43dee req-12be8f77-6fd4-460a-bdde-3917c4f5fd3c service nova] Creating event network-vif-unplugged:cdb35a6b-139d-435e-9c32-4c2cc700c91d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:37.481491 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-f946c219-de92-4252-9b6e-3c6d4df43dee req-12be8f77-6fd4-460a-bdde-3917c4f5fd3c service nova] Creating event network-vif-unplugged:c4baf2f0-f599-4e18-a1c9-15315a90ac2d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:37.481491 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-f946c219-de92-4252-9b6e-3c6d4df43dee req-12be8f77-6fd4-460a-bdde-3917c4f5fd3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.035911 Apr 30 21:28:37.482693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2048/4194] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:37.807728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:37.812387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:37.818146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:37.818674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:37.819566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:37.820074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:37.828937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:37.861343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:37.869667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:37.874804 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-787667e6-1c19-4d7d-91e9-7bc4eb408469 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2756 microversion: 2.42 time: 0.455450 Apr 30 21:28:37.876117 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2147/4195] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:37 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2756 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:37.888239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3ff2baba-ba02-43fc-b226-58cc577a131b req-b86b4f0b-b045-4384-a9c0-ce5265308bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f94f699-f51b-4e21-b7d9-f157c1af6c20", "tag": "882e823c-4f61-46bf-ace8-7292bf8414df"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:37.919493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3ff2baba-ba02-43fc-b226-58cc577a131b req-b86b4f0b-b045-4384-a9c0-ce5265308bf7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:37.920489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3ff2baba-ba02-43fc-b226-58cc577a131b req-b86b4f0b-b045-4384-a9c0-ce5265308bf7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:37.955749 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3ff2baba-ba02-43fc-b226-58cc577a131b req-b86b4f0b-b045-4384-a9c0-ce5265308bf7 service nova] Creating event network-changed:882e823c-4f61-46bf-ace8-7292bf8414df for instance 3f94f699-f51b-4e21-b7d9-f157c1af6c20 on nch1-master-1 Apr 30 21:28:37.963532 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3ff2baba-ba02-43fc-b226-58cc577a131b req-b86b4f0b-b045-4384-a9c0-ce5265308bf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084496 Apr 30 21:28:37.964500 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2148/4196] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:38.012062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:38.029869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:38.031297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:38.032490 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6013a149-4fbf-4598-a2a1-a8d57fe69e78 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.229760 Apr 30 21:28:38.042955 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2049/4197] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:37 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:38.435814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:38.436810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:38.448378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:38.452990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:38.455517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:38.455991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:38.463610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:38.465473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:38.486309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:38.486884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:38.487875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:38.488336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:38.581052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:38.611317 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75ba8e98-7a04-4f09-84b5-c4f43314b564 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1309 microversion: 2.1 time: 0.181663 Apr 30 21:28:38.614283 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2149/4198] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:38 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1309 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:38.898941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:38.899622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:38.906334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:38.906791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:38.907729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:38.908192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:38.933397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:38.949028 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dc5fedff-d34d-49f8-9a9e-32d819684264 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 0.488990 Apr 30 21:28:38.950536 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2050/4199] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:38 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:39.069644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:39.070813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:39.077882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:39.079035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:39.080101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:39.080781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:39.263000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:39.278031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:39.285811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:39.287315 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-07f00297-f9e4-48df-939c-6731eaddc658 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.231802 Apr 30 21:28:39.298740 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2051/4200] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:39 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:39.344589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:39.358658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:39.365336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:39.365336 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c4205e9-da31-47bf-a330-f864d7c0aec7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2710 microversion: 2.42 time: 0.468876 Apr 30 21:28:39.365336 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2150/4201] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:38 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2710 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:39.631374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:39.632714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:39.644645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:39.645103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:39.646606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:39.647243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:39.831062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:39.842001 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a7e3900-6ac3-43aa-bbba-0cf923b1568c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1297 microversion: 2.1 time: 0.211575 Apr 30 21:28:39.842001 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2052/4202] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:39 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1297 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:39.968662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:39.970012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:39.981365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:39.981951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:39.982941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:39.983648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:40.060885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9c91447d-a8e6-4ef6-8dbb-ef1726027de8 req-11957fbb-4ba4-4c4d-a90d-676efd063a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-deleted", "tag": "cdb35a6b-139d-435e-9c32-4c2cc700c91d"}, {"name": "network-changed", "server_uuid": "59606606-7788-4de5-acc4-c5a4b5e3cc89", "tag": "911780b0-ee18-4416-9ba0-121a1a2e1db6"}, {"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-deleted", "tag": "b7b29b71-981b-4ddd-b8fa-c4dc14de585e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:40.076518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9c91447d-a8e6-4ef6-8dbb-ef1726027de8 req-11957fbb-4ba4-4c4d-a90d-676efd063a58 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:40.077157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9c91447d-a8e6-4ef6-8dbb-ef1726027de8 req-11957fbb-4ba4-4c4d-a90d-676efd063a58 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:40.097061 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9c91447d-a8e6-4ef6-8dbb-ef1726027de8 req-11957fbb-4ba4-4c4d-a90d-676efd063a58 service nova] Creating event network-vif-deleted:cdb35a6b-139d-435e-9c32-4c2cc700c91d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:40.097061 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9c91447d-a8e6-4ef6-8dbb-ef1726027de8 req-11957fbb-4ba4-4c4d-a90d-676efd063a58 service nova] Creating event network-changed:911780b0-ee18-4416-9ba0-121a1a2e1db6 for instance 59606606-7788-4de5-acc4-c5a4b5e3cc89 on nch2-master-1 Apr 30 21:28:40.097061 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9c91447d-a8e6-4ef6-8dbb-ef1726027de8 req-11957fbb-4ba4-4c4d-a90d-676efd063a58 service nova] Creating event network-vif-deleted:b7b29b71-981b-4ddd-b8fa-c4dc14de585e for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:40.108609 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9c91447d-a8e6-4ef6-8dbb-ef1726027de8 req-11957fbb-4ba4-4c4d-a90d-676efd063a58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.052954 Apr 30 21:28:40.110345 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2053/4203] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:40.314209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:40.317090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:40.330170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:40.330827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:40.339686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:40.340894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:40.368747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:40.381423 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f9291614-6b1d-47c8-ac87-6e416a345e32 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 0.416775 Apr 30 21:28:40.396073 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2151/4204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:39 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:40.404839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:40.405598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:40.412472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:40.413065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:40.414533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:40.415337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:40.436352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:40.446858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:40.448536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:40.450073 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a8540cfb-51d5-4b83-a559-d8991cde3f06 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.143616 Apr 30 21:28:40.451267 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2054/4205] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:40 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:40.833695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:40.847322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:40.856711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:40.856711 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4271e99d-29e2-4feb-9664-ef482bf316d7 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2348 microversion: 2.42 time: 0.453592 Apr 30 21:28:40.856711 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2152/4206] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:40 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2348 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:40.857668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:40.858480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:40.865949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:40.868564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:40.869384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:40.869865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:41.275077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:41.290683 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e3a4152-17c4-400d-98c2-43cbdca2e635 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.437603 Apr 30 21:28:41.291623 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2055/4207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:40 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:41.408281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:41.409261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:41.456295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:41.461275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:41.463945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:41.473189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:41.474249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:41.481739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:41.492089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:41.492613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:41.493607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:41.494096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:42.108220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:42.118533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:42.119974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:42.121407 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3046bf7a-932a-4383-aa43-def3a35f92a8 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.655461 Apr 30 21:28:42.122691 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2056/4208] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:41 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:42.138693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:42.139616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:42.155506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:42.156246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:42.157641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:42.158276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:42.660719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:42.674896 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6e6f7142-9dff-4160-8f18-eed6408137dd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 1.274814 Apr 30 21:28:42.688357 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2153/4209] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:41 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:42.695446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a3627ac0-604e-4d19-b44f-0ec5bd894a73 req-94f21747-76f8-415a-8313-db63bf7f9079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-deleted", "tag": "c4baf2f0-f599-4e18-a1c9-15315a90ac2d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:42.718951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a3627ac0-604e-4d19-b44f-0ec5bd894a73 req-94f21747-76f8-415a-8313-db63bf7f9079 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:42.727427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a3627ac0-604e-4d19-b44f-0ec5bd894a73 req-94f21747-76f8-415a-8313-db63bf7f9079 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:42.761703 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a3627ac0-604e-4d19-b44f-0ec5bd894a73 req-94f21747-76f8-415a-8313-db63bf7f9079 service nova] Creating event network-vif-deleted:c4baf2f0-f599-4e18-a1c9-15315a90ac2d for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:42.780606 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a3627ac0-604e-4d19-b44f-0ec5bd894a73 req-94f21747-76f8-415a-8313-db63bf7f9079 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090457 Apr 30 21:28:42.783867 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2154/4210] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:42.797641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8acaf92d-7223-4550-9988-4cb4a80c08ca req-518efefb-95e0-4c48-92cd-efc2e5ecf3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576b1918-2d33-4134-acbc-e25ba61935da", "tag": "2e7e973a-d313-4fb5-98ef-fc330c4aab05"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:42.818981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8acaf92d-7223-4550-9988-4cb4a80c08ca req-518efefb-95e0-4c48-92cd-efc2e5ecf3e9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:42.822065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8acaf92d-7223-4550-9988-4cb4a80c08ca req-518efefb-95e0-4c48-92cd-efc2e5ecf3e9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:42.850270 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8acaf92d-7223-4550-9988-4cb4a80c08ca req-518efefb-95e0-4c48-92cd-efc2e5ecf3e9 service nova] Creating event network-changed:2e7e973a-d313-4fb5-98ef-fc330c4aab05 for instance 576b1918-2d33-4134-acbc-e25ba61935da on nch1-master-1 Apr 30 21:28:42.856984 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8acaf92d-7223-4550-9988-4cb4a80c08ca req-518efefb-95e0-4c48-92cd-efc2e5ecf3e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071559 Apr 30 21:28:42.857606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2155/4211] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:42.862856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:42.863784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:42.871755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:42.872395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:42.873662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:42.874369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:43.116315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.128744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.130275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.140646 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-252ba1d6-c5b9-4176-8380-479befac0dac tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2348 microversion: 2.42 time: 1.014019 Apr 30 21:28:43.142320 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2057/4212] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:42 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2348 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:43.149946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:43.157569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:43.168647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:43.169404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:43.170400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:43.172098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:43.363993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.365699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.379012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.380533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.381729 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ce197e2-7435-4f52-8e91-4da52a05d0e4 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.238225 Apr 30 21:28:43.386495 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e3cb0836-579e-41fc-98c2-db2a697f668d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.521152 Apr 30 21:28:43.387932 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2156/4213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:42 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:43.394050 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2058/4214] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:43 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:43.694093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:43.695064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:43.702455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:43.703015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:43.706917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:43.706917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:43.846600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:43.856210 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9f3b2e33-35d8-4a48-9258-c15e81b22cee tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 0.166265 Apr 30 21:28:43.857235 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2157/4215] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:43 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:44.170128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:44.173901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:44.188326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.189010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.189840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.190292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.289358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-37a13c8a-50d7-4c64-b856-c4d52985daa6 req-97050f5a-e0ec-462f-99ef-e743152ad703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59606606-7788-4de5-acc4-c5a4b5e3cc89", "name": "network-vif-plugged", "status": "completed", "tag": "911780b0-ee18-4416-9ba0-121a1a2e1db6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:44.289817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:44.300888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:44.302465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:44.304237 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-69b73dab-e4ac-4bee-b549-40f8bb24bfc2 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 2167 microversion: 2.42 time: 0.142540 Apr 30 21:28:44.305175 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2059/4216] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:44 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 2167 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:44.307616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-37a13c8a-50d7-4c64-b856-c4d52985daa6 req-97050f5a-e0ec-462f-99ef-e743152ad703 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.308204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-37a13c8a-50d7-4c64-b856-c4d52985daa6 req-97050f5a-e0ec-462f-99ef-e743152ad703 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.325173 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-37a13c8a-50d7-4c64-b856-c4d52985daa6 req-97050f5a-e0ec-462f-99ef-e743152ad703 service nova] Creating event network-vif-plugged:911780b0-ee18-4416-9ba0-121a1a2e1db6 for instance 59606606-7788-4de5-acc4-c5a4b5e3cc89 on nch2-master-1 Apr 30 21:28:44.327318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-37a13c8a-50d7-4c64-b856-c4d52985daa6 req-97050f5a-e0ec-462f-99ef-e743152ad703 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045992 Apr 30 21:28:44.328172 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2158/4217] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:28:44.404759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:44.405885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:44.418323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.419223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.419966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:44.420397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.420739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:44.421250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.435661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.436101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.440822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.441284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.615132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:44.624303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:44.625890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:44.627092 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2621cc72-88fd-40f3-9a15-9de30ff00ec1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.222514 Apr 30 21:28:44.627861 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2159/4218] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:44 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:44.816232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1c92b816-5c82-40d1-9c40-2004d2d89739 req-0e43ee47-9263-489c-b0d6-137f216c4d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c0f51-02f6-41f2-a5c5-d1954741772f", "name": "network-vif-deleted", "tag": "b222076d-c1a2-4c03-8c2a-48a53d5a9274"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:44.817557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:44.834674 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a44fe814-16e5-4ece-bef0-285a42b6cc1e tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.434230 Apr 30 21:28:44.836047 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2060/4219] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:44 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:44.879420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:44.880372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:44.888408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.889348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1c92b816-5c82-40d1-9c40-2004d2d89739 req-0e43ee47-9263-489c-b0d6-137f216c4d23 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.893191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.893418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1c92b816-5c82-40d1-9c40-2004d2d89739 req-0e43ee47-9263-489c-b0d6-137f216c4d23 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.893546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:44.893546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:44.924160 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1c92b816-5c82-40d1-9c40-2004d2d89739 req-0e43ee47-9263-489c-b0d6-137f216c4d23 service nova] Creating event network-vif-deleted:b222076d-c1a2-4c03-8c2a-48a53d5a9274 for instance c71c0f51-02f6-41f2-a5c5-d1954741772f on nch1-master-1 Apr 30 21:28:44.933792 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1c92b816-5c82-40d1-9c40-2004d2d89739 req-0e43ee47-9263-489c-b0d6-137f216c4d23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122797 Apr 30 21:28:44.937269 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2160/4220] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:45.126631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:45.135917 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e3280a3-48f9-4ffe-acd0-5c9fa8511a26 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 0.266148 Apr 30 21:28:45.136905 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2061/4221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:44 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:45.326548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:45.327375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:45.334230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:45.335577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:45.336429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:45.337102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:45.420482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:45.430920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:45.432435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:45.434480 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0f91635-f29c-4918-906a-c8701caad7c9 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1605 microversion: 2.42 time: 0.112103 Apr 30 21:28:45.434480 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2161/4222] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:45 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:45.645242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:45.645924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:45.653343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:45.653851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:45.654667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:45.655117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:45.720250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:45.728786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:45.731599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:45.731599 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b34cc5b-005b-4691-93cf-97136f1187c2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.090094 Apr 30 21:28:45.732016 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2062/4223] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:45 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:45.851406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:45.852056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:45.859120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:45.859578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:45.872478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:45.872478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.043851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.057947 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-94df7039-8fc8-4a58-8efd-eff043dd6ba8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.210330 Apr 30 21:28:46.059505 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2162/4224] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:45 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:46.154468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:46.155355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:46.162343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.163549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.164329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.165199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.323828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.332584 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d43ba869-6735-4483-9502-06f3a391baa4 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1320 microversion: 2.1 time: 0.182467 Apr 30 21:28:46.333489 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2063/4225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:46 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:46.359204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e80ffc97-019f-486e-a687-64738d9dd9df req-f0ee4ad1-08fc-4996-81bb-89c18eabb990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f94f699-f51b-4e21-b7d9-f157c1af6c20", "name": "network-vif-plugged", "status": "completed", "tag": "882e823c-4f61-46bf-ace8-7292bf8414df"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:46.370079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e80ffc97-019f-486e-a687-64738d9dd9df req-f0ee4ad1-08fc-4996-81bb-89c18eabb990 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.377083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e80ffc97-019f-486e-a687-64738d9dd9df req-f0ee4ad1-08fc-4996-81bb-89c18eabb990 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.398727 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e80ffc97-019f-486e-a687-64738d9dd9df req-f0ee4ad1-08fc-4996-81bb-89c18eabb990 service nova] Creating event network-vif-plugged:882e823c-4f61-46bf-ace8-7292bf8414df for instance 3f94f699-f51b-4e21-b7d9-f157c1af6c20 on nch1-master-1 Apr 30 21:28:46.405967 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e80ffc97-019f-486e-a687-64738d9dd9df req-f0ee4ad1-08fc-4996-81bb-89c18eabb990 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049121 Apr 30 21:28:46.405967 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2163/4226] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:46.452936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:46.453869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:46.466967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.469107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.472390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.473255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.511655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.512275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.512932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lazy-loading 'fault' on Instance uuid c71c0f51-02f6-41f2-a5c5-d1954741772f {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:28:46.568665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.577351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.579122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af1585cd61ba445eba82fb0b5c74a460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81eb3fcf4664f479119191dbc28bf07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.580553 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e206885-00ea-4128-a0f4-f2c35eb51755 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 200 len: 1372 microversion: 2.42 time: 0.131888 Apr 30 21:28:46.581125 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2064/4227] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:46 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:46.752921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:46.754123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:46.768055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.769326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.770584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:46.771257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:46.859911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.871700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.873953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:46.875722 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42e30b2d-71db-4d9d-b49b-061a61821691 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.128440 Apr 30 21:28:46.883103 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2164/4228] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:46 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:47.078054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:47.078707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:47.085539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.086038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.086838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.087532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.226349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:47.233965 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a082140e-43df-402c-9692-c8edb0a10121 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.159689 Apr 30 21:28:47.234541 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2065/4229] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:47 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:47.349597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:47.350259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:47.356858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.357551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.358384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.358925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.513034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:47.520671 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89377c87-ac5b-4afc-b6f1-159c7db6800f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 200 len: 1507 microversion: 2.1 time: 0.174949 Apr 30 21:28:47.521257 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2165/4230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:47 2022] GET /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:47.537171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:47.537735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 3f94f699-f51b-4e21-b7d9-f157c1af6c20] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:47.544117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.544582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.545361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.545837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.601964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:47.602722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] [instance: c71c0f51-02f6-41f2-a5c5-d1954741772f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:47.610082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.610809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.613031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.620745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.652963 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] HTTP exception thrown: Instance c71c0f51-02f6-41f2-a5c5-d1954741772f could not be found. Apr 30 21:28:47.652963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Returning 404 to user: Instance c71c0f51-02f6-41f2-a5c5-d1954741772f could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:28:47.652963 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cb05774-b603-4c24-8d58-f77096711c9b tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f" status: 404 len: 111 microversion: 2.42 time: 0.051096 Apr 30 21:28:47.652963 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2166/4231] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:47 2022] GET /compute/v2.1/servers/c71c0f51-02f6-41f2-a5c5-d1954741772f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:28:47.666329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d05d619-db14-4bd9-9a1f-c90525ff1206 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] Calling method '.version_select at 0x7fdc13cfd820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:47.714039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:47.722812 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b2f87ff-2ce2-4e50-b395-e569277e3d16 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/3f94f699-f51b-4e21-b7d9-f157c1af6c20" status: 200 len: 1320 microversion: 2.1 time: 0.188570 Apr 30 21:28:47.723723 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2066/4232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:47 2022] GET /compute/v2.1/servers/3f94f699-f51b-4e21-b7d9-f157c1af6c20 => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:47.759797 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d05d619-db14-4bd9-9a1f-c90525ff1206 tempest-TaggedBootDevicesTest_v242-1954731281 tempest-TaggedBootDevicesTest_v242-1954731281-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375931719" status: 204 len: 0 microversion: 2.42 time: 0.098279 Apr 30 21:28:47.760402 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2167/4233] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Apr 30 21:28:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375931719 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:28:47.896228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:47.897778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:47.909111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.909111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:47.909111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:47.909111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:48.003598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:48.013452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:48.013681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:48.014890 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9cd069c9-c8d3-4b01-ad6b-eb5149b92655 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.122532 Apr 30 21:28:48.015455 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2067/4234] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:47 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:48.253434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:48.254686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:48.262713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:48.263436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:48.264391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:48.265015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:48.420095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e3e7067a-c739-444f-b7f4-b8b2198ebfd8 req-39d52005-2146-4451-ac47-5b8744cf22c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576b1918-2d33-4134-acbc-e25ba61935da", "name": "network-vif-plugged", "status": "completed", "tag": "2e7e973a-d313-4fb5-98ef-fc330c4aab05"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:48.445098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e3e7067a-c739-444f-b7f4-b8b2198ebfd8 req-39d52005-2146-4451-ac47-5b8744cf22c9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:48.445553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e3e7067a-c739-444f-b7f4-b8b2198ebfd8 req-39d52005-2146-4451-ac47-5b8744cf22c9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:48.463038 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e3e7067a-c739-444f-b7f4-b8b2198ebfd8 req-39d52005-2146-4451-ac47-5b8744cf22c9 service nova] Creating event network-vif-plugged:2e7e973a-d313-4fb5-98ef-fc330c4aab05 for instance 576b1918-2d33-4134-acbc-e25ba61935da on nch1-master-1 Apr 30 21:28:48.477012 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e3e7067a-c739-444f-b7f4-b8b2198ebfd8 req-39d52005-2146-4451-ac47-5b8744cf22c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057718 Apr 30 21:28:48.481174 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2068/4235] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:28:48.524396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:48.532977 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-669d872b-e35c-4681-985c-477d3276b30b tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.285268 Apr 30 21:28:48.533601 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2168/4236] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:48 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:48.742019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:48.742746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 3f94f699-f51b-4e21-b7d9-f157c1af6c20] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:48.755500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:48.756516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:48.758271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:48.776364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:48.941212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:48.948911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-643920d5-1b23-4350-900b-ab9770468480 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/3f94f699-f51b-4e21-b7d9-f157c1af6c20" status: 200 len: 1508 microversion: 2.1 time: 0.211986 Apr 30 21:28:48.949481 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2069/4237] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:48 2022] GET /compute/v2.1/servers/3f94f699-f51b-4e21-b7d9-f157c1af6c20 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:48.965197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:48.966052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 3f94f699-f51b-4e21-b7d9-f157c1af6c20] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:48.972255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:48.972843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:48.973795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:48.974637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:49.002622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 3f94f699-f51b-4e21-b7d9-f157c1af6c20] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:49.037659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:49.039110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:49.047411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:49.053315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:49.053315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:49.053315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:49.120150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:49.128416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:49.129974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:49.131151 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5513d9ef-8446-4908-8b44-cbe66754df44 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.099696 Apr 30 21:28:49.138664 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2070/4238] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:49 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:49.389720 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-63ff8799-50a3-46ed-a149-05620f7115fc tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3f94f699-f51b-4e21-b7d9-f157c1af6c20" status: 204 len: 0 microversion: 2.1 time: 0.428266 Apr 30 21:28:49.390613 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2169/4239] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:48 2022] DELETE /compute/v2.1/servers/3f94f699-f51b-4e21-b7d9-f157c1af6c20 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:28:49.399743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:49.400258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:49.406490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:49.406956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:49.407757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:49.408209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:49.450154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 59606606-7788-4de5-acc4-c5a4b5e3cc89] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:28:49.551316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:49.556136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:49.559448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:49.560204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:49.561275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:49.562038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:49.783456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:49.793420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-918d250f-4053-4be3-bde1-01a09545e076 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.246322 Apr 30 21:28:49.794609 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2170/4240] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:49 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:50.154668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:50.155316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:50.177454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:50.177950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:50.179578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:50.180025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:50.233037 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bbf906cd-bc24-413c-8f74-20e8638c1b7f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "DELETE /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89" status: 204 len: 0 microversion: 2.1 time: 0.837517 Apr 30 21:28:50.233908 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2071/4241] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:28:49 2022] DELETE /compute/v2.1/servers/59606606-7788-4de5-acc4-c5a4b5e3cc89 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:28:50.295199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:50.304678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:50.306880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:50.308718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f72fc1a-a576-4dbf-8743-73de5dc31c5a tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.162184 Apr 30 21:28:50.321458 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2171/4242] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:50 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:50.564441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-518479210", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "63413cf0-7b82-429b-a889-4c8044c3572d"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:50.670912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] validate_networks() for [('63413cf0-7b82-429b-a889-4c8044c3572d', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:28:50.814964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:50.820351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:50.836429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:50.848554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:50.848554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:50.848554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:51.301275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:51.309370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8976f621-eb5f-414c-b5ca-f88f8a6b182c tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1364 microversion: 2.1 time: 0.501876 Apr 30 21:28:51.325442 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2172/4243] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:50 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:51.343197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:51.348209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:51.374785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:51.377502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:51.386052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:51.389804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:51.561540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:51.581109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:28:51.581546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:28:51.582135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:28:51.582456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:28:51.582917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:28:51.592243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:51.596060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:51.596338 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1bc774c4-b309-489d-8cf9-66d875b659d5 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.268482 Apr 30 21:28:51.596950 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2173/4244] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:51 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:51.603632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:51.604310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:51.605329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:51.606224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:51.652713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Getting quotas for project a036fe856ad94ef98ff000ee43a9b599. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:28:51.662215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Getting quotas for user 1649221dd0a749b0ac9762baa57815fd and project a036fe856ad94ef98ff000ee43a9b599. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:28:51.689189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Going to run 2 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:28:51.695970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:28:51.841631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=e35daa06-9b02-4d7a-b97b-38983cde598a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:28:52.042082 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c26959a4-afd4-4e8e-85be-f4aac2b8bde1 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.481512 Apr 30 21:28:52.045640 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2072/4245] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:28:50 2022] POST /compute/v2.1/servers => generated 32 bytes in 1485 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 30 21:28:52.054434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:52.057771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:52.058876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Searching by: {'deleted': False, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599'} {{(pid=130671) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:28:52.075494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:52.076257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:52.077078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:52.077662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:52.113387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.multi_cell_list [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=130671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:28:52.153690 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18e3028b-da7e-49ee-a48c-17e5a12879da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.106086 Apr 30 21:28:52.154562 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2174/4246] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:28:52 2022] GET /compute/v2.1/servers => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:52.172279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f190b926-6109-4434-bc33-54389b80947c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:52.172909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f190b926-6109-4434-bc33-54389b80947c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:52.328355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:52.330981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:52.342245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f190b926-6109-4434-bc33-54389b80947c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:52.352813 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f190b926-6109-4434-bc33-54389b80947c tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1217 microversion: 2.1 time: 0.183727 Apr 30 21:28:52.360094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:52.365360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:52.365360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:52.365360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:52.385628 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2073/4247] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:52 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:52.614570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:52.616714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:52.630967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:52.633105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:52.645988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:52.648018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:52.847692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:52.862257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:52.867056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:52.869438 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d6be636-4e87-4fb0-b8e2-043abd6fa9b3 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.259174 Apr 30 21:28:52.873011 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2074/4248] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:52 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:52.930793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4ab6892f-b797-40e2-a8f9-5bc7377a3ba8 req-08d3f244-2c53-4a4e-8ef2-2210c551cfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f94f699-f51b-4e21-b7d9-f157c1af6c20", "name": "network-vif-deleted", "tag": "882e823c-4f61-46bf-ace8-7292bf8414df"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:52.943831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4ab6892f-b797-40e2-a8f9-5bc7377a3ba8 req-08d3f244-2c53-4a4e-8ef2-2210c551cfb9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:52.947736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4ab6892f-b797-40e2-a8f9-5bc7377a3ba8 req-08d3f244-2c53-4a4e-8ef2-2210c551cfb9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:52.964059 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4ab6892f-b797-40e2-a8f9-5bc7377a3ba8 req-08d3f244-2c53-4a4e-8ef2-2210c551cfb9 service nova] Creating event network-vif-deleted:882e823c-4f61-46bf-ace8-7292bf8414df for instance 3f94f699-f51b-4e21-b7d9-f157c1af6c20 on nch1-master-1 Apr 30 21:28:52.977409 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4ab6892f-b797-40e2-a8f9-5bc7377a3ba8 req-08d3f244-2c53-4a4e-8ef2-2210c551cfb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050818 Apr 30 21:28:52.990569 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2075/4249] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:28:53.225971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:53.239715 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a163afd7-db1a-4b58-8b55-95138af53dac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1553 microversion: 2.1 time: 0.915825 Apr 30 21:28:53.240237 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2175/4250] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:52 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1553 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:53.262068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d16f7fa6-19e8-449d-92c3-5b0d2361b879 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:53.263150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d16f7fa6-19e8-449d-92c3-5b0d2361b879 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:53.272729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16f7fa6-19e8-449d-92c3-5b0d2361b879 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:53.274972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16f7fa6-19e8-449d-92c3-5b0d2361b879 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:53.274972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16f7fa6-19e8-449d-92c3-5b0d2361b879 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:53.275579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d16f7fa6-19e8-449d-92c3-5b0d2361b879 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:53.371654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-72451e37-fb55-42eb-a182-eb4f1f0dfc37 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:53.376957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-72451e37-fb55-42eb-a182-eb4f1f0dfc37 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:53.405475 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d16f7fa6-19e8-449d-92c3-5b0d2361b879 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148803 Apr 30 21:28:53.406112 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2076/4251] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:28:53 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:53.530193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72451e37-fb55-42eb-a182-eb4f1f0dfc37 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:53.537463 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-72451e37-fb55-42eb-a182-eb4f1f0dfc37 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1217 microversion: 2.1 time: 0.170882 Apr 30 21:28:53.538395 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2176/4252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:53 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:28:53.892368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:53.893731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:53.900695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:53.904465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:53.904465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:53.904465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:53.990199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:53.999765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:54.001241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:54.002504 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b27bc6b8-0721-4506-98b7-1c156f56075b tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.115280 Apr 30 21:28:54.016309 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2077/4253] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:53 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:54.558590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:54.559616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:54.568620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:54.569782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:54.570683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:54.571577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:54.714479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:54.723194 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02368371-5ba6-4417-acc2-e3c0020d25a6 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1221 microversion: 2.1 time: 0.171215 Apr 30 21:28:54.723863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2177/4254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:54 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:55.022834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-be0b70c7-9cc5-4806-8c2e-97763ddd00f4 req-d91f0649-44e4-461e-aef2-00356f569b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59606606-7788-4de5-acc4-c5a4b5e3cc89", "name": "network-vif-deleted", "tag": "911780b0-ee18-4416-9ba0-121a1a2e1db6"}, {"name": "network-changed", "server_uuid": "576b1918-2d33-4134-acbc-e25ba61935da", "tag": "2e7e973a-d313-4fb5-98ef-fc330c4aab05"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:55.023505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:55.024135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:55.038372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:55.039068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:55.040409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:55.040860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:55.043731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-be0b70c7-9cc5-4806-8c2e-97763ddd00f4 req-d91f0649-44e4-461e-aef2-00356f569b2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:55.044123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-be0b70c7-9cc5-4806-8c2e-97763ddd00f4 req-d91f0649-44e4-461e-aef2-00356f569b2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:55.063915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-be0b70c7-9cc5-4806-8c2e-97763ddd00f4 req-d91f0649-44e4-461e-aef2-00356f569b2f service nova] Creating event network-vif-deleted:911780b0-ee18-4416-9ba0-121a1a2e1db6 for instance 59606606-7788-4de5-acc4-c5a4b5e3cc89 on nch2-master-1 Apr 30 21:28:55.064435 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-be0b70c7-9cc5-4806-8c2e-97763ddd00f4 req-d91f0649-44e4-461e-aef2-00356f569b2f service nova] Creating event network-changed:2e7e973a-d313-4fb5-98ef-fc330c4aab05 for instance 576b1918-2d33-4134-acbc-e25ba61935da on nch1-master-1 Apr 30 21:28:55.073436 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-be0b70c7-9cc5-4806-8c2e-97763ddd00f4 req-d91f0649-44e4-461e-aef2-00356f569b2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058957 Apr 30 21:28:55.074406 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2078/4255] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:55.150920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:55.159460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:55.160949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:55.162143 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f6fbe1f-48a0-4cd5-8fad-2b37befba509 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.143380 Apr 30 21:28:55.163246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2178/4256] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:55 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:28:55.742290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:55.743005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:55.752949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:55.753736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:55.757873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:55.758520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:55.871694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:55.883827 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e684f64-a847-49e5-8ff8-babe39a27564 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1269 microversion: 2.1 time: 0.145545 Apr 30 21:28:55.885444 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2079/4257] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:55 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1269 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:56.186840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:56.186840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:56.191903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:56.197583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:56.200902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:56.202347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:56.281053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:56.292198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:56.293833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:56.295123 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c693d95e-3dc1-48a4-87c5-f7888a2190b2 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.117305 Apr 30 21:28:56.295703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2179/4258] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:56 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:56.902572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:56.903588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:56.910786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:56.911249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:56.912252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:56.913623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:57.006952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:57.018225 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-291b29d4-e77a-47c2-aaaa-f497e68d5b63 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1287 microversion: 2.1 time: 0.118617 Apr 30 21:28:57.019194 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2080/4259] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:56 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:57.313817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:57.314446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:57.321471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:57.321960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:57.322727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:57.323165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:57.395348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:57.404989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:57.406737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:57.409854 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-848778ff-2733-4c1d-8403-645ea2370d14 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.100029 Apr 30 21:28:57.413133 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2180/4260] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:57 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:58.025956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d1644582-6b0e-41aa-8c82-7d8178edf2f0 req-082831ab-9b1c-4567-b634-50d965978464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e35daa06-9b02-4d7a-b97b-38983cde598a", "tag": "3e200a7e-1b6a-4b92-aa26-30d74ccb898e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:58.035754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:58.036634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d1644582-6b0e-41aa-8c82-7d8178edf2f0 req-082831ab-9b1c-4567-b634-50d965978464 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:58.036830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:58.037108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d1644582-6b0e-41aa-8c82-7d8178edf2f0 req-082831ab-9b1c-4567-b634-50d965978464 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:58.044121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:58.044303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:58.045310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:58.045980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:58.052597 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d1644582-6b0e-41aa-8c82-7d8178edf2f0 req-082831ab-9b1c-4567-b634-50d965978464 service nova] Creating event network-changed:3e200a7e-1b6a-4b92-aa26-30d74ccb898e for instance e35daa06-9b02-4d7a-b97b-38983cde598a on nch1-master-1 Apr 30 21:28:58.058403 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d1644582-6b0e-41aa-8c82-7d8178edf2f0 req-082831ab-9b1c-4567-b634-50d965978464 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038141 Apr 30 21:28:58.059397 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2081/4261] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:58.304889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:58.315270 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31442a94-aaa4-4ed7-a44b-1d34b8aed8f5 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1317 microversion: 2.1 time: 0.283301 Apr 30 21:28:58.319551 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2181/4262] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:58 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:58.429409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:58.430318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:58.436558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:58.437007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:58.437820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:58.438275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:58.507196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:58.516398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:58.518301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:58.519510 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81ac93ec-c5f9-44c2-8b73-9cbe2c5ac501 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.095007 Apr 30 21:28:58.526588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2082/4263] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:58 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:28:58.605180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-037fc2ad-0c1e-4da6-946a-31a666223ded req-e7d55061-1b60-46b3-a8e3-9b49c585097b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3", "tag": "b6bca012-9566-4044-886c-9ea9662009e4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:28:58.618635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-037fc2ad-0c1e-4da6-946a-31a666223ded req-e7d55061-1b60-46b3-a8e3-9b49c585097b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:58.619119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-037fc2ad-0c1e-4da6-946a-31a666223ded req-e7d55061-1b60-46b3-a8e3-9b49c585097b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:58.634699 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-037fc2ad-0c1e-4da6-946a-31a666223ded req-e7d55061-1b60-46b3-a8e3-9b49c585097b service nova] Creating event network-changed:b6bca012-9566-4044-886c-9ea9662009e4 for instance 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 on nch2-master-1 Apr 30 21:28:58.640478 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-037fc2ad-0c1e-4da6-946a-31a666223ded req-e7d55061-1b60-46b3-a8e3-9b49c585097b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044035 Apr 30 21:28:58.641259 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2182/4264] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:28:59.336244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:59.339278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:59.343768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:59.344657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:59.345692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:59.346033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:59.478361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:59.485927 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-740eefce-4617-4c6b-92e6-006fab34d3da tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1317 microversion: 2.1 time: 0.153555 Apr 30 21:28:59.486485 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2083/4265] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:28:59 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:28:59.539838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:28:59.540545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:28:59.546998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:59.547458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:59.548237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:28:59.548679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:28:59.613935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:59.623028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:59.624542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:28:59.625771 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-79883d6a-1326-4d9d-a4f6-9730024c9336 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.091017 Apr 30 21:28:59.626362 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2183/4266] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:28:59 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:00.503468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:00.504101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:00.511497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:00.511970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:00.512901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:00.513995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:00.644217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:00.645609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:00.646354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:00.653601 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d63527b8-fc9f-45b7-b2c5-a7d43f15fe41 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1317 microversion: 2.1 time: 0.154123 Apr 30 21:29:00.654233 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2084/4267] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:00 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:00.659249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:00.659249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:00.659249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:00.659249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:00.729011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:00.737538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:00.739716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:00.741665 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c6a6426-c3ce-46ff-8a7e-d7374cb96587 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.100569 Apr 30 21:29:00.742711 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2184/4268] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:00 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:01.671129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:01.673041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:01.681588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:01.682237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:01.683417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:01.683957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:01.775879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:01.777029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:01.785487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:01.787447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:01.788709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:01.789282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:01.848567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:01.856489 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a0893eeb-1fc6-4096-bcd8-72456bbf2c76 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1317 microversion: 2.1 time: 0.189022 Apr 30 21:29:01.857315 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2085/4269] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:01 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:01.869253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:01.877297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:01.879000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:01.880197 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-51bb68ce-fa93-4a1d-9e22-3aade25db181 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1406 microversion: 2.54 time: 0.109073 Apr 30 21:29:01.880770 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2185/4270] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:01 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:02.873550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:02.874297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:02.881063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:02.882653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:02.882916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:02.883364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:02.899510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:02.900131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:02.907607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:02.908071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:02.908863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:02.909301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:02.990066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:02.999271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:03.012166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:03.012166 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ce716c0-e094-4f00-acab-df01ccea91da tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1424 microversion: 2.54 time: 0.107190 Apr 30 21:29:03.012166 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2186/4271] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:02 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:03.059100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:03.066625 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-84cb0278-f35b-4e0c-85c7-dc766070334f tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1317 microversion: 2.1 time: 0.197094 Apr 30 21:29:03.067344 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2086/4272] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:02 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:04.022103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:04.023369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:04.030853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:04.035840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:04.035840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:04.035840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:04.087555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:04.089214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:04.096975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:04.098334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:04.099037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:04.100098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:04.101437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:04.110889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:04.113394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:04.115413 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6de3f672-7c96-4d85-aaba-f49628abea4e tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1412 microversion: 2.54 time: 0.097310 Apr 30 21:29:04.117082 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2187/4273] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:04 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:04.274417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:04.284358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ddc88d62-0a03-475a-afa1-23354d354f49 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1317 microversion: 2.1 time: 0.203723 Apr 30 21:29:04.284931 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2087/4274] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:04 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:04.328831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-7e774036-669f-44e8-aa58-d7196176b97b req-ac169bf6-cc6d-4eaf-8d9e-5cfc58605bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3", "name": "network-vif-plugged", "status": "completed", "tag": "b6bca012-9566-4044-886c-9ea9662009e4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:04.338368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7e774036-669f-44e8-aa58-d7196176b97b req-ac169bf6-cc6d-4eaf-8d9e-5cfc58605bd9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:04.339067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7e774036-669f-44e8-aa58-d7196176b97b req-ac169bf6-cc6d-4eaf-8d9e-5cfc58605bd9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:04.351643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-7e774036-669f-44e8-aa58-d7196176b97b req-ac169bf6-cc6d-4eaf-8d9e-5cfc58605bd9 service nova] Creating event network-vif-plugged:b6bca012-9566-4044-886c-9ea9662009e4 for instance 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 on nch2-master-1 Apr 30 21:29:04.356643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-7e774036-669f-44e8-aa58-d7196176b97b req-ac169bf6-cc6d-4eaf-8d9e-5cfc58605bd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 Apr 30 21:29:04.357246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2188/4275] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:05.138570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:05.139195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:05.145913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:05.146374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:05.147154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:05.147662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:05.212366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:05.219718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:05.221241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:05.222480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-79c134cc-14f3-48f8-8498-c6b8a54899d0 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1412 microversion: 2.54 time: 0.087899 Apr 30 21:29:05.223215 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2088/4276] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:05 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:05.306073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:05.307608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:05.314374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:05.314873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:05.315660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:05.316142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:05.446856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:05.454364 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4538ce9-1d10-418c-a29e-6e09abb1f849 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1317 microversion: 2.1 time: 0.153591 Apr 30 21:29:05.454946 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2189/4277] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:05 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:06.241738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:06.243046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:06.262427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:06.262905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:06.263707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:06.264646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:06.370758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-0017d07d-ef3e-4328-a1ee-dc74d02d2503 req-a52f77ce-26f9-4b4a-9fec-cc2486a80537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e35daa06-9b02-4d7a-b97b-38983cde598a", "name": "network-vif-plugged", "status": "completed", "tag": "3e200a7e-1b6a-4b92-aa26-30d74ccb898e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:06.377357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:06.383504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0017d07d-ef3e-4328-a1ee-dc74d02d2503 req-a52f77ce-26f9-4b4a-9fec-cc2486a80537 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:06.384185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0017d07d-ef3e-4328-a1ee-dc74d02d2503 req-a52f77ce-26f9-4b4a-9fec-cc2486a80537 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:06.386106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:06.387620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:06.388896 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c1d5d21f-ed43-4529-8401-cb1ad78813b1 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1397 microversion: 2.54 time: 0.151494 Apr 30 21:29:06.389628 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2089/4278] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:06 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1397 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:06.400175 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-0017d07d-ef3e-4328-a1ee-dc74d02d2503 req-a52f77ce-26f9-4b4a-9fec-cc2486a80537 service nova] Creating event network-vif-plugged:3e200a7e-1b6a-4b92-aa26-30d74ccb898e for instance e35daa06-9b02-4d7a-b97b-38983cde598a on nch1-master-1 Apr 30 21:29:06.406005 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-0017d07d-ef3e-4328-a1ee-dc74d02d2503 req-a52f77ce-26f9-4b4a-9fec-cc2486a80537 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038856 Apr 30 21:29:06.406609 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2190/4279] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:06.411560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d906f655-a425-4114-afbd-efd0a6832f55 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '.version_select at 0x7fdc26121700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:06.475813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:06.477289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:06.485897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:06.486357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:06.487232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:06.487673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:06.545294 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d906f655-a425-4114-afbd-efd0a6832f55 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1106407419" status: 204 len: 0 microversion: 2.54 time: 0.140727 Apr 30 21:29:06.546650 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2090/4280] 10.222.0.23 () {60 vars in 1318 bytes} [Sat Apr 30 21:29:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1106407419 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:29:06.573142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:06.573661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:06.602798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:06.606534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:06.608272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:06.614302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:06.662922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:29:07.080493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:07.089897 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fed3221c-bd4d-42e5-99b3-fbf338a7b020 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 200 len: 1504 microversion: 2.1 time: 0.621004 Apr 30 21:29:07.090463 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2191/4281] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:06 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:07.099546 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78048795-e619-4ffb-a863-36cc59a87e38 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 204 len: 0 microversion: 2.54 time: 0.540387 Apr 30 21:29:07.101142 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2091/4282] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:29:06 2022] DELETE /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 21:29:07.111751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:07.112905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:07.124348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:07.127985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:07.128099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:07.128099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:07.128475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:07.128970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:07.134048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:07.134506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:07.135305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:07.135754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:07.271522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:07.284822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:07.292903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:07.294791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c2cd003-a5fc-41dd-b6a1-73effb587a46 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1403 microversion: 2.54 time: 0.177654 Apr 30 21:29:07.295935 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2192/4283] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:07 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1403 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:07.391390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:07.408009 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e1682c53-029b-4441-a179-f3550a41b72a tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a" status: 200 len: 1317 microversion: 2.1 time: 0.301548 Apr 30 21:29:07.408614 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2092/4284] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:07 2022] GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:08.314205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:08.314918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:08.321701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.322195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:08.323070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.323522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:08.395167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:08.403819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:08.405338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:08.406552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3500c1ff-1217-4998-a3b8-dbeced59b5ca tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1403 microversion: 2.54 time: 0.096616 Apr 30 21:29:08.407121 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2193/4285] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:08 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1403 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:08.433274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:08.434019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:08.448378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.448856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:08.453174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.453643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:08.654388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:08.659279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2cadb6af-e3e0-46d0-837b-b91a0ddb7753 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a" status: 200 len: 1505 microversion: 2.1 time: 0.234459 Apr 30 21:29:08.659279 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2093/4286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:08 2022] GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:08.682828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:08.683655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:08.690373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.691470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:08.692385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.692937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:08.728087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:29:08.936796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:08.937428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:08.944361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.951230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:08.951230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:08.951230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.124048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.135515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ce5bc51-6107-4f95-9726-e69ea65beb47 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.414034 Apr 30 21:29:09.135515 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2094/4287] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:08 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:09.160568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:09.160568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:09.166681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.167862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.168756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.169132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.238744 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d3e2dc8-31ea-4d2a-b5f3-3c9d58dd81d3 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a" status: 204 len: 0 microversion: 2.1 time: 0.564956 Apr 30 21:29:09.241451 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2194/4288] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:29:08 2022] DELETE /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:29:09.254163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:09.264165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:09.264165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.264596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.265387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.265859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.294269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:29:09.332864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.339563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47075fc5-5915-41be-9195-1048a25b966f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.188891 Apr 30 21:29:09.340127 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2095/4289] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:09 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:09.355690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:09.368951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:09.368951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.368951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.368951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.368951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.510250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.514259 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c1f0978-9791-4764-9276-03305bb6a149 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.162225 Apr 30 21:29:09.525413 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2096/4290] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:09 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:09.532010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:09.532626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:09.541236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.541700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.543348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.543784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.586406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.590792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.590792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lazy-loading 'fault' on Instance uuid 278bfcd6-ff16-4875-8627-3f6f34791c77 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:29:09.631797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.640020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.642594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5bf2d0e148477a9a233d03bd8989dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf6569dac6e40749091f906a707d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.642805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c49312ca-719d-4b5b-a788-ce7f1d85c408 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 200 len: 1408 microversion: 2.54 time: 0.116371 Apr 30 21:29:09.643365 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2097/4291] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:09 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:09.647686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:09.648821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:09.654329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.654784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.655559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.656006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.664303 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c5a3d71-ff6f-4a10-b6ab-161670ee2a73 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "DELETE /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 204 len: 0 microversion: 2.1 time: 0.416557 Apr 30 21:29:09.665720 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2195/4292] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:29:09 2022] DELETE /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:29:09.674509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:09.675271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:09.681200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.681655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.682477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:09.682921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:09.855079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.862802 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-621f4bee-75d4-4148-bed7-84be82f95d3a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.218424 Apr 30 21:29:09.863371 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2098/4293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:09 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:09.865648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:09.873903 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b680f087-4f4d-4055-b054-607d14eebdbb tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a" status: 200 len: 1511 microversion: 2.1 time: 0.203796 Apr 30 21:29:09.874474 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2196/4294] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:09 2022] GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:09.967838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1858546864", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "6d21022d-393a-4eff-ba51-560f37353f44"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:10.026607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] validate_networks() for [('6d21022d-393a-4eff-ba51-560f37353f44', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:29:10.415380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:29:10.415380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:29:10.415629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:29:10.415906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:29:10.416319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:29:10.425377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:10.425863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:10.426680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:10.427122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:10.450664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:29:10.452464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for user 20b4082fa07249e2b6dfb9b4506ab398 and project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:29:10.466841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:29:10.469228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:29:10.662170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:10.663209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] [instance: 278bfcd6-ff16-4875-8627-3f6f34791c77] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:10.671963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:10.672561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:10.673286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:10.673825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:10.676501 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7f9758f6-2af0-46c8-910f-0903333054a0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713130 Apr 30 21:29:10.677912 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2099/4295] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:29:10.691498 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] HTTP exception thrown: Instance 278bfcd6-ff16-4875-8627-3f6f34791c77 could not be found. Apr 30 21:29:10.692416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] Returning 404 to user: Instance 278bfcd6-ff16-4875-8627-3f6f34791c77 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:10.693364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35b95170-7d05-4201-b50e-d5cef00ee742 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:10.693704 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e3816a1-b628-4cd5-872e-09285a9bc3b6 tempest-ServerShowV254Test-1111156433 tempest-ServerShowV254Test-1111156433-project] 10.222.0.23 "GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77" status: 404 len: 111 microversion: 2.54 time: 0.035670 Apr 30 21:29:10.694301 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2197/4296] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:10 2022] GET /compute/v2.1/servers/278bfcd6-ff16-4875-8627-3f6f34791c77 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:29:10.696856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35b95170-7d05-4201-b50e-d5cef00ee742 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:10.830823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35b95170-7d05-4201-b50e-d5cef00ee742 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:10.830823 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35b95170-7d05-4201-b50e-d5cef00ee742 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1215 microversion: 2.1 time: 0.142168 Apr 30 21:29:10.840047 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2100/4297] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:10 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:10.893862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:10.898786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:10.904505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:10.905432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:10.906948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:10.907771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:11.166849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:11.175420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6ac3986d-a946-4436-bd2d-3a707b2d4a05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a" status: 200 len: 1511 microversion: 2.1 time: 0.288413 Apr 30 21:29:11.176271 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2198/4298] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:10 2022] GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:11.531013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-b3d0706e-b4da-4c02-b1f8-943b06408df8 req-0bf792c2-296d-4f3d-814a-70b42e1d829d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e35daa06-9b02-4d7a-b97b-38983cde598a", "name": "network-vif-deleted", "tag": "3e200a7e-1b6a-4b92-aa26-30d74ccb898e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:11.556551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b3d0706e-b4da-4c02-b1f8-943b06408df8 req-0bf792c2-296d-4f3d-814a-70b42e1d829d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:11.558788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-b3d0706e-b4da-4c02-b1f8-943b06408df8 req-0bf792c2-296d-4f3d-814a-70b42e1d829d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:11.605002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-b3d0706e-b4da-4c02-b1f8-943b06408df8 req-0bf792c2-296d-4f3d-814a-70b42e1d829d service nova] Creating event network-vif-deleted:3e200a7e-1b6a-4b92-aa26-30d74ccb898e for instance e35daa06-9b02-4d7a-b97b-38983cde598a on nch1-master-1 Apr 30 21:29:11.612789 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-b3d0706e-b4da-4c02-b1f8-943b06408df8 req-0bf792c2-296d-4f3d-814a-70b42e1d829d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086603 Apr 30 21:29:11.614473 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2101/4299] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:11.775298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c67f1b4f-7fbc-43c1-b43a-8134cb433d8d req-148ec5ae-d245-458d-b8fd-e6d98481244d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3", "name": "network-vif-deleted", "tag": "b6bca012-9566-4044-886c-9ea9662009e4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:11.803698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c67f1b4f-7fbc-43c1-b43a-8134cb433d8d req-148ec5ae-d245-458d-b8fd-e6d98481244d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:11.806347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c67f1b4f-7fbc-43c1-b43a-8134cb433d8d req-148ec5ae-d245-458d-b8fd-e6d98481244d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:11.835852 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c67f1b4f-7fbc-43c1-b43a-8134cb433d8d req-148ec5ae-d245-458d-b8fd-e6d98481244d service nova] Creating event network-vif-deleted:b6bca012-9566-4044-886c-9ea9662009e4 for instance 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 on nch2-master-1 Apr 30 21:29:11.846118 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c67f1b4f-7fbc-43c1-b43a-8134cb433d8d req-148ec5ae-d245-458d-b8fd-e6d98481244d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076857 Apr 30 21:29:11.853237 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2199/4300] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:11.856764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:11.858827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:11.866161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:11.867367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:11.872824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:11.872824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:11.955178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:11.964202 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4053f6cd-aaea-4968-8309-b116049efb3c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1219 microversion: 2.1 time: 0.120063 Apr 30 21:29:11.974582 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2102/4301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:11 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:12.193195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:12.194071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:12.200714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:12.212043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:12.212043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:12.212043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:12.235959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:12.236539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:12.237027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lazy-loading 'fault' on Instance uuid e35daa06-9b02-4d7a-b97b-38983cde598a {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:29:12.285495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1649221dd0a749b0ac9762baa57815fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a036fe856ad94ef98ff000ee43a9b599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:12.295288 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99ceab56-0c09-4542-9057-726d4d5635cd tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a" status: 200 len: 1307 microversion: 2.1 time: 0.106513 Apr 30 21:29:12.296510 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2200/4302] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:12 2022] GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:12.981114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:12.981932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:12.988332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:12.988796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:12.989639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:12.990352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:13.073187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:13.081167 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb2446c3-820a-4135-8260-b2b440cf93d1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1267 microversion: 2.1 time: 0.104066 Apr 30 21:29:13.082020 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2103/4303] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:12 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:13.313175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:13.314692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: e35daa06-9b02-4d7a-b97b-38983cde598a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:13.322057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:13.322526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:13.323354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:13.323807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:13.339065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] HTTP exception thrown: Instance e35daa06-9b02-4d7a-b97b-38983cde598a could not be found. Apr 30 21:29:13.339681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Returning 404 to user: Instance e35daa06-9b02-4d7a-b97b-38983cde598a could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:13.340735 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-81b551e5-417c-4765-8205-7bd0789fa443 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a" status: 404 len: 111 microversion: 2.1 time: 0.032208 Apr 30 21:29:13.341461 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2201/4304] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:13 2022] GET /compute/v2.1/servers/e35daa06-9b02-4d7a-b97b-38983cde598a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:29:13.349509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:13.350157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] [instance: 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:13.356985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:13.357686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:13.358745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:13.359293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:13.379769 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] HTTP exception thrown: Instance 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 could not be found. Apr 30 21:29:13.379769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] Returning 404 to user: Instance 752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:13.379769 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de2c21eb-4605-474c-90c4-27b5c3177e05 tempest-MultipleCreateTestJSON-58285536 tempest-MultipleCreateTestJSON-58285536-project] 10.222.0.23 "GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3" status: 404 len: 111 microversion: 2.1 time: 0.029572 Apr 30 21:29:13.379769 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2104/4305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:13 2022] GET /compute/v2.1/servers/752bfd87-b2bd-4b7d-89cf-d70c58d9f0d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:29:14.098870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:14.099770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:14.106805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:14.107408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:14.108299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:14.108859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:14.199282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:14.209285 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1559e528-649e-41bf-bc7a-f91a7776c568 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1273 microversion: 2.1 time: 0.114736 Apr 30 21:29:14.210339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2202/4306] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:14 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:15.234207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:15.234922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:15.244992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:15.245916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:15.246995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:15.247732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:15.659322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:15.667925 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ec4e971-3680-42fa-b6c2-4e44df0780b2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1315 microversion: 2.1 time: 0.443608 Apr 30 21:29:15.668723 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2105/4307] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:15 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:16.182287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-359186358", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:16.260478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] validate_networks() for [('c7cbed3c-359b-4472-8bf9-f34e2c55b91b', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:29:16.666639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-23e05aea-8e1f-4bf8-b065-247470f40674 req-7de2adf4-48e0-4bc3-9fdc-771d9596d495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "563b93e0-a029-49fe-a501-1c8c192370d0", "tag": "432d721f-3bf6-4293-bd4a-313b2128a6fb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:16.677522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-23e05aea-8e1f-4bf8-b065-247470f40674 req-7de2adf4-48e0-4bc3-9fdc-771d9596d495 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:16.678388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-23e05aea-8e1f-4bf8-b065-247470f40674 req-7de2adf4-48e0-4bc3-9fdc-771d9596d495 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:16.693107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-23e05aea-8e1f-4bf8-b065-247470f40674 req-7de2adf4-48e0-4bc3-9fdc-771d9596d495 service nova] Creating event network-changed:432d721f-3bf6-4293-bd4a-313b2128a6fb for instance 563b93e0-a029-49fe-a501-1c8c192370d0 on nch2-master-1 Apr 30 21:29:16.703513 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-23e05aea-8e1f-4bf8-b065-247470f40674 req-7de2adf4-48e0-4bc3-9fdc-771d9596d495 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040811 Apr 30 21:29:16.705040 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2106/4308] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:29:16.721616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:16.722669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:16.730702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:16.731382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:16.732358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:16.732966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:17.045814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:29:17.046421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:29:17.047140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:29:17.047639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:29:17.048131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:29:17.053453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:17.062921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02a69046-3dca-49f7-b00e-cdbe76622520 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1315 microversion: 2.1 time: 0.355948 Apr 30 21:29:17.063507 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2107/4309] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:16 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:17.064156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:17.066811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:17.067644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:17.070662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:17.110303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Getting quotas for project 3383c2433214484eb41e99aacb653b80. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:29:17.117195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Getting quotas for user baf1d13615bc491ab98d2a644e681c12 and project 3383c2433214484eb41e99aacb653b80. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:29:17.131666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:29:17.134914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:29:17.242452 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19fecdc0-8fc8-4c06-8d4e-929c102c9d66 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238474 Apr 30 21:29:17.243096 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2203/4310] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:29:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:29:17.254927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-931577232", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": "none"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:17.260739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a88b3ef0-851d-44d2-b1ad-495570241416 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:17.261799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a88b3ef0-851d-44d2-b1ad-495570241416 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:17.376173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:29:17.376611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:29:17.377091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:29:17.377519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:29:17.378156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:29:17.388515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:17.389049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:17.389976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:17.390632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:17.417729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Getting quotas for project f3fa1520caa74e8fa7af9cda4044db7c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:29:17.425854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Getting quotas for user 00258107f1e64ee489d35b481aec2198 and project f3fa1520caa74e8fa7af9cda4044db7c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:29:17.458823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:29:17.463578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:29:17.653819 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96cbe0d8-be70-4a70-b6c6-f653a0435649 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.588666 Apr 30 21:29:17.654683 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2108/4311] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:29:17.674408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aded51e8-86b4-4eec-898f-6d75569ffb80 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:17.675050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aded51e8-86b4-4eec-898f-6d75569ffb80 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:17.743484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a88b3ef0-851d-44d2-b1ad-495570241416 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:17.756720 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a88b3ef0-851d-44d2-b1ad-495570241416 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1216 microversion: 2.1 time: 0.505244 Apr 30 21:29:17.766704 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2204/4312] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:17 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1216 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:17.796760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aded51e8-86b4-4eec-898f-6d75569ffb80 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:17.805177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aded51e8-86b4-4eec-898f-6d75569ffb80 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:17.811758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aded51e8-86b4-4eec-898f-6d75569ffb80 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:17.816999 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aded51e8-86b4-4eec-898f-6d75569ffb80 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1280 microversion: 2.47 time: 0.150929 Apr 30 21:29:17.817676 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2109/4313] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:17 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:18.082345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:18.083287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:18.095430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:18.096166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:18.098075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:18.098710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:18.280398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:18.291285 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7895bc5a-a59b-4b76-9ba2-a275e19f2c72 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1315 microversion: 2.1 time: 0.214979 Apr 30 21:29:18.291887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2205/4314] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:18 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:18.776244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:18.776244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:18.795916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:18.796662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:18.797481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:18.797960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:18.839325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fb0950d2-0ecf-408b-855b-ba1a34444664 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:18.839954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fb0950d2-0ecf-408b-855b-ba1a34444664 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:18.896528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:18.918411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-961665b9-4bd4-4771-a6ab-5f5c25464b79 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1220 microversion: 2.1 time: 0.147527 Apr 30 21:29:18.925330 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2110/4315] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:18 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:18.946742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb0950d2-0ecf-408b-855b-ba1a34444664 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:18.954956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb0950d2-0ecf-408b-855b-ba1a34444664 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:18.956486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb0950d2-0ecf-408b-855b-ba1a34444664 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:18.957678 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fb0950d2-0ecf-408b-855b-ba1a34444664 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1280 microversion: 2.47 time: 0.123555 Apr 30 21:29:18.970633 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2206/4316] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:18 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1280 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:19.310017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:19.310797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:19.317410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:19.318140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:19.319493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:19.321363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:19.484777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:19.494288 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c0bd5882-5d23-4082-bad5-0fe6b28fc3e4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1315 microversion: 2.1 time: 0.188877 Apr 30 21:29:19.495187 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2111/4317] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:19 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:19.943287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:19.943909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:19.954319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:19.955055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:19.956027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:19.956685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:19.978238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:19.979560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:19.986903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:19.987732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:19.988902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:19.989534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:20.063044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:20.071397 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1260ee76-ac79-4d43-86c6-9aacf2d13b77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1268 microversion: 2.1 time: 0.132720 Apr 30 21:29:20.074656 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2207/4318] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:19 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1268 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:20.115792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:20.124922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:20.127205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:20.128465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-682634c3-40fc-4408-808d-970f805ea8e3 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1332 microversion: 2.47 time: 0.155780 Apr 30 21:29:20.129201 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2112/4319] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:19 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:20.512607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:20.513234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:20.519854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:20.520363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:20.521187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:20.521901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:20.740012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:20.751273 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c3d83bd-1828-49bc-a1fe-89e700af2fc5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1315 microversion: 2.1 time: 0.242444 Apr 30 21:29:20.752683 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2208/4320] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:20 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:21.091361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:21.091963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:21.099976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:21.101402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:21.102214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:21.102659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:21.149044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:21.149705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:21.156422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:21.156932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:21.157877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:21.158348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:21.167386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:21.175175 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88346dbb-478c-443c-9e03-419e8bd2655a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1274 microversion: 2.1 time: 0.087876 Apr 30 21:29:21.175758 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2113/4321] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:21 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:21.234124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:21.244263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:21.245974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:21.248114 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc43a3e4-f8de-42c3-bfe4-dd987c49d908 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1338 microversion: 2.47 time: 0.104569 Apr 30 21:29:21.250111 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2209/4322] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:21 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:21.769929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:21.770566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:21.784772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:21.785268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:21.786151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:21.786796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:21.925440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:21.933504 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e1e22b7-10fc-45ce-824b-a9e24f1a57c5 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1315 microversion: 2.1 time: 0.168186 Apr 30 21:29:21.934192 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2114/4323] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:21 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:22.192244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:22.192854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:22.200207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:22.200661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:22.201449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:22.201920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:22.208110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ea014d23-9f7b-4cf7-a61a-510682344635 req-44080744-33fb-445f-aaff-07216319ca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563b93e0-a029-49fe-a501-1c8c192370d0", "name": "network-vif-plugged", "status": "completed", "tag": "432d721f-3bf6-4293-bd4a-313b2128a6fb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:22.222164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ea014d23-9f7b-4cf7-a61a-510682344635 req-44080744-33fb-445f-aaff-07216319ca6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:22.224628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ea014d23-9f7b-4cf7-a61a-510682344635 req-44080744-33fb-445f-aaff-07216319ca6a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:22.237514 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ea014d23-9f7b-4cf7-a61a-510682344635 req-44080744-33fb-445f-aaff-07216319ca6a service nova] Creating event network-vif-plugged:432d721f-3bf6-4293-bd4a-313b2128a6fb for instance 563b93e0-a029-49fe-a501-1c8c192370d0 on nch2-master-1 Apr 30 21:29:22.244383 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ea014d23-9f7b-4cf7-a61a-510682344635 req-44080744-33fb-445f-aaff-07216319ca6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040136 Apr 30 21:29:22.245414 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2115/4324] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:29:22.274354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:22.275607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:22.289924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:22.290615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:22.292916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:22.294253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:22.423217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:22.435479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:22.437523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:22.439445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:22.440708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-477d6c91-9525-42ef-8adf-644b34e5d106 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1338 microversion: 2.47 time: 0.173541 Apr 30 21:29:22.441394 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2116/4325] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:22 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1338 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:22.451314 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f77a9a3-8810-4acb-9078-49c611a3267a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.262830 Apr 30 21:29:22.452220 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2210/4326] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:22 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:22.952788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:22.953602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:22.962225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:22.966946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:22.968748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:22.969673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.131257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:23.139008 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-497b6f88-903e-4453-bfb0-24b3914c5f1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1315 microversion: 2.1 time: 0.190778 Apr 30 21:29:23.139791 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2117/4327] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:22 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:23.242081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-792e06d9-0563-48a9-96f3-12dae8f13937 req-b21176a7-156b-4f20-a470-b9a159548faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc46f81-a8bd-46ba-b2c4-6a859c458690", "tag": "0909419b-0751-4574-88cd-5569bff0727a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:23.282726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-792e06d9-0563-48a9-96f3-12dae8f13937 req-b21176a7-156b-4f20-a470-b9a159548faa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:23.283657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-792e06d9-0563-48a9-96f3-12dae8f13937 req-b21176a7-156b-4f20-a470-b9a159548faa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.312034 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-792e06d9-0563-48a9-96f3-12dae8f13937 req-b21176a7-156b-4f20-a470-b9a159548faa service nova] Creating event network-changed:0909419b-0751-4574-88cd-5569bff0727a for instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 on nch1-master-1 Apr 30 21:29:23.321072 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-792e06d9-0563-48a9-96f3-12dae8f13937 req-b21176a7-156b-4f20-a470-b9a159548faa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085105 Apr 30 21:29:23.331800 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2211/4328] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:23.459638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:23.461046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:23.467963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:23.468551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.469433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:23.470030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.479067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:23.479828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:23.504971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:23.505440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.506344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:23.510536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.569735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:23.578808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:23.580654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:23.582143 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e68d19eb-26fd-42ad-8e6e-a91859c36601 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1359 microversion: 2.47 time: 0.126503 Apr 30 21:29:23.595439 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2118/4329] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:23 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1359 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:23.601417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ba1af99d-c5f8-4327-a10f-6b019bee6877 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1349722489"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:23.602839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ba1af99d-c5f8-4327-a10f-6b019bee6877 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:23.610009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ba1af99d-c5f8-4327-a10f-6b019bee6877 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:23.610734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ba1af99d-c5f8-4327-a10f-6b019bee6877 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.611664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ba1af99d-c5f8-4327-a10f-6b019bee6877 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:23.612120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ba1af99d-c5f8-4327-a10f-6b019bee6877 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:23.764739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:23.777223 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fb609954-d37f-4cba-bf51-7c5c5efa3827 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.308840 Apr 30 21:29:23.778998 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2212/4330] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:23 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:24.158394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:24.159303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:24.166557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.166557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.167263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.167714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.177531 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ba1af99d-c5f8-4327-a10f-6b019bee6877 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "POST /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922/action" status: 202 len: 52 microversion: 2.47 time: 0.580064 Apr 30 21:29:24.178674 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2119/4331] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:29:23 2022] POST /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922/action => generated 52 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 30 21:29:24.190224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:24.190818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:24.200925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.201414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.202229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.202872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.239223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:29:24.340424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:24.348420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4cadd9e-1a56-4c28-b079-45adfdd8bca1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1502 microversion: 2.1 time: 0.195029 Apr 30 21:29:24.349137 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2213/4332] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:24 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:24.365388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:24.366638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:24.379697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.379697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.379697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.379697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.528979 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.network.security_group_api [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Removing security group 493c1a9e-dab0-43ad-9a6f-638d130ca67b from port 432d721f-3bf6-4293-bd4a-313b2128a6fb Apr 30 21:29:24.551004 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8420a465-24f2-434f-908c-4586e2ab63a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 204 len: 0 microversion: 2.47 time: 0.364713 Apr 30 21:29:24.555931 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2120/4333] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:29:24 2022] DELETE /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:29:24.560659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:24.562099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:24.573003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.573503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.574326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.574781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.705219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:24.717172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:24.719163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:24.720928 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e92f5b00-c5f4-4b37-9926-fea9c8f420b1 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1365 microversion: 2.47 time: 0.164419 Apr 30 21:29:24.721479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2121/4334] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:24 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:24.795255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:24.796094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:24.802217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.802674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:24.804093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:24.804723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:25.228340 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1597e82-c08a-49d9-a5a5-1fb57367a5de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0/action" status: 202 len: 0 microversion: 2.1 time: 0.866651 Apr 30 21:29:25.229290 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2214/4335] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:29:24 2022] POST /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0/action => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:29:25.237897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:25.238914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:25.261166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:25.261939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:25.262070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:25.263224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:25.263961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:25.270903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88a87b7d-2af6-4421-9dad-a2e3d12bfee3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.479752 Apr 30 21:29:25.275764 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2122/4336] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:24 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:25.363601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-fd88b6e1-5961-480f-9160-0c119a9e2076 req-f4120dec-a374-4f56-8560-0dca2a37bedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "563b93e0-a029-49fe-a501-1c8c192370d0", "tag": "432d721f-3bf6-4293-bd4a-313b2128a6fb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:25.385567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fd88b6e1-5961-480f-9160-0c119a9e2076 req-f4120dec-a374-4f56-8560-0dca2a37bedb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:25.386731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fd88b6e1-5961-480f-9160-0c119a9e2076 req-f4120dec-a374-4f56-8560-0dca2a37bedb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:25.425182 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-fd88b6e1-5961-480f-9160-0c119a9e2076 req-f4120dec-a374-4f56-8560-0dca2a37bedb service nova] Creating event network-changed:432d721f-3bf6-4293-bd4a-313b2128a6fb for instance 563b93e0-a029-49fe-a501-1c8c192370d0 on nch2-master-1 Apr 30 21:29:25.432176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-fd88b6e1-5961-480f-9160-0c119a9e2076 req-f4120dec-a374-4f56-8560-0dca2a37bedb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072808 Apr 30 21:29:25.433157 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2123/4337] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:25.741980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:25.743462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:25.757879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:25.758268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:25.759243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:25.763612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:25.765337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:25.768186 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80453b37-a3db-4619-ab01-1b7804ed558b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1460 microversion: 2.1 time: 0.534167 Apr 30 21:29:25.784010 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2215/4338] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:25 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1460 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:25.806939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:25.812467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:25.817716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:25.818195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:25.819046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:25.819480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:26.012518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:26.031000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:26.035882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:26.039669 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49913e40-1429-41b3-b49c-994562241d03 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1365 microversion: 2.47 time: 0.303780 Apr 30 21:29:26.041370 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2124/4339] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:25 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:26.292630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:26.293523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:26.296543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:26.302089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:26.303026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:26.304109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-654e0807-75c8-491a-a48f-5da2d9fc66de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.514872 Apr 30 21:29:26.304275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:26.304711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:26.305187 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2216/4340] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:25 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:26.330116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:26.330724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:26.339890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:26.340349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:26.341140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:26.341581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:26.735055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:26.751090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:26.757246 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-33dd352f-5227-406b-ae51-9331cf581d10 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.430959 Apr 30 21:29:26.770160 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2217/4341] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:26.775794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:26.776632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:26.780753 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4d38f621-01af-4fb8-8442-09eb9e8ad8a1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.493041 Apr 30 21:29:26.782289 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2125/4342] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:26 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:26.784830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:26.785304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:26.786350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:26.786664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:27.060994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:27.062498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:27.073145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:27.073901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:27.079617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:27.080644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:27.221975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:27.233822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:27.244967 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eb61ab6a-0b9c-4c35-8ec3-6a5eb090e00b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.473547 Apr 30 21:29:27.246094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:27.248062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:27.255370 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7a24a991-d4d2-4e79-9826-fcdfc8841b2f tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1365 microversion: 2.47 time: 0.199579 Apr 30 21:29:27.256248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2126/4343] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:27 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:29:27.260709 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2218/4344] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:26 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:27.264708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:27.265338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:27.271716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:27.273062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:27.274168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:27.274839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:27.798855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:27.799489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:27.807176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:27.807880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:27.808677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:27.809298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:27.945268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:27.954682 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9d9bb70e-a80b-4385-b61c-ea0cd99ddaa7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.693752 Apr 30 21:29:27.955718 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2127/4345] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:27 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:28.128597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:28.128820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1137388507", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "6d21022d-393a-4eff-ba51-560f37353f44"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:28.144750 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7027e79f-a2c4-4ac0-a997-2b2737da7ac2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.349505 Apr 30 21:29:28.155599 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2219/4346] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:27 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:28.224335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] validate_networks() for [('6d21022d-393a-4eff-ba51-560f37353f44', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:29:28.293001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:28.294120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:28.300879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:28.301355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:28.302174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:28.302623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:28.376350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:28.378381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:28.378381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lazy-loading 'fault' on Instance uuid 34787c04-8468-41fd-99f5-63400119a922 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:29:28.535325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:28.550882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:28.552751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00258107f1e64ee489d35b481aec2198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fa1520caa74e8fa7af9cda4044db7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:28.554588 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b75db1ed-150b-4f1d-b603-f07a67a9ad0a tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 200 len: 1370 microversion: 2.47 time: 0.274737 Apr 30 21:29:28.555993 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2220/4347] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:28 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 1370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:29:29.168116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:29.171240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:29.186083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.187164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.188866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.189579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.196962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:29:29.198099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:29:29.198998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:29:29.199881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:29:29.201729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:29:29.221712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.222598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.223680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.224504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.248702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:29:29.255590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Getting quotas for user 20b4082fa07249e2b6dfb9b4506ab398 and project 3364787934af4f59b17a58b380fe95da. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:29:29.279530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:29:29.282526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:29:29.451358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d22084f1-aa85-4975-808e-c4be33b06b0e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324820 Apr 30 21:29:29.453879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:29.455322 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2128/4348] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:29:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:29:29.471183 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0e17d9a-a871-496c-a582-77d53640db22 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.311211 Apr 30 21:29:29.471541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2221/4349] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:29 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:29.480593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e4849585-86e4-4785-b7b5-5f05a7b2c2d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:29.502475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e4849585-86e4-4785-b7b5-5f05a7b2c2d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:29.576818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:29.578332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] [instance: 34787c04-8468-41fd-99f5-63400119a922] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:29.588710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.589483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.591392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.592067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.609252 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] HTTP exception thrown: Instance 34787c04-8468-41fd-99f5-63400119a922 could not be found. Apr 30 21:29:29.610191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] Returning 404 to user: Instance 34787c04-8468-41fd-99f5-63400119a922 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:29.611871 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2675d6ae-6dc6-496f-87c3-df8d5d2537a5 tempest-ServersAaction247Test-1051801679 tempest-ServersAaction247Test-1051801679-project] 10.222.0.23 "GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922" status: 404 len: 111 microversion: 2.47 time: 0.040637 Apr 30 21:29:29.612950 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2222/4350] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:29:29 2022] GET /compute/v2.1/servers/34787c04-8468-41fd-99f5-63400119a922 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:29:29.666587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e4849585-86e4-4785-b7b5-5f05a7b2c2d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:29.678899 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e4849585-86e4-4785-b7b5-5f05a7b2c2d7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1215 microversion: 2.1 time: 0.216317 Apr 30 21:29:29.694422 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2129/4351] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:29 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:29.913456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9f666f6e-0ef9-4b90-9f4a-fb6cff772f73 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:29.914352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9f666f6e-0ef9-4b90-9f4a-fb6cff772f73 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:29.920777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f666f6e-0ef9-4b90-9f4a-fb6cff772f73 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.921534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f666f6e-0ef9-4b90-9f4a-fb6cff772f73 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.922681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f666f6e-0ef9-4b90-9f4a-fb6cff772f73 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:29.923357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f666f6e-0ef9-4b90-9f4a-fb6cff772f73 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:29.959862 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9f666f6e-0ef9-4b90-9f4a-fb6cff772f73 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/ips" status: 200 len: 149 microversion: 2.1 time: 0.293939 Apr 30 21:29:29.959862 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2223/4352] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:29:29 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/ips => generated 149 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:30.495800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:30.500573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:30.512743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:30.514099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:30.515121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:30.515810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:30.698258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:30.698970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:30.727919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:30.729508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:30.730502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:30.731182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:30.733497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:30.741911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c180d5e3-5a4c-4af9-bf9e-4c87d580f830 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.257837 Apr 30 21:29:30.746031 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2130/4353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:30 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:30.927319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:30.938661 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-866d7d1b-56cf-4198-9e75-fa013c9a7b90 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1219 microversion: 2.1 time: 0.245988 Apr 30 21:29:30.940580 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2224/4354] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:30 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1219 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:31.414670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cf471771-a83a-48bf-97b6-2f9f78acc87c req-3695405b-70e2-4cef-9840-6661f6a81ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc46f81-a8bd-46ba-b2c4-6a859c458690", "name": "network-vif-plugged", "status": "completed", "tag": "0909419b-0751-4574-88cd-5569bff0727a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:31.429268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cf471771-a83a-48bf-97b6-2f9f78acc87c req-3695405b-70e2-4cef-9840-6661f6a81ab0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:31.433096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cf471771-a83a-48bf-97b6-2f9f78acc87c req-3695405b-70e2-4cef-9840-6661f6a81ab0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:31.449726 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cf471771-a83a-48bf-97b6-2f9f78acc87c req-3695405b-70e2-4cef-9840-6661f6a81ab0 service nova] Creating event network-vif-plugged:0909419b-0751-4574-88cd-5569bff0727a for instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 on nch1-master-1 Apr 30 21:29:31.470840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cf471771-a83a-48bf-97b6-2f9f78acc87c req-3695405b-70e2-4cef-9840-6661f6a81ab0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062659 Apr 30 21:29:31.471459 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2131/4355] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:31.761564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:31.762206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:31.768869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:31.769410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:31.770325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:31.770848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:31.959186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:31.960181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:31.972369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:31.973041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:31.973944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:31.974603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:32.121886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:32.149411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a7c8fa2e-d146-440f-8240-864cbf078661 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1267 microversion: 2.1 time: 0.195831 Apr 30 21:29:32.168586 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2132/4356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:31 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:32.168901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:32.182976 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ebed34b-725b-4c3e-bbe0-1624ceef64b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1316 microversion: 2.1 time: 0.426505 Apr 30 21:29:32.196019 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2225/4357] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:31 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:33.027103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b08ce48b-427b-4e2c-8fb6-29fce76e8e58"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:33.029034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:33.036195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:33.037038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:33.038541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:33.039212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:33.178735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:33.179610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:33.197611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:33.200105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:33.202511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:33.204285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:33.447143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:33.467319 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-28189964-df4a-45e1-882b-3c2a7f9c9bcb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1273 microversion: 2.1 time: 0.294664 Apr 30 21:29:33.468033 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2226/4358] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:33 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:33.486051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:33.486999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:33.497798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:33.498262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:33.500483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:33.502530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:33.841385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:33.851792 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1e813808-9195-400b-9359-b6e98019c574 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.382646 Apr 30 21:29:33.852493 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2227/4359] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:33 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:34.047537 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "POST /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024036 Apr 30 21:29:34.053062 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2133/4360] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:29:33 2022] POST /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments => generated 194 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:34.075547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-353566469", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:34.161974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] validate_networks() for [('c7cbed3c-359b-4472-8bf9-f34e2c55b91b', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:29:34.494376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:34.495417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:34.508775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:34.511229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:34.512785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:34.514410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:35.225727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:35.229283 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-92c57e01-95b7-40eb-9f22-bbba47d6a64e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.747392 Apr 30 21:29:35.243393 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2134/4361] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:34 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:35.432839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:29:35.434914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:29:35.436342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:29:35.438831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:29:35.440003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:29:35.456436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:35.457720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:35.459660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:35.460530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:35.491570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Getting quotas for project 3383c2433214484eb41e99aacb653b80. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:29:35.500011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Getting quotas for user baf1d13615bc491ab98d2a644e681c12 and project 3383c2433214484eb41e99aacb653b80. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:29:35.518540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:29:35.523362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:29:35.736829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a02512a-9bb7-4992-a42d-0395b3cb4245 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.666076 Apr 30 21:29:35.737575 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2228/4362] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:29:35.748613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8cc24d46-c69e-458c-b1ed-76a95d8d431d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:35.749232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8cc24d46-c69e-458c-b1ed-76a95d8d431d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:35.886451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8cc24d46-c69e-458c-b1ed-76a95d8d431d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:35.904415 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8cc24d46-c69e-458c-b1ed-76a95d8d431d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1216 microversion: 2.1 time: 0.149068 Apr 30 21:29:35.905085 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2135/4363] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:35 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:36.250565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:36.251364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:36.261964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:36.262738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:36.293453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:36.293453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:36.915347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c038f311-9da6-4d87-8716-497bc9008040 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:36.917367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c038f311-9da6-4d87-8716-497bc9008040 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:37.034308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:37.070997 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ad7c023-f0df-4450-bb90-4df2324619df tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.826322 Apr 30 21:29:37.077277 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2229/4364] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:36 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:37.180058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c038f311-9da6-4d87-8716-497bc9008040 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:37.189211 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c038f311-9da6-4d87-8716-497bc9008040 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1216 microversion: 2.1 time: 0.281387 Apr 30 21:29:37.190955 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2136/4365] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:36 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1216 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:38.093739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:38.094924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:38.102485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:38.102943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:38.103814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:38.104289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:38.214243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:38.225957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:38.286794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:38.288135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:38.289063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:38.295649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:38.455191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:38.482081 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ddfbfaa5-711e-4fd5-a85b-09d9b47cb7c1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.392158 Apr 30 21:29:38.492781 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2230/4366] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:38 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:38.506714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-73ab387c-753f-4013-88cd-68ec4404a026 req-098b80ce-ac5c-4dac-860c-44a4564d11dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78ceea4-5d4e-46b9-a50d-18210101ab3f", "tag": "f2e67c00-e892-4977-95b6-739f701898d8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:38.537022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-73ab387c-753f-4013-88cd-68ec4404a026 req-098b80ce-ac5c-4dac-860c-44a4564d11dd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:38.541839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-73ab387c-753f-4013-88cd-68ec4404a026 req-098b80ce-ac5c-4dac-860c-44a4564d11dd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:38.574960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:38.579061 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-73ab387c-753f-4013-88cd-68ec4404a026 req-098b80ce-ac5c-4dac-860c-44a4564d11dd service nova] Creating event network-changed:f2e67c00-e892-4977-95b6-739f701898d8 for instance d78ceea4-5d4e-46b9-a50d-18210101ab3f on nch1-master-1 Apr 30 21:29:38.591271 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6172ecd7-211a-4c13-a4c7-a19f96326eae tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1268 microversion: 2.1 time: 0.381272 Apr 30 21:29:38.592343 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2137/4367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:38 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1268 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:38.600807 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-73ab387c-753f-4013-88cd-68ec4404a026 req-098b80ce-ac5c-4dac-860c-44a4564d11dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104372 Apr 30 21:29:38.602538 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2231/4368] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:38.978768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:38.979737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:38.992058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:38.996855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:38.998020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:38.998647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:39.134260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-952975873", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "67da36fe-d1c8-44c5-82e3-244a386b97d9"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:39.162340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lazy-loading 'services' on Instance uuid 576b1918-2d33-4134-acbc-e25ba61935da {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:29:39.206462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] validate_networks() for [('67da36fe-d1c8-44c5-82e3-244a386b97d9', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:29:39.487955 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3d54811-1df6-421a-a6f4-88f2567728ca tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments/b08ce48b-427b-4e2c-8fb6-29fce76e8e58" status: 202 len: 0 microversion: 2.1 time: 0.513771 Apr 30 21:29:39.493791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2232/4369] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:29:38 2022] DELETE /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments/b08ce48b-427b-4e2c-8fb6-29fce76e8e58 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:29:39.505072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cc9ba83-6688-4095-8d53-74fd1d82f6a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:39.506273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cc9ba83-6688-4095-8d53-74fd1d82f6a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:39.514702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc9ba83-6688-4095-8d53-74fd1d82f6a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:39.515453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc9ba83-6688-4095-8d53-74fd1d82f6a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:39.518022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc9ba83-6688-4095-8d53-74fd1d82f6a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:39.518599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cc9ba83-6688-4095-8d53-74fd1d82f6a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:39.558126 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cc9ba83-6688-4095-8d53-74fd1d82f6a5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062282 Apr 30 21:29:39.567353 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2233/4370] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:29:39 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:39.567353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:39.567917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:39.575411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:39.576171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:39.588515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:39.588515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:40.163636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:40.183971 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3f37022e-c9f5-46d5-9002-3e8f4d1441e6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.620773 Apr 30 21:29:40.184552 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2234/4371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:39 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:40.189342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:40.189988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:40.206855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:40.207317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:40.208111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:40.208556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:40.433622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:40.442983 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-228749f5-bfe6-4ca0-8db2-8b4e1432e187 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1274 microversion: 2.1 time: 0.257171 Apr 30 21:29:40.444561 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2235/4372] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:40 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:40.564036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:29:40.570693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2fea6d8-cf8e-4095-8874-ead8ed6d31c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:40.570950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:29:40.577231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:29:40.577231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:29:40.577231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:29:40.578094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2fea6d8-cf8e-4095-8874-ead8ed6d31c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:40.588970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2fea6d8-cf8e-4095-8874-ead8ed6d31c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:40.591719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:40.592571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2fea6d8-cf8e-4095-8874-ead8ed6d31c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:40.593559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2fea6d8-cf8e-4095-8874-ead8ed6d31c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:40.594207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2fea6d8-cf8e-4095-8874-ead8ed6d31c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:40.594894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:40.597581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:40.598322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:40.637744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Getting quotas for project 4e881eef596f442ea5e731596de728a3. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:29:40.649438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Getting quotas for user c9945e69c5714cd4b1d2667969eaef2a and project 4e881eef596f442ea5e731596de728a3. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:29:40.657580 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2fea6d8-cf8e-4095-8874-ead8ed6d31c3 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091319 Apr 30 21:29:40.675942 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2236/4373] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:29:40 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:29:40.687169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:29:40.694664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:29:40.875790 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e6bc2f4-7003-452e-9065-c18109fb7dd6 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039933 Apr 30 21:29:40.880433 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2138/4374] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:29:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:29:40.892075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08faaebe-7156-4c9c-9dcf-adaa46c6a934 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:40.892714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-08faaebe-7156-4c9c-9dcf-adaa46c6a934 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:41.089861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08faaebe-7156-4c9c-9dcf-adaa46c6a934 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:41.102904 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08faaebe-7156-4c9c-9dcf-adaa46c6a934 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1224 microversion: 2.1 time: 0.212579 Apr 30 21:29:41.115423 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2237/4375] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:40 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1224 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:41.202480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:41.203460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:41.214707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:41.222900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:41.223940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:41.226015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:41.461977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:41.463629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:41.471827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:41.472368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:41.473312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:41.473885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:41.946181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:41.957637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:41.959708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2d963308-b03c-4ada-8d49-cd5e47b0c7a2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.762410 Apr 30 21:29:41.967944 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b3239c63-d14d-4d52-b3e9-5f871fc2e239 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1316 microversion: 2.1 time: 0.511073 Apr 30 21:29:41.968637 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2238/4376] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:41 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:41.970919 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2139/4377] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:41 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:41.973898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cff0de7e-018d-4dbf-a9c8-3309cf25e4eb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:41.975917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cff0de7e-018d-4dbf-a9c8-3309cf25e4eb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:41.984042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cff0de7e-018d-4dbf-a9c8-3309cf25e4eb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:41.987057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cff0de7e-018d-4dbf-a9c8-3309cf25e4eb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:41.987057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cff0de7e-018d-4dbf-a9c8-3309cf25e4eb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:41.987057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cff0de7e-018d-4dbf-a9c8-3309cf25e4eb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.020359 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cff0de7e-018d-4dbf-a9c8-3309cf25e4eb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050483 Apr 30 21:29:42.036289 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2239/4378] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:29:41 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:29:42.118406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:42.118406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:42.120328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d539a22c-43e2-4568-9886-3d0e2f3e9d95 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:42.120952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d539a22c-43e2-4568-9886-3d0e2f3e9d95 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:42.133528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.138277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.141654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.141654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.174345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:29:42.203314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d539a22c-43e2-4568-9886-3d0e2f3e9d95 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:42.228654 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d539a22c-43e2-4568-9886-3d0e2f3e9d95 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1224 microversion: 2.1 time: 0.112008 Apr 30 21:29:42.229887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2240/4379] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:42 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:42.534523 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-303063ce-d3bb-45aa-8f11-38114c6c4ab0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 204 len: 0 microversion: 2.1 time: 0.422609 Apr 30 21:29:42.535220 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2140/4380] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:29:42 2022] DELETE /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:29:42.544040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:42.545430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:42.554622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.555079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.556073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.556743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.831366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:42.842676 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a08ef23d-77ec-4ed6-a82f-413f5485f73d tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1678 microversion: 2.1 time: 0.302366 Apr 30 21:29:42.843272 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2241/4381] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:42 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1678 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:42.978401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:42.979823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:42.984663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:42.985295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:42.986215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.986680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.987471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.987922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.996635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.998463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:42.998463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:42.998463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:43.325153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:43.338048 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ac95af7-e7f6-4d40-87d2-568f538f76c0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.362738 Apr 30 21:29:43.338048 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2141/4382] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:42 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:43.345030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4046b180-1272-49c6-a37d-2ec4dc99e5e7 req-b90db0b1-428e-400f-a220-0be125a7ec83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31cef50-72cc-494d-a5fe-64b4621e25f4", "tag": "da107f90-c47b-440c-bbe6-6ed3d39cfbb1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:43.367664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4046b180-1272-49c6-a37d-2ec4dc99e5e7 req-b90db0b1-428e-400f-a220-0be125a7ec83 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:43.368246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4046b180-1272-49c6-a37d-2ec4dc99e5e7 req-b90db0b1-428e-400f-a220-0be125a7ec83 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:43.384533 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4046b180-1272-49c6-a37d-2ec4dc99e5e7 req-b90db0b1-428e-400f-a220-0be125a7ec83 service nova] Creating event network-changed:da107f90-c47b-440c-bbe6-6ed3d39cfbb1 for instance f31cef50-72cc-494d-a5fe-64b4621e25f4 on nch2-master-1 Apr 30 21:29:43.398202 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4046b180-1272-49c6-a37d-2ec4dc99e5e7 req-b90db0b1-428e-400f-a220-0be125a7ec83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056428 Apr 30 21:29:43.399525 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2142/4383] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:43.405888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:43.407987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:43.409057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:43.417932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:43.418391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:43.419229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:43.419812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:43.421074 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b8355e1-ea6c-43ea-b12d-057d2d3e6d45 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1316 microversion: 2.1 time: 0.440337 Apr 30 21:29:43.422524 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2242/4384] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:42 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:43.591131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:43.602526 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-039ea1bf-2a1d-4b77-b68e-4a5f16ed87e0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1228 microversion: 2.1 time: 0.201065 Apr 30 21:29:43.603835 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2143/4385] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:43 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1228 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:43.871394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:43.872959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:43.889826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:43.890291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:43.891116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:43.891560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:44.147168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:44.155379 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-446a79b2-be83-4f45-ab43-c9945ad6abc7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1678 microversion: 2.1 time: 0.299038 Apr 30 21:29:44.167152 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2243/4386] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:43 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1678 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:44.355038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:44.355779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:44.370191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:44.374306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:44.374306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:44.374306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:44.440490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:44.443678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:44.451852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:44.452616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:44.453908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:44.455019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:44.807009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:44.815383 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7c111cf8-425b-40d2-a2fa-cfce525d5405 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.465373 Apr 30 21:29:44.830669 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2144/4387] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:44 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:44.835723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:44.836358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:44.842560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:44.843083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:44.853151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:44.853151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:44.936513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:44.950694 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-988270a6-c02a-4813-a186-264e6402e757 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1316 microversion: 2.1 time: 0.515446 Apr 30 21:29:44.958439 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2244/4388] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:44 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:44.993736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:45.005124 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-28612a97-414b-47e7-a985-6e076a24f8bf tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1276 microversion: 2.1 time: 0.173211 Apr 30 21:29:45.008026 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2145/4389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:44 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:45.173519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:45.175044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:45.189679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:45.196238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:45.196238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:45.196238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:45.672942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:45.685244 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19ec61d2-cd18-4b8f-a15f-da1b8dbc6ab7 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1678 microversion: 2.1 time: 0.515694 Apr 30 21:29:45.686120 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2245/4390] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:45 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1678 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:45.835509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:45.835509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:45.843961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:45.844594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:45.845590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:45.846070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:45.975414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:45.976736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:45.984175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:45.985103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:45.985935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:45.986373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:46.321896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:46.329751 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d979595a-a9e7-4b3f-96f2-4d24850c259b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.500397 Apr 30 21:29:46.338903 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2146/4391] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:45 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:46.344115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:46.344925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:46.362765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:46.363231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:46.364040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:46.364473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:46.558629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:46.566282 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc96d601-a2d9-4fd3-b259-66ddee769ad9 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1282 microversion: 2.1 time: 0.225849 Apr 30 21:29:46.566872 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2147/4392] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:46 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:46.587254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:46.601020 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-078be40b-2383-4f94-9627-2eb5f39b4a7e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1316 microversion: 2.1 time: 0.630737 Apr 30 21:29:46.603019 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2246/4393] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:45 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:46.703911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:46.704536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:46.715377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:46.715907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:46.717986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:46.718486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:46.905485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:46.918442 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fdf8ae54-1e65-4139-8f5f-0c205f0323f5 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1611 microversion: 2.1 time: 0.218656 Apr 30 21:29:46.921248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2148/4394] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:46 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1611 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:47.149607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-19e54fe3-775f-4d18-9906-f354b21123f9 req-bee484f7-89d9-4e1c-ad82-9228fa3ad916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576b1918-2d33-4134-acbc-e25ba61935da", "name": "network-vif-deleted", "tag": "2e7e973a-d313-4fb5-98ef-fc330c4aab05"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:47.163498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-19e54fe3-775f-4d18-9906-f354b21123f9 req-bee484f7-89d9-4e1c-ad82-9228fa3ad916 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.164184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-19e54fe3-775f-4d18-9906-f354b21123f9 req-bee484f7-89d9-4e1c-ad82-9228fa3ad916 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.169145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a924bc65-ee83-427d-9561-bc30f4ed1108 req-54fe870f-2ae5-4a3c-941c-7e634bf7d47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78ceea4-5d4e-46b9-a50d-18210101ab3f", "name": "network-vif-plugged", "status": "completed", "tag": "f2e67c00-e892-4977-95b6-739f701898d8"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:47.190031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a924bc65-ee83-427d-9561-bc30f4ed1108 req-54fe870f-2ae5-4a3c-941c-7e634bf7d47f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.190031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a924bc65-ee83-427d-9561-bc30f4ed1108 req-54fe870f-2ae5-4a3c-941c-7e634bf7d47f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.208248 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a924bc65-ee83-427d-9561-bc30f4ed1108 req-54fe870f-2ae5-4a3c-941c-7e634bf7d47f service nova] Creating event network-vif-plugged:f2e67c00-e892-4977-95b6-739f701898d8 for instance d78ceea4-5d4e-46b9-a50d-18210101ab3f on nch1-master-1 Apr 30 21:29:47.222229 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-19e54fe3-775f-4d18-9906-f354b21123f9 req-bee484f7-89d9-4e1c-ad82-9228fa3ad916 service nova] Creating event network-vif-deleted:2e7e973a-d313-4fb5-98ef-fc330c4aab05 for instance 576b1918-2d33-4134-acbc-e25ba61935da on nch1-master-1 Apr 30 21:29:47.230121 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-19e54fe3-775f-4d18-9906-f354b21123f9 req-bee484f7-89d9-4e1c-ad82-9228fa3ad916 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084368 Apr 30 21:29:47.231987 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2247/4395] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:47.245009 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a924bc65-ee83-427d-9561-bc30f4ed1108 req-54fe870f-2ae5-4a3c-941c-7e634bf7d47f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079243 Apr 30 21:29:47.246468 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2149/4396] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:47.388268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:47.399205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:47.409546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.412323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.419021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.419738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.584125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:47.586713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:47.598266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.599051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.600879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.603546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.789395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:47.799647 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35188d02-35a2-45ea-91ec-66a5185a2302 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.444257 Apr 30 21:29:47.803799 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2248/4397] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:47 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:47.816988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:47.821685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:47.830597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.831049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.837886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.838554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.925354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:47.940488 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a4798f9-bc33-43c1-9bf3-e9379ff0a3f0 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1324 microversion: 2.1 time: 0.361264 Apr 30 21:29:47.944311 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2150/4398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:47 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:47.956007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:47.961355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:47.974863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.978252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:47.979420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:47.980295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:48.033563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:48.035062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:48.036220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lazy-loading 'fault' on Instance uuid 576b1918-2d33-4134-acbc-e25ba61935da {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:29:48.131591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9b55d852942538c3ad8f317dcd73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ceedad6e134d94ac8758f8385a47e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:48.143139 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45ed093e-e22b-45eb-9629-a93aa06ab7ff tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 200 len: 1329 microversion: 2.1 time: 0.197302 Apr 30 21:29:48.144641 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2151/4399] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:47 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 1329 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:48.175619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:48.183105 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26d10789-0b86-4c11-b9af-30be4fac04db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1316 microversion: 2.1 time: 0.376397 Apr 30 21:29:48.192257 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2249/4400] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:47 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:48.821105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:48.822127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:48.834935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5fbcf493-ca4a-4e62-9c4a-8b3d74a428a2 req-280a4298-a6b3-4de0-83ba-124fdea13029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f937ee40-00e0-463e-a46f-98be4b2340a6", "tag": "711a5170-97b9-4376-a31c-71464d032129"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:48.839887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:48.840455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:48.841319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:48.841936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:48.852328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5fbcf493-ca4a-4e62-9c4a-8b3d74a428a2 req-280a4298-a6b3-4de0-83ba-124fdea13029 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:48.857936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5fbcf493-ca4a-4e62-9c4a-8b3d74a428a2 req-280a4298-a6b3-4de0-83ba-124fdea13029 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:48.921430 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5fbcf493-ca4a-4e62-9c4a-8b3d74a428a2 req-280a4298-a6b3-4de0-83ba-124fdea13029 service nova] Creating event network-changed:711a5170-97b9-4376-a31c-71464d032129 for instance f937ee40-00e0-463e-a46f-98be4b2340a6 on nch1-master-1 Apr 30 21:29:48.927223 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5fbcf493-ca4a-4e62-9c4a-8b3d74a428a2 req-280a4298-a6b3-4de0-83ba-124fdea13029 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097282 Apr 30 21:29:48.932145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2250/4401] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:48.963238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:48.963959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:48.976144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:48.976927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:48.977934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:48.978544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:49.228800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:49.256372 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5114149-f5c4-417d-b7c3-f307ee646fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1315 microversion: 2.1 time: 0.439205 Apr 30 21:29:49.264495 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2152/4402] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:48 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:49.289305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:49.290186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:49.307656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:49.313695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:49.314908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:49.315580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:49.344560 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 576b1918-2d33-4134-acbc-e25ba61935da could not be found. Apr 30 21:29:49.345298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 576b1918-2d33-4134-acbc-e25ba61935da could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:49.346100 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7df46e4-ab6f-4c86-ae04-50f473db2c21 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 404 len: 111 microversion: 2.1 time: 0.080322 Apr 30 21:29:49.346674 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2153/4403] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:49 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:29:49.353594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:49.358525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:49.368213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:49.369516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:49.370802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:49.371480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:49.636950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:49.644806 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4749944a-86ae-472e-b4d2-9c2192c6817d tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1324 microversion: 2.1 time: 0.687851 Apr 30 21:29:49.650392 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2251/4404] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:48 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1324 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:49.655547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b44d65e2-ddd9-4531-ae9c-14bbbda4ca70 req-b44a3c6e-4e08-467c-87de-c52d2dee98b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31cef50-72cc-494d-a5fe-64b4621e25f4", "name": "network-vif-plugged", "status": "completed", "tag": "da107f90-c47b-440c-bbe6-6ed3d39cfbb1"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:49.665356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b44d65e2-ddd9-4531-ae9c-14bbbda4ca70 req-b44a3c6e-4e08-467c-87de-c52d2dee98b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:49.665843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b44d65e2-ddd9-4531-ae9c-14bbbda4ca70 req-b44a3c6e-4e08-467c-87de-c52d2dee98b8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:49.682355 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b44d65e2-ddd9-4531-ae9c-14bbbda4ca70 req-b44a3c6e-4e08-467c-87de-c52d2dee98b8 service nova] Creating event network-vif-plugged:da107f90-c47b-440c-bbe6-6ed3d39cfbb1 for instance f31cef50-72cc-494d-a5fe-64b4621e25f4 on nch2-master-1 Apr 30 21:29:49.687287 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b44d65e2-ddd9-4531-ae9c-14bbbda4ca70 req-b44a3c6e-4e08-467c-87de-c52d2dee98b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039486 Apr 30 21:29:49.687891 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2252/4405] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:49.694659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d73b4428-dcb9-44e3-a9b8-e1c6441f7222 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '.version_select at 0x7fdc13d7d700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:49.717674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:49.727408 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a072b40-00d9-4798-be86-ac1eaaba8d59 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1316 microversion: 2.1 time: 0.378839 Apr 30 21:29:49.728231 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2154/4406] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:49 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:49.816352 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d73b4428-dcb9-44e3-a9b8-e1c6441f7222 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67356959" status: 202 len: 0 microversion: 2.1 time: 0.127030 Apr 30 21:29:49.819701 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2253/4407] 10.222.0.23 () {58 vars in 1214 bytes} [Sat Apr 30 21:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67356959 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:29:49.859713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1511739888", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "b6efb226-82a9-469b-89a1-a066d2512523"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:49.919814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] validate_networks() for [('b6efb226-82a9-469b-89a1-a066d2512523', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:29:50.281569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:50.282745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:50.296442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.300037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.301066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.301692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.373223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:29:50.373727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:29:50.374148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:29:50.378314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:29:50.378314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:29:50.384908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.385366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.386213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.386653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.406643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Getting quotas for project af7d810b16a945cc921509e1c20d101d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:29:50.412974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Getting quotas for user f3e406059e394bc89a1bb7609c8d4236 and project af7d810b16a945cc921509e1c20d101d. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:29:50.425961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:29:50.428699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:29:50.556733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:50.566209 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-583fcbc6-abca-4940-9a78-47e73cfa2d2b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1502 microversion: 2.1 time: 0.289289 Apr 30 21:29:50.566883 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2254/4408] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:50 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:50.589630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3558433c-4c44-40a0-9634-e3b84dd93ed7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:50.592326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3558433c-4c44-40a0-9634-e3b84dd93ed7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:50.599883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3558433c-4c44-40a0-9634-e3b84dd93ed7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.600551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3558433c-4c44-40a0-9634-e3b84dd93ed7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.601851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3558433c-4c44-40a0-9634-e3b84dd93ed7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.602834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3558433c-4c44-40a0-9634-e3b84dd93ed7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.645103 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8145d688-e6ce-4635-aa87-12d923095edd tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914768 Apr 30 21:29:50.646944 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2155/4409] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:29:50.664732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-105d1419-9510-4405-9d3b-7681db416e98 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:50.668036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-105d1419-9510-4405-9d3b-7681db416e98 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:50.757233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-105d1419-9510-4405-9d3b-7681db416e98 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:50.760879 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-105d1419-9510-4405-9d3b-7681db416e98 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1217 microversion: 2.1 time: 0.107879 Apr 30 21:29:50.761707 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2156/4410] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:50 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:50.766717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:50.767664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:50.791404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.792505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.793727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.795373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.910076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3558433c-4c44-40a0-9634-e3b84dd93ed7 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f/action" status: 202 len: 0 microversion: 2.1 time: 0.328557 Apr 30 21:29:50.911351 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2255/4411] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:29:50 2022] POST /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:29:50.931555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:50.932354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:50.942157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.945207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:50.946698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:50.947471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:51.057045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:51.066072 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98533c96-d04d-4038-ad8f-b6e181bef4c8 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1324 microversion: 2.1 time: 0.303046 Apr 30 21:29:51.076546 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2157/4412] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:50 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1324 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:51.081811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:51.082378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:51.088882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:51.089352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:51.090184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:51.090639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:51.245842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:51.253338 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6892a804-a7f5-458d-87fc-6aa12b6ace5c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1316 microversion: 2.1 time: 0.339647 Apr 30 21:29:51.254264 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2256/4413] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:50 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:51.313493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:51.322914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0cf0b595-6c58-4e66-933a-9a3df584893f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1507 microversion: 2.1 time: 0.244750 Apr 30 21:29:51.326035 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2158/4414] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:51 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:51.778737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0db3a4e2-75ae-4af5-a834-52640c49b6e7 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:51.779391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0db3a4e2-75ae-4af5-a834-52640c49b6e7 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:51.836419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0db3a4e2-75ae-4af5-a834-52640c49b6e7 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:51.847132 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0db3a4e2-75ae-4af5-a834-52640c49b6e7 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1217 microversion: 2.1 time: 0.072848 Apr 30 21:29:51.847717 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2257/4415] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:51 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:52.086268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:52.087880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:52.094221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.094916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.095714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.096162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.248688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:52.256563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5990aee-2eb0-42e4-b95f-446fa183ec15 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1324 microversion: 2.1 time: 0.176799 Apr 30 21:29:52.257400 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2159/4416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:52 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:52.271984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:52.273203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:52.284760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.285429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.286433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.287937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.343259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:52.344187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:52.351572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.352031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.353065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.353511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.532247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:52.540987 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43c1b1e4-d1e1-470b-b17e-d215502ae1f8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1506 microversion: 2.1 time: 0.273713 Apr 30 21:29:52.544534 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2258/4417] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:52 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:52.563675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:52.564532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:52.573606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.574830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.574975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.576102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.597669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:52.608909 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e1b9a03a-66f8-4d2b-8c5a-27a042127e06 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1487 microversion: 2.1 time: 0.269727 Apr 30 21:29:52.609648 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2160/4418] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:52 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:52.617036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:29:52.627458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:52.631044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:52.634556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.635020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.635807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:52.636461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:52.660460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lazy-loading 'flavor' on Instance uuid d78ceea4-5d4e-46b9-a50d-18210101ab3f {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:29:53.036453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-98b37bc0-77eb-4d3d-bc37-953a451c48dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 204 len: 0 microversion: 2.1 time: 0.472215 Apr 30 21:29:53.040917 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2259/4419] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:29:52 2022] DELETE /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:29:53.058364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:53.062976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:53.068436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.069118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.070164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.071282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.177990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:53.185841 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ef5b52e-fe60-4be7-a5a7-628808fbfe47 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1269 microversion: 2.1 time: 0.143380 Apr 30 21:29:53.186431 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2260/4420] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:53 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:53.190890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:53.191675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:53.197638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.198127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.198902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.199343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.350615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:53.360199 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e8a8fc8c-cde9-4f56-acdb-46914c3f1337 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1512 microversion: 2.1 time: 0.172541 Apr 30 21:29:53.364092 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2261/4421] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:53 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:53.364232 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0321c469-1d37-42ff-aec7-4a07a1ae2410 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f/action" status: 202 len: 0 microversion: 2.1 time: 0.739320 Apr 30 21:29:53.364232 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2161/4422] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:29:52 2022] POST /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:29:53.374827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:53.375741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:53.382798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.383398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.384183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.384622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.385352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:53.386920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:53.395138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.395931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.397842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:53.398504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:53.600953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:53.605367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:53.608733 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ea62618-42c6-4c5a-99c2-08ddc958e6a1 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1324 microversion: 2.1 time: 0.245923 Apr 30 21:29:53.609336 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2262/4423] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:53 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:53.613116 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f1b3646b-0193-4279-bd5c-e850a3474a89 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1493 microversion: 2.1 time: 0.244921 Apr 30 21:29:53.613675 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2162/4424] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:53 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1493 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:54.202892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:54.203489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:54.211440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:54.211895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:54.212675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:54.213116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:54.284237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:54.302286 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18c108a5-5b47-4de4-9800-afc78a5380e5 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1269 microversion: 2.1 time: 0.103323 Apr 30 21:29:54.303003 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2263/4425] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:54 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:54.382295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:54.383601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:54.402814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:54.403582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:54.404544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:54.405447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:54.627498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:54.628799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:54.636687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:54.637223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:54.638255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:54.638883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:55.013827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:55.026667 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f9cb2f15-deec-4dd8-a9ba-f9de363cfc30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1512 microversion: 2.1 time: 0.651757 Apr 30 21:29:55.027436 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2163/4426] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:54 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1512 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:55.032448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:55.033066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:55.040246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:55.040770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:55.041578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:55.042187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:55.252017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:55.260701 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8be0e95d-a682-46cb-b33f-b3828c6fb7af tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1324 microversion: 2.1 time: 0.638448 Apr 30 21:29:55.261345 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2264/4427] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:54 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:55.265995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9e4b6b89-fae0-4ee4-885b-bc05f9730e19 req-2803a9b9-1ef3-48d4-a946-f72cec441c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f937ee40-00e0-463e-a46f-98be4b2340a6", "name": "network-vif-plugged", "status": "completed", "tag": "711a5170-97b9-4376-a31c-71464d032129"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:55.289373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9e4b6b89-fae0-4ee4-885b-bc05f9730e19 req-2803a9b9-1ef3-48d4-a946-f72cec441c0a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:55.290075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9e4b6b89-fae0-4ee4-885b-bc05f9730e19 req-2803a9b9-1ef3-48d4-a946-f72cec441c0a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:55.303685 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9e4b6b89-fae0-4ee4-885b-bc05f9730e19 req-2803a9b9-1ef3-48d4-a946-f72cec441c0a service nova] Creating event network-vif-plugged:711a5170-97b9-4376-a31c-71464d032129 for instance f937ee40-00e0-463e-a46f-98be4b2340a6 on nch1-master-1 Apr 30 21:29:55.308724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9e4b6b89-fae0-4ee4-885b-bc05f9730e19 req-2803a9b9-1ef3-48d4-a946-f72cec441c0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046016 Apr 30 21:29:55.309399 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2265/4428] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:55.324200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:55.327818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:55.337372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:55.340546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:55.341368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:55.342152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:55.408576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:55.418252 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-559296a5-559a-4ac9-8318-f89c489784c9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1514 microversion: 2.1 time: 0.389443 Apr 30 21:29:55.419104 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2164/4429] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:55 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:55.445717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:55.456088 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45f8e074-1a8d-422c-a750-1c89023dc94a tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1275 microversion: 2.1 time: 0.136012 Apr 30 21:29:55.457249 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2266/4430] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:55 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:55.638670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e2fed19c-5d29-4438-a534-689b926ac3e9 req-8bb37305-f911-4a7a-bcab-c4d98478d141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31cef50-72cc-494d-a5fe-64b4621e25f4", "name": "network-vif-deleted", "tag": "da107f90-c47b-440c-bbe6-6ed3d39cfbb1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:55.653059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e2fed19c-5d29-4438-a534-689b926ac3e9 req-8bb37305-f911-4a7a-bcab-c4d98478d141 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:55.655822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e2fed19c-5d29-4438-a534-689b926ac3e9 req-8bb37305-f911-4a7a-bcab-c4d98478d141 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:55.671178 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e2fed19c-5d29-4438-a534-689b926ac3e9 req-8bb37305-f911-4a7a-bcab-c4d98478d141 service nova] Creating event network-vif-deleted:da107f90-c47b-440c-bbe6-6ed3d39cfbb1 for instance f31cef50-72cc-494d-a5fe-64b4621e25f4 on nch2-master-1 Apr 30 21:29:55.679414 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e2fed19c-5d29-4438-a534-689b926ac3e9 req-8bb37305-f911-4a7a-bcab-c4d98478d141 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044845 Apr 30 21:29:55.683308 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2165/4431] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:56.044618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:56.046188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:56.057260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.061892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.061892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.061892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.097147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.097588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.098356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lazy-loading 'fault' on Instance uuid f31cef50-72cc-494d-a5fe-64b4621e25f4 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:29:56.142622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:56.152131 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af132b9b-2087-4d3a-9b39-d7620dab780d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 200 len: 1306 microversion: 2.1 time: 0.111943 Apr 30 21:29:56.153081 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2267/4432] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:56 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:56.278947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:56.284926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:56.287125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.287851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.288940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.289095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.441323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:56.442624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:56.453372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.454170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.457228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.458350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.498513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:56.510493 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e3da99b-8898-4f43-a63d-e21817a4c1cb tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1324 microversion: 2.1 time: 0.236009 Apr 30 21:29:56.520283 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2166/4433] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:56 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:56.535269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:56.535269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:56.535269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.535269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.535269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:56.535269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:56.803810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:56.812550 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b2cbab35-4346-4480-b1d8-bb6164736e13 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1514 microversion: 2.1 time: 0.376471 Apr 30 21:29:56.813136 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2268/4434] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:56 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:56.877192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:56.885386 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-347567fa-5caa-4414-9a5e-48d2044f1fb9 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1317 microversion: 2.1 time: 0.363218 Apr 30 21:29:56.902860 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2167/4435] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:56 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:57.170697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:57.171298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:57.178136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.178597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:57.179385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.179848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:57.213065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. Apr 30 21:29:57.214098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:57.215205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6835993d-f7df-4e4d-a276-1493817da6b6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 404 len: 111 microversion: 2.1 time: 0.048339 Apr 30 21:29:57.216358 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2269/4436] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:57 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:29:57.225691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:57.226397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:57.249048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.249514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:57.250345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.250798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:57.527674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:57.528295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:57.538072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.539348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:57.540444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.541119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:57.821459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:57.832401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:57.837012 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2b6a67c-d5aa-486e-aba8-1ea8847fce6e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1521 microversion: 2.1 time: 0.313077 Apr 30 21:29:57.844068 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2270/4437] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:57 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:29:57.844278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cc6613ae-85dd-4ae3-a33b-3cc52e875b65 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.622537 Apr 30 21:29:57.845389 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2168/4438] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:57 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:57.851658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:57.852955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:57.861235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.862491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:57.863470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:57.864101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.100888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:58.113378 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ffee6df3-1776-4eca-b047-758cd5477051 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.266302 Apr 30 21:29:58.114021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2169/4439] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:57 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:58.128226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:58.129042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:58.142569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.143110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.144016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.144943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.151411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] Calling method '.version_select at 0x7fdc205d4280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:58.152327 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:29:58.152327 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:29:58.154973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.155443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.174091 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] HTTP exception thrown: Instance is not a member of specified network Apr 30 21:29:58.182946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Returning 404 to user: Instance is not a member of specified network {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:58.182946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d4321431-17ae-4f5d-8de0-636bd4e2989c tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.057347 Apr 30 21:29:58.182946 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2170/4440] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 21:29:58 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6/ips/invalid => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:29:58.187256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:58.188224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:58.196572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.197331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.198411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.199051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.202112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.204331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.250754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.251229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.263267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-baf5e077-e689-43f8-9a83-ffa9a4571caf tempest-PortsAdminExtendedAttrsTestJSON-791463614 tempest-PortsAdminExtendedAttrsTestJSON-791463614-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.424602 Apr 30 21:29:58.266675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2271/4441] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:29:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:58.297457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1ece87a6-2149-4088-a022-32740648e3af tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:58.298739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1ece87a6-2149-4088-a022-32740648e3af tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:58.302362 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1ece87a6-2149-4088-a022-32740648e3af tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.031875 Apr 30 21:29:58.303074 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2272/4442] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:29:58 2022] POST /compute/v2.1/servers => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:29:58.320333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-701b551e-d1a6-41a2-8e2c-a132ae44b618 req-04a037c4-cf85-44f8-9f79-2e278859d5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98c505c-ce28-43b4-ab4d-1a72477ce0c6", "tag": "c7ee00e9-7450-4592-8d1d-f7c36c4915f4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:58.342606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-701b551e-d1a6-41a2-8e2c-a132ae44b618 req-04a037c4-cf85-44f8-9f79-2e278859d5f2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.343069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-701b551e-d1a6-41a2-8e2c-a132ae44b618 req-04a037c4-cf85-44f8-9f79-2e278859d5f2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.355613 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-701b551e-d1a6-41a2-8e2c-a132ae44b618 req-04a037c4-cf85-44f8-9f79-2e278859d5f2 service nova] Creating event network-changed:c7ee00e9-7450-4592-8d1d-f7c36c4915f4 for instance f98c505c-ce28-43b4-ab4d-1a72477ce0c6 on nch2-master-1 Apr 30 21:29:58.360881 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-701b551e-d1a6-41a2-8e2c-a132ae44b618 req-04a037c4-cf85-44f8-9f79-2e278859d5f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055198 Apr 30 21:29:58.361725 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2273/4443] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:58.369279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-556d1caf-66b4-49bc-b107-fdc283a7a9dd tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:58.370018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-556d1caf-66b4-49bc-b107-fdc283a7a9dd tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Failed to fetch instance by id 999 {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 30 21:29:58.370712 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-556d1caf-66b4-49bc-b107-fdc283a7a9dd tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] HTTP exception thrown: Instance 999 could not be found. Apr 30 21:29:58.371523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-556d1caf-66b4-49bc-b107-fdc283a7a9dd tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Returning 404 to user: Instance 999 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:29:58.372590 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-556d1caf-66b4-49bc-b107-fdc283a7a9dd tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008816 Apr 30 21:29:58.373650 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2274/4444] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:29:58 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:29:58.378971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:58.379935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:58.389326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.390596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.391354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.392080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.642812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:58.655055 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e9de0157-6231-431d-ab0e-ef77caf243de tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1317 microversion: 2.1 time: 0.476256 Apr 30 21:29:58.668452 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2171/4445] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:58 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:58.674003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:58.674417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:58.683677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.684436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.685444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.686334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.727257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:29:58.816669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:58.840742 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8671cdab-1ed8-4a7a-b0d6-44bf0ae6f189 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.457983 Apr 30 21:29:58.840742 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2275/4446] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:58 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:58.853516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9f3ea18a-7455-40d7-9816-555d11b09c68 req-d4cc59a4-0925-4b1b-aed6-36cb6533d731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78ceea4-5d4e-46b9-a50d-18210101ab3f", "name": "network-vif-plugged", "status": "completed", "tag": "f2e67c00-e892-4977-95b6-739f701898d8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:29:58.879198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9f3ea18a-7455-40d7-9816-555d11b09c68 req-d4cc59a4-0925-4b1b-aed6-36cb6533d731 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.879904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9f3ea18a-7455-40d7-9816-555d11b09c68 req-d4cc59a4-0925-4b1b-aed6-36cb6533d731 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.900823 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9f3ea18a-7455-40d7-9816-555d11b09c68 req-d4cc59a4-0925-4b1b-aed6-36cb6533d731 service nova] Creating event network-vif-plugged:f2e67c00-e892-4977-95b6-739f701898d8 for instance d78ceea4-5d4e-46b9-a50d-18210101ab3f on nch1-master-1 Apr 30 21:29:58.912669 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9f3ea18a-7455-40d7-9816-555d11b09c68 req-d4cc59a4-0925-4b1b-aed6-36cb6533d731 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073566 Apr 30 21:29:58.913981 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2276/4447] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:29:58.924715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:58.927543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:58.942178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.945658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:58.948479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:58.954728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:59.123268 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f47d82a7-11cf-4219-9b77-df0e84ebd010 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 204 len: 0 microversion: 2.1 time: 0.453258 Apr 30 21:29:59.125277 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2172/4448] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:29:58 2022] DELETE /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:29:59.134347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:59.134850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:59.149645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:59.152591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:59.153640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:59.157570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:59.492528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:59.502377 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c2bc7d8-75eb-4cdb-8e0a-17b6b2f360e1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.586995 Apr 30 21:29:59.511783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:59.517779 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2277/4449] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:58 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:59.529369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:59.532758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:59.532892 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab878f90-6041-46d6-8dac-d1be4b76ec5b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.402723 Apr 30 21:29:59.534215 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2173/4450] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:59 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:29:59.566819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:59.567391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:59.568822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:59.571566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:59.678590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:29:59.679873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:29:59.701862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:59.702565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:59.706986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:29:59.709301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:29:59.883479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:29:59.904590 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aee5d613-f9db-48ff-942f-36930cbb852e tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1527 microversion: 2.1 time: 0.384930 Apr 30 21:29:59.906566 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2278/4451] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:59 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1527 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:00.009567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:00.024674 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f6ec9b13-9c55-4ae3-95da-aa579078cbcb tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1317 microversion: 2.1 time: 0.353297 Apr 30 21:30:00.026831 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2174/4452] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:29:59 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:00.262558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:00.271760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:00.278412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.280032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:00.285194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.289226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:00.323366 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 576b1918-2d33-4134-acbc-e25ba61935da could not be found. Apr 30 21:30:00.324491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 576b1918-2d33-4134-acbc-e25ba61935da could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:00.326829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b65bd92b-b62e-4aba-ae25-e74960b76fb2 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 404 len: 111 microversion: 2.1 time: 0.069015 Apr 30 21:30:00.337202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:00.337858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 576b1918-2d33-4134-acbc-e25ba61935da] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:00.347527 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2279/4453] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:30:00 2022] DELETE /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:00.350420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.351056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:00.355936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.356860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:00.397915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 576b1918-2d33-4134-acbc-e25ba61935da could not be found. Apr 30 21:30:00.398562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 576b1918-2d33-4134-acbc-e25ba61935da could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:00.401600 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cc74a97c-a26f-4ae4-a4d6-33c1afd70fc8 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da" status: 404 len: 111 microversion: 2.1 time: 0.068527 Apr 30 21:30:00.402218 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2175/4454] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:00 2022] GET /compute/v2.1/servers/576b1918-2d33-4134-acbc-e25ba61935da => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:00.553044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:00.553891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:00.584846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.585486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:00.590609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.591270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:00.929728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:00.930833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:00.951576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.952787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:00.958916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:00.958916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:01.099504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:01.107987 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9fcb440a-2e14-4aaa-a302-869530425a5c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.561065 Apr 30 21:30:01.110416 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2280/4455] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:00 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:01.130880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:01.134566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:01.152320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:01.153702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:01.158569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:01.159234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:01.483941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:01.498523 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dbb87833-ac4f-4939-9878-3fddcbe09658 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1527 microversion: 2.1 time: 0.574539 Apr 30 21:30:01.499410 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2176/4456] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:00 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1527 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:01.597334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:01.610098 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0270da5-0015-4cd6-9fd2-456757d34539 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1317 microversion: 2.1 time: 0.478756 Apr 30 21:30:01.614316 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2281/4457] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:01 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:02.128551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:02.129703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:02.150430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:02.151359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:02.152048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:02.152505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:02.342609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:02.354479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-38728f5a-9769-43d8-b8a5-7687d467bdaf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.229833 Apr 30 21:30:02.358364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2177/4458] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:02 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:02.481392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-30cc932a-55d6-4385-bc10-0fecfbf667aa req-98459a25-ea11-4412-89f1-b8186f4dc682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f937ee40-00e0-463e-a46f-98be4b2340a6", "name": "network-vif-deleted", "tag": "711a5170-97b9-4376-a31c-71464d032129"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:02.498550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-30cc932a-55d6-4385-bc10-0fecfbf667aa req-98459a25-ea11-4412-89f1-b8186f4dc682 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:02.501467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-30cc932a-55d6-4385-bc10-0fecfbf667aa req-98459a25-ea11-4412-89f1-b8186f4dc682 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:02.519042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:02.521256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:02.526698 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-30cc932a-55d6-4385-bc10-0fecfbf667aa req-98459a25-ea11-4412-89f1-b8186f4dc682 service nova] Creating event network-vif-deleted:711a5170-97b9-4376-a31c-71464d032129 for instance f937ee40-00e0-463e-a46f-98be4b2340a6 on nch1-master-1 Apr 30 21:30:02.537088 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-30cc932a-55d6-4385-bc10-0fecfbf667aa req-98459a25-ea11-4412-89f1-b8186f4dc682 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059217 Apr 30 21:30:02.538981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:02.540602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:02.543103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:02.544051 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2282/4459] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:02.547901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:02.631129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:02.632587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:02.646259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:02.647208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:02.648244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:02.648926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:02.721800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:02.730356 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f7c9d3f-05ae-4b06-b063-9ee483cfcb21 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1485 microversion: 2.1 time: 0.217281 Apr 30 21:30:02.732694 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2178/4460] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:02 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1485 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:02.871958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:02.880873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-03b667f5-c363-48a7-9938-dfd78aba8353 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1317 microversion: 2.1 time: 0.254112 Apr 30 21:30:02.882378 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2283/4461] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:02 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:03.376438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:03.377183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:03.384095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:03.384805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:03.385375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:03.385859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:03.556405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:03.564244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5c24d8a-e836-49cc-b9da-60468541a09d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.191775 Apr 30 21:30:03.564811 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2179/4462] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:03 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:03.748428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:03.749185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:03.769210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:03.771134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:03.771427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:03.771939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:03.848457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:03.849729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:03.850497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lazy-loading 'fault' on Instance uuid f937ee40-00e0-463e-a46f-98be4b2340a6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:30:03.898915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:03.899542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:03.911125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9945e69c5714cd4b1d2667969eaef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e881eef596f442ea5e731596de728a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:03.915725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:03.920369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:03.923229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:03.923974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:03.937095 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-03d31d25-99f1-4cbc-87a4-83084bef8205 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 200 len: 1314 microversion: 2.1 time: 0.191887 Apr 30 21:30:03.944968 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2284/4463] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:03 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:04.235300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:04.244010 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5760d24-b888-44be-9545-7b8b45afd16d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1317 microversion: 2.1 time: 0.349880 Apr 30 21:30:04.244592 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2180/4464] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:03 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:04.279278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-967cb291-ddfd-447c-928e-086dcd21d5ac tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-957282154", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0fe89388-81fb-4f6e-b86b-d1159cdf1d17", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:04.369865 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-967cb291-ddfd-447c-928e-086dcd21d5ac tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Block Device 0fe89388-81fb-4f6e-b86b-d1159cdf1d17 is not bootable. Apr 30 21:30:04.371285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-967cb291-ddfd-447c-928e-086dcd21d5ac tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Block Device 0fe89388-81fb-4f6e-b86b-d1159cdf1d17 is not bootable. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:04.373185 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-967cb291-ddfd-447c-928e-086dcd21d5ac tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.098017 Apr 30 21:30:04.374949 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2285/4465] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:04.383590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:04.388498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:04.395221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.396250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.398604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.399072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.582363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:04.584499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:04.597585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.598084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.599572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.600007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.612051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:04.624852 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-813503e4-6e49-483e-a7b6-5382dd072b05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.246064 Apr 30 21:30:04.627482 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2181/4466] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:04 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:04.652032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:04.653105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:04.686793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.687526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.688545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.689407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.882185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:04.893426 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22ddbdba-1671-4b0b-a8fb-69949c83358b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.315327 Apr 30 21:30:04.907267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2286/4467] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:04 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:04.914721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3b9f6bdf-4ba4-4107-b3f3-c05f9e2f0932 req-c1115cd5-8ad9-45dc-8d38-5668bf82f5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98c505c-ce28-43b4-ab4d-1a72477ce0c6", "name": "network-vif-plugged", "status": "completed", "tag": "c7ee00e9-7450-4592-8d1d-f7c36c4915f4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:04.929001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3b9f6bdf-4ba4-4107-b3f3-c05f9e2f0932 req-c1115cd5-8ad9-45dc-8d38-5668bf82f5da service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.929420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:04.930013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3b9f6bdf-4ba4-4107-b3f3-c05f9e2f0932 req-c1115cd5-8ad9-45dc-8d38-5668bf82f5da service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.944262 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6a1cf145-618b-455c-a817-0a193a8bd08f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.300775 Apr 30 21:30:04.945478 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2182/4468] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:04 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:04.946882 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3b9f6bdf-4ba4-4107-b3f3-c05f9e2f0932 req-c1115cd5-8ad9-45dc-8d38-5668bf82f5da service nova] Creating event network-vif-plugged:c7ee00e9-7450-4592-8d1d-f7c36c4915f4 for instance f98c505c-ce28-43b4-ab4d-1a72477ce0c6 on nch2-master-1 Apr 30 21:30:04.955019 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3b9f6bdf-4ba4-4107-b3f3-c05f9e2f0932 req-c1115cd5-8ad9-45dc-8d38-5668bf82f5da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045057 Apr 30 21:30:04.956214 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2287/4469] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:04.959023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:04.959784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] [instance: f937ee40-00e0-463e-a46f-98be4b2340a6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:04.969120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.970038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:04.971498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:04.972103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:05.001416 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] HTTP exception thrown: Instance f937ee40-00e0-463e-a46f-98be4b2340a6 could not be found. Apr 30 21:30:05.002574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] Returning 404 to user: Instance f937ee40-00e0-463e-a46f-98be4b2340a6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:05.003666 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d9c20ec-4424-4412-84c8-ff4e1e0c3617 tempest-ServerAddressesNegativeTestJSON-1219891741 tempest-ServerAddressesNegativeTestJSON-1219891741-project] 10.222.0.23 "GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6" status: 404 len: 111 microversion: 2.1 time: 0.050665 Apr 30 21:30:05.006338 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2183/4470] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:04 2022] GET /compute/v2.1/servers/f937ee40-00e0-463e-a46f-98be4b2340a6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:30:05.265816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:05.267986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:05.321510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:05.322001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:05.324393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:05.325058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:05.615195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:05.634218 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80973cb3-ef11-403f-8726-82cda10a9f53 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1317 microversion: 2.1 time: 0.372135 Apr 30 21:30:05.635203 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2288/4471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:05 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:05.922228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:05.923681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:05.936574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:05.937131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:05.938039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:05.938848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:06.221512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:06.229689 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47a23038-fb47-4d03-beb6-c79287646e76 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.319782 Apr 30 21:30:06.231283 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2184/4472] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:05 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:06.657470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:06.658223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:06.670336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:06.672818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:06.672818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:06.672818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:06.950113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:06.988625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4e99ae08-092b-46cd-8922-ca48a9853959 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1505 microversion: 2.1 time: 0.334856 Apr 30 21:30:06.993585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2289/4473] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:06 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:07.011365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56a9cc58-93e4-4f01-bc66-e67fa256e533 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:07.011908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-56a9cc58-93e4-4f01-bc66-e67fa256e533 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:07.030940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a9cc58-93e4-4f01-bc66-e67fa256e533 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.034151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a9cc58-93e4-4f01-bc66-e67fa256e533 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.039623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a9cc58-93e4-4f01-bc66-e67fa256e533 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.039623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a9cc58-93e4-4f01-bc66-e67fa256e533 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.107361 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56a9cc58-93e4-4f01-bc66-e67fa256e533 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6/ips" status: 200 len: 108 microversion: 2.1 time: 0.100795 Apr 30 21:30:07.111386 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2185/4474] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:30:07 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6/ips => generated 108 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:07.121720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c728d8ee-05a7-4bcf-9523-9284f468138d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:07.122503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c728d8ee-05a7-4bcf-9523-9284f468138d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:07.133529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c728d8ee-05a7-4bcf-9523-9284f468138d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.135151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c728d8ee-05a7-4bcf-9523-9284f468138d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.136024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c728d8ee-05a7-4bcf-9523-9284f468138d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.136541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c728d8ee-05a7-4bcf-9523-9284f468138d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.173634 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c728d8ee-05a7-4bcf-9523-9284f468138d tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6/ips" status: 200 len: 108 microversion: 2.1 time: 0.055781 Apr 30 21:30:07.175346 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2290/4475] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:30:07 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6/ips => generated 108 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:07.188346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0989f97c-fa64-44ab-9814-59bd084e1bd0 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:07.189144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0989f97c-fa64-44ab-9814-59bd084e1bd0 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:07.196024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0989f97c-fa64-44ab-9814-59bd084e1bd0 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.196783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0989f97c-fa64-44ab-9814-59bd084e1bd0 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.197722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0989f97c-fa64-44ab-9814-59bd084e1bd0 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.198212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0989f97c-fa64-44ab-9814-59bd084e1bd0 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.228503 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0989f97c-fa64-44ab-9814-59bd084e1bd0 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6/ips/tempest-ServerAddressesTestJSON-904974667-network" status: 200 len: 93 microversion: 2.1 time: 0.047232 Apr 30 21:30:07.229354 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2186/4476] 10.222.0.23 () {58 vars in 1397 bytes} [Sat Apr 30 21:30:07 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6/ips/tempest-ServerAddressesTestJSON-904974667-network => generated 93 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:30:07.242437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:07.243269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:07.254813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:07.255817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:07.257211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.257674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.261544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.262235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.264052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.264770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.265906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.266580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.337943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:30:07.522799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:07.532385 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16105af4-76aa-4e1d-a904-ef074dfe2691 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.284551 Apr 30 21:30:07.533038 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2187/4477] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:07 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:07.934203 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96e9a03a-4b0b-48f7-ab2e-b444ee1d2851 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 204 len: 0 microversion: 2.1 time: 0.697342 Apr 30 21:30:07.939329 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2291/4478] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:30:07 2022] DELETE /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:30:07.945636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:07.947262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:07.962296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.962921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:07.964053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:07.965568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:08.222741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:08.222741 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-feccd3d9-5048-4088-9665-1b58b7732759 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1511 microversion: 2.1 time: 0.197842 Apr 30 21:30:08.222741 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2188/4479] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:07 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:08.553523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:08.554270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:08.568123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:08.570271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:08.570271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:08.577967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:09.243931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:09.247890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:09.261247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:09.263819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:09.268824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:09.325155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.058s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:09.472732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:09.494691 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e242da5-4ccd-49af-acf1-8fe86f077cc2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.944654 Apr 30 21:30:09.495621 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2292/4480] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:08 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:09.510221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-24c9073f-7101-4229-8c4b-f35a0e88af86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1621316612", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "destination_type": "local"}, {"source_type": "volume", "uuid": "af5d97e7-2077-48c5-a106-53d364f2886a", "destination_type": "invalid"}], "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:09.515371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-24c9073f-7101-4229-8c4b-f35a0e88af86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:09.520896 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-24c9073f-7101-4229-8c4b-f35a0e88af86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018834 Apr 30 21:30:09.526790 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2293/4481] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:09 2022] POST /compute/v2.1/servers => generated 155 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:09.536704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:09.539457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:09.560164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:09.560573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:09.561373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:09.562821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:09.834928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:09.844223 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7cec303b-7002-4ffb-8724-8669b7c3d7be tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1511 microversion: 2.1 time: 0.606599 Apr 30 21:30:09.856042 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2189/4482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:09 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1511 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:09.990715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:10.005541 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db9e8fe7-869f-4ccd-8608-cda92b5fc743 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.473277 Apr 30 21:30:10.006730 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2294/4483] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:09 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:10.024744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-168829702", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": "none"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:10.030646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:10.030646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:10.038988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:10.039905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:10.041481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:10.042104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:10.120538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:30:10.126026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:30:10.126026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:30:10.126026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:30:10.128594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:30:10.153617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:10.154111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:10.158165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:10.158894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:10.209376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Getting quotas for project b5de501af17b45a596e24e0fe7611ece. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:30:10.216251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Getting quotas for user ea92ff9a9c1142ce8890ab1379535f1b and project b5de501af17b45a596e24e0fe7611ece. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:30:10.235231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:30:10.242267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:30:10.557918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:10.569923 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-baa2fed2-4dd6-4ef2-a11b-deaa1a046b92 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.546879 Apr 30 21:30:10.591035 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2295/4484] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:10 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:10.596660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:10.597540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:10.606714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:10.607192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:10.607965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:10.611018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:10.644301 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f7dc1b6b-ffa9-4e97-9809-d8c10d62e0d5 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.786653 Apr 30 21:30:10.649018 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2190/4485] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:30:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:30:10.665206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0a3e600e-906a-4b39-bbd3-dbd6a5c1c956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:10.666519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0a3e600e-906a-4b39-bbd3-dbd6a5c1c956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:10.901678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a3e600e-906a-4b39-bbd3-dbd6a5c1c956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:10.914885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a3e600e-906a-4b39-bbd3-dbd6a5c1c956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:10.918554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a3e600e-906a-4b39-bbd3-dbd6a5c1c956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:10.922779 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0a3e600e-906a-4b39-bbd3-dbd6a5c1c956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196" status: 200 len: 1277 microversion: 2.47 time: 0.267467 Apr 30 21:30:10.926438 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2191/4486] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:10 2022] GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:30:10.933543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d8a4ed8-a089-4ed9-b8d0-9a98e542bc21 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-176372279", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:10.944631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d8a4ed8-a089-4ed9-b8d0-9a98e542bc21 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:10.955836 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d8a4ed8-a089-4ed9-b8d0-9a98e542bc21 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.027729 Apr 30 21:30:10.958665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2192/4487] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:10 2022] POST /compute/v2.1/servers => generated 624 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:10.980520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:10.981640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:10.997736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:10.999692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.000357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.000814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.022136 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 5f2823b0-27c1-4215-ad94-59d3ac52878b could not be found. Apr 30 21:30:11.022906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 5f2823b0-27c1-4215-ad94-59d3ac52878b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:11.023870 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b14e07db-4c5f-4f8a-8b98-46a7e2a06666 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 404 len: 111 microversion: 2.1 time: 0.064064 Apr 30 21:30:11.024535 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2193/4488] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:30:10 2022] DELETE /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:11.031128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:11.032070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:11.046050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.048012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.049689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.050868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.117186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:11.131192 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d2d3d7b5-ea2a-4e56-a564-34a6aafcddc8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.535358 Apr 30 21:30:11.134290 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2296/4489] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:10 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:11.141514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:11.142604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:11.155350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.155815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.157584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.158302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.445061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:11.476275 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-26372829-8abb-4aa1-81bc-c26b000979cc tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1511 microversion: 2.1 time: 0.450416 Apr 30 21:30:11.476866 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2194/4490] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:11 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:11.494241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1369316737", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": "none"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:11.561084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:11.575902 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9fe93144-9317-4244-ad30-fed0d2729a91 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.437811 Apr 30 21:30:11.579291 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2297/4491] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:11 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:11.594083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:11.595042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 5f2823b0-27c1-4215-ad94-59d3ac52878b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:11.601577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.602402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.603478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.604164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.621278 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 5f2823b0-27c1-4215-ad94-59d3ac52878b could not be found. Apr 30 21:30:11.622344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 5f2823b0-27c1-4215-ad94-59d3ac52878b could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:11.623448 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f7e00829-e4f4-4325-abfd-faeff37968bb tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b" status: 404 len: 111 microversion: 2.1 time: 0.042933 Apr 30 21:30:11.624936 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2298/4492] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:11 2022] GET /compute/v2.1/servers/5f2823b0-27c1-4215-ad94-59d3ac52878b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:11.629094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:30:11.630838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f9662141-05cf-4cf2-86de-cdb1fc63136f req-092b10a1-c50e-481a-8a07-03eba10916ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98c505c-ce28-43b4-ab4d-1a72477ce0c6", "name": "network-vif-deleted", "tag": "c7ee00e9-7450-4592-8d1d-f7c36c4915f4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:11.633152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:30:11.633679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:30:11.640542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f9662141-05cf-4cf2-86de-cdb1fc63136f req-092b10a1-c50e-481a-8a07-03eba10916ea service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.641538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f9662141-05cf-4cf2-86de-cdb1fc63136f req-092b10a1-c50e-481a-8a07-03eba10916ea service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.648894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:30:11.653706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:30:11.655642 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f9662141-05cf-4cf2-86de-cdb1fc63136f req-092b10a1-c50e-481a-8a07-03eba10916ea service nova] Creating event network-vif-deleted:c7ee00e9-7450-4592-8d1d-f7c36c4915f4 for instance f98c505c-ce28-43b4-ab4d-1a72477ce0c6 on nch2-master-1 Apr 30 21:30:11.662313 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f9662141-05cf-4cf2-86de-cdb1fc63136f req-092b10a1-c50e-481a-8a07-03eba10916ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035601 Apr 30 21:30:11.664376 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2299/4493] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:11.675164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:11.677108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:11.684753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.685579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.686790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.687469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.714853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.716536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.718224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.720331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.760474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Getting quotas for project b5de501af17b45a596e24e0fe7611ece. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:30:11.768926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Getting quotas for user ea92ff9a9c1142ce8890ab1379535f1b and project b5de501af17b45a596e24e0fe7611ece. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:30:11.784963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:30:11.788736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:30:11.890242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:11.901497 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fb852839-5124-439f-9cd8-82555da3b47c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.234326 Apr 30 21:30:11.913311 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2300/4494] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:11 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:11.913311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:11.913311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:11.922597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.922597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.922597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.922597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.940493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 could not be found. Apr 30 21:30:11.941184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:11.942713 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4e2ece96-05fc-403e-a500-9014a86f40ac tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 404 len: 111 microversion: 2.1 time: 0.038668 Apr 30 21:30:11.943561 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2301/4495] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:30:11 2022] DELETE /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:11.952466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:11.953043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:11.970685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.972539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.974742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:11.978052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:11.993365 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 could not be found. Apr 30 21:30:11.994008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:12.000341 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e17dd257-9e00-4bb8-a6d2-b7c210dd6a47 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4" status: 404 len: 111 microversion: 2.1 time: 0.047207 Apr 30 21:30:12.000341 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2302/4496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:11 2022] GET /compute/v2.1/servers/ec43e8e7-f55f-467d-b9b0-b0c7fed9c9d4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:12.000857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e17f178e-a4b5-4a2a-aa26-1c57a2f8e134 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:12.002293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e17f178e-a4b5-4a2a-aa26-1c57a2f8e134 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:12.003439 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e17f178e-a4b5-4a2a-aa26-1c57a2f8e134 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006595 Apr 30 21:30:12.003575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16dec114-37f7-48de-9791-dd2ac19c884d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.518648 Apr 30 21:30:12.007716 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2303/4497] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:11 2022] POST /compute/v2.1/servers => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:12.008963 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2195/4498] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:30:12.018940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:12.024683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:12.026811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.027275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.028058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.028691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.043225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-53a0a5e4-180f-4d57-971c-cb317710a937 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:12.044682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53a0a5e4-180f-4d57-971c-cb317710a937 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:12.107325 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-53a0a5e4-180f-4d57-971c-cb317710a937 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "PUT /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 992 microversion: 2.47 time: 0.091586 Apr 30 21:30:12.108340 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2196/4499] 10.222.0.23 () {62 vars in 1296 bytes} [Sat Apr 30 21:30:12 2022] PUT /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 992 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:30:12.123873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07d8e33a-b0f4-4212-b93e-bbf54df8a038 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:12.133705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-07d8e33a-b0f4-4212-b93e-bbf54df8a038 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:12.254123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07d8e33a-b0f4-4212-b93e-bbf54df8a038 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:12.273302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07d8e33a-b0f4-4212-b93e-bbf54df8a038 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:12.273302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-07d8e33a-b0f4-4212-b93e-bbf54df8a038 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:12.273302 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-07d8e33a-b0f4-4212-b93e-bbf54df8a038 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1278 microversion: 2.47 time: 0.152786 Apr 30 21:30:12.273302 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2197/4500] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:12 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:12.277885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:12.293901 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7cf04df8-d1ab-402d-9ef8-de392271b590 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.279066 Apr 30 21:30:12.299108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:12.299570 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2304/4501] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:12 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:12.300456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:12.316211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:12.317792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:12.324760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.325216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.326050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.326504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.332220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.333478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.335628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.336457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.593721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:12.607477 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aac61a35-d342-43be-be35-d635d1b07ea4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.334307 Apr 30 21:30:12.619024 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2198/4502] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:12 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:12.627586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:12.628478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:12.635883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.636347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.637147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.637595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.713081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:12.717663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.718771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.719475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lazy-loading 'fault' on Instance uuid f98c505c-ce28-43b4-ab4d-1a72477ce0c6 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:30:12.736108 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c00a792-7609-46f6-9a3a-f5fff8266612 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.414441 Apr 30 21:30:12.768064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e406059e394bc89a1bb7609c8d4236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7d810b16a945cc921509e1c20d101d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:12.768945 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2305/4503] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:12 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:12.791968 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-87299ebc-6d75-4aac-b340-a5dc6bd48c09 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 200 len: 1307 microversion: 2.1 time: 0.170989 Apr 30 21:30:12.794289 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2199/4504] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:12 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:12.896621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc6d0594-dbeb-4b16-83f1-a8107020f353 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1706105964", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": -1, "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:12.914896 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-fc6d0594-dbeb-4b16-83f1-a8107020f353 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Flavor -1 could not be found. Apr 30 21:30:12.915434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc6d0594-dbeb-4b16-83f1-a8107020f353 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:12.916322 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc6d0594-dbeb-4b16-83f1-a8107020f353 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.025230 Apr 30 21:30:12.923328 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2306/4505] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:12 2022] POST /compute/v2.1/servers => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:12.928395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:12.929178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:12.940920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.941391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:12.942736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:12.943387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.175515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:13.187410 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8d35c1d2-5e3f-4ba9-81ba-a3d3c0c03635 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.263797 Apr 30 21:30:13.188344 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2200/4506] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:12 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:13.207620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:13.210889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:13.218637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.219410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.220394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.221039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.298847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-27094acf-414a-4dd2-840f-5d9aa17741ca tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:13.299492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-27094acf-414a-4dd2-840f-5d9aa17741ca tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:13.404458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-27094acf-414a-4dd2-840f-5d9aa17741ca tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:13.506001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-27094acf-414a-4dd2-840f-5d9aa17741ca tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:13.508679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-27094acf-414a-4dd2-840f-5d9aa17741ca tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:13.510338 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-27094acf-414a-4dd2-840f-5d9aa17741ca tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1278 microversion: 2.47 time: 0.221070 Apr 30 21:30:13.513270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:13.523506 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0913090c-4053-4ed0-b1bf-144ecc677dde tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.320086 Apr 30 21:30:13.524904 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2201/4507] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:13 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:13.539004 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2307/4508] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:13 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:13.592144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12080ac2-5b99-433b-b01d-01290aba29b0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-32631576", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:13.593497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12080ac2-5b99-433b-b01d-01290aba29b0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:13.594485 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12080ac2-5b99-433b-b01d-01290aba29b0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.006523 Apr 30 21:30:13.595005 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2202/4509] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:13 2022] POST /compute/v2.1/servers => generated 145 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:13.603509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:13.604143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:13.610372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.610834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.611626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.612073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.626844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:13.627533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:13.634326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.634792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.635590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.636269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.814766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:13.822247 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9138b4eb-cae8-49d0-af94-92d73b256768 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.222553 Apr 30 21:30:13.822822 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2308/4510] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:13 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:13.823911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:13.827344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:13.827964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] [instance: f98c505c-ce28-43b4-ab4d-1a72477ce0c6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:13.832946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9450b59f-40f7-4d38-837b-8ce371148d01 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.211224 Apr 30 21:30:13.843046 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2203/4511] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:13 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:13.843046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:13.843046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:13.847554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.848543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.848958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.849362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.849496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.849837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.850224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:13.850737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:13.865272 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] HTTP exception thrown: Instance f98c505c-ce28-43b4-ab4d-1a72477ce0c6 could not be found. Apr 30 21:30:13.865930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] Returning 404 to user: Instance f98c505c-ce28-43b4-ab4d-1a72477ce0c6 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:13.866765 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2a1e708f-98d2-4610-8288-b8b0babbbf77 tempest-ServerAddressesTestJSON-2131831455 tempest-ServerAddressesTestJSON-2131831455-project] 10.222.0.23 "GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6" status: 404 len: 111 microversion: 2.1 time: 0.043027 Apr 30 21:30:13.869888 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2309/4512] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:13 2022] GET /compute/v2.1/servers/f98c505c-ce28-43b4-ab4d-1a72477ce0c6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:14.035145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:14.052380 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-917acbc0-c172-4ead-a0fd-6c09e9e4716a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.214367 Apr 30 21:30:14.053803 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2204/4513] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:13 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:14.212255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67b88461-7382-472a-84b8-524851a1c3b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-706392308", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:14.216900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-67b88461-7382-472a-84b8-524851a1c3b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Apr 30 21:30:14.218027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67b88461-7382-472a-84b8-524851a1c3b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:14.219590 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67b88461-7382-472a-84b8-524851a1c3b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.019910 Apr 30 21:30:14.236325 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2310/4514] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:14 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:14.236604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:14.236604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:14.242638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.243502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.244757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.245590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.545354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:14.546719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:14.567951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.578788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.581232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.583280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.617360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:14.626567 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75ae70f2-7a7a-4989-a08a-7fc9c3029c64 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.401694 Apr 30 21:30:14.628686 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2205/4515] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:14 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:14.648836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:14.649464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:14.673056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.673056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.673056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.673056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.694613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:14.705038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:14.706652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:14.707847 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84a44385-066a-41e7-ad10-280beedce5dc tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1330 microversion: 2.47 time: 0.180666 Apr 30 21:30:14.708402 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2311/4516] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:14 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1330 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:14.856633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:14.857655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:14.868092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.870019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.874405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:14.874969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:14.985010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:15.006765 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18eff174-0a80-432b-a1d8-51fb7ebb820b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.361389 Apr 30 21:30:15.008867 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2206/4517] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:14 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:15.111868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:15.131098 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bcdee2d7-827a-4204-a97a-d62f7d5191fb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.284057 Apr 30 21:30:15.132165 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2312/4518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:14 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:15.199894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b6e13a2-874e-4813-9a2b-39b63d9a0673 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1191541973", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "key_name": "tempest-key-1203402174", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:15.285391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-1b6e13a2-874e-4813-9a2b-39b63d9a0673 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] validate_networks() for [('c7cbed3c-359b-4472-8bf9-f34e2c55b91b', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:30:15.731503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:15.738546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:15.746709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:15.747173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:15.747971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:15.748607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:15.783065 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1b6e13a2-874e-4813-9a2b-39b63d9a0673 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Invalid key_name provided. Apr 30 21:30:15.784487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b6e13a2-874e-4813-9a2b-39b63d9a0673 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid key_name provided. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:15.786125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b6e13a2-874e-4813-9a2b-39b63d9a0673 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.590007 Apr 30 21:30:15.787449 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2207/4519] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:15 2022] POST /compute/v2.1/servers => generated 70 bytes in 592 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:15.842618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:15.842618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:15.842618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:15.842618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:15.842618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:15.842618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:15.848791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:15.871007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:15.872589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:15.873949 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92d8d6cb-2514-4d37-a815-317af16ee976 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1330 microversion: 2.47 time: 0.151063 Apr 30 21:30:15.875246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2313/4520] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:15 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1330 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:30:15.992302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:16.000083 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4acee2c-e99e-4793-8293-d2c3f2665a96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.206962 Apr 30 21:30:16.000648 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2208/4521] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:15 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:16.016958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:16.017567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:16.023694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.024152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.024968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.025415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.150351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:16.151264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:16.158113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.158627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.159769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.161063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.195899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:16.209128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6baab1f-9089-4238-8722-527d1e21c159 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.195953 Apr 30 21:30:16.209712 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2314/4522] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:16 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:16.315480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:16.323604 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44300076-5946-45cf-81ac-ba52b58c2bb2 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 0.178271 Apr 30 21:30:16.324256 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2209/4523] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:16 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:16.391386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73686584-d325-46ba-9cef-a9e9125d3307 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1509138683", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:16.496602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.security_group_api [None req-73686584-d325-46ba-9cef-a9e9125d3307 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Neutron security group does_not_exist not found {{(pid=130671) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Apr 30 21:30:16.497193 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-73686584-d325-46ba-9cef-a9e9125d3307 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Apr 30 21:30:16.498022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73686584-d325-46ba-9cef-a9e9125d3307 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:16.499303 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73686584-d325-46ba-9cef-a9e9125d3307 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.111817 Apr 30 21:30:16.499863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2315/4524] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:16 2022] POST /compute/v2.1/servers => generated 106 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:16.512958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:16.513655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:16.523308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.523944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.524836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.525708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.680162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:16.688010 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5e1cc8b4-d876-49ce-8c7c-d4498df55bcf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.183271 Apr 30 21:30:16.688588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2210/4525] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:16 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:16.710625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:16.711417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:16.717791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.719709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.719709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.719709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.895251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:16.896460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:16.903440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.904275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.905511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.906470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.918923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:16.928478 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6632f21a-b9c4-467f-9d78-3e26189bce77 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.224844 Apr 30 21:30:16.932319 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2316/4526] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:16 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:16.952986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ead809df-2fab-4e6d-9f09-5b6958cb8f70 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:16.955919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ead809df-2fab-4e6d-9f09-5b6958cb8f70 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 00e204d5-91ae-4eca-98cf-727b6edb9201] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:16.969333 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ead809df-2fab-4e6d-9f09-5b6958cb8f70 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 00e204d5-91ae-4eca-98cf-727b6edb9201 could not be found. Apr 30 21:30:16.970840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ead809df-2fab-4e6d-9f09-5b6958cb8f70 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 00e204d5-91ae-4eca-98cf-727b6edb9201 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:16.972088 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ead809df-2fab-4e6d-9f09-5b6958cb8f70 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00e204d5-91ae-4eca-98cf-727b6edb9201" status: 404 len: 111 microversion: 2.1 time: 0.028087 Apr 30 21:30:16.973245 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2317/4527] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:30:16 2022] DELETE /compute/v2.1/servers/00e204d5-91ae-4eca-98cf-727b6edb9201 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:16.983287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:16.984988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:16.992341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.992869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:16.993603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:16.994321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.018383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.029145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.030935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.032176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e88406a3-2d87-4e53-95e9-c16a7b35f70d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1338 microversion: 2.47 time: 0.143703 Apr 30 21:30:17.032881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2211/4528] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:16 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1338 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:30:17.155340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.166117 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f37baadb-10fb-4193-8fe6-36b9422604da tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.187830 Apr 30 21:30:17.170658 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2318/4529] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:16 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:17.189286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:17.190359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:17.204167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.210852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.210852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.210852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.340703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:17.341541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:17.353101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.355935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.355935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.355935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.444203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.451894 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dab40562-2f8e-42cc-882a-83121bbb734f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.267872 Apr 30 21:30:17.452482 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2212/4530] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:17 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:17.468520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-faeb0176-3a75-405e-aa43-c5edc3ac1006 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:17.469106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-faeb0176-3a75-405e-aa43-c5edc3ac1006 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Failed to fetch instance by id 9223372036854775808 {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 30 21:30:17.469751 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-faeb0176-3a75-405e-aa43-c5edc3ac1006 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Apr 30 21:30:17.470463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-faeb0176-3a75-405e-aa43-c5edc3ac1006 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:17.471356 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-faeb0176-3a75-405e-aa43-c5edc3ac1006 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.006990 Apr 30 21:30:17.471983 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2213/4531] 10.222.0.23 () {58 vars in 1187 bytes} [Sat Apr 30 21:30:17 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:30:17.483316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:17.484062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:17.497935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.498510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.503112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.503112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.538901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.558024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-968530aa-8064-4c01-93e4-b952a48c20ed tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1506 microversion: 2.1 time: 0.213197 Apr 30 21:30:17.565626 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2319/4532] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:17 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:17.662561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.671856 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ac75bd1-e5cc-46aa-a0c1-a2b966d7fbdf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.193891 Apr 30 21:30:17.679906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2214/4533] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:17 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:17.688933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:17.689649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:17.696374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.696835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.697610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.698086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.858591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:17.868936 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-187ac9e0-5919-4773-a304-6b835233b683 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.183980 Apr 30 21:30:17.869545 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2320/4534] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:17 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:17.886091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5369f9b2-d7a4-47af-a7cc-cf01af985afd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:17.886736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5369f9b2-d7a4-47af-a7cc-cf01af985afd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Failed to fetch instance by id -1 {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 30 21:30:17.887315 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-5369f9b2-d7a4-47af-a7cc-cf01af985afd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance -1 could not be found. Apr 30 21:30:17.890313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5369f9b2-d7a4-47af-a7cc-cf01af985afd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance -1 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:17.891143 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5369f9b2-d7a4-47af-a7cc-cf01af985afd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.010047 Apr 30 21:30:17.891808 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2215/4535] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:30:17 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:30:17.906047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:17.909934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:17.925023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.925726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:17.932413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:17.932413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.062343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:18.063006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:18.071029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.071591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.072507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.073203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.094828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:18.103470 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4d7374e7-e8e4-45f0-b131-078613d017c9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.201262 Apr 30 21:30:18.104188 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2321/4536] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:17 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:18.129612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:18.130532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:18.153088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.153485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.154407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.154737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.159964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:18.172761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:18.175959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:18.177998 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ead2244-3d50-4c34-9c98-26e47216d8a4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1336 microversion: 2.47 time: 0.124750 Apr 30 21:30:18.178912 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2216/4537] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:18 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:18.374744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:18.385163 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1cba59a3-2911-4a0f-8c59-8a29d98e538d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.260889 Apr 30 21:30:18.385990 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2322/4538] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:18 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:18.402538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ae894aa-cc20-4213-a19d-711477526ad7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:18.403576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ae894aa-cc20-4213-a19d-711477526ad7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 837a8d26-86f4-49f2-90e9-7ea4879fdd70] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:18.409750 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1ae894aa-cc20-4213-a19d-711477526ad7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 837a8d26-86f4-49f2-90e9-7ea4879fdd70 could not be found. Apr 30 21:30:18.410300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ae894aa-cc20-4213-a19d-711477526ad7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 837a8d26-86f4-49f2-90e9-7ea4879fdd70 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:18.411158 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ae894aa-cc20-4213-a19d-711477526ad7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/837a8d26-86f4-49f2-90e9-7ea4879fdd70/action" status: 404 len: 111 microversion: 2.1 time: 0.013077 Apr 30 21:30:18.414024 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2217/4539] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:18 2022] POST /compute/v2.1/servers/837a8d26-86f4-49f2-90e9-7ea4879fdd70/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:18.421050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:18.421662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:18.427822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.428270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.429041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.429479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.576477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:18.577384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:18.587284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.587756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.588571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.589027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.725750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:18.742689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5a02b4d7-e845-4d34-8c8b-bd8f6979884b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.325482 Apr 30 21:30:18.754617 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2323/4540] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:18 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:18.762081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:18.763085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:18.769505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.770515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:18.771291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:18.771725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.027621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.040781 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-09d9537d-30ac-4ae1-8b1d-e4059a4a048a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1506 microversion: 2.1 time: 0.469483 Apr 30 21:30:19.041386 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2218/4541] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:18 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:19.108351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.117501 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f82f764-9ddc-4720-afe4-1965332e892b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.359182 Apr 30 21:30:19.118128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2324/4542] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:18 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:19.134273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-36c1a6a8-5fe7-4ac6-9227-4927cc186554 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:19.136466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-36c1a6a8-5fe7-4ac6-9227-4927cc186554 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: d170c205-d13c-46d0-8c6c-c47557ef470b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:19.144251 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-36c1a6a8-5fe7-4ac6-9227-4927cc186554 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance d170c205-d13c-46d0-8c6c-c47557ef470b could not be found. Apr 30 21:30:19.144867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-36c1a6a8-5fe7-4ac6-9227-4927cc186554 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance d170c205-d13c-46d0-8c6c-c47557ef470b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:19.145732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-36c1a6a8-5fe7-4ac6-9227-4927cc186554 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/d170c205-d13c-46d0-8c6c-c47557ef470b/action" status: 404 len: 111 microversion: 2.1 time: 0.015703 Apr 30 21:30:19.146661 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2219/4543] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:19 2022] POST /compute/v2.1/servers/d170c205-d13c-46d0-8c6c-c47557ef470b/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:19.155884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:19.156688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:19.167054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.167967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.168783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.169230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.209654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:19.210346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:19.221425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.221956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.222772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.223783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.308113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.317802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.319357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.320980 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-139b5c48-60c3-46f7-9e9d-2030b34ec8c0 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1336 microversion: 2.47 time: 0.117926 Apr 30 21:30:19.321682 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2220/4544] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:19 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:19.346824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.356156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7859b14e-df10-4825-9daa-7f3f123e7426 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.205208 Apr 30 21:30:19.356737 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2325/4545] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:19 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:19.374003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:19.374636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:19.380993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.381453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.382268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.382720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.534937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.544005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9121e9a-5a71-475e-b9c2-f2bc61a72dfa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.173948 Apr 30 21:30:19.544968 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2221/4546] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:19 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:19.560817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16e4ee7b-2334-4f5b-9044-82e27c7731e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:19.561679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16e4ee7b-2334-4f5b-9044-82e27c7731e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: ccc1f631-fcb9-4df2-8f48-2e3333e3370e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:19.568532 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-16e4ee7b-2334-4f5b-9044-82e27c7731e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance ccc1f631-fcb9-4df2-8f48-2e3333e3370e could not be found. Apr 30 21:30:19.569214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16e4ee7b-2334-4f5b-9044-82e27c7731e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance ccc1f631-fcb9-4df2-8f48-2e3333e3370e could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:19.570162 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16e4ee7b-2334-4f5b-9044-82e27c7731e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/ccc1f631-fcb9-4df2-8f48-2e3333e3370e" status: 404 len: 111 microversion: 2.1 time: 0.013921 Apr 30 21:30:19.570803 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2326/4547] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:19 2022] GET /compute/v2.1/servers/ccc1f631-fcb9-4df2-8f48-2e3333e3370e => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:19.583161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:19.583804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:19.589974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.590437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.591239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.591692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.753672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:19.763169 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb13e63b-bd97-4ac2-a61a-08e7e3a26ceb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.186641 Apr 30 21:30:19.767691 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2222/4548] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:19 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:19.787120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:19.788019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:19.795123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.795848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.796647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:19.797085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:19.993742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:20.009594 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-24e3c79e-192f-43be-ab3a-5d2ec27a24f5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.227477 Apr 30 21:30:20.009594 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2327/4549] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:19 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:20.064722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:20.065978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:20.077019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.080408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:20.090346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.090346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:20.248012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4746085-70d5-4620-a075-b7c2c15f8615 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-283211827", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:20.272618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4746085-70d5-4620-a075-b7c2c15f8615 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:20.275172 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4746085-70d5-4620-a075-b7c2c15f8615 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.038236 Apr 30 21:30:20.280902 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2328/4550] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:20.299101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:20.300080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:20.327772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.329061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:20.331590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.334926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:20.647063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:20.670750 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c72aee9-6a7b-4443-9e72-c1129c27dfff tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1506 microversion: 2.1 time: 0.610202 Apr 30 21:30:20.679600 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2223/4551] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:20 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:20.702851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:20.705213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:20.725436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.728722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:20.737613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.737613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:20.737908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:20.746981 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-707ae2aa-b91b-4e46-a951-2172ea9a983f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.464250 Apr 30 21:30:20.748244 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2329/4552] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:20 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:20.771538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:20.778837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:20.790146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.790680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:20.792576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:20.793211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.033278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:21.061885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:21.063417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:21.064594 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d88a3264-9c6b-4dd5-baf5-c5f816f40cb7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1336 microversion: 2.47 time: 0.383652 Apr 30 21:30:21.065166 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2224/4553] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:20 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1336 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:21.085831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3d0a4d99-a3c4-4b2e-94b5-bfc9bd122af5 req-8319cb55-61bf-4b1f-a5b6-9a240e760a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78ceea4-5d4e-46b9-a50d-18210101ab3f", "name": "network-vif-unplugged", "status": "completed", "tag": "f2e67c00-e892-4977-95b6-739f701898d8"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:21.141647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3d0a4d99-a3c4-4b2e-94b5-bfc9bd122af5 req-8319cb55-61bf-4b1f-a5b6-9a240e760a53 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.142142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3d0a4d99-a3c4-4b2e-94b5-bfc9bd122af5 req-8319cb55-61bf-4b1f-a5b6-9a240e760a53 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.174946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3d0a4d99-a3c4-4b2e-94b5-bfc9bd122af5 req-8319cb55-61bf-4b1f-a5b6-9a240e760a53 service nova] Creating event network-vif-unplugged:f2e67c00-e892-4977-95b6-739f701898d8 for instance d78ceea4-5d4e-46b9-a50d-18210101ab3f on nch1-master-1 Apr 30 21:30:21.177947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:21.191262 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-411acc02-48a0-4d86-9ea5-091ad852d6d6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.429494 Apr 30 21:30:21.192692 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3d0a4d99-a3c4-4b2e-94b5-bfc9bd122af5 req-8319cb55-61bf-4b1f-a5b6-9a240e760a53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125380 Apr 30 21:30:21.194548 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2225/4554] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:21.199247 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2330/4555] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:20 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:21.227804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:21.228556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:21.244853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.245329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.246397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.246940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.315479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 3981cebe-916e-45b7-a15c-a2639be85842 could not be found. Apr 30 21:30:21.317503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 3981cebe-916e-45b7-a15c-a2639be85842 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:21.319723 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e9c1b67-94e1-4899-9835-05ea206b5a38 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 404 len: 111 microversion: 2.1 time: 0.122712 Apr 30 21:30:21.320843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2226/4556] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:30:21 2022] DELETE /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:21.352227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:21.353140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] [instance: 3981cebe-916e-45b7-a15c-a2639be85842] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:21.364054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.365402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47d968d3-bd0a-4619-8e46-f72bf134fa8e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-749754298", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:21.368239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47d968d3-bd0a-4619-8e46-f72bf134fa8e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:21.369246 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47d968d3-bd0a-4619-8e46-f72bf134fa8e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.008876 Apr 30 21:30:21.373071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.373610 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2227/4557] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:21 2022] POST /compute/v2.1/servers => generated 133 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:21.379600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.379600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.429557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:21.430231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:21.433046 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] HTTP exception thrown: Instance 3981cebe-916e-45b7-a15c-a2639be85842 could not be found. Apr 30 21:30:21.433707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] Returning 404 to user: Instance 3981cebe-916e-45b7-a15c-a2639be85842 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:21.434602 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-00be30be-cd81-4758-afeb-e8da14bbb2e0 tempest-AttachVolumeNegativeTest-612541851 tempest-AttachVolumeNegativeTest-612541851-project] 10.222.0.23 "GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842" status: 404 len: 111 microversion: 2.1 time: 0.105791 Apr 30 21:30:21.445495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2331/4558] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:21 2022] GET /compute/v2.1/servers/3981cebe-916e-45b7-a15c-a2639be85842 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:21.456838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.457783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.458805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.459267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.700106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:21.700830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:21.722303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:21.726061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.726600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.729834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.733856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.735461 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82168494-d1f4-4c44-b830-12c1e84d1f96 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.352883 Apr 30 21:30:21.740492 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2228/4559] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:21 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:21.761847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:21.766635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:21.798102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.799983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:21.801035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:21.807705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:22.391910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:22.401252 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-afad4d35-d0dd-44ce-8c96-2c3e40fa0a49 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.650525 Apr 30 21:30:22.405116 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2229/4560] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:21 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:22.410004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:22.410972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:22.422345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:22.427093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:22.427093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:22.427093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:22.553748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:22.567402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:22.572245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:22.573653 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88bffab6-f731-4826-b11c-f22ad4318c4f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1357 microversion: 2.47 time: 0.170634 Apr 30 21:30:22.575249 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2230/4561] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:22 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:22.582581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10030867-1e37-445b-b096-466f6d42c168 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:22.583530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-10030867-1e37-445b-b096-466f6d42c168 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 206e229b-6319-42c4-ada0-a2ec3ff6f6b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:22.599872 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-10030867-1e37-445b-b096-466f6d42c168 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 206e229b-6319-42c4-ada0-a2ec3ff6f6b3 could not be found. Apr 30 21:30:22.604973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10030867-1e37-445b-b096-466f6d42c168 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 206e229b-6319-42c4-ada0-a2ec3ff6f6b3 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:22.604973 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10030867-1e37-445b-b096-466f6d42c168 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/206e229b-6319-42c4-ada0-a2ec3ff6f6b3/action" status: 404 len: 111 microversion: 2.1 time: 0.027824 Apr 30 21:30:22.610554 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2231/4562] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:22 2022] POST /compute/v2.1/servers/206e229b-6319-42c4-ada0-a2ec3ff6f6b3/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:22.618656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:22.620959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:22.630136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:22.630760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:22.631631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:22.632095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:22.730353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:30:22.731054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:30:22.731387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:30:22.734049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:30:22.734878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:30:23.036151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:23.048336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.048836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.051538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.052052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.115670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e04de839-ef93-43d7-ad67-d9b1ca898f66 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "POST /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d/action" status: 202 len: 1079 microversion: 2.47 time: 0.501777 Apr 30 21:30:23.117046 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2232/4563] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Apr 30 21:30:22 2022] POST /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d/action => generated 1079 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 30 21:30:23.121855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:23.122741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:23.137995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.139502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.140930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.141594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.271100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:23.287575 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce885b27-d13f-4849-88e7-8513e8b8bd62 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 200 len: 1509 microversion: 2.1 time: 1.598611 Apr 30 21:30:23.289222 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2332/4564] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:21 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 1509 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:23.305714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:23.306674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:23.318204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.318204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.318204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.318204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.435184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:23.460057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:23.463148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:23.464701 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-119b5056-db1f-4092-896b-7c4c050f42f4 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.172924 Apr 30 21:30:23.465385 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2333/4565] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:23 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:23.470867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:23.471803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:23.479373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.480365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.482542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.483227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.666462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:23.685775 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fa0a8ba6-74c3-411c-8b62-4f3cdb64403f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.568256 Apr 30 21:30:23.686407 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2233/4566] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:23 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:23.702979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:23.703838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:23.710449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.710917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:23.711714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:23.712166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.177491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:24.188720 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96e842c7-7b98-4004-b640-4a5b15137a2a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.721682 Apr 30 21:30:24.189577 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2334/4567] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:23 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:24.218846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:24.219854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:24.227038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.227860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.229056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.229695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.262797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:24.298741 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-87e2b9b6-4932-4078-84cb-5a90cde4a38c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.596211 Apr 30 21:30:24.301687 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2234/4568] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:23 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:24.317840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b81ea155-bd77-4472-b324-696b4f39f051 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:24.319119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b81ea155-bd77-4472-b324-696b4f39f051 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:24.328722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b81ea155-bd77-4472-b324-696b4f39f051 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.329580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b81ea155-bd77-4472-b324-696b4f39f051 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.330744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b81ea155-bd77-4472-b324-696b4f39f051 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.331398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b81ea155-bd77-4472-b324-696b4f39f051 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.541077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:24.549671 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-54735c1d-abf8-4421-bc77-aa8153dc4fbf tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.336199 Apr 30 21:30:24.550304 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2335/4569] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:24 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:24.572558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:24.573508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:24.592873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.594801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b81ea155-bd77-4472-b324-696b4f39f051 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 202 len: 0 microversion: 2.1 time: 0.280916 Apr 30 21:30:24.596120 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2235/4570] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:24 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:30:24.609342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.611532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.614930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:24.616645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.622512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:24.639864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.639864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.639864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.639864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.868994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:24.884199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:24.888220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:24.889474 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff04973c-4cff-4ebe-a047-fb3f6f61698f tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.337690 Apr 30 21:30:24.890082 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2336/4571] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:24 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:24.914462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:24.915113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:24.946736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.947195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:24.947997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:24.948441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:25.027909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:25.045990 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3be38ccc-4d80-46a9-a3a5-08a4a2df492f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.447611 Apr 30 21:30:25.047149 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2236/4572] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:24 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:25.066310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:25.066734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:25.084596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:25.085228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:25.087039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:25.093180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:25.352141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:25.377853 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e36ace7-16ca-4b1e-b90d-27bfbf52987c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1510 microversion: 2.1 time: 0.472907 Apr 30 21:30:25.381081 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2337/4573] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:24 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:25.473804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:25.484452 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aece39f1-3e2b-4b36-8148-4c74d83f1a5f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.424273 Apr 30 21:30:25.489515 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2237/4574] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:25 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:25.514758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4aff9db9-86d2-497a-853e-6a1747225c80 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:25.530696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4aff9db9-86d2-497a-853e-6a1747225c80 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:25.537509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4aff9db9-86d2-497a-853e-6a1747225c80 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:25.596665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4aff9db9-86d2-497a-853e-6a1747225c80 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Going to try to stop instance {{(pid=130671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:30:25.877537 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4aff9db9-86d2-497a-853e-6a1747225c80 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.376369 Apr 30 21:30:25.887573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:25.888326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:25.890232 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2338/4575] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:25 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:30:25.902715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:25.903979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:25.909538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:25.911917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:25.913375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:25.914515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:25.926855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:25.928213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:25.930712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:25.933044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:26.199981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:26.212498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:26.217562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:26.222190 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89c2720c-81eb-45eb-a40a-eb7e49c71b1c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.316954 Apr 30 21:30:26.225097 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2339/4576] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:25 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:26.398818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:26.399464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:26.407282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:26.408181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:26.409914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:26.412503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.110991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:27.124713 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-39bc734e-0465-4fd6-adf1-d547a66bb430 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 1.241426 Apr 30 21:30:27.127392 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2238/4577] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:25 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:27.169874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:27.185127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-932a3997-f990-42d1-b608-6d803e89b9cf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1490 microversion: 2.1 time: 0.792194 Apr 30 21:30:27.188232 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2340/4578] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:26 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1490 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:27.212853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:27.214033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:27.232475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.233440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.244192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:27.245518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:27.252430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.253441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.260820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.263771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.265557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.267706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.330686 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Cannot 'pause' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state paused Apr 30 21:30:27.333863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 409 to user: Cannot 'pause' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state paused {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:27.337299 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d066f1bd-b14a-42ea-a7f0-caef0c92be50 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 409 len: 143 microversion: 2.1 time: 0.128066 Apr 30 21:30:27.345649 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2239/4579] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:27 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 143 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:30:27.351685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e4a0ad57-5fe4-43b2-9abf-4768fb5b22a7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:27.353447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e4a0ad57-5fe4-43b2-9abf-4768fb5b22a7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:27.369814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a0ad57-5fe4-43b2-9abf-4768fb5b22a7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.371047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a0ad57-5fe4-43b2-9abf-4768fb5b22a7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.372791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a0ad57-5fe4-43b2-9abf-4768fb5b22a7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.373452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4a0ad57-5fe4-43b2-9abf-4768fb5b22a7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.591614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:27.623200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:27.636784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:27.636784 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-12c3f2a8-1189-45e3-9318-95f7498be1a6 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.393234 Apr 30 21:30:27.638395 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2341/4580] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:27 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:27.663105 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e4a0ad57-5fe4-43b2-9abf-4768fb5b22a7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 202 len: 0 microversion: 2.1 time: 0.320262 Apr 30 21:30:27.667015 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2240/4581] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:27 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:30:27.671798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:27.672432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:27.682936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.683400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:27.690390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:27.690860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:28.144633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:28.148027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:28.157643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:28.158147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:28.161796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:28.163725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:28.296872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:28.304814 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a6acbf6-5871-46d0-80b9-dc73e4df31e7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1497 microversion: 2.1 time: 0.636831 Apr 30 21:30:28.305397 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2342/4582] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:27 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1497 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:28.614100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-875293722", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:28.694601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] validate_networks() for [('370bffef-cf23-4a5f-a166-489a93a35b76', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:30:28.777969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:28.790416 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-253612d6-5007-4959-800a-4e4d6b7e5c9c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.650375 Apr 30 21:30:28.801569 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2241/4583] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:28 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:28.807711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:28.808679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:28.817606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:28.818437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:28.819615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:28.820282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:29.311872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:29.322788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:29.326445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:29.327976 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8d0b28cb-cde4-4ee4-8692-dcc26fcd4f8c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.524660 Apr 30 21:30:29.334779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2242/4584] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:28 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:29.345777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:29.346512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:29.357865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:29.359780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:29.360693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:29.361985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:29.774778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:29.782927 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e553d06e-31a1-4b9e-9d99-1383126e9a3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.446926 Apr 30 21:30:29.783506 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2243/4585] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:29 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:29.807543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:29.808733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:29.815196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:29.817678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:29.824703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:29.831096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:29.852979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:30:29.853546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:30:29.854028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:30:29.862429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:30:29.862429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:30:29.872936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:29.873462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:29.874478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:29.874928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:29.902706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:30:29.902706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for user 41a26877b24c4687a0c8cc4ffc6d69dd and project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:30:29.916313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:30:29.918920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:30:30.056988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:30.080659 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4744dbf1-5f28-427c-9e90-ca7f14746fbc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.273154 Apr 30 21:30:30.093128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7b132c39-abed-4156-9649-9575406081c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.666297 Apr 30 21:30:30.095752 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2343/4586] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:30:30.096008 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2244/4587] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:29 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:30.105411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:30.109180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:30.115917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:30.116416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:30.117869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:30.118299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:30.118459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:30.122406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:30.140543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:30.141258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:30.142816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:30.143402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:30.199698 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. Apr 30 21:30:30.210462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:30.213195 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a5a4c6b-7bb9-484c-a411-b8deececbba0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4/action" status: 404 len: 111 microversion: 2.1 time: 0.114254 Apr 30 21:30:30.220582 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2245/4588] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:30 2022] POST /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4/action => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:30.233949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-118c7c56-e7e1-4bec-861c-aca9b12ac425 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:30.234671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-118c7c56-e7e1-4bec-861c-aca9b12ac425 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:31.108464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-118c7c56-e7e1-4bec-861c-aca9b12ac425 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:31.117901 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-118c7c56-e7e1-4bec-861c-aca9b12ac425 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1221 microversion: 2.1 time: 0.897702 Apr 30 21:30:31.119161 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2246/4589] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:30 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1221 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:31.142199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:31.146886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:31.163001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:31.168926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:31.170332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:31.171633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:31.172400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:31.189129 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1b5de721-54d6-4e19-be49-136f8cce901c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 1.086373 Apr 30 21:30:31.200673 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2344/4590] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:30 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:31.230528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:31.236763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:31.288382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:31.289983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:31.291911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:31.301275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:31.623558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:31.632680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:31.634618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:31.635822 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-48792f82-f13a-4357-8c97-8c180f70b4e7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.427278 Apr 30 21:30:31.637256 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2345/4591] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:31 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:31.646671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1600258887", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:31.735783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] validate_networks() for [('370bffef-cf23-4a5f-a166-489a93a35b76', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:30:31.859833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:31.870208 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e36421b-a81b-4629-9aa7-94805ee5804b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.748956 Apr 30 21:30:31.870808 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2247/4592] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:31 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:31.893286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:31.894084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:31.904159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:31.904705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:31.905518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:31.906004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:32.284104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:32.303156 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d6ca568-a85a-47ba-abbc-9654605391e2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.418866 Apr 30 21:30:32.304291 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2248/4593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:31 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:32.309466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:32.310328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:32.321198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:32.324979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:32.324979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:32.324979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:32.634806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:32.642566 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9da79f4c-f5d2-455c-9555-75cd2883919c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.336968 Apr 30 21:30:32.643155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2249/4594] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:32 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:32.660516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-032f216e-d2b3-4437-960e-4620b0d9d5fd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:32.664678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-032f216e-d2b3-4437-960e-4620b0d9d5fd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: a7b7e97c-c468-454e-8363-e4871f1d0ff6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:32.682365 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-032f216e-d2b3-4437-960e-4620b0d9d5fd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance a7b7e97c-c468-454e-8363-e4871f1d0ff6 could not be found. Apr 30 21:30:32.683253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-032f216e-d2b3-4437-960e-4620b0d9d5fd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance a7b7e97c-c468-454e-8363-e4871f1d0ff6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:32.684301 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-032f216e-d2b3-4437-960e-4620b0d9d5fd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/a7b7e97c-c468-454e-8363-e4871f1d0ff6/action" status: 404 len: 111 microversion: 2.1 time: 0.035983 Apr 30 21:30:32.685051 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2250/4595] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:32 2022] POST /compute/v2.1/servers/a7b7e97c-c468-454e-8363-e4871f1d0ff6/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:32.694991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:32.696689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:32.708273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:32.708973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:32.709983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:32.710603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:32.935132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:32.937250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:32.938825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:32.940051 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f72ff997-a1e7-4ad7-aeee-6811c954b35d tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.251279 Apr 30 21:30:32.962788 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2251/4596] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:32 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:32.971583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:32.980793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:33.003311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.007671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:33.012146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.012848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:33.059214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:30:33.059723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:30:33.060165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:30:33.060901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:30:33.061527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:30:33.080726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.083777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:33.083777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.089221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:33.143584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:30:33.155953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for user 41a26877b24c4687a0c8cc4ffc6d69dd and project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:30:33.189661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:30:33.198806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:30:33.430595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:33.439556 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-21fc09f6-7156-4c6d-be76-b1254a7f7b99 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.473868 Apr 30 21:30:33.444442 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2252/4597] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:32 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:33.462047 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-046cc434-a4da-45f2-aa32-c52048dbd51d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.823426 Apr 30 21:30:33.466427 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2346/4598] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:30:33.470155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:33.470817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:33.480026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-12e5618a-d87f-446c-abde-6a0c30f91ae5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:33.493365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-12e5618a-d87f-446c-abde-6a0c30f91ae5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:33.493562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.493991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:33.495164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.495784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:33.735329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12e5618a-d87f-446c-abde-6a0c30f91ae5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:33.748298 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-12e5618a-d87f-446c-abde-6a0c30f91ae5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1222 microversion: 2.1 time: 0.272611 Apr 30 21:30:33.748791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2347/4599] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:33 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1222 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:33.778484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:33.779502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:33.790240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.792871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:33.792871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:33.797107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.147652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.155764 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b1c2f31-affb-4ed6-899b-a5ecd91048b3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.690991 Apr 30 21:30:34.156571 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2253/4600] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:33 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:34.161800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:34.162511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:34.168817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.169275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.170099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.170578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.175558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.185029 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-baae86be-4c11-4fbd-ada7-7895e7fb4b5a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.425076 Apr 30 21:30:34.187363 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2348/4601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:33 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:34.195347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:34.197168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:34.203385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.203892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.204708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.205152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.221890 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. Apr 30 21:30:34.223349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:34.224202 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6096d795-3360-42b8-a153-16fc46d8f473 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4/action" status: 404 len: 111 microversion: 2.1 time: 0.035701 Apr 30 21:30:34.225064 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2349/4602] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:34 2022] POST /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:34.233208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:34.234041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:34.240658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.241115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.241935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.242382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.246103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.254988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.297327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.297327 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-13834247-7306-498b-8d05-2d06d058fbab tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.136261 Apr 30 21:30:34.297327 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2254/4603] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:34 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:34.450104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.460487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a04deca0-6dd2-4860-a992-7cc0c2194db7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.229402 Apr 30 21:30:34.460487 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2350/4604] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:34 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:34.476380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:34.477019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:34.484367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.484838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.485861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.486852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.730620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.753433 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-69b4f99c-c298-4cff-9994-4b96a7a2e0e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.281351 Apr 30 21:30:34.754488 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2255/4605] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:34 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:34.765635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c869fdfc-5322-4abf-9b7e-b1afb6241684 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:34.766386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c869fdfc-5322-4abf-9b7e-b1afb6241684 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:34.776200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-576ce7c6-2164-46a7-94fc-334cc5467b9c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:34.778163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-576ce7c6-2164-46a7-94fc-334cc5467b9c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 18d857d9-0e46-4509-aac3-b8a6ba5200b2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:34.784220 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-576ce7c6-2164-46a7-94fc-334cc5467b9c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 18d857d9-0e46-4509-aac3-b8a6ba5200b2 could not be found. Apr 30 21:30:34.785786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-576ce7c6-2164-46a7-94fc-334cc5467b9c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 18d857d9-0e46-4509-aac3-b8a6ba5200b2 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:34.787249 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-576ce7c6-2164-46a7-94fc-334cc5467b9c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/18d857d9-0e46-4509-aac3-b8a6ba5200b2/action" status: 404 len: 111 microversion: 2.1 time: 0.015270 Apr 30 21:30:34.788339 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2256/4606] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:34 2022] POST /compute/v2.1/servers/18d857d9-0e46-4509-aac3-b8a6ba5200b2/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:34.798262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:34.802294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:34.807618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.808166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.809034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:34.809802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:34.859311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c869fdfc-5322-4abf-9b7e-b1afb6241684 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:34.886174 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c869fdfc-5322-4abf-9b7e-b1afb6241684 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1222 microversion: 2.1 time: 0.125042 Apr 30 21:30:34.888058 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2351/4607] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:34 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:35.022401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:35.032788 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b632bc49-0df4-43df-99d7-1d7aaddbab94 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.240263 Apr 30 21:30:35.034206 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2257/4608] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:34 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:35.052539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:35.063106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:35.084467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.085012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.085950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.086458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.204064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:35.204785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:35.212181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.212717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.213654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.214211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.228281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:35.235883 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2324e48e-0761-4731-967a-1968ac714514 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.187775 Apr 30 21:30:35.236458 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2352/4609] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:35 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:35.263420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80f9378d-e27b-442e-8a4f-f1f77b92f36c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:35.263420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80f9378d-e27b-442e-8a4f-f1f77b92f36c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 692a2bbc-682b-4ad2-9ea4-17723f8a0151] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:35.264940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-80f9378d-e27b-442e-8a4f-f1f77b92f36c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 692a2bbc-682b-4ad2-9ea4-17723f8a0151 could not be found. Apr 30 21:30:35.265930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80f9378d-e27b-442e-8a4f-f1f77b92f36c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 692a2bbc-682b-4ad2-9ea4-17723f8a0151 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:35.266943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80f9378d-e27b-442e-8a4f-f1f77b92f36c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/692a2bbc-682b-4ad2-9ea4-17723f8a0151/action" status: 404 len: 111 microversion: 2.1 time: 0.016585 Apr 30 21:30:35.267527 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2353/4610] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:35 2022] POST /compute/v2.1/servers/692a2bbc-682b-4ad2-9ea4-17723f8a0151/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:35.290139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:35.291470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:35.300783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.301598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.302804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.303703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.636878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:35.649840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cfdab61a-3e67-4874-9a3e-6451d58bec45 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1679 microversion: 2.1 time: 0.449832 Apr 30 21:30:35.650482 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2258/4611] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:35 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1679 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:35.663526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:35.680204 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1b99b048-ba4f-4624-b36d-8c896a740dea tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.396262 Apr 30 21:30:35.680797 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2354/4612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:35 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:35.698995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:35.699873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:35.712065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:35.717020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.717494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.718335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.718787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.724268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:35.763714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.764370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.765380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.765920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.885704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:35.897517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:35.899928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:35.901420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b9735c2-aefd-4fde-b4bd-a55a85b65e88 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.249747 Apr 30 21:30:35.915027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2259/4613] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:35 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:35.922369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:35.922369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:35.931640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.933207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:35.934371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:35.934865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.038230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:36.048463 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-66d5a9c7-94a4-460f-9e1d-88061ae7d00f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1218 microversion: 2.1 time: 0.132149 Apr 30 21:30:36.054033 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2260/4614] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:35 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:36.145235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:36.162271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e730c1f1-27f8-405b-bed5-5cd195efd2f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.453862 Apr 30 21:30:36.162867 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2355/4615] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:35 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:36.178970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:36.179529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:36.186184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.186909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.188034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.192278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.228899 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Cannot 'restore' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active Apr 30 21:30:36.229921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 409 to user: Cannot 'restore' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:36.230845 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aa44df01-a326-4497-97b3-b428a11d31f9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 409 len: 145 microversion: 2.1 time: 0.055940 Apr 30 21:30:36.231405 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2261/4616] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:36 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 145 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:30:36.240826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:36.241988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:36.251448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.251910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.255670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.256136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.526427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:36.535530 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9053701c-4e1d-4473-a8b6-0a11b1b9f4b4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.299067 Apr 30 21:30:36.538359 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2356/4617] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:36 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:36.553927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:36.554560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:36.561575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.562083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.562893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.563345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.673732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:36.674550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:36.692816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.694731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:36.696738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:36.698472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:37.626620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:37.641169 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d3c34a2-2c5a-4f7d-881d-be9f8dfdc1c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 1.090970 Apr 30 21:30:37.643864 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2262/4618] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:36 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:37.655019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:37.663837 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a2639ae-b284-4e6b-8186-1248b08bcbeb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1656 microversion: 2.1 time: 0.994997 Apr 30 21:30:37.678113 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2357/4619] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:36 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1656 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:37.678241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:37.678241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:37.678441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:37.678441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:37.696158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:37.696158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:37.696158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:37.696538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:37.697366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:37.697860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:37.698656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:37.699297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:37.920637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:37.928383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:37.932974 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a42a1196-e364-4321-9d6e-c736ebb9210d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1280 microversion: 2.1 time: 0.263121 Apr 30 21:30:37.934234 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2358/4620] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:37 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1280 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:37.939532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad8444f8-fb18-456b-b202-f3cf9ddb7a9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:37.941567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad8444f8-fb18-456b-b202-f3cf9ddb7a9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 4d43bc75-7cb4-45ba-b55d-ca50551bf41f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:37.951078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:37.951315 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ad8444f8-fb18-456b-b202-f3cf9ddb7a9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 4d43bc75-7cb4-45ba-b55d-ca50551bf41f could not be found. Apr 30 21:30:37.952045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad8444f8-fb18-456b-b202-f3cf9ddb7a9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 4d43bc75-7cb4-45ba-b55d-ca50551bf41f could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:37.953259 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad8444f8-fb18-456b-b202-f3cf9ddb7a9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/4d43bc75-7cb4-45ba-b55d-ca50551bf41f/action" status: 404 len: 111 microversion: 2.1 time: 0.017547 Apr 30 21:30:37.955798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2359/4621] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:37 2022] POST /compute/v2.1/servers/4d43bc75-7cb4-45ba-b55d-ca50551bf41f/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:37.955933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:37.960012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef08a993-ede8-4d7c-8c2a-0c0d528cf8b9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:37.962355 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-716ebfd5-873d-4e1e-98e5-04d8785022b7 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.303017 Apr 30 21:30:37.963868 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2263/4622] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:37 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:37.970507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef08a993-ede8-4d7c-8c2a-0c0d528cf8b9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:37.971242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef08a993-ede8-4d7c-8c2a-0c0d528cf8b9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:38.004282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:38.008516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:38.025627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef08a993-ede8-4d7c-8c2a-0c0d528cf8b9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Going to try to start instance {{(pid=130671) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 30 21:30:38.030392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:38.031117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:38.032154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:38.036759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:38.390037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:38.404361 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-354a97c5-5a35-49bc-b920-659aea1b4c86 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.430654 Apr 30 21:30:38.406298 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef08a993-ede8-4d7c-8c2a-0c0d528cf8b9 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.451107 Apr 30 21:30:38.409066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2360/4624] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:37 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:30:38.411663 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2264/4624] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:37 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:38.431855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:38.432865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:38.434545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:38.436612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:38.447537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:38.448063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:38.449231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:38.450857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:38.463514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:38.463514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:38.464250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:38.464944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.241043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:39.252420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-498b7874-65a5-4c33-8774-1e3cc860ab5b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.834151 Apr 30 21:30:39.256533 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2265/4625] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:38 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:39.279183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:39.280297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:39.297521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.298074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.298865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.299532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.564435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:39.571130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:39.585679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b6555f8a-402c-48b0-bb02-69f783e067f9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1280 microversion: 2.1 time: 0.321805 Apr 30 21:30:39.592606 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2266/4626] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:39 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:39.603269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:39.604105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:39.605595 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ecc1eec6-d005-4c16-be62-9b99e204478f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1665 microversion: 2.1 time: 1.187819 Apr 30 21:30:39.606836 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2361/4627] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:38 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1665 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:39.614141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b8c3c327-1005-4bfd-96f7-1e751d488f89 req-7a13f8ba-67ca-4df0-b711-4721815fbb69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7e10f1-c515-4ca6-9d45-1dadb182b495", "tag": "f6dea3ed-49b0-46d6-a0a1-fd1777349430"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:39.616245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.616923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.620066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.626244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.637331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b8c3c327-1005-4bfd-96f7-1e751d488f89 req-7a13f8ba-67ca-4df0-b711-4721815fbb69 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.637331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b8c3c327-1005-4bfd-96f7-1e751d488f89 req-7a13f8ba-67ca-4df0-b711-4721815fbb69 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.657497 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b8c3c327-1005-4bfd-96f7-1e751d488f89 req-7a13f8ba-67ca-4df0-b711-4721815fbb69 service nova] Creating event network-changed:f6dea3ed-49b0-46d6-a0a1-fd1777349430 for instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 on nch2-master-1 Apr 30 21:30:39.666565 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b8c3c327-1005-4bfd-96f7-1e751d488f89 req-7a13f8ba-67ca-4df0-b711-4721815fbb69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057432 Apr 30 21:30:39.667177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2362/4628] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:39.672844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:39.673729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:39.682262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.682969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.683982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.684429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.713597 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Cannot 'resume' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active Apr 30 21:30:39.716228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 409 to user: Cannot 'resume' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:39.717205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ccabfc1-a67d-4809-90db-0d294ea23859 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 409 len: 144 microversion: 2.1 time: 0.048576 Apr 30 21:30:39.718030 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2363/4629] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:39 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 144 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:30:39.729155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:39.730269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:39.743292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.744021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.744985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:39.745613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:39.849094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:39.866831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:39.871483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:39.871483 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e450706b-85de-4e1c-a7ec-4a9c8a63c82c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.275791 Apr 30 21:30:39.871483 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2267/4630] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:39 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:40.416624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:40.424586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-deb24b27-fbd3-4313-8dc5-7539a78704e6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.699650 Apr 30 21:30:40.426350 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2364/4631] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:39 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:40.446908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:40.448578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:40.468201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:40.468710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:40.469495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:40.471027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:40.608596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:40.610167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:40.621097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:40.622029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:40.624408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:40.625251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:41.054752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:41.064228 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ec3de46-f418-4a3e-8bc7-52575c4dcfeb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1280 microversion: 2.1 time: 0.460916 Apr 30 21:30:41.071190 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2365/4632] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:40 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1280 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:41.101237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:41.101900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:41.130081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:41.131184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:41.132471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:41.133151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:41.803819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:41.815791 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e12c0036-302e-4743-9c1e-7f65bbbe2126 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 1.372925 Apr 30 21:30:41.816658 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2268/4633] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:40 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:41.832143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:41.833286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:41.851405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:41.852283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:41.853337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:41.857879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:42.020755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:42.042057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab2c97e9-49bf-475c-ade1-1938c4a69f39 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1665 microversion: 2.1 time: 0.962761 Apr 30 21:30:42.042057 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2366/4634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:41 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1665 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:42.086935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:42.087859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:42.101560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:42.107258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:42.114466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:42.114466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:42.220777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:42.233315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:42.238348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:42.241094 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e3047f3-84dc-4b52-8d1b-d6dd44822a12 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.417137 Apr 30 21:30:42.241962 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2269/4635] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:41 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:42.249126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6fe81800-1119-49bd-8ea8-e0c9328accb8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c7cbed3c-359b-4472-8bf9-f34e2c55b91b"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:42.251103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6fe81800-1119-49bd-8ea8-e0c9328accb8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:42.251841 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6fe81800-1119-49bd-8ea8-e0c9328accb8 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008456 Apr 30 21:30:42.256162 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2270/4636] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:42 2022] POST /compute/v2.1/servers => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:30:42.269668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:42.270390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:42.293171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:42.293945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:42.294763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:42.295603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:42.539486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:42.548984 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53e1062e-7770-411c-aad8-12d95991e24b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.464572 Apr 30 21:30:42.560503 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2367/4637] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:42 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:42.584165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:42.610115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f344e662-3677-4065-a37e-aa0625d7d38f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.352557 Apr 30 21:30:42.623931 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2271/4638] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:42 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:42.628222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:42.628697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:42.662221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:42.662221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:42.667364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:42.669893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:43.056407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:43.061946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:43.062738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:43.073775 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01428e6a-563e-488e-a06a-714549339bc3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.449621 Apr 30 21:30:43.083304 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2368/4639] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:42 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:43.086511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:43.087680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:43.088120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:43.088580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:43.103192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82aeeafa-5dda-4b65-b100-6d1159386cee tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:43.103192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-82aeeafa-5dda-4b65-b100-6d1159386cee tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: da7fb8ab-35d4-4df9-8d81-58dc82bb52d3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:43.125796 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-82aeeafa-5dda-4b65-b100-6d1159386cee tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance da7fb8ab-35d4-4df9-8d81-58dc82bb52d3 could not be found. Apr 30 21:30:43.129145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82aeeafa-5dda-4b65-b100-6d1159386cee tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance da7fb8ab-35d4-4df9-8d81-58dc82bb52d3 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:30:43.135745 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-82aeeafa-5dda-4b65-b100-6d1159386cee tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/da7fb8ab-35d4-4df9-8d81-58dc82bb52d3/action" status: 404 len: 111 microversion: 2.1 time: 0.040393 Apr 30 21:30:43.137137 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2369/4640] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:43 2022] POST /compute/v2.1/servers/da7fb8ab-35d4-4df9-8d81-58dc82bb52d3/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:30:43.160173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:43.169435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:43.192183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:43.196725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:43.209088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:43.222941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:43.873782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:43.887426 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d20cf3b0-70fe-46bd-8809-e170b659c53f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1665 microversion: 2.1 time: 0.833935 Apr 30 21:30:43.903101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2272/4641] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:43 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1665 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:43.916878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:43.917603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:43.930879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:43.932695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:43.933532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:43.934406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:44.103290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:44.114068 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77bc9f7d-69a0-4249-a87b-87eed3dcdf25 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.966814 Apr 30 21:30:44.115196 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2370/4642] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:43 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:44.137485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:44.139382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:44.152129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:44.160816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:44.161898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:44.163076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:44.163663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:44.170478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:44.183137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:44.185577 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f3a409ce-6d34-444f-8012-fd9b8b7fe893 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.280977 Apr 30 21:30:44.187028 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2273/4643] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:43 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:44.204588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:44.208165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:44.218715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:44.220560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:44.223832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:44.226717 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:45.086977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:45.090715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:45.098072 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c53fd54-a234-4397-b710-302b802b593c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.981615 Apr 30 21:30:45.102580 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-60726b6c-3602-4e51-893d-3453e4634b30 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.913552 Apr 30 21:30:45.103839 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2274/4644] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:44 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:45.111428 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2371/4645] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:44 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:45.123861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:45.125662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:45.128623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:45.129428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:45.144303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:45.145224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:45.147126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:45.149122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:45.149921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:45.161559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:45.162751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:45.164429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:45.252744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lazy-loading 'flavor' on Instance uuid 7dc46f81-a8bd-46ba-b2c4-6a859c458690 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:30:45.812273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:45.821399 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0498218d-89cf-48f7-b1ba-2cb9137d224c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.716466 Apr 30 21:30:45.831700 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2275/4646] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:45 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:45.837499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:45.838433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:45.845414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:45.846476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:45.848279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:45.848901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:46.048029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:46.068494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:46.070566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:46.072747 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4641a66-9bf6-4ce6-9e7a-f2feb478fe79 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.239717 Apr 30 21:30:46.086372 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2276/4647] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:45 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:46.098254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:46.099279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:46.109797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:46.110616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:46.112886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:46.113628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:46.240218 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6a2bc60-e96f-4517-aa80-a060c2f6fee1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 202 len: 0 microversion: 2.1 time: 1.124704 Apr 30 21:30:46.241439 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2372/4648] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:45 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:30:46.251063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:46.252018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:46.261208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:46.262060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:46.275508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:46.277127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:46.870235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:46.880657 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a106c4a5-f14b-43c1-882d-6e32cec6061b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.792730 Apr 30 21:30:46.899430 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2277/4649] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:46 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:46.915909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:46.921014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:46.927284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:46.928987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:46.930154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:46.931539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:47.072642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:47.081599 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7c8dab14-971f-48b6-a638-92545e52f992 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.837905 Apr 30 21:30:47.083411 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2373/4650] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:46 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:47.090641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ff200c8b-b802-48db-ab67-439613fb9dc7 req-befa6754-b23b-4829-86bb-8619c15e440e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972883b8-db95-40bb-bec0-6e16a9ee35d8", "tag": "d5503947-830f-4d9d-94cc-e5a9c55e9a7c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:47.101575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ff200c8b-b802-48db-ab67-439613fb9dc7 req-befa6754-b23b-4829-86bb-8619c15e440e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:47.102199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ff200c8b-b802-48db-ab67-439613fb9dc7 req-befa6754-b23b-4829-86bb-8619c15e440e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:47.128198 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ff200c8b-b802-48db-ab67-439613fb9dc7 req-befa6754-b23b-4829-86bb-8619c15e440e service nova] Creating event network-changed:d5503947-830f-4d9d-94cc-e5a9c55e9a7c for instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 on nch2-master-1 Apr 30 21:30:47.136607 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ff200c8b-b802-48db-ab67-439613fb9dc7 req-befa6754-b23b-4829-86bb-8619c15e440e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048519 Apr 30 21:30:47.137728 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2374/4651] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:47.154839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:47.169999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:47.187602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:47.188460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:47.194301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:47.195065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.046500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:48.063515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:48.079476 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d89c138-3c00-4bbe-aa26-c7f129d752d4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 1.178705 Apr 30 21:30:48.083056 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-780aa2f4-c035-49e6-a5a3-3e3775225df8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.935042 Apr 30 21:30:48.097530 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2375/4652] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:47 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:48.102556 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2278/4653] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:46 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:48.119293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-51d6d406-cfa8-48f0-ab43-e9d36be5f15b req-7cfd58b2-1f3d-450c-be9f-43b2e54a8aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7e10f1-c515-4ca6-9d45-1dadb182b495", "name": "network-vif-plugged", "status": "completed", "tag": "f6dea3ed-49b0-46d6-a0a1-fd1777349430"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:48.120649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:48.131116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:48.155742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-51d6d406-cfa8-48f0-ab43-e9d36be5f15b req-7cfd58b2-1f3d-450c-be9f-43b2e54a8aeb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:48.156195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-51d6d406-cfa8-48f0-ab43-e9d36be5f15b req-7cfd58b2-1f3d-450c-be9f-43b2e54a8aeb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.161330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:48.163540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.164516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:48.164982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.207510 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-51d6d406-cfa8-48f0-ab43-e9d36be5f15b req-7cfd58b2-1f3d-450c-be9f-43b2e54a8aeb service nova] Creating event network-vif-plugged:f6dea3ed-49b0-46d6-a0a1-fd1777349430 for instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 on nch2-master-1 Apr 30 21:30:48.225182 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-51d6d406-cfa8-48f0-ab43-e9d36be5f15b req-7cfd58b2-1f3d-450c-be9f-43b2e54a8aeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121941 Apr 30 21:30:48.227193 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2376/4654] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:48.287939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:48.293694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:48.327846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:48.328334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.329182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:48.334307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.523835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:48.535003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:48.536959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:48.540183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0849fa33-3e1a-4ee9-8e5e-d99690315d5b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.435221 Apr 30 21:30:48.544243 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2279/4655] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:48 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:48.551796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:48.558100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:48.570436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:48.574978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.575870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:48.576340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:48.994732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:49.008955 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5169b33d-e52a-41e2-979b-6c39867b2a0e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.770386 Apr 30 21:30:49.009735 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2377/4656] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:48 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:49.074263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:49.096352 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0687bda8-67a8-48f9-85d0-dbeaf8bb6a78 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.539077 Apr 30 21:30:49.107987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:49.109303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:49.118460 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2280/4657] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:48 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:49.135598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.136585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.145246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.146339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:49.148778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.152344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:49.174428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.175833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.177019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.177968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.498790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:49.511900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:49.515416 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9271b87f-d4a6-486e-b3ea-d975d6c0eede tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.414729 Apr 30 21:30:49.520915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0cee0fb6-ec23-41aa-8a52-1f0644086503 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.401083 Apr 30 21:30:49.522007 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2378/4658] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:49 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:49.533750 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2281/4659] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:49 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:49.540557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:49.542281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:49.549191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.563034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:49.563905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.565007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.566220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.567011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:49.590638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.598397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.599444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:49.600029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:49.645310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lazy-loading 'flavor' on Instance uuid 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:30:49.770850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:49.781390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:49.786154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:49.786154 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-80735b1b-d8b8-4f3b-b5c8-82760d020f29 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1366 microversion: 2.47 time: 0.225828 Apr 30 21:30:49.786406 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2282/4660] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:49 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:50.026500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:50.027654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:50.034926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.035670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.036935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.038213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.093958 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d8d86fd-37e1-40e2-9724-09723419642c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.555046 Apr 30 21:30:50.094651 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2379/4661] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:49 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:30:50.119348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:50.124411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:50.150578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.150578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.151325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.158160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.335747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:50.355795 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4bd2a5a6-baa6-459b-ae92-bce8e7b85f19 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.322624 Apr 30 21:30:50.355795 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2283/4662] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:50 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:50.584653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:50.594862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:50.598874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:50.619204 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-69f2dde7-2e88-4b04-8fd2-3e57bcb322a1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1677 microversion: 2.1 time: 0.503825 Apr 30 21:30:50.620269 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2380/4663] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:50 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1677 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:50.646395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.646853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.647965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.648558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.804786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:50.806021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:50.813083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.814069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.815740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:50.816408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:50.980306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:50.989147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:50.990864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:50.992088 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-916eb2ac-f13e-4b19-97fc-558a40ab9956 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1384 microversion: 2.47 time: 0.192357 Apr 30 21:30:50.995291 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2381/4664] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:50 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1384 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:30:51.238380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:51.251376 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9ed4632-b48c-4909-9719-15372ec74664 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.703062 Apr 30 21:30:51.253500 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2284/4665] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:50 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:51.372409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:51.373036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:51.379468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:51.382068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:51.382068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:51.382068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:51.638643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:51.645769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:51.646422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:51.653643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:51.654326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:51.657779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:51.658749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:51.662284 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d5d7306b-9eda-4df8-bc1d-8082e994b1f2 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.294258 Apr 30 21:30:51.663643 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2382/4666] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:51 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:52.011387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:52.012289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:52.026046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.026904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.031652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.032298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.188690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:52.210234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:52.212251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:52.217920 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80884c57-41ab-4064-a44d-c88855114b67 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1372 microversion: 2.47 time: 0.206182 Apr 30 21:30:52.220475 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2383/4667] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:52 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:30:52.245169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:52.255404 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-746707f2-772c-4c0e-a267-d91046225977 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1660 microversion: 2.1 time: 0.621517 Apr 30 21:30:52.256684 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2285/4668] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:51 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1660 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:52.279461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:52.279840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:52.287127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e41c6fac-4c04-422c-a6a4-af11502f1aef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:52.287768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e41c6fac-4c04-422c-a6a4-af11502f1aef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:52.290316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.291136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.292234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.292821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.297138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e41c6fac-4c04-422c-a6a4-af11502f1aef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.297655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e41c6fac-4c04-422c-a6a4-af11502f1aef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.298650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e41c6fac-4c04-422c-a6a4-af11502f1aef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.299066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e41c6fac-4c04-422c-a6a4-af11502f1aef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.538742 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e41c6fac-4c04-422c-a6a4-af11502f1aef tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action" status: 202 len: 0 microversion: 2.1 time: 0.256694 Apr 30 21:30:52.551231 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2286/4669] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:52 2022] POST /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:30:52.561197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:52.561197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:52.577309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.577898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.578733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.579197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.587593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:52.595698 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aa25310a-36e1-4652-84d8-ff8ee0183409 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.329853 Apr 30 21:30:52.596807 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2384/4670] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:52 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:52.702260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:52.705213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:52.719171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.719644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:52.730151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:52.732242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:53.114468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:53.131048 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-315a4a92-2a51-4470-9278-6102bee31bb4 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1666 microversion: 2.1 time: 0.577610 Apr 30 21:30:53.134858 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2287/4671] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:52 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1666 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:53.242233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:53.244003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:53.266245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:53.268874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:53.274701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:53.275664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:53.295826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:53.304704 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c7e088f1-f28c-426c-af89-a8f6bb010e15 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.628523 Apr 30 21:30:53.309741 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2385/4672] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:52 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:53.613289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:53.614775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:53.630650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:53.631278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:53.632275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:53.632873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:53.846101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:53.857065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:53.858613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:53.860000 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-382aa385-c9c0-498b-814a-534790342559 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1372 microversion: 2.47 time: 0.622790 Apr 30 21:30:53.870280 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2288/4673] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:53 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1372 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:53.923805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:53.932816 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d97f2496-00f3-462b-b6c3-7d24cbe0b7e3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.324093 Apr 30 21:30:53.945257 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2386/4674] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:53 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:54.152665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:54.153398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:54.164423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.164999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:54.165896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.166349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:54.321218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:54.322919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:54.331331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.332333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:54.353872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.353872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:54.538642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:54.546451 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-487b1219-bcbe-4971-a154-3912fb87f2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1666 microversion: 2.1 time: 0.397686 Apr 30 21:30:54.556927 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2289/4675] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:54 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1666 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:54.645878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:54.658755 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b8519835-fa5b-4240-8908-b0420f5778f0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.341517 Apr 30 21:30:54.668633 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2387/4676] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:54 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:54.885609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:54.886441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:54.896547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.898332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:54.899482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.900846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:54.952933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:54.954295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:54.963187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.967773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:54.969123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:54.973006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.069614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.086400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.096411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.096411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-42856e75-f51c-4f3c-953c-60cf8da728ae tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1357 microversion: 2.47 time: 0.217462 Apr 30 21:30:55.098832 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2290/4677] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:54 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:55.112562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-515f0fe2-f81c-47e3-9e1c-754c84ca9586 req-85103def-c283-41f0-810f-c679e8b82bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972883b8-db95-40bb-bec0-6e16a9ee35d8", "name": "network-vif-plugged", "status": "completed", "tag": "d5503947-830f-4d9d-94cc-e5a9c55e9a7c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:55.126279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-515f0fe2-f81c-47e3-9e1c-754c84ca9586 req-85103def-c283-41f0-810f-c679e8b82bde service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.126989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-515f0fe2-f81c-47e3-9e1c-754c84ca9586 req-85103def-c283-41f0-810f-c679e8b82bde service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.142797 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-515f0fe2-f81c-47e3-9e1c-754c84ca9586 req-85103def-c283-41f0-810f-c679e8b82bde service nova] Creating event network-vif-plugged:d5503947-830f-4d9d-94cc-e5a9c55e9a7c for instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 on nch2-master-1 Apr 30 21:30:55.150448 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-515f0fe2-f81c-47e3-9e1c-754c84ca9586 req-85103def-c283-41f0-810f-c679e8b82bde service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049139 Apr 30 21:30:55.153680 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2291/4678] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:30:55.158798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:55.165914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.167453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Searching by: {'deleted': False, 'project_id': 'b5de501af17b45a596e24e0fe7611ece'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 21:30:55.178182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.188809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.188809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.188809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.378340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.378498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 21:30:55.391988 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26f3b137-a6d9-48aa-977a-358866e0088b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.443341 Apr 30 21:30:55.400751 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2388/4679] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:54 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:55.507301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.515209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.515871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.536989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.540360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.567406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:55.567406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:55.576410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.579763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.582766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.583224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.583823 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a60a8099-ec05-414a-9ec3-e6ee6f5b2307 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.430785 Apr 30 21:30:55.585161 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2292/4680] 10.222.0.23 () {60 vars in 1186 bytes} [Sat Apr 30 21:30:55 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:55.607090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:55.607729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:55.614451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.615188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.616721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.617321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.650716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:30:55.798548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:55.822402 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20048967-f9e0-4836-a52c-7d9c679ee4ec tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1666 microversion: 2.1 time: 0.262039 Apr 30 21:30:55.832587 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2389/4681] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:55 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1666 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:55.839040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:55.839664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:55.845626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.846809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.847604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:55.848049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:55.997459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:56.013994 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9237d8c6-51ef-4709-aa9d-f448f403ec7d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1322 microversion: 2.1 time: 0.178743 Apr 30 21:30:56.029182 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2390/4682] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:55 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:56.160142 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ec8e632-6b18-4287-b6ec-f6ca4c934cd8 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 204 len: 0 microversion: 2.47 time: 0.557121 Apr 30 21:30:56.166041 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2293/4683] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:30:55 2022] DELETE /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:30:56.176731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:56.177388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:56.191746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:56.192400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:56.198832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:56.199474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:56.307564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:56.316874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:56.318486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:56.321310 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0af0fe40-d41a-4d14-95af-83c9933893e3 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1363 microversion: 2.47 time: 0.150532 Apr 30 21:30:56.322498 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2391/4684] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:56 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:56.420442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:56.422032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:56.433645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:56.434335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:56.435311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:56.435948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:56.691743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:56.699851 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aa543345-ff11-4924-93ca-f6e93acf5de0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.284882 Apr 30 21:30:56.710238 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2294/4685] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:56 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:56.840284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:56.840810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:56.848473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:56.848937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:56.849733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:56.850205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.020462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:57.030830 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31224fc9-b401-4d15-be15-6431d2186045 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.194285 Apr 30 21:30:57.032012 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2392/4686] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:56 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:57.048041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:57.050154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:57.051711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:57.052520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:57.061564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.062267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.068286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.068286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.068468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.068468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.068468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.068468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.389052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:57.405577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-664bc81b-d8fc-4a83-a3a9-f64dd5896beb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1669 microversion: 2.1 time: 0.360421 Apr 30 21:30:57.409269 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2393/4687] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:57 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:57.415945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:57.416740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:57.428409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.429058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.430190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.430858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.439192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:57.452909 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02f3edd4-1187-4488-b0ac-7b88a75ab145 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1515 microversion: 2.1 time: 0.408040 Apr 30 21:30:57.464594 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2295/4688] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:57 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:30:57.469773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:57.470563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:57.499960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.502913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.509290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.509290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.557810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:30:57.558417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:57.567032 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Working on deleting snapshot 54ec0891-de30-4ac3-8570-6b6c7a4a999c from shelved instance... Apr 30 21:30:57.570837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:57.572525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:57.574260 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a41e6662-358e-4532-91cf-bb5f4c7394ed tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1363 microversion: 2.47 time: 0.162645 Apr 30 21:30:57.593985 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2394/4689] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:57 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:57.604115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:57.608721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:57.623632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.630779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.631728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:57.632228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:57.685632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lazy-loading 'flavor' on Instance uuid 972883b8-db95-40bb-bec0-6e16a9ee35d8 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:30:58.148398 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1b71aaca-d4d5-43cd-a422-10716a6c6941 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8/action" status: 200 len: 32 microversion: 2.1 time: 0.552665 Apr 30 21:30:58.149013 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2395/4690] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:30:57 2022] POST /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8/action => generated 32 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:30:58.157146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:58.159489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:58.175471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:58.176378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:58.177359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:58.177850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:58.554743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:58.565069 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77518c10-6c05-49cd-acc8-442bfd0e9cb6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.414563 Apr 30 21:30:58.567471 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2396/4691] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:58 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:58.579207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:58.582117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:58.598257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:58.599243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:58.600223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:58.600864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:58.835280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:58.849202 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6d583906-69be-4930-98a7-55c42de8918d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.279119 Apr 30 21:30:58.850574 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2397/4692] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:58 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:30:58.856145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:30:58.857137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:30:58.867243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:58.868647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:58.869924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:58.870514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:58.954378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:58.954844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:58.955350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lazy-loading 'fault' on Instance uuid 8de711a6-047f-4a09-a2f0-ccd2b835c16d {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:30:59.044574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:59.056171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:59.058084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:30:59.060068 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89bb9217-1436-4551-8d11-a64aa84a89fb tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 200 len: 1368 microversion: 2.47 time: 0.207852 Apr 30 21:30:59.061023 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2398/4693] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:30:58 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:30:59.073176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1199247545", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "b5a76fe5-1607-43e6-8432-9aab1bc20c97"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:30:59.178819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] validate_networks() for [('b5a76fe5-1607-43e6-8432-9aab1bc20c97', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:30:59.447216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Doing local delete in cell a79cdb58-89e7-4a84-81e2-51e402cc5dd5(cell1) {{(pid=130670) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 30 21:30:59.448428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:30:59.448955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:30:59.449464 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 30 21:30:59.453426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] deallocate_for_instance() {{(pid=130670) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} Apr 30 21:31:00.029003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:31:00.029003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:31:00.029003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:31:00.029003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:31:00.029003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:31:00.046694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:00.048003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:00.054524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:00.055060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:00.085156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Getting quotas for project 83c1c99c0d904b58946a2a623c674759. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:31:00.099462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Getting quotas for user 1e5bf319f22145459e3c71d158430d63 and project 83c1c99c0d904b58946a2a623c674759. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:31:00.118090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:31:00.120764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:31:00.338527 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3fc69078-cba7-4280-a51d-95bb19943cf2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269598 Apr 30 21:31:00.350876 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2399/4694] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:30:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:31:00.355572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:00.356209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:00.364656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:00.365344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:00.366503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:00.367107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:00.683313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:00.691290 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d3a6962a-cdb5-42f7-8233-13f40390f00f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.340889 Apr 30 21:31:00.694930 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2400/4695] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:00 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:00.697537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:00.698719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:00.712815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:00.713629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:00.714624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:00.715224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:00.751215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Updating instance_info_cache with network_info: [] {{(pid=130670) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 30 21:31:01.335168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:01.343818 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe94e14d-d917-4ce0-a965-bdbca4687f25 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.650005 Apr 30 21:31:01.344445 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2401/4696] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:00 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:01.366973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:01.367604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: 8de711a6-047f-4a09-a2f0-ccd2b835c16d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:01.375442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.376137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.376990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.377981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.395197 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] HTTP exception thrown: Instance 8de711a6-047f-4a09-a2f0-ccd2b835c16d could not be found. Apr 30 21:31:01.396054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Returning 404 to user: Instance 8de711a6-047f-4a09-a2f0-ccd2b835c16d could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:01.397101 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-60be8019-49a5-4540-a7b6-747911f00921 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d" status: 404 len: 111 microversion: 2.47 time: 0.043254 Apr 30 21:31:01.397654 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2402/4697] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:31:01 2022] GET /compute/v2.1/servers/8de711a6-047f-4a09-a2f0-ccd2b835c16d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:31:01.402632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42ef8bb8-8720-4381-80da-08f232e91ae9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:01.403255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42ef8bb8-8720-4381-80da-08f232e91ae9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:01.484333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42ef8bb8-8720-4381-80da-08f232e91ae9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:01.494221 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42ef8bb8-8720-4381-80da-08f232e91ae9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1214 microversion: 2.1 time: 0.095241 Apr 30 21:31:01.496339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2403/4698] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:01 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:01.511809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-48fdff08-d2ae-450e-89bf-156440bbb793 req-38119a09-4cf5-49f0-8bdc-1471a79fd070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78ceea4-5d4e-46b9-a50d-18210101ab3f", "name": "network-vif-deleted", "tag": "f2e67c00-e892-4977-95b6-739f701898d8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:01.554966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-48fdff08-d2ae-450e-89bf-156440bbb793 req-38119a09-4cf5-49f0-8bdc-1471a79fd070 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.555878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-48fdff08-d2ae-450e-89bf-156440bbb793 req-38119a09-4cf5-49f0-8bdc-1471a79fd070 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.573795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.compute.server_external_events [req-48fdff08-d2ae-450e-89bf-156440bbb793 req-38119a09-4cf5-49f0-8bdc-1471a79fd070 service nova] Unable to find a host for instance d78ceea4-5d4e-46b9-a50d-18210101ab3f. Dropping event network-vif-deleted {{(pid=130671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 30 21:31:01.576655 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-48fdff08-d2ae-450e-89bf-156440bbb793 req-38119a09-4cf5-49f0-8bdc-1471a79fd070 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.076993 Apr 30 21:31:01.580014 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2404/4699] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 30 21:31:01.588442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:01.589573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:01.605886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.606695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.608078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.609140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.653890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:31:01.718492 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f24980ce-3ff0-4fc4-8529-59018e95e2be tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 204 len: 0 microversion: 2.1 time: 4.252464 Apr 30 21:31:01.723060 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2296/4700] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:30:57 2022] DELETE /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 0 bytes in 4254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:31:01.729380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:01.730249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:01.737232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.737942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.739037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.739558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.894063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:01.903941 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-685f8edd-0c23-4af9-8315-a36907895f9e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.177701 Apr 30 21:31:01.905317 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2297/4701] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:01 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:01.911773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:01.912610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: d78ceea4-5d4e-46b9-a50d-18210101ab3f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:01.919539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.920253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.921259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.921988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.939290 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] HTTP exception thrown: Instance d78ceea4-5d4e-46b9-a50d-18210101ab3f could not be found. Apr 30 21:31:01.940379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Returning 404 to user: Instance d78ceea4-5d4e-46b9-a50d-18210101ab3f could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:01.942252 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44628c31-7e46-40ba-bb93-6389d7ad8b33 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f" status: 404 len: 111 microversion: 2.1 time: 0.035754 Apr 30 21:31:01.943360 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2298/4702] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:01 2022] GET /compute/v2.1/servers/d78ceea4-5d4e-46b9-a50d-18210101ab3f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:01.955941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:01.956510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:01.963831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.964395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:01.965274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:01.966013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.005445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:31:02.131835 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3653b35-84ef-4e75-940c-4be6c3b4158a tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196" status: 204 len: 0 microversion: 2.47 time: 0.546984 Apr 30 21:31:02.133165 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2405/4703] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:31:01 2022] DELETE /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:31:02.149196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:02.150186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:02.163144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.164391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.167031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.167966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.263046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:02.279316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:02.280761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:02.282013 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75e3b345-470f-4684-b814-1699d81a73c2 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196" status: 200 len: 1362 microversion: 2.47 time: 0.143684 Apr 30 21:31:02.285807 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2406/4704] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:31:02 2022] GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:31:02.363619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:02.364558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:02.371539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.372140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.373052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.373635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.403325 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2834ca76-4a51-4c89-b6ed-6b9d7a4410f8 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "DELETE /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 204 len: 0 microversion: 2.1 time: 0.455180 Apr 30 21:31:02.406130 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2299/4705] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:31:01 2022] DELETE /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:31:02.415191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:02.419066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:02.430526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.431062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.431961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.432576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.582012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:02.589810 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-167c9ee5-902a-4b13-97fe-7daf93fadd7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1466 microversion: 2.1 time: 0.179138 Apr 30 21:31:02.599998 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2300/4706] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:02 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1466 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:02.604820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:02.605383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:02.619337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:02.626170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.627761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.628192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.628775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.638552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6118705-8865-4eeb-8417-5de8b3671b57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.279057 Apr 30 21:31:02.640329 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2407/4707] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:02 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:02.733103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:02.740890 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df0a7a0a-1b7b-496d-9ca4-8f1a90329b4b tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1218 microversion: 2.1 time: 0.140081 Apr 30 21:31:02.749877 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2301/4708] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:02 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:02.922864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:02.923593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:02.936735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.938293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:02.939211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:02.942383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.100374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:03.108407 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a7f298d1-fb84-461f-acac-866e4b3a3530 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.190129 Apr 30 21:31:03.109063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2408/4709] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:02 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:03.304359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:03.306129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:03.313365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.314258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.316107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.316712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.393822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:03.407355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:03.409812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:03.411296 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a41f3ab8-6b7c-41f4-922b-eaeab7c30a6c tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196" status: 200 len: 1362 microversion: 2.47 time: 0.114790 Apr 30 21:31:03.412409 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2302/4710] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:31:03 2022] GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196 => generated 1362 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:31:03.609986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:03.610615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:03.617266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.619132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.619952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.620728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.659921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:03.661058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:03.682841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.683309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.684139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.689697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.722670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:03.731307 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4572258d-8fc6-45c8-99da-893b14882800 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1466 microversion: 2.1 time: 0.125310 Apr 30 21:31:03.741905 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2409/4711] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:03 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1466 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:03.758544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:03.759480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:03.766759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.769192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.770134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:03.771500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:03.867344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:03.877703 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-77ec8a71-8b4a-43a5-968b-85762e01cad9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.223927 Apr 30 21:31:03.878341 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2303/4712] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:03 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:03.913257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:03.923384 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee1ef446-6dd8-4dde-8513-d0aec3399f19 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1210 microversion: 2.1 time: 0.168883 Apr 30 21:31:03.924416 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2410/4713] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:03 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:04.136079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:04.136809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:04.144047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.146163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.146163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.146163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.430789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:04.431431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:04.446335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.448187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.449011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.449460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.465502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:04.477039 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e7d6bef-72d8-40c5-9b5e-ecd4f95bf2e0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.355139 Apr 30 21:31:04.478990 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2304/4714] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:04 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:04.500661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.501125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.501703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lazy-loading 'fault' on Instance uuid b30f3a5d-3ae9-4c27-839b-b16f7f55d196 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:31:04.604340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:04.614591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:04.618045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea92ff9a9c1142ce8890ab1379535f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de501af17b45a596e24e0fe7611ece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:04.620140 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-05b2b46a-6f5e-4b2c-89a5-aeee10e2dd95 tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196" status: 200 len: 1367 microversion: 2.47 time: 0.193284 Apr 30 21:31:04.620983 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2411/4715] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:31:04 2022] GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:31:04.750078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:04.754419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:04.758114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.758580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.759380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.759829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.894908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:04.895114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:04.905687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.906743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:04.923721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.925354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.925840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.951472 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5ae3b96-36e9-45b6-be03-0fdddb112553 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1466 microversion: 2.1 time: 0.203697 Apr 30 21:31:04.954638 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2305/4716] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:04 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1466 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:04.969116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:04.970143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:04.988224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.992442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:04.992442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:04.992442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:05.443121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:05.454913 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94cc4596-1211-4f3b-a4d4-82b8c737dfa7 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1274 microversion: 2.1 time: 0.497238 Apr 30 21:31:05.455560 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2306/4717] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:04 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1274 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:05.495558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5ac11b28-d81d-422d-a44d-a7740bef13ff req-71477a71-4bf8-4475-a7c4-80fa6c8cc426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563b93e0-a029-49fe-a501-1c8c192370d0", "name": "network-vif-deleted", "tag": "432d721f-3bf6-4293-bd4a-313b2128a6fb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:05.507835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5ac11b28-d81d-422d-a44d-a7740bef13ff req-71477a71-4bf8-4475-a7c4-80fa6c8cc426 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:05.508620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5ac11b28-d81d-422d-a44d-a7740bef13ff req-71477a71-4bf8-4475-a7c4-80fa6c8cc426 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:05.561435 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5ac11b28-d81d-422d-a44d-a7740bef13ff req-71477a71-4bf8-4475-a7c4-80fa6c8cc426 service nova] Creating event network-vif-deleted:432d721f-3bf6-4293-bd4a-313b2128a6fb for instance 563b93e0-a029-49fe-a501-1c8c192370d0 on nch2-master-1 Apr 30 21:31:05.568113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5ac11b28-d81d-422d-a44d-a7740bef13ff req-71477a71-4bf8-4475-a7c4-80fa6c8cc426 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084507 Apr 30 21:31:05.569045 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2307/4718] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:31:05.580969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:05.581409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:05.581409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:05.603707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:05.606346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:05.606346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:05.606346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:05.608470 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df779cc8-32b0-4ded-a9eb-5458bc0c85c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.716874 Apr 30 21:31:05.609159 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2412/4719] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:04 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:05.642190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:05.643391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] [instance: b30f3a5d-3ae9-4c27-839b-b16f7f55d196] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:05.663906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:05.663906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:05.663906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:05.663906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:05.687631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] HTTP exception thrown: Instance b30f3a5d-3ae9-4c27-839b-b16f7f55d196 could not be found. Apr 30 21:31:05.692675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] Returning 404 to user: Instance b30f3a5d-3ae9-4c27-839b-b16f7f55d196 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:05.692675 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-223e9623-2fe4-4932-b116-740bd1196f6b tempest-ServerShowV247Test-1105272084 tempest-ServerShowV247Test-1105272084-project] 10.222.0.23 "GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196" status: 404 len: 111 microversion: 2.47 time: 0.051884 Apr 30 21:31:05.692675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2413/4720] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:31:05 2022] GET /compute/v2.1/servers/b30f3a5d-3ae9-4c27-839b-b16f7f55d196 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:31:05.882675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:05.890699 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4014ddcc-e7ff-47bb-a128-f4341947be27 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.320173 Apr 30 21:31:05.891898 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2308/4721] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:05 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:05.976490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:05.977116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:05.983202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:05.983836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:05.984686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:05.985134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:06.030112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:06.030655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:06.031128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lazy-loading 'fault' on Instance uuid 563b93e0-a029-49fe-a501-1c8c192370d0 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:31:06.099411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:06.107539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-067f9644-76c7-421c-8066-e1fc4619a605 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 200 len: 1305 microversion: 2.1 time: 0.134801 Apr 30 21:31:06.108423 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2414/4722] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:05 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:06.472928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:06.473556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:06.487873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:06.488883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:06.489992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:06.490650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:06.638669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:06.638669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:06.645242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:06.645882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:06.648785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:06.649261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:06.839577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:06.849422 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8dc28afe-6e47-4ce3-addd-724e5d088ad6 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 0.380968 Apr 30 21:31:06.853686 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2309/4723] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:06 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:06.894423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:06.904225 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6cb09d8-d77e-41cf-9652-606b20df60f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.281569 Apr 30 21:31:06.910858 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2415/4724] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:06 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:06.914559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:06.915252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:06.924862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:06.927256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:06.928085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:06.930266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.128489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:07.129217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 563b93e0-a029-49fe-a501-1c8c192370d0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:07.139569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.139569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.149747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.149747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.163501 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] HTTP exception thrown: Instance 563b93e0-a029-49fe-a501-1c8c192370d0 could not be found. Apr 30 21:31:07.164285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Returning 404 to user: Instance 563b93e0-a029-49fe-a501-1c8c192370d0 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:07.165215 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-657f314a-965c-43f0-996f-0de9f69d24eb tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0" status: 404 len: 111 microversion: 2.1 time: 0.044572 Apr 30 21:31:07.168712 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2416/4725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:07 2022] GET /compute/v2.1/servers/563b93e0-a029-49fe-a501-1c8c192370d0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:31:07.185308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:07.198777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:07.199570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:07.199764 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75fab12c-bc67-4cd8-b7f3-09f2c998875d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.292422 Apr 30 21:31:07.205655 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2310/4726] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:06 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:07.224899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.227192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.228631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.234511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.261016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:31:07.558600 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d2289e7-9dff-4cb6-9842-85e8cdbdcd9e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 204 len: 0 microversion: 2.1 time: 0.385387 Apr 30 21:31:07.559088 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2417/4727] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:31:07 2022] DELETE /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:31:07.569470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:07.571290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:07.582404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.583067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.584448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.585255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.781888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:07.799482 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8da11b6-6f94-4700-8f5e-4ee48f7cb4de tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1509 microversion: 2.1 time: 0.235240 Apr 30 21:31:07.801340 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2311/4728] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:07 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:07.875865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:07.877345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:07.885094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.885605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.886651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.887294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.921386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:07.922048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:07.928953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.929708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:07.930688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:07.931297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:08.092245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:08.100451 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fbd8a92a-dd02-4bb6-a060-40369ba91b61 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 0.230245 Apr 30 21:31:08.101650 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2418/4729] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:07 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:08.135712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:08.156838 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5049998-419e-44cf-ae04-8b7fb13f1362 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.230107 Apr 30 21:31:08.157590 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2312/4730] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:07 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:08.222348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:08.223116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:08.229514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:08.230129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:08.231202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:08.232339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:08.493829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:08.507378 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5fab02e-1ebc-4843-88a9-4c93bed0adb0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.288852 Apr 30 21:31:08.511614 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2419/4731] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:08 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:08.826449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2fde0df0-0ced-410b-a1c2-aeb850593c15 req-f2aa522a-8478-4c4e-b43e-e03ce315090f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb12917-3c9f-44fb-b85c-89430e043c23", "tag": "16312283-df83-4845-a85e-fa372d0a8125"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:08.826939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:08.827639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:08.840288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:08.843101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:08.849363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:08.849363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:08.849614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2fde0df0-0ced-410b-a1c2-aeb850593c15 req-f2aa522a-8478-4c4e-b43e-e03ce315090f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:08.850116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2fde0df0-0ced-410b-a1c2-aeb850593c15 req-f2aa522a-8478-4c4e-b43e-e03ce315090f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:08.885510 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2fde0df0-0ced-410b-a1c2-aeb850593c15 req-f2aa522a-8478-4c4e-b43e-e03ce315090f service nova] Creating event network-changed:16312283-df83-4845-a85e-fa372d0a8125 for instance 2cb12917-3c9f-44fb-b85c-89430e043c23 on nch1-master-1 Apr 30 21:31:08.903678 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2fde0df0-0ced-410b-a1c2-aeb850593c15 req-f2aa522a-8478-4c4e-b43e-e03ce315090f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077811 Apr 30 21:31:08.903678 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2313/4732] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:09.129800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:09.135303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:09.166315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:09.167815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:09.169725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:09.170379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:09.191541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:09.208587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3dc72a3-ce4a-4ddc-aa90-c271d4b313ba tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1509 microversion: 2.1 time: 0.386845 Apr 30 21:31:09.215495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2420/4733] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:08 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:09.230096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:09.231121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:09.240630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:09.241356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:09.242795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:09.243761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:10.264156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:10.289745 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fddb5bf9-ab4a-4e9b-b391-b80160e5d64f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 1.174594 Apr 30 21:31:10.300769 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2314/4734] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:09 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:10.323445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:10.324314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:10.339230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:10.339944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:10.340959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:10.342446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:10.493173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:10.502628 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-898592e3-1192-4ee7-8926-b6328f6301aa tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 1.285553 Apr 30 21:31:10.503382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2421/4735] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:09 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:10.508754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:10.509610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:10.517224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:10.518517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:10.519527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:10.520108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:10.849090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:10.864260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:10.871799 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1689784a-4f3a-40d5-acd1-7a0f3655cc88 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.569039 Apr 30 21:31:10.880719 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2315/4736] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:10 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:10.891271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-744b7a5b-4c34-4044-9155-55d9a84619e0 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1509 microversion: 2.1 time: 0.384001 Apr 30 21:31:10.894584 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2422/4737] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:10 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:11.307904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:11.308522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:11.331575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:11.332088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:11.332927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:11.337521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:11.669997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf50605b-6cf9-4efd-9ef9-1f9ef5d82033 tempest-ComputeTenantNetworksTest-1620703521 tempest-ComputeTenantNetworksTest-1620703521-project] Calling method '.version_select at 0x7fdc20822820>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:12.045538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:12.076277 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30f4b0fd-c8fd-4e69-86f0-a88a27dfcef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 0.771912 Apr 30 21:31:12.096536 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2423/4738] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:11 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:12.116658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf50605b-6cf9-4efd-9ef9-1f9ef5d82033 tempest-ComputeTenantNetworksTest-1620703521 tempest-ComputeTenantNetworksTest-1620703521-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.865071 Apr 30 21:31:12.118589 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2316/4739] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:31:11 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:12.128408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:12.129664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:12.146162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.149747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.160731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.163839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.407201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8fd2d685-ac8b-43c5-880e-fcdfd8663757 req-d723dd73-3f86-447b-b0c5-29c2c448b480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92194639-28d0-4a67-a51e-1179fd33a2fa", "name": "network-vif-deleted", "tag": "bc5636f2-cf40-44f0-9964-ab84de7da2a8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:12.424198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:12.424959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8fd2d685-ac8b-43c5-880e-fcdfd8663757 req-d723dd73-3f86-447b-b0c5-29c2c448b480 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.425591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8fd2d685-ac8b-43c5-880e-fcdfd8663757 req-d723dd73-3f86-447b-b0c5-29c2c448b480 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.438041 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93600e5d-e6fb-41f4-a52c-124e7073abfb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.318142 Apr 30 21:31:12.439680 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8fd2d685-ac8b-43c5-880e-fcdfd8663757 req-d723dd73-3f86-447b-b0c5-29c2c448b480 service nova] Creating event network-vif-deleted:bc5636f2-cf40-44f0-9964-ab84de7da2a8 for instance 92194639-28d0-4a67-a51e-1179fd33a2fa on nch2-master-1 Apr 30 21:31:12.440566 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2317/4740] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:12 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:12.449069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:12.449069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:12.461469 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8fd2d685-ac8b-43c5-880e-fcdfd8663757 req-d723dd73-3f86-447b-b0c5-29c2c448b480 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360482 Apr 30 21:31:12.462858 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2424/4741] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:12.466774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.467298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.468054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.468506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.469950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:12.471565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:12.483163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.483639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.484526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.485057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.528989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:12.529447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:12.530156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lazy-loading 'fault' on Instance uuid 92194639-28d0-4a67-a51e-1179fd33a2fa {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:31:12.616842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:12.625053 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73e3fe0a-5cc5-4931-8a54-11163e216b1e tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 200 len: 1305 microversion: 2.1 time: 0.160770 Apr 30 21:31:12.628032 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2425/4742] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:12 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 1305 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:12.641895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-309481d0-6b3e-4ae6-a1ad-33712a6e9c1f tempest-ComputeTenantNetworksTest-1620703521 tempest-ComputeTenantNetworksTest-1620703521-project] Calling method '.version_select at 0x7fdc13539ca0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:12.808969 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-309481d0-6b3e-4ae6-a1ad-33712a6e9c1f tempest-ComputeTenantNetworksTest-1620703521 tempest-ComputeTenantNetworksTest-1620703521-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/a7f5c82b-6e79-4599-a093-165abda0e481" status: 200 len: 140 microversion: 2.1 time: 0.177321 Apr 30 21:31:12.808969 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2426/4743] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:31:12 2022] GET /compute/v2.1/os-tenant-networks/a7f5c82b-6e79-4599-a093-165abda0e481 => generated 140 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:12.834104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:12.875461 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e1c631f-f57c-457f-8079-2948ad0dab4d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1532 microversion: 2.1 time: 0.433416 Apr 30 21:31:12.876470 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2318/4744] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:12 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1532 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:13.102847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:13.103692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:13.114507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.114863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.116831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.117371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.376984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:13.399738 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e3fba78d-9c42-4782-8e70-8d1afdbbbef8 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 0.298798 Apr 30 21:31:13.403681 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2427/4745] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:13 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:13.458236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:13.458866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:13.476375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.477029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.478559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.479160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.649715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:13.650776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 92194639-28d0-4a67-a51e-1179fd33a2fa] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:13.662223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.663210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.664532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.665334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.682502 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] HTTP exception thrown: Instance 92194639-28d0-4a67-a51e-1179fd33a2fa could not be found. Apr 30 21:31:13.684187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Returning 404 to user: Instance 92194639-28d0-4a67-a51e-1179fd33a2fa could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:13.685869 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df2b20a7-4b48-4afe-b025-5bace7a9f157 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa" status: 404 len: 111 microversion: 2.1 time: 0.043167 Apr 30 21:31:13.687372 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2428/4746] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:13 2022] GET /compute/v2.1/servers/92194639-28d0-4a67-a51e-1179fd33a2fa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:31:13.696603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:13.697789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:13.711131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.711960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.713616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.715326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.718596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:13.734480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-88161c69-d309-42f1-b827-38f80150a9af tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.281272 Apr 30 21:31:13.738699 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2319/4747] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:13 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:13.772266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:31:13.894777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:13.895472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:13.903209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.903679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:13.904488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:13.904941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:14.089175 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ea94f6c-e4fb-465b-9de7-6c04d449572a tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 204 len: 0 microversion: 2.1 time: 0.397712 Apr 30 21:31:14.090279 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2429/4748] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:31:13 2022] DELETE /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:31:14.105251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:14.107379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:14.115267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:14.116221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:14.117540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:14.118586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:14.351558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:14.362765 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0ab9fd91-dd82-4430-b51c-ed499184d9ff tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1532 microversion: 2.1 time: 0.471372 Apr 30 21:31:14.362765 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2320/4749] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:13 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1532 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:14.424325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:14.424979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:14.448004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:14.460499 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-34074419-cf2f-4781-adaf-f8d92b14ea77 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1496 microversion: 2.1 time: 0.360322 Apr 30 21:31:14.461391 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2430/4750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:14 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1496 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:14.477076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:14.480503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:14.480503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:14.480503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:14.693815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:14.702204 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e9538ea-af89-4e02-ae0c-a676b5d41da5 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 0.288222 Apr 30 21:31:14.712564 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2321/4751] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:14 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:14.765899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:14.766755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:14.774938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:14.775677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:14.777780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:14.778755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:15.242429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:15.272467 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd5c4e42-dd99-421e-b1f6-13ef73fb55b1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.512840 Apr 30 21:31:15.273798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2431/4752] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:14 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:15.378455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:15.379183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:15.385900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:15.386596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:15.387384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:15.387827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:15.601313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:15.609188 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a47c298-11af-4081-a99a-640081ad16fb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1532 microversion: 2.1 time: 0.235210 Apr 30 21:31:15.620600 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2432/4753] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:15 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1532 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:15.631098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:15.632771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:15.640874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:15.641606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:15.643194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:15.644452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:15.724217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-79bd6a8b-213a-4992-98c6-4e7707763183 req-a5ced7d1-4636-43a9-ae64-6e70eb523126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb12917-3c9f-44fb-b85c-89430e043c23", "name": "network-vif-plugged", "status": "completed", "tag": "16312283-df83-4845-a85e-fa372d0a8125"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:15.745104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-79bd6a8b-213a-4992-98c6-4e7707763183 req-a5ced7d1-4636-43a9-ae64-6e70eb523126 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:15.745746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-79bd6a8b-213a-4992-98c6-4e7707763183 req-a5ced7d1-4636-43a9-ae64-6e70eb523126 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:15.765935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-79bd6a8b-213a-4992-98c6-4e7707763183 req-a5ced7d1-4636-43a9-ae64-6e70eb523126 service nova] Creating event network-vif-plugged:16312283-df83-4845-a85e-fa372d0a8125 for instance 2cb12917-3c9f-44fb-b85c-89430e043c23 on nch1-master-1 Apr 30 21:31:15.774082 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-79bd6a8b-213a-4992-98c6-4e7707763183 req-a5ced7d1-4636-43a9-ae64-6e70eb523126 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426152 Apr 30 21:31:15.775107 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2322/4754] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:15.782750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:15.784603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:15.791964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:15.792640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:15.794578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:15.795225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:16.195283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:16.202943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8cb000d8-c7fa-4faf-937a-f9b7f095eeee tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1496 microversion: 2.1 time: 0.581105 Apr 30 21:31:16.203533 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2433/4755] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:15 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1496 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:16.211123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:16.220977 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11722562-09a3-45b2-a665-3bf84a76eae1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 0.443897 Apr 30 21:31:16.229848 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2323/4756] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:15 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:16.291983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:16.293154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:16.316635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:16.317565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:16.319162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:16.319773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:16.578983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:16.586620 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43e822a7-7d0d-4409-8361-66b1c25404da tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.300148 Apr 30 21:31:16.587255 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2434/4757] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:16 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:16.627511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:16.628268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:16.649983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:16.650780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:16.651937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:16.652672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:16.949019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-742a65c3-c424-457a-a292-0f0a9ead8bcd req-ced6c5ca-92c6-4f7e-be14-48cd35913a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad593d69-b420-4af6-b0d2-73c63481895a", "name": "network-vif-deleted", "tag": "dcd8283d-d19b-4e47-b08b-9296cfaa449a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:16.971799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-742a65c3-c424-457a-a292-0f0a9ead8bcd req-ced6c5ca-92c6-4f7e-be14-48cd35913a3a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:16.972448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-742a65c3-c424-457a-a292-0f0a9ead8bcd req-ced6c5ca-92c6-4f7e-be14-48cd35913a3a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.034537 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-742a65c3-c424-457a-a292-0f0a9ead8bcd req-ced6c5ca-92c6-4f7e-be14-48cd35913a3a service nova] Creating event network-vif-deleted:dcd8283d-d19b-4e47-b08b-9296cfaa449a for instance ad593d69-b420-4af6-b0d2-73c63481895a on nch1-master-1 Apr 30 21:31:17.045171 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-742a65c3-c424-457a-a292-0f0a9ead8bcd req-ced6c5ca-92c6-4f7e-be14-48cd35913a3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099959 Apr 30 21:31:17.066468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2435/4758] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:17.075769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:17.096458 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-663a38fc-7b39-4732-a8a5-7457e9713d4a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.471807 Apr 30 21:31:17.098768 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2324/4759] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:16 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:17.223482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:17.225282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:17.238535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:17.239120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:17.245500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:17.245989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.246868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:17.247315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.253307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:17.253824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.254756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:17.255212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.395748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:17.418331 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f3a9b7e-43e1-4303-8bfc-b4936ce72a3b tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 200 len: 1287 microversion: 2.1 time: 0.199806 Apr 30 21:31:17.422609 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2436/4760] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:17 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 1287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:17.603993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:17.604757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:17.616220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:17.616940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.624730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:17.625559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.728245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:17.744439 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1d1ba0c2-164f-4c50-b683-cdac2b4265b9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1314 microversion: 2.1 time: 0.507445 Apr 30 21:31:17.745895 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2325/4761] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:17 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:17.814695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-936d0678-344f-4a97-8f68-9bcd9f065729 req-1121841b-f2ac-472a-8e2c-7b0801c694ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc46f81-a8bd-46ba-b2c4-6a859c458690", "name": "network-vif-plugged", "status": "completed", "tag": "0909419b-0751-4574-88cd-5569bff0727a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:17.827727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-936d0678-344f-4a97-8f68-9bcd9f065729 req-1121841b-f2ac-472a-8e2c-7b0801c694ab service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:17.834685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-936d0678-344f-4a97-8f68-9bcd9f065729 req-1121841b-f2ac-472a-8e2c-7b0801c694ab service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:17.882472 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-936d0678-344f-4a97-8f68-9bcd9f065729 req-1121841b-f2ac-472a-8e2c-7b0801c694ab service nova] Creating event network-vif-plugged:0909419b-0751-4574-88cd-5569bff0727a for instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 on nch1-master-1 Apr 30 21:31:17.890877 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-936d0678-344f-4a97-8f68-9bcd9f065729 req-1121841b-f2ac-472a-8e2c-7b0801c694ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080142 Apr 30 21:31:17.892709 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2326/4762] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:31:17.939973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:17.950011 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c243eaa9-17dd-46bb-a689-b25d8ef6d9e5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.349751 Apr 30 21:31:17.952874 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2437/4763] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:17 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:18.118601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:18.120475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:18.127924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.128699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.129711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.130662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.333533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:18.343944 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-38d9d35d-7ed3-4fc3-9edf-83aa789b60f7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.229521 Apr 30 21:31:18.345569 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2327/4764] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:18 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:18.451363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:18.452279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: ad593d69-b420-4af6-b0d2-73c63481895a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:18.460879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.461622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.462601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.463043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.510170 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] HTTP exception thrown: Instance ad593d69-b420-4af6-b0d2-73c63481895a could not be found. Apr 30 21:31:18.510170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Returning 404 to user: Instance ad593d69-b420-4af6-b0d2-73c63481895a could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:18.510170 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e1040f41-4320-4b08-87ea-550ad78c5f7d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a" status: 404 len: 111 microversion: 2.1 time: 0.051114 Apr 30 21:31:18.510170 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2438/4765] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:18 2022] GET /compute/v2.1/servers/ad593d69-b420-4af6-b0d2-73c63481895a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:18.522689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:18.523461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:18.532004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.533462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.534506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.535231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.568750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:31:18.760061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:18.760771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:18.770755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.773447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.774469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.775961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.883276 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-592ddf23-9c48-4aec-8c6a-f4303d6f1960 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 204 len: 0 microversion: 2.1 time: 0.369896 Apr 30 21:31:18.884164 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2328/4766] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:31:18 2022] DELETE /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:31:18.892693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:18.893415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:18.911519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.911997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:18.912804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:18.924287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:19.280186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:19.299773 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c11bb66-311f-4a9c-b41f-004bd11bb48f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1497 microversion: 2.1 time: 0.542431 Apr 30 21:31:19.320660 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2439/4767] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:18 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1497 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:19.332437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:19.334994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:19.351565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:19.354052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:19.356063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:19.357268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:19.488030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:19.510192 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0cb49c3e-f722-4f3c-afd8-3f8cbcd9ca36 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1675 microversion: 2.1 time: 0.611322 Apr 30 21:31:19.510192 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2329/4768] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:18 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1675 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:19.513774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:19.519140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:19.537683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:19.539719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:19.543712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:19.544352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:19.776167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:19.787802 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3c9a29f-246c-4083-ba66-2a2ddcedacd8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.464440 Apr 30 21:31:19.806508 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2440/4769] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:19 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:19.865155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:19.874952 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f4f75f5-bae2-4bcf-a180-9d61b4952fbf tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.368021 Apr 30 21:31:19.900676 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2330/4770] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:19 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:20.439419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:20.439941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:20.451526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:20.451990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:20.452789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:20.453232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:20.483895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:31:20.524277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:20.529576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:20.533109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:20.536283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:20.538640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:20.539458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:20.871785 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d6ce94f5-1ba8-4bf8-9613-90efea026256 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 204 len: 0 microversion: 2.1 time: 0.437618 Apr 30 21:31:20.891314 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2441/4771] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:31:20 2022] DELETE /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:31:20.891314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:20.891314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:20.911291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:20.913089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:20.919271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:20.921285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:21.470936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:21.485526 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6f52954-0840-4a11-a71b-8e7e9b6d7dc1 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1675 microversion: 2.1 time: 0.965183 Apr 30 21:31:21.488776 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2331/4772] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:20 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1675 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:21.497780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:21.498986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:21.508464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:21.509686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:21.510676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:21.511337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:21.705359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:21.713647 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02a90d43-ce54-45b6-856c-e4880a9d6c9f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.832386 Apr 30 21:31:21.718809 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2442/4773] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:20 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:21.731173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:21.732689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:21.747583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:21.748356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:21.750966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:21.752270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:22.186967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:22.195678 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b6141744-5d79-4d33-803b-c8a9f695f27c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1503 microversion: 2.1 time: 0.705094 Apr 30 21:31:22.201578 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2332/4774] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:21 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1503 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:22.460444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:22.470202 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7b68455a-b2ce-4216-9c73-00dcfdcaca2b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.750029 Apr 30 21:31:22.474863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2443/4775] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:21 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:22.507870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:22.508899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:22.519769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:22.520572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:22.521592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:22.522264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:22.734678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:22.736663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:22.749898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:22.760471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:22.762259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:22.762906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:23.295932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:23.309545 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-511dd9f5-2acb-47a0-bcac-cf379dc08b15 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1675 microversion: 2.1 time: 0.804194 Apr 30 21:31:23.311377 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2333/4776] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:22 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1675 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:23.326451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:23.329222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:23.346682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:23.346682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:23.348657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:23.351080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:23.681268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:23.693581 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-76bd5f94-3d24-4aff-b60d-8535469b7e17 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1461 microversion: 2.1 time: 0.379526 Apr 30 21:31:23.694506 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2334/4777] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:23 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1461 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:23.710347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:23.711362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:23.719650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:23.721049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:23.722155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:23.722742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:24.299326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:24.339469 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bccbae5b-d002-4279-8682-2a29441ee5a5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 1.608769 Apr 30 21:31:24.340083 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2444/4778] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:22 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:24.363327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-fc2a5bda-8b2c-40c1-8428-d7fe0c94e76e req-72f0d72a-bc43-41d2-b9d2-c23b0254ab57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb12917-3c9f-44fb-b85c-89430e043c23", "name": "network-vif-deleted", "tag": "16312283-df83-4845-a85e-fa372d0a8125"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:24.396817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fc2a5bda-8b2c-40c1-8428-d7fe0c94e76e req-72f0d72a-bc43-41d2-b9d2-c23b0254ab57 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:24.402996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fc2a5bda-8b2c-40c1-8428-d7fe0c94e76e req-72f0d72a-bc43-41d2-b9d2-c23b0254ab57 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:24.429695 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fc2a5bda-8b2c-40c1-8428-d7fe0c94e76e req-72f0d72a-bc43-41d2-b9d2-c23b0254ab57 service nova] Creating event network-vif-deleted:16312283-df83-4845-a85e-fa372d0a8125 for instance 2cb12917-3c9f-44fb-b85c-89430e043c23 on nch1-master-1 Apr 30 21:31:24.436815 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-fc2a5bda-8b2c-40c1-8428-d7fe0c94e76e req-72f0d72a-bc43-41d2-b9d2-c23b0254ab57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089098 Apr 30 21:31:24.438184 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2445/4779] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:24.447531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:24.448755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:24.457479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:24.458346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:24.459342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:24.460302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:24.757528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:24.766047 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6e41f67-073e-44a1-af83-5f2db021ae1c tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1609 microversion: 2.1 time: 0.324408 Apr 30 21:31:24.773366 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2446/4780] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:24 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1609 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:24.778680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:24.784286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:24.801479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:24.802154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:24.805077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:24.805960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:24.862037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:24.871905 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-faaa038d-be7d-4522-ae21-f66a37068722 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 1.166019 Apr 30 21:31:24.878632 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2335/4781] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:23 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:24.907248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:24.913626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:24.914151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lazy-loading 'fault' on Instance uuid 2cb12917-3c9f-44fb-b85c-89430e043c23 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:31:25.103036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:25.124634 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9e3943d-7f80-4c24-a368-726f60c347cb tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 200 len: 1304 microversion: 2.1 time: 0.349866 Apr 30 21:31:25.125246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2447/4782] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:24 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 1304 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:25.359131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:25.360000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:25.373007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:25.374374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:25.381072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:25.381362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:25.791477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:25.792994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:25.808079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:25.808835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:25.809733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:25.810239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:26.037828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:26.047624 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7640513c-88af-49b2-b1ec-53514e4761dc tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.695036 Apr 30 21:31:26.053838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2336/4783] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:25 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:26.061429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b4082fa07249e2b6dfb9b4506ab398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3364787934af4f59b17a58b380fe95da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:26.066277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:26.066277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:26.082885 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a8269bd-adbe-4774-9e24-23f63e1e293f tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 200 len: 1609 microversion: 2.1 time: 0.295796 Apr 30 21:31:26.085174 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2448/4784] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:25 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 1609 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:26.112619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:26.113091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:26.121498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:26.122574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:26.143230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:26.144199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: 2cb12917-3c9f-44fb-b85c-89430e043c23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:26.154751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:26.156191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:26.166483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:26.166483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:26.197024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] HTTP exception thrown: Instance 2cb12917-3c9f-44fb-b85c-89430e043c23 could not be found. Apr 30 21:31:26.207477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Returning 404 to user: Instance 2cb12917-3c9f-44fb-b85c-89430e043c23 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:26.211296 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-876dc4af-472f-48d7-ab3e-f4ed1489a6be tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23" status: 404 len: 111 microversion: 2.1 time: 0.073324 Apr 30 21:31:26.215837 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2449/4785] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:26 2022] GET /compute/v2.1/servers/2cb12917-3c9f-44fb-b85c-89430e043c23 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:26.384478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1391114549", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "b5a76fe5-1607-43e6-8432-9aab1bc20c97"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:26.502232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] validate_networks() for [('b5a76fe5-1607-43e6-8432-9aab1bc20c97', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:31:26.856309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:26.867329 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7c5af903-41f1-4847-8689-5081c0ed5b81 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.812004 Apr 30 21:31:26.876631 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2337/4786] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:26 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:26.893385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5b602f6d-80e2-484c-9fc3-9d822645572d req-0152d68d-4ff4-4089-97e1-d4422dcb3c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc03c3f-0d6d-4f49-b619-9987c06bfab4", "name": "network-vif-deleted", "tag": "241a93d8-ce90-4d90-8ad1-26bae3d008ad"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:26.915912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5b602f6d-80e2-484c-9fc3-9d822645572d req-0152d68d-4ff4-4089-97e1-d4422dcb3c86 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:26.915912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5b602f6d-80e2-484c-9fc3-9d822645572d req-0152d68d-4ff4-4089-97e1-d4422dcb3c86 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:26.945057 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5b602f6d-80e2-484c-9fc3-9d822645572d req-0152d68d-4ff4-4089-97e1-d4422dcb3c86 service nova] Creating event network-vif-deleted:241a93d8-ce90-4d90-8ad1-26bae3d008ad for instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 on nch2-master-1 Apr 30 21:31:26.957375 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5b602f6d-80e2-484c-9fc3-9d822645572d req-0152d68d-4ff4-4089-97e1-d4422dcb3c86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078859 Apr 30 21:31:26.959155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2338/4787] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:27.067775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:27.069228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:27.093211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:27.100422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:27.104603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:27.107848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:27.817566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:31:27.818551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:31:27.819786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:31:27.821097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:31:27.822330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:31:27.849127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:27.850232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:27.851244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:27.856524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:27.869106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:27.880231 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-088bd0ab-154f-48a3-8324-c3c92b309fd1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.815090 Apr 30 21:31:27.882452 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2339/4788] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:27 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:27.905800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:27.909339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] [instance: 4fc03c3f-0d6d-4f49-b619-9987c06bfab4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:27.918750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Getting quotas for project 83c1c99c0d904b58946a2a623c674759. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:31:27.922120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:27.922590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:27.925028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:27.934004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:27.947072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Getting quotas for user 1e5bf319f22145459e3c71d158430d63 and project 83c1c99c0d904b58946a2a623c674759. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:31:27.972942 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] HTTP exception thrown: Instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 could not be found. Apr 30 21:31:27.974089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Returning 404 to user: Instance 4fc03c3f-0d6d-4f49-b619-9987c06bfab4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:27.975477 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24ccf496-f131-465e-96ef-03586f42c4d6 tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4" status: 404 len: 111 microversion: 2.1 time: 0.080966 Apr 30 21:31:27.976548 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2340/4789] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:27 2022] GET /compute/v2.1/servers/4fc03c3f-0d6d-4f49-b619-9987c06bfab4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:27.990120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:31:27.993153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:31:27.995017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:28.004734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:28.011498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:28.012298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:28.014469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:28.015116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:28.211497 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-627254fd-4ed8-44a3-8c02-6e57c43b1a33 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831458 Apr 30 21:31:28.215438 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2450/4790] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:31:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:31:28.228439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-416fd9cb-591a-446d-9744-27a1ea5ba90d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] Calling method '.version_select at 0x7fdc135653a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:28.332851 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-416fd9cb-591a-446d-9744-27a1ea5ba90d tempest-ServerActionsTestJSON-861334409 tempest-ServerActionsTestJSON-861334409-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909017049" status: 202 len: 0 microversion: 2.1 time: 0.113476 Apr 30 21:31:28.333844 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2451/4791] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:31:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909017049 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:31:28.341530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ba96d38-aeab-416f-ae5c-545d3db2dd4e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:28.346374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ba96d38-aeab-416f-ae5c-545d3db2dd4e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:28.548394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ba96d38-aeab-416f-ae5c-545d3db2dd4e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:28.565278 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ba96d38-aeab-416f-ae5c-545d3db2dd4e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1214 microversion: 2.1 time: 0.230250 Apr 30 21:31:28.566097 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2452/4792] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:28 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:28.576782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:28.586268 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dcac4945-57c4-47a6-9561-a9bef7ca73c4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.608023 Apr 30 21:31:28.594598 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2341/4793] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:27 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:28.910250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:28.910881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:28.947549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:28.948259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:28.952660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:28.954769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:29.490405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:29.529854 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a36ebbc0-4e24-4d6b-9a55-985f34376705 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.620567 Apr 30 21:31:29.531949 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2453/4794] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:28 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:29.583912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-267906e5-cf71-42d5-8cc0-8068a4dd61f2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:29.585159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-267906e5-cf71-42d5-8cc0-8068a4dd61f2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:29.615522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:29.616206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:29.625015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:29.631138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:29.634841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:29.639099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:29.734726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-267906e5-cf71-42d5-8cc0-8068a4dd61f2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:29.745141 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-267906e5-cf71-42d5-8cc0-8068a4dd61f2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1214 microversion: 2.1 time: 0.166948 Apr 30 21:31:29.750634 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2342/4795] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:29 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:30.056363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:30.066930 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e161893c-937d-44ac-914c-3a6612202418 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.453664 Apr 30 21:31:30.067915 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2454/4796] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:29 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:30.554890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:30.556038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:30.570248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:30.571715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:30.575096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:30.575739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:30.772503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:30.773986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:30.781614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:30.782771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:30.783739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:30.784258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:30.978050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:30.981371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:30.991012 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d77e3557-939e-4ff3-9167-ed022a205945 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1266 microversion: 2.1 time: 0.229789 Apr 30 21:31:30.991777 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2455/4797] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:30 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:31.008570 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a586fc0-faae-41fe-9c3b-6b9d36e71543 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.450622 Apr 30 21:31:31.009601 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2343/4798] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:30 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:31.084971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:31.085595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:31.092175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:31.092828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:31.093614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:31.094233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:31.304462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:31.312751 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad84c3c5-fc2d-4136-ba1e-54d5401edd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.231877 Apr 30 21:31:31.313375 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2456/4799] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:31 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:32.013783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:32.014332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:32.025055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:32.026616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:32.027286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:32.027968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:32.030993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:32.031709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:32.048953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:32.049480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:32.050680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:32.051129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:32.512797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:32.538056 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-037bf019-0c5a-499a-9e1d-ceccbc8bb60f tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1272 microversion: 2.1 time: 0.523829 Apr 30 21:31:32.540716 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2344/4800] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:32 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1272 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:32.556756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:32.559866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:32.579365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:32.581046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:32.582656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:32.584907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:32.846400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:32.850947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:32.858025 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e6fdd8ab-17b3-47f6-9f40-3dfc4d060e9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.315556 Apr 30 21:31:32.865127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cb80f6b4-d84b-4db9-a30a-3f232d5c185e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1521 microversion: 2.1 time: 0.842667 Apr 30 21:31:32.868549 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2457/4801] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:32 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:32.873438 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2345/4802] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:32 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:33.561528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:33.562225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:33.583149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:33.587019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:33.590564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:33.595065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:33.900816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:33.901441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:33.918399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:33.930110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:33.931198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:33.931667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:34.029506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:34.049407 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0927b37-266e-49db-9d0f-dac7956dc9a0 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 0.492774 Apr 30 21:31:34.058263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2458/4803] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:33 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:34.070102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:34.075293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:34.093029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:34.099544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:34.100663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:34.102396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:34.669322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:34.685191 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f6617e4-52bd-4bd8-9b95-4eb06b96a994 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1501 microversion: 2.1 time: 0.787921 Apr 30 21:31:34.688802 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2346/4804] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:33 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1501 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:34.708363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:34.709231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:34.716774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:34.717809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:34.718881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:34.719632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:35.078516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:35.090221 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f49d4a2-588a-4666-aeb2-037f35880eaa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 1.030403 Apr 30 21:31:35.097998 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2459/4805] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:34 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:35.133004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:35.142551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:35.185012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:35.185798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:35.195787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:35.196770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:35.294230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:35.306947 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fd36c26a-9046-40cf-a336-1a725dfb27bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1515 microversion: 2.1 time: 0.608347 Apr 30 21:31:35.315016 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2347/4806] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:34 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:35.343080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3cbf69af-c6b8-4e4f-a978-17b71708b1f3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:35.351034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3cbf69af-c6b8-4e4f-a978-17b71708b1f3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 467af8af-2445-4d92-a2b8-ffef6118b3c4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:35.382471 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3cbf69af-c6b8-4e4f-a978-17b71708b1f3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Instance 467af8af-2445-4d92-a2b8-ffef6118b3c4 could not be found. Apr 30 21:31:35.382471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3cbf69af-c6b8-4e4f-a978-17b71708b1f3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 404 to user: Instance 467af8af-2445-4d92-a2b8-ffef6118b3c4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:35.382471 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3cbf69af-c6b8-4e4f-a978-17b71708b1f3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/467af8af-2445-4d92-a2b8-ffef6118b3c4/action" status: 404 len: 111 microversion: 2.1 time: 0.052695 Apr 30 21:31:35.385978 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2348/4807] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:31:35 2022] POST /compute/v2.1/servers/467af8af-2445-4d92-a2b8-ffef6118b3c4/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:35.412255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68da3e75-4a56-4fe1-9abf-2bfe94b7baa5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:35.414487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-68da3e75-4a56-4fe1-9abf-2bfe94b7baa5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:35.435672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da3e75-4a56-4fe1-9abf-2bfe94b7baa5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:35.436605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da3e75-4a56-4fe1-9abf-2bfe94b7baa5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:35.441666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da3e75-4a56-4fe1-9abf-2bfe94b7baa5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:35.442574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68da3e75-4a56-4fe1-9abf-2bfe94b7baa5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:35.845096 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68da3e75-4a56-4fe1-9abf-2bfe94b7baa5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action" status: 202 len: 0 microversion: 2.1 time: 0.454798 Apr 30 21:31:35.846493 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2349/4808] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:31:35 2022] POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:31:35.865121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:35.869479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:35.886867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:35.890247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:35.897663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:35.900937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:35.933469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:35.952580 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-353e711f-2970-488e-949a-cc4c9ee3db94 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 0.848229 Apr 30 21:31:35.953982 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2460/4809] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:35 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:36.118401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:36.122894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:36.133797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:36.134944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:36.135926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:36.136383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:36.653847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:36.663460 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01194482-6b30-4c48-98a9-989a9e98288e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.549804 Apr 30 21:31:36.668636 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2461/4810] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:36 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:36.681894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f748d8ba-5ac7-4385-9f5f-a9ad304c44b6 req-63814be0-decd-41bf-8a4b-c126d6490bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fa7242-dfe6-4127-9f9a-b113bd888d22", "tag": "4f03b0bc-bb2a-47d5-87f6-7d65f140764e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:36.705169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f748d8ba-5ac7-4385-9f5f-a9ad304c44b6 req-63814be0-decd-41bf-8a4b-c126d6490bdd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:36.706500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f748d8ba-5ac7-4385-9f5f-a9ad304c44b6 req-63814be0-decd-41bf-8a4b-c126d6490bdd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:36.733573 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f748d8ba-5ac7-4385-9f5f-a9ad304c44b6 req-63814be0-decd-41bf-8a4b-c126d6490bdd service nova] Creating event network-changed:4f03b0bc-bb2a-47d5-87f6-7d65f140764e for instance a8fa7242-dfe6-4127-9f9a-b113bd888d22 on nch1-master-1 Apr 30 21:31:36.747384 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f748d8ba-5ac7-4385-9f5f-a9ad304c44b6 req-63814be0-decd-41bf-8a4b-c126d6490bdd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076609 Apr 30 21:31:36.749849 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2462/4811] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:36.751980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:36.761135 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1eab83b7-3fbd-4b77-8eeb-81505aec7dfd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1520 microversion: 2.1 time: 0.910457 Apr 30 21:31:36.765837 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2350/4812] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:35 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1520 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:36.974315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:36.975780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:36.992918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:36.994940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:36.995962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:36.998900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:37.582749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:37.605956 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c9f296df-478d-4196-8984-4b80025218e9 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 0.639104 Apr 30 21:31:37.620883 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2463/4813] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:36 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:37.684839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:37.686583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:37.695306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:37.696071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:37.696877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:37.697323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:37.783144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:37.784113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:37.796478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:37.797168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:37.800199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:37.802185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:37.946506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:37.959076 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32c24e66-783d-4725-9bc5-bf25f37917c6 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 0.278360 Apr 30 21:31:37.962649 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2351/4814] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:37 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:38.087274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:38.132761 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16f4682d-2d53-49f4-9a84-7399d62610a9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1500 microversion: 2.1 time: 0.352326 Apr 30 21:31:38.146499 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2464/4815] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:37 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1500 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:38.152946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:38.155046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:38.164404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.165123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:38.166147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.166797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:38.215195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lazy-loading 'flavor' on Instance uuid ae7e10f1-c515-4ca6-9d45-1dadb182b495 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:31:38.237584 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Cannot 'rescue' instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 while it is in vm_state paused Apr 30 21:31:38.239022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 409 to user: Cannot 'rescue' instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 while it is in vm_state paused {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:38.240532 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f79fc4a-8a89-47df-9caf-8a661d301320 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action" status: 409 len: 144 microversion: 2.1 time: 0.091555 Apr 30 21:31:38.241691 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2352/4816] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:31:38 2022] POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action => generated 144 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:31:38.253627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b7a4f228-f6ae-4dfc-a25e-e2986999de65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:38.254606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b7a4f228-f6ae-4dfc-a25e-e2986999de65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:38.261202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a4f228-f6ae-4dfc-a25e-e2986999de65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.261988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a4f228-f6ae-4dfc-a25e-e2986999de65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:38.263006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a4f228-f6ae-4dfc-a25e-e2986999de65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.264139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7a4f228-f6ae-4dfc-a25e-e2986999de65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:38.635489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:38.635670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:38.657257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.657740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:38.658606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.660402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:38.660503 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b7a4f228-f6ae-4dfc-a25e-e2986999de65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action" status: 202 len: 0 microversion: 2.1 time: 0.410135 Apr 30 21:31:38.661232 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2465/4817] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:31:38 2022] POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:31:38.675320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:38.678536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:38.697084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.701383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:38.702410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:38.703109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:39.628308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:39.637394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:39.640377 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de0cf628-852e-4c97-94bf-61949c543069 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1507 microversion: 2.1 time: 0.970791 Apr 30 21:31:39.641539 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2466/4818] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:38 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1507 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:39.659642 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5044b39d-3c16-4038-b670-1533d14e55ab tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 1.015983 Apr 30 21:31:39.659642 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2353/4819] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:38 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:39.674213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:39.674789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:39.696743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:39.697199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:39.698029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:39.698472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:40.661295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:40.663639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:40.686240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:40.689525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:40.696053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:40.697894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:40.759283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:40.778869 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e9d891d9-a236-49e5-9226-53e8e231e1cd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 1.119061 Apr 30 21:31:40.781152 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2467/4820] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:39 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:40.821347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:40.826476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:40.858442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:40.862635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:40.866307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:40.867100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:41.394699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:41.421078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-942cc46e-4b43-42b3-94f3-c0a0307a6f65 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1515 microversion: 2.1 time: 0.762789 Apr 30 21:31:41.421721 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2354/4821] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:40 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1515 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:41.450159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:41.461219 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c43ac268-9f3e-4cf9-93a7-bddfa980627e tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 0.674668 Apr 30 21:31:41.463755 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2468/4822] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:40 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:41.799511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:41.803751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:41.809280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:41.809750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:41.810576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:41.811026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:42.479039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:42.483059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:42.495083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:42.495555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:42.496363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:42.497004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:43.032959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:43.044515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1a22bb76-e8c5-467a-b7db-24c040ca326d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1527 microversion: 2.1 time: 1.249611 Apr 30 21:31:43.055824 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2355/4823] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:41 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1527 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:43.232945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:43.241164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d296aba3-9a7e-4018-b64e-a536793c34ba req-3ff4019d-7c97-4262-951e-239456da17fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fa7242-dfe6-4127-9f9a-b113bd888d22", "name": "network-vif-plugged", "status": "completed", "tag": "4f03b0bc-bb2a-47d5-87f6-7d65f140764e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:43.248602 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f7a10b5-6fb8-43f3-bab0-49a2dc6b9e21 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 0.774287 Apr 30 21:31:43.253078 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2469/4824] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:42 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:43.254981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d296aba3-9a7e-4018-b64e-a536793c34ba req-3ff4019d-7c97-4262-951e-239456da17fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:43.255415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d296aba3-9a7e-4018-b64e-a536793c34ba req-3ff4019d-7c97-4262-951e-239456da17fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:43.305967 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d296aba3-9a7e-4018-b64e-a536793c34ba req-3ff4019d-7c97-4262-951e-239456da17fc service nova] Creating event network-vif-plugged:4f03b0bc-bb2a-47d5-87f6-7d65f140764e for instance a8fa7242-dfe6-4127-9f9a-b113bd888d22 on nch1-master-1 Apr 30 21:31:43.315277 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d296aba3-9a7e-4018-b64e-a536793c34ba req-3ff4019d-7c97-4262-951e-239456da17fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078268 Apr 30 21:31:43.315936 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2356/4825] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:44.076223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:44.076848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:44.090687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:44.098218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:44.098218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:44.098218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:44.285198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:44.294485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:44.294485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:44.300644 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cd0113f1-d7e0-4882-a0fb-6fd26264a4e9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1509 microversion: 2.1 time: 0.228555 Apr 30 21:31:44.305621 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2470/4826] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:44 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:44.307732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:44.311051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:44.311878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:44.312333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:44.535633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:44.543502 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5fdffdd-a663-4b9c-86f9-7434be3eb554 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 0.272285 Apr 30 21:31:44.547824 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2357/4827] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:44 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:44.706951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:44.707962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:44.713990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:44.714673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:44.715444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:44.716302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:44.749453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lazy-loading 'flavor' on Instance uuid ae7e10f1-c515-4ca6-9d45-1dadb182b495 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:31:45.116422 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c2d507b5-a4e0-4c38-9a18-e356aff7a2bd tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action" status: 200 len: 32 microversion: 2.1 time: 0.413663 Apr 30 21:31:45.117223 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2471/4828] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:31:44 2022] POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:31:45.132928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:45.133229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:45.144506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:45.145136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:45.146195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:45.151838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:45.332674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:45.333866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:45.348648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:45.349342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:45.350328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:45.350956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:45.567259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:45.577490 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e1f59e3-8784-4c6c-ab7e-b47ead46198d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.454258 Apr 30 21:31:45.588538 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2358/4829] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:45 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:45.607084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:45.611220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:45.623073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:45.628160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:45.628160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:45.628160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:45.763976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:45.788889 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b291637c-319a-4f0c-9c35-12acf291c198 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1509 microversion: 2.1 time: 0.460287 Apr 30 21:31:45.802745 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2472/4830] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:45 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:45.963903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:45.973143 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0408d04a-9d17-4455-bbd0-9a5aa737bd62 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1314 microversion: 2.1 time: 0.371246 Apr 30 21:31:45.973815 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2359/4831] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:45 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:46.596639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:46.598299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:46.607150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:46.608589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:46.609549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:46.610362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:46.771896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:46.789689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-86e401ce-b6c6-43cc-87e3-fef4ab637c06 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.198426 Apr 30 21:31:46.792057 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2473/4832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:46 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:46.806658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:46.807276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:46.823365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:46.823829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:46.824621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:46.825062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:46.991153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:46.992023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:47.003287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.006168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.008513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.011318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.138365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:47.163999 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0eec0ae-2537-41a3-8f23-355ebbb7e157 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1512 microversion: 2.1 time: 0.361317 Apr 30 21:31:47.170887 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2360/4833] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:46 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:47.176580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-772698ce-97cd-4ff5-89ae-f34824ead20b req-ea717a52-2cfa-4db3-98d3-047286f6c421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc46f81-a8bd-46ba-b2c4-6a859c458690", "name": "network-vif-unplugged", "status": "completed", "tag": "0909419b-0751-4574-88cd-5569bff0727a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:47.205786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-772698ce-97cd-4ff5-89ae-f34824ead20b req-ea717a52-2cfa-4db3-98d3-047286f6c421 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.215806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-772698ce-97cd-4ff5-89ae-f34824ead20b req-ea717a52-2cfa-4db3-98d3-047286f6c421 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.256814 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-772698ce-97cd-4ff5-89ae-f34824ead20b req-ea717a52-2cfa-4db3-98d3-047286f6c421 service nova] Creating event network-vif-unplugged:0909419b-0751-4574-88cd-5569bff0727a for instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 on nch1-master-1 Apr 30 21:31:47.275305 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-772698ce-97cd-4ff5-89ae-f34824ead20b req-ea717a52-2cfa-4db3-98d3-047286f6c421 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102727 Apr 30 21:31:47.278389 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2361/4834] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:47.290956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:47.291761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:47.319451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.319451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.321823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.324233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.384795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:47.394616 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c2324c16-1991-4435-be99-22101df0afa2 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1498 microversion: 2.1 time: 0.407597 Apr 30 21:31:47.402444 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2474/4835] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:46 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1498 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:47.576611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:47.587777 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad9c007c-6719-488a-ba91-7dc8f45b57e5 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1512 microversion: 2.1 time: 0.308048 Apr 30 21:31:47.598609 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2362/4836] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:47 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:47.636557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:47.637240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:47.645994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.646465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.647256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.647699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.690460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lazy-loading 'flavor' on Instance uuid 7dc46f81-a8bd-46ba-b2c4-6a859c458690 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:31:47.720922 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Cannot 'shelve' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state shelved_offloaded Apr 30 21:31:47.720922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 409 to user: Cannot 'shelve' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state shelved_offloaded {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:47.720922 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3b4c9f31-5094-4d55-ba3a-ffe7bdb76835 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 409 len: 155 microversion: 2.1 time: 0.075165 Apr 30 21:31:47.720922 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2475/4837] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:31:47 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 155 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:31:47.728156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94260203-22d2-4a6f-9c84-036d03e392dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:47.729108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94260203-22d2-4a6f-9c84-036d03e392dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:47.755692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94260203-22d2-4a6f-9c84-036d03e392dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.755692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94260203-22d2-4a6f-9c84-036d03e392dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.755692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94260203-22d2-4a6f-9c84-036d03e392dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.755692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94260203-22d2-4a6f-9c84-036d03e392dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.809285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:47.809965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:47.827810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.830388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:47.833969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:47.835697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:48.086852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:48.096044 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3aea1948-0779-4a47-83ef-b841da0ca810 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.292222 Apr 30 21:31:48.106107 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2476/4838] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:47 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:48.115557 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94260203-22d2-4a6f-9c84-036d03e392dd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 202 len: 0 microversion: 2.1 time: 0.391175 Apr 30 21:31:48.119076 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2363/4839] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:31:47 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:31:48.128711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:48.129401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:48.149128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:48.151957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:48.155580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:48.155580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:48.404879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:48.417722 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da33bf0e-4888-4a90-9e75-da2b0ad01502 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1460 microversion: 2.1 time: 0.293934 Apr 30 21:31:48.431467 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2477/4840] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:48 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1460 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:48.575993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:48.586345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:48.588071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:48.588679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:48.589887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:48.590439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:48.628356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:31:49.044415 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7fd3f0d1-76c2-43df-ba3a-182f90083c2c tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 204 len: 0 microversion: 2.1 time: 0.468606 Apr 30 21:31:49.044415 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2364/4841] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:31:48 2022] DELETE /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:31:49.051575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:49.052457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:49.073088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:49.075507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:49.079014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:49.079589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:49.116258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:49.117110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:49.132809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:49.135517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:49.136516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:49.137080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:49.423865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:49.435614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19902092-8674-4183-b5b8-00dac6a5009a tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1504 microversion: 2.1 time: 0.387940 Apr 30 21:31:49.445004 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2478/4842] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:49 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:49.452239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:49.453687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:49.460807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:49.461359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:49.462609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:49.463158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:49.474337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:49.483487 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c19ebd1-8957-4df0-92bd-ef6c421beffe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.372682 Apr 30 21:31:49.495323 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2365/4843] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:49 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:49.709800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:49.719358 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c070b78-6f7a-469f-9d7b-6a96d2abfc8f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1460 microversion: 2.1 time: 0.271853 Apr 30 21:31:49.732479 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2479/4844] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:49 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1460 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:50.453541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:50.454495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:50.461884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:50.462601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:50.463538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:50.464255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:50.502995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:50.504094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:50.520395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:50.522394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:50.526619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:50.527165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:50.780348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:50.787505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:50.792821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-95969d2e-718e-4fd2-b330-8eee4adcc6e1 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1504 microversion: 2.1 time: 0.343245 Apr 30 21:31:50.793804 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2366/4845] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:50 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1504 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:50.806062 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-46d0e096-13bb-414a-82ec-8096098072bb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.308262 Apr 30 21:31:50.806921 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2480/4846] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:50 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:50.815254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:50.816197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:50.822858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:50.823391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:50.824233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:50.824680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:51.178256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:51.184341 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-984df38a-a5df-40b3-b6a8-ada6791be61c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1460 microversion: 2.1 time: 0.376007 Apr 30 21:31:51.190970 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2481/4847] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:50 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1460 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:51.339436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f2c63fe-146d-4c00-8386-fac52ade9c55 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Action: 'create', calling method: .version_select at 0x7fdc13fb8e50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:51.392549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-0f2c63fe-146d-4c00-8386-fac52ade9c55 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Getting quotas for project 35c149f6d0184da2ad1f324dda8b5d1a. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:31:51.411694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-0f2c63fe-146d-4c00-8386-fac52ade9c55 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Getting quotas for user 5036e109752841e890d804f5e96d04cb and project 35c149f6d0184da2ad1f324dda8b5d1a. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:31:51.602654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-0f2c63fe-146d-4c00-8386-fac52ade9c55 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Getting quotas for project 35c149f6d0184da2ad1f324dda8b5d1a. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:31:51.612639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-0f2c63fe-146d-4c00-8386-fac52ade9c55 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Getting quotas for user 5036e109752841e890d804f5e96d04cb and project 35c149f6d0184da2ad1f324dda8b5d1a. Resources: {'server_groups'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:31:51.630390 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f2c63fe-146d-4c00-8386-fac52ade9c55 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.834912 Apr 30 21:31:51.631410 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2367/4848] 10.222.0.23 () {62 vars in 1213 bytes} [Sat Apr 30 21:31:50 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:31:51.642478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0422140e-7e2b-434a-918b-4b2d2a65b830 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:51.654496 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0422140e-7e2b-434a-918b-4b2d2a65b830 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.016101 Apr 30 21:31:51.655092 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2482/4849] 10.222.0.23 () {60 vars in 1192 bytes} [Sat Apr 30 21:31:51 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:31:51.665692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-62b7389f-5e84-4aac-a6b6-2453c30bdf73 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:51.676347 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-62b7389f-5e84-4aac-a6b6-2453c30bdf73 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/ff43ead2-1c07-409b-bb3c-cbc9f359804c" status: 200 len: 235 microversion: 2.64 time: 0.014304 Apr 30 21:31:51.677886 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2368/4850] 10.222.0.23 () {60 vars in 1303 bytes} [Sat Apr 30 21:31:51 2022] GET /compute/v2.1/os-server-groups/ff43ead2-1c07-409b-bb3c-cbc9f359804c => generated 235 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:31:51.695751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70b5139c-ef3c-4823-b6dd-670c083cac01 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:51.812931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:51.814616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:51.827472 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70b5139c-ef3c-4823-b6dd-670c083cac01 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/ff43ead2-1c07-409b-bb3c-cbc9f359804c" status: 204 len: 0 microversion: 2.64 time: 0.142222 Apr 30 21:31:51.832232 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2483/4851] 10.222.0.23 () {60 vars in 1306 bytes} [Sat Apr 30 21:31:51 2022] DELETE /compute/v2.1/os-server-groups/ff43ead2-1c07-409b-bb3c-cbc9f359804c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:31:51.837667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:51.839573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:51.842451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:51.843299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:51.848979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:51.850235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:51.867789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:51.868513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:51.871677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:51.872371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:52.021739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5bf319f22145459e3c71d158430d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c1c99c0d904b58946a2a623c674759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:52.029581 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-813e9692-d979-49d1-b2aa-88f6a866844d tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 200 len: 1462 microversion: 2.1 time: 0.222189 Apr 30 21:31:52.031963 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2369/4852] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:51 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 1462 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:52.038154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-abde2e53-4690-4d92-b478-fae556195037 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:52.046208 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-abde2e53-4690-4d92-b478-fae556195037 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] HTTP exception thrown: Instance group ff43ead2-1c07-409b-bb3c-cbc9f359804c could not be found. Apr 30 21:31:52.047753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-abde2e53-4690-4d92-b478-fae556195037 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] Returning 404 to user: Instance group ff43ead2-1c07-409b-bb3c-cbc9f359804c could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:52.049204 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-abde2e53-4690-4d92-b478-fae556195037 tempest-ServerGroup264TestJSON-319264316 tempest-ServerGroup264TestJSON-319264316-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/ff43ead2-1c07-409b-bb3c-cbc9f359804c" status: 404 len: 117 microversion: 2.64 time: 0.015920 Apr 30 21:31:52.053905 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2370/4853] 10.222.0.23 () {60 vars in 1306 bytes} [Sat Apr 30 21:31:52 2022] DELETE /compute/v2.1/os-server-groups/ff43ead2-1c07-409b-bb3c-cbc9f359804c => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:31:52.060022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c218fdd1-fed8-4f2c-a5cc-a2aaf3f0eeb6 req-a1ed7de5-beb7-4841-a9fb-626203bb121b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fa7242-dfe6-4127-9f9a-b113bd888d22", "name": "network-vif-deleted", "tag": "4f03b0bc-bb2a-47d5-87f6-7d65f140764e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:31:52.070583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c218fdd1-fed8-4f2c-a5cc-a2aaf3f0eeb6 req-a1ed7de5-beb7-4841-a9fb-626203bb121b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:52.071421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c218fdd1-fed8-4f2c-a5cc-a2aaf3f0eeb6 req-a1ed7de5-beb7-4841-a9fb-626203bb121b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:52.085410 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c218fdd1-fed8-4f2c-a5cc-a2aaf3f0eeb6 req-a1ed7de5-beb7-4841-a9fb-626203bb121b service nova] Creating event network-vif-deleted:4f03b0bc-bb2a-47d5-87f6-7d65f140764e for instance a8fa7242-dfe6-4127-9f9a-b113bd888d22 on nch1-master-1 Apr 30 21:31:52.092501 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c218fdd1-fed8-4f2c-a5cc-a2aaf3f0eeb6 req-a1ed7de5-beb7-4841-a9fb-626203bb121b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037007 Apr 30 21:31:52.093934 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2371/4854] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:31:52.120690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:52.130618 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b437425f-bda7-499e-8bd2-dd1de4d12bca tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.296957 Apr 30 21:31:52.137498 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2484/4855] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:51 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:52.206817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:52.207876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:52.214269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:52.214695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:52.215504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:52.216119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:52.374055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:52.382928 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-328a2567-5cd1-4347-b858-3cfb78a4fec0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.180853 Apr 30 21:31:52.383520 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2372/4856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:52 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:53.055934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:53.058666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] [instance: a8fa7242-dfe6-4127-9f9a-b113bd888d22] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:53.068800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:53.069749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:53.071048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:53.071712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:53.118943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] HTTP exception thrown: Instance a8fa7242-dfe6-4127-9f9a-b113bd888d22 could not be found. Apr 30 21:31:53.121376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] Returning 404 to user: Instance a8fa7242-dfe6-4127-9f9a-b113bd888d22 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:31:53.127643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc08a5bc-df03-4832-bac4-4752203f5307 tempest-VolumesActionsTest-178027447 tempest-VolumesActionsTest-178027447-project] 10.222.0.23 "GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22" status: 404 len: 111 microversion: 2.1 time: 0.079521 Apr 30 21:31:53.127643 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2485/4857] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:53 2022] GET /compute/v2.1/servers/a8fa7242-dfe6-4127-9f9a-b113bd888d22 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:53.151552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:53.155506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:53.178074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:53.178894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:53.179895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:53.180635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:53.400514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:53.401215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:53.415672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:53.421874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:53.422341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:53.423143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:53.423590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:53.425125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1eb5ff66-d60c-43c8-82d9-ba434aaa7752 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.281143 Apr 30 21:31:53.426363 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2373/4858] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:53 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:53.769562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:53.788211 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-28b6a396-b13c-4b39-9841-bc4b5a38e816 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.391684 Apr 30 21:31:53.788809 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2486/4859] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:53 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:54.442627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:54.443403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:54.454417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:54.454974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:54.456153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:54.457119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:54.733636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:54.745413 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b446f56-6203-48de-86d9-291a0a7ada51 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.306138 Apr 30 21:31:54.758425 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2374/4860] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:54 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:54.809869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:54.810573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:54.819553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:54.820132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:54.821007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:54.822670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:55.755565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:55.764751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:55.766715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:55.771596 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a7aebb88-9b57-4be9-9617-b603d1da35b7 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.963236 Apr 30 21:31:55.772764 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2487/4861] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:54 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:55.789490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:55.790434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:55.792565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:55.795774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:56.507505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:56.522454 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5757e125-3170-4f53-bf46-530c0588e335 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.762243 Apr 30 21:31:56.523696 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2375/4862] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:55 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:31:56.795924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:56.796746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:56.804350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:56.807664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:56.807664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:56.807664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:57.111375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:57.119480 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b8fdacb1-0a62-4fc6-b2d1-c7a606a549bd tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.328955 Apr 30 21:31:57.131740 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2488/4863] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:56 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:57.542822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:57.542822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:57.548674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:57.549352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:57.551303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:57.553705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:57.964927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:57.978922 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8331a3b-c04c-40da-895b-3f7bd8ce342d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.442069 Apr 30 21:31:57.980755 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2376/4864] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:57 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:58.139933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:58.142100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:58.168893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:58.169425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:58.170301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:58.170754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:58.671382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:58.684327 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e9e88855-52e1-4995-b78e-1fafab32cd73 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.549242 Apr 30 21:31:58.688522 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2489/4865] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:58 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:31:58.998455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:58.999772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:59.023635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:59.029359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:59.037873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:59.046102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:59.704585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:31:59.706122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:31:59.727344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:59.729594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:59.731921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:31:59.732433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:31:59.803180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:31:59.824082 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ac6fc906-dcd3-4359-8b4b-2aa9217035ba tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.830710 Apr 30 21:31:59.828549 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2377/4866] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:58 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:00.324958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:00.334533 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-daef207b-190e-4433-b08b-76a3a8f2d6a9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.635306 Apr 30 21:32:00.335353 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2490/4867] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:31:59 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:00.842075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:00.843946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:00.859631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:00.860109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:00.860943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:00.861592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:01.234927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:01.247892 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74c077f7-010a-4fa2-a632-4072290b4b41 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.409838 Apr 30 21:32:01.252727 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2378/4868] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:00 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:01.353322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:01.354074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:01.365115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:01.365115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:01.365115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:01.365643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:02.236320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:02.260349 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e07ce28-3aaf-44ec-bdab-ca28374646a4 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.911801 Apr 30 21:32:02.269470 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2491/4869] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:01 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:02.291836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:02.293380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:02.308523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:02.312701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:02.316152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:02.318096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:03.137710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:03.150195 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a3df2be-e75f-4130-8613-e30975c5a20e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.888905 Apr 30 21:32:03.150793 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2379/4870] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:02 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:03.307847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:03.309650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:03.348885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:03.352469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:03.360236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:03.360878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:03.826203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:03.834497 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4af7d01-e9ae-409b-a148-1c4d90f4d8a0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.555546 Apr 30 21:32:03.835084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2492/4871] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:03 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:04.168521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:04.169212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:04.184474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:04.194895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:04.195911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:04.196384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:04.853417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:04.854371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:04.873446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:04.881037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:04.883249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:04.886910 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7b3966f-d2bb-4c4b-a6f5-b46555e463a1 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.722316 Apr 30 21:32:04.890858 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2380/4872] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:04 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:04.893270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:04.893814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:05.783935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:05.806005 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a1b98da4-e209-4ba4-aa89-e5679051a48c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.946591 Apr 30 21:32:05.806845 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2493/4873] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:04 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:05.907512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:05.909289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:05.934755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:05.941468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:05.942605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:05.943304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:06.458447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:06.487117 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2deefd1a-37ed-4ab5-aecb-4a8050a4f9df tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1501 microversion: 2.1 time: 0.573278 Apr 30 21:32:06.487117 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2381/4874] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:05 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1501 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:06.494485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3025c91-4710-444f-a17e-e4de84b6c2f1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:06.497374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:06.508910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:06.509809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:06.511051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:06.511928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:06.583857 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Cannot 'attach_volume' instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 while it is in vm_state rescued Apr 30 21:32:06.585593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 409 to user: Cannot 'attach_volume' instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 while it is in vm_state rescued {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:06.591136 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a8e57f76-cdd7-4575-9fb0-06452fe82c38 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.101485 Apr 30 21:32:06.615550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5056fc26-ab61-42e4-8074-625058764314 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:06.616564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5056fc26-ab61-42e4-8074-625058764314 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:06.619910 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2494/4875] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:32:06 2022] POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/os-volume_attachments => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:32:06.631716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5056fc26-ab61-42e4-8074-625058764314 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:06.641165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5056fc26-ab61-42e4-8074-625058764314 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:06.641165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5056fc26-ab61-42e4-8074-625058764314 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:06.642118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5056fc26-ab61-42e4-8074-625058764314 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:06.825016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:06.825778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:06.857565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:06.858080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:06.859539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:06.859991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:06.932243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5056fc26-ab61-42e4-8074-625058764314 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action" status: 202 len: 0 microversion: 2.1 time: 0.325292 Apr 30 21:32:06.937157 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2382/4876] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:06 2022] POST /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:32:06.974040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:06.974900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:07.022535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:07.023019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:07.023842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:07.024296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:07.372169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:07.386621 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8a25627-a749-440f-80f9-fd353d4b81de tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.565607 Apr 30 21:32:07.397987 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2495/4877] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:06 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:08.181368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:08.194796 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-080f670d-16c7-42fa-981d-75be97a2b2bf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1509 microversion: 2.1 time: 1.255217 Apr 30 21:32:08.197925 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2383/4878] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:06 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1509 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:08.407894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:08.408795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:08.424016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:08.426470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:08.427606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:08.429637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:09.216784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:09.217427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:09.237386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:09.241197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:09.247042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:09.247767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:09.846493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:09.859154 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c29da8f-1412-4e8f-bc16-5ed4cd22d254 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 1.458515 Apr 30 21:32:09.864420 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2496/4879] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:08 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:10.065137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:10.088536 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e1ecb96-83a9-4ba9-9ff4-920429b92097 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1509 microversion: 2.1 time: 0.876634 Apr 30 21:32:10.111080 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2384/4880] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:09 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1509 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:10.880954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:10.882383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:10.943559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:10.949872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:10.959923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:10.970463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:11.115469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:11.129119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:11.158532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:11.174009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:11.175192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:11.175663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:13.013596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:13.037978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c69e83bb-d340-42ca-b093-b6ba01c5506b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 2.162410 Apr 30 21:32:13.047719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:13.051111 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2497/4881] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:10 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:13.079567 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ac415739-9824-4283-a92f-ca97bca8a091 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1509 microversion: 2.1 time: 1.968588 Apr 30 21:32:13.083242 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2385/4882] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:11 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1509 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:14.072503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:14.073802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:14.082096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:14.101493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:14.103616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:14.114547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:14.115753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:14.121129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:14.129035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:14.131718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:14.132826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:14.139159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:14.741948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:14.750224 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de0bd808-6baa-475d-acf4-0c3ee1868389 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.681491 Apr 30 21:32:14.753415 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2498/4883] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:14 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:14.759341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:14.770104 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fdf223eb-a8db-4653-9f52-4194b8f2699c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1515 microversion: 2.1 time: 0.676409 Apr 30 21:32:14.777064 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2386/4884] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:14 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1515 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:15.786527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:15.791587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:15.821958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:15.824136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:15.833850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:15.834887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:16.274779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:16.291012 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd8145dd-fd17-46cf-9ef9-45500747cf98 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.524002 Apr 30 21:32:16.300711 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2499/4885] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:15 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:16.337222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-10967241", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:17.280892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] validate_networks() for [('a09f59df-65ff-4e7f-b7ad-b8a3d18c2fb3', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:32:17.314063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:17.314686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:17.336572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:17.337029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:17.346261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:17.346261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:17.787356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:17.807825 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-885e8012-d4f0-462e-b43b-d11f62e156aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.498922 Apr 30 21:32:17.819945 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2500/4886] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:17 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:18.129629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b1c5f56-b9f2-4d27-8754-0130de7202d9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'create', calling method: .version_select at 0x7fdc1340b790>, body: {"keypair": {"name": "tempest-keypair-914487521"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:18.174183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9b1c5f56-b9f2-4d27-8754-0130de7202d9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:32:18.193226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9b1c5f56-b9f2-4d27-8754-0130de7202d9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for user 41a26877b24c4687a0c8cc4ffc6d69dd and project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:32:18.353990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:32:18.355412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:32:18.356122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:32:18.358445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:32:18.359745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:32:18.376850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:18.377609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:18.378728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:18.379641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:18.409000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Getting quotas for project 7328d5d6d45a4e80820e1a57f9f9a81c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:32:18.416540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Getting quotas for user f5f04392a4c94046bc7da53b4dffb0e3 and project 7328d5d6d45a4e80820e1a57f9f9a81c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:32:18.437241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:32:18.450960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:32:18.618345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9b1c5f56-b9f2-4d27-8754-0130de7202d9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:32:18.621062 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70f908b4-3d59-47a7-8184-9c0026a29365 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.550690 Apr 30 21:32:18.646197 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2387/4887] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:32:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:32:18.651463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ed1dcec3-d5fd-4d36-bd43-6471380fdd45 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:18.652609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9b1c5f56-b9f2-4d27-8754-0130de7202d9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for user 41a26877b24c4687a0c8cc4ffc6d69dd and project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:32:18.669499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ed1dcec3-d5fd-4d36-bd43-6471380fdd45 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:18.704606 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b1c5f56-b9f2-4d27-8754-0130de7202d9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.579957 Apr 30 21:32:18.710333 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2501/4888] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:32:18 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:18.808537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ed1dcec3-d5fd-4d36-bd43-6471380fdd45 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:18.828977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:18.829783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:18.834618 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ed1dcec3-d5fd-4d36-bd43-6471380fdd45 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1212 microversion: 2.1 time: 0.186957 Apr 30 21:32:18.844039 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2388/4889] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:18 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1212 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:18.844131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:18.844209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:18.844964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:18.845411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:19.176055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:19.188144 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-06d8d503-7137-4b38-a3bf-84a098d7402a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.363970 Apr 30 21:32:19.190527 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2502/4890] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:18 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:19.859489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9a9ee1c-ea63-4905-9b8c-5f8169ec9b12 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:19.863887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9a9ee1c-ea63-4905-9b8c-5f8169ec9b12 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:20.059270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9a9ee1c-ea63-4905-9b8c-5f8169ec9b12 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:20.070809 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9a9ee1c-ea63-4905-9b8c-5f8169ec9b12 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1212 microversion: 2.1 time: 0.215844 Apr 30 21:32:20.087231 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2389/4891] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:19 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1212 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:20.206271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:20.208013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:20.229636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:20.230339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:20.231370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:20.231966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:20.862517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:20.873087 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f931e66-40a1-4f4d-98f2-65d597e5383a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.671973 Apr 30 21:32:20.879323 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2503/4892] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:20 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:21.091242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:21.091842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:21.116791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:21.116791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:21.116791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:21.116791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:21.393032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:21.410839 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-829efe86-0b4a-403b-b696-5fb2fc10f145 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1208 microversion: 2.1 time: 0.321364 Apr 30 21:32:21.413708 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2390/4893] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:21 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1208 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:21.892331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:21.893491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:21.902420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:21.904271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:21.905805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:21.906593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:22.366090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:22.397481 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad2c5a11-a249-46b7-9ee9-3bfceec938c2 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.509428 Apr 30 21:32:22.412038 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2504/4894] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:21 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:22.456791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:22.463152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:22.501414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:22.501932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:22.502757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:22.503213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:22.674313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:22.683134 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dd99f6fe-ea8f-4a3b-bc92-1a1f59be7829 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1282 microversion: 2.1 time: 0.238560 Apr 30 21:32:22.688258 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2391/4895] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:22 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:23.437217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:23.438940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:23.506103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:23.513507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:23.518545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:23.522616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:23.603999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-91c2caad-627b-4c67-a8e4-aff3dc18f2ba req-f735b28f-2a1e-48f0-a421-4f71e6a89229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc46f81-a8bd-46ba-b2c4-6a859c458690", "name": "network-vif-plugged", "status": "completed", "tag": "0909419b-0751-4574-88cd-5569bff0727a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:23.629339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-91c2caad-627b-4c67-a8e4-aff3dc18f2ba req-f735b28f-2a1e-48f0-a421-4f71e6a89229 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:23.630578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-91c2caad-627b-4c67-a8e4-aff3dc18f2ba req-f735b28f-2a1e-48f0-a421-4f71e6a89229 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:23.672925 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-91c2caad-627b-4c67-a8e4-aff3dc18f2ba req-f735b28f-2a1e-48f0-a421-4f71e6a89229 service nova] Creating event network-vif-plugged:0909419b-0751-4574-88cd-5569bff0727a for instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 on nch1-master-1 Apr 30 21:32:23.704149 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-91c2caad-627b-4c67-a8e4-aff3dc18f2ba req-f735b28f-2a1e-48f0-a421-4f71e6a89229 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104784 Apr 30 21:32:23.707334 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2392/4896] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:32:23.715613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:23.717602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:23.729065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:23.729841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:23.730854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:23.732704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:24.082694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:24.099209 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f7ccb13-2020-48e2-946e-986f8aa911fb tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1270 microversion: 2.1 time: 0.391770 Apr 30 21:32:24.112429 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2393/4897] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:23 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1270 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:24.929886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:24.948115 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eae1cb8d-47dc-4b12-a1e7-0b94ceb5c87f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 1.525377 Apr 30 21:32:24.948115 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2505/4898] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:23 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:25.120510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:25.121968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:25.155956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:25.163247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:25.171143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:25.172021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:25.964810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:25.965097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:25.965097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:26.006697 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bfb4eb77-bb85-4bc4-af77-c630a8b76bf0 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1312 microversion: 2.1 time: 0.890794 Apr 30 21:32:26.007871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:26.009248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:26.011331 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2394/4899] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:25 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1312 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:26.012302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:26.142519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:26.150411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1992168545", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "370bffef-cf23-4a5f-a166-489a93a35b76"}], "security_groups": [{"name": "tempest-securitygroup--1002983020"}], "key_name": "tempest-keypair-914487521", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:26.396521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:26.408801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7e9913e1-8e82-4b74-9599-15ade37c8107 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.448743 Apr 30 21:32:26.409415 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2506/4900] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:25 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:26.476710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] validate_networks() for [('370bffef-cf23-4a5f-a166-489a93a35b76', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:32:26.679332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ea3389bd-fd48-43c3-b829-3f8df236de01 req-aa8871a2-dd15-4b9f-b55a-c5ca1606b708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd620d0-2e66-4144-8ff1-59e3f2f377f1", "tag": "3baf3b06-fafa-4bc0-a0fc-3b5bcaba856d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:26.695704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ea3389bd-fd48-43c3-b829-3f8df236de01 req-aa8871a2-dd15-4b9f-b55a-c5ca1606b708 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:26.702122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ea3389bd-fd48-43c3-b829-3f8df236de01 req-aa8871a2-dd15-4b9f-b55a-c5ca1606b708 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:26.767812 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ea3389bd-fd48-43c3-b829-3f8df236de01 req-aa8871a2-dd15-4b9f-b55a-c5ca1606b708 service nova] Creating event network-changed:3baf3b06-fafa-4bc0-a0fc-3b5bcaba856d for instance ecd620d0-2e66-4144-8ff1-59e3f2f377f1 on nch1-master-1 Apr 30 21:32:26.791033 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ea3389bd-fd48-43c3-b829-3f8df236de01 req-aa8871a2-dd15-4b9f-b55a-c5ca1606b708 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105814 Apr 30 21:32:26.792982 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2507/4901] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:32:27.031045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:27.035249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:27.088227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:27.088733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:27.089574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:27.090043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:27.608875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:27.641923 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a4dd473-348a-4874-9547-a48f6d5f1e3d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1312 microversion: 2.1 time: 0.614724 Apr 30 21:32:27.642565 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2508/4902] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:27 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:27.680490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:27.681129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:27.684539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:32:27.685041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:32:27.685456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:32:27.686491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:32:27.686929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:32:27.703282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:27.708506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:27.708506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:27.708506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:27.720676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:27.721410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:27.721999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:27.722458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:27.790333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:32:27.799213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Getting quotas for user 41a26877b24c4687a0c8cc4ffc6d69dd and project 9ef2f32360be4d6c87d31bb5307ad696. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:32:27.816617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:32:27.819806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:32:28.052066 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14df77a4-30ce-4196-892f-9900dcfbd6ef tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.908937 Apr 30 21:32:28.062031 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2395/4903] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:32:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:32:28.066443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:28.083768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b92b41d-c436-4bc0-9392-e0fb4aaec1d0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:28.085555 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c3182f9-657c-4c14-97af-ce89dca06263 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.439010 Apr 30 21:32:28.086573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5b92b41d-c436-4bc0-9392-e0fb4aaec1d0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:28.099324 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2509/4904] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:27 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:28.226407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b92b41d-c436-4bc0-9392-e0fb4aaec1d0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:28.236724 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b92b41d-c436-4bc0-9392-e0fb4aaec1d0 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1245 microversion: 2.1 time: 0.171941 Apr 30 21:32:28.249435 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2396/4905] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:28 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1245 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:28.663063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:28.664328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:28.681678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:28.682505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:28.684511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:28.685116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:29.106842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:29.109520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:29.139417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:29.143180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:29.145866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:29.151960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:29.331801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:29.346568 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-acf72a34-4ce9-4c8a-8c55-96b496a2e0e6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1312 microversion: 2.1 time: 0.690254 Apr 30 21:32:29.360486 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2510/4906] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:28 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1312 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:29.378302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-198a8c7a-eefc-4f48-a438-91e08b9f0c2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:29.384895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-198a8c7a-eefc-4f48-a438-91e08b9f0c2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:29.526155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-198a8c7a-eefc-4f48-a438-91e08b9f0c2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:29.543586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-198a8c7a-eefc-4f48-a438-91e08b9f0c2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1245 microversion: 2.1 time: 0.181244 Apr 30 21:32:29.561407 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2511/4907] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:29 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1245 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:29.581675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:29.589675 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab08c58a-ad15-46c1-8a94-7e6a1b18ef8a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1518 microversion: 2.1 time: 0.487193 Apr 30 21:32:29.600997 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2397/4908] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:29 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1518 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:30.367974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:30.369528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:30.380509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:30.384559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:30.386298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:30.390003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:30.567798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:30.569015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:30.575993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:30.586437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:30.587558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:30.588177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:30.855514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:30.867066 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5904507-2b5d-4991-ad4b-04c420e71f56 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1297 microversion: 2.1 time: 0.302868 Apr 30 21:32:30.867594 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2398/4909] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:30 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1297 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:30.887546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:30.887546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:30.901261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:30.901735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:30.915200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:30.916089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:30.941818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:30.949468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45a5da84-8358-45a7-bbe3-348d054a8d04 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1312 microversion: 2.1 time: 0.586547 Apr 30 21:32:30.950125 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2512/4910] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:30 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1312 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:31.354114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:31.374360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51a18781-816b-4967-958d-c6666219707a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.501547 Apr 30 21:32:31.374874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2399/4911] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:30 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:31.391552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:31.392091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:31.402148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:31.413665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:31.417982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:31.422946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:31.887549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:31.889601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:31.910290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:31.913139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:31.918351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:31.919087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:31.931586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:31.940622 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-045f168b-437f-4359-be8f-f7f5ea6a353f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.553727 Apr 30 21:32:31.941212 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2513/4912] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:31 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:31.976570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:31.977207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:32.004309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:32.011116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:32.014671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:32.018720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:32.125593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:32.137642 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f0e64223-e4e0-4678-9903-905af44ebc3a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1303 microversion: 2.1 time: 0.256509 Apr 30 21:32:32.151265 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2400/4913] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:31 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1303 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:32.161026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:32.175873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:32.202954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:32.204069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:32.212246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:32.214226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:32.711252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:32.755386 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c9abec4-42e1-47a4-9044-5767d7c9b6a3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1312 microversion: 2.1 time: 0.788982 Apr 30 21:32:32.756490 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2514/4914] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:31 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1312 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:32.836658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:32.846804 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8631948f-053b-44d6-ba4e-3e11b862497c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.693931 Apr 30 21:32:32.847406 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2401/4915] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:32 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:32.865229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-999ac8c8-f149-4b40-92eb-7a611059317a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:32.871951 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-999ac8c8-f149-4b40-92eb-7a611059317a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance af10652f-e88e-4068-baa5-50659be89a45 has no mapping to a cell. Apr 30 21:32:32.872599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-999ac8c8-f149-4b40-92eb-7a611059317a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance af10652f-e88e-4068-baa5-50659be89a45 has no mapping to a cell. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:32.874274 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-999ac8c8-f149-4b40-92eb-7a611059317a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/af10652f-e88e-4068-baa5-50659be89a45/action" status: 404 len: 117 microversion: 2.1 time: 0.013608 Apr 30 21:32:32.885371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:32.896138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:32.896834 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2515/4916] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:32 2022] POST /compute/v2.1/servers/af10652f-e88e-4068-baa5-50659be89a45/action => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:32:32.896919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:32.897107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:32.898037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:32.898647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.169490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:33.170362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:33.189585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.189915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.191129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.193590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.231057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:33.238763 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-773de2f3-90fc-4786-870b-ad1a770ac778 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.358998 Apr 30 21:32:33.246267 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2402/4917] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:32 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:33.258881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:33.259888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:33.267709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.269968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.269968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.269968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.336903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:33.352816 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c13494b-8b16-4e40-a9c3-d411ae00fc1a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1303 microversion: 2.1 time: 0.188030 Apr 30 21:32:33.358382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2516/4918] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:33 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:33.646755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:33.646755 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f643c5d5-e644-43f4-a42c-5b75b1d01efe tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.319010 Apr 30 21:32:33.646755 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2403/4919] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:33 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:33.648183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-00e2f79d-50c9-47dc-ab05-b760ee33ac99 req-0c718875-d694-438f-8485-f340689d5343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd620d0-2e66-4144-8ff1-59e3f2f377f1", "name": "network-vif-plugged", "status": "completed", "tag": "3baf3b06-fafa-4bc0-a0fc-3b5bcaba856d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:33.663188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35cb2524-962a-46d2-b99a-6ebb3980c5f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:33.663976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35cb2524-962a-46d2-b99a-6ebb3980c5f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 4b6ef00c-83ba-4629-967d-dfab17eb874b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:33.667761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-00e2f79d-50c9-47dc-ab05-b760ee33ac99 req-0c718875-d694-438f-8485-f340689d5343 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.668453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-00e2f79d-50c9-47dc-ab05-b760ee33ac99 req-0c718875-d694-438f-8485-f340689d5343 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.670947 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-35cb2524-962a-46d2-b99a-6ebb3980c5f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 4b6ef00c-83ba-4629-967d-dfab17eb874b could not be found. Apr 30 21:32:33.671563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35cb2524-962a-46d2-b99a-6ebb3980c5f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 4b6ef00c-83ba-4629-967d-dfab17eb874b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:33.672481 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35cb2524-962a-46d2-b99a-6ebb3980c5f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/4b6ef00c-83ba-4629-967d-dfab17eb874b/action" status: 404 len: 111 microversion: 2.1 time: 0.013306 Apr 30 21:32:33.673061 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2404/4920] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:33 2022] POST /compute/v2.1/servers/4b6ef00c-83ba-4629-967d-dfab17eb874b/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:32:33.681571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:33.682235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:33.684151 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-00e2f79d-50c9-47dc-ab05-b760ee33ac99 req-0c718875-d694-438f-8485-f340689d5343 service nova] Creating event network-vif-plugged:3baf3b06-fafa-4bc0-a0fc-3b5bcaba856d for instance ecd620d0-2e66-4144-8ff1-59e3f2f377f1 on nch1-master-1 Apr 30 21:32:33.690058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.690523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.690765 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-00e2f79d-50c9-47dc-ab05-b760ee33ac99 req-0c718875-d694-438f-8485-f340689d5343 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048952 Apr 30 21:32:33.691322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.691776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.692094 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2517/4921] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:32:33.776906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:33.778044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:33.796792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.796792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:33.796792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:33.798478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:34.313860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:34.323262 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b9f13d7e-60cc-4207-98b2-86a9bdb21862 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.645652 Apr 30 21:32:34.327917 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2405/4922] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:33 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:34.345581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:34.346524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:34.362741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:34.363827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:34.364876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:34.365532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:34.502444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:34.510915 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a54613d-0663-4017-9033-9687353a5b51 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1312 microversion: 2.1 time: 0.738401 Apr 30 21:32:34.514286 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2518/4923] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:33 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1312 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:34.524234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:34.534756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:34.550734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:34.551444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:34.552441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:34.553077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:34.803864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:34.812279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b9776896-ed12-4247-9096-f1d3cff9aa93 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.471363 Apr 30 21:32:34.812876 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2406/4924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:34 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:34.829596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:34.830590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:34.837572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:34.838156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:34.839309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:34.839823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:34.876505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lazy-loading 'flavor' on Instance uuid 7dc46f81-a8bd-46ba-b2c4-6a859c458690 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:32:34.996969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:35.009527 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31881263-06de-4bd2-9c82-491f88260cbf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.489799 Apr 30 21:32:35.017791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2519/4925] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:34 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:35.292773 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f82616bf-2171-491f-84bf-9c97e63d8ae1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 202 len: 0 microversion: 2.1 time: 0.466645 Apr 30 21:32:35.296442 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2407/4926] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:34 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:32:35.305406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:35.306247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:35.319520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:35.320287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:35.322468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:35.324850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:35.532297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:35.533307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:35.547558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:35.547784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:35.549693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:35.550508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:35.902274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:35.910913 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-684827f7-b481-4468-a744-8a8a07c33b68 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1513 microversion: 2.1 time: 0.613083 Apr 30 21:32:35.914905 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2520/4927] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:35 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1513 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:35.999310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:36.009792 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0ae0736e-50c0-4b1c-8896-eb8d34d8e2ed tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1498 microversion: 2.1 time: 0.482837 Apr 30 21:32:36.011388 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2408/4928] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:35 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1498 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:36.026537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:36.027567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:36.038231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:36.045051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:36.057513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.059644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:36.062102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.062747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:36.068387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.068387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:36.068387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.068387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:36.110348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lazy-loading 'flavor' on Instance uuid ecd620d0-2e66-4144-8ff1-59e3f2f377f1 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:32:36.458478 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5dca39ac-194e-4dea-b5d4-2ca8255b1576 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "POST /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1/action" status: 200 len: 32 microversion: 2.1 time: 0.435519 Apr 30 21:32:36.462986 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2521/4929] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:36 2022] POST /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:32:36.484403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:36.487062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:36.508590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:36.511277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.512543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:36.514420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.516428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-879287f9-c1a9-4330-993c-ea500abf946c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.482198 Apr 30 21:32:36.517387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:36.526056 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2409/4930] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:36 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:36.928516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:36.929139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:36.950311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.950988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:36.955252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:36.955599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.019118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:37.034013 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2beccd8a-2492-4a6a-8361-8e1235b9776f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.562836 Apr 30 21:32:37.038675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2522/4931] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:36 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:37.330722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:37.363377 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8779b983-d368-4588-b0e2-6f086fe17ce1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1496 microversion: 2.1 time: 0.438407 Apr 30 21:32:37.365027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2410/4932] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:36 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1496 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:37.380528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:37.381290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:37.390798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:37.393645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.393645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:37.393645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.439216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lazy-loading 'flavor' on Instance uuid 7dc46f81-a8bd-46ba-b2c4-6a859c458690 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:32:37.447107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6131f972-2db7-497b-94d5-987088a11f8e req-1aecb70a-7343-4302-937c-01a6232ae54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f89281bb-203e-4c4d-a650-8cebfbed3346", "tag": "3fba1066-dfcd-4d25-9f47-0d574a2347de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:37.469887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6131f972-2db7-497b-94d5-987088a11f8e req-1aecb70a-7343-4302-937c-01a6232ae54f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:37.470610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6131f972-2db7-497b-94d5-987088a11f8e req-1aecb70a-7343-4302-937c-01a6232ae54f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.491396 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Cannot 'suspend' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state suspended Apr 30 21:32:37.492306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 409 to user: Cannot 'suspend' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state suspended {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:37.493189 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8049afc5-d94b-4701-876a-d64b36d5df03 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 409 len: 148 microversion: 2.1 time: 0.116710 Apr 30 21:32:37.493817 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2523/4933] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:37 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 148 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:32:37.502452 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6131f972-2db7-497b-94d5-987088a11f8e req-1aecb70a-7343-4302-937c-01a6232ae54f service nova] Creating event network-changed:3fba1066-dfcd-4d25-9f47-0d574a2347de for instance f89281bb-203e-4c4d-a650-8cebfbed3346 on nch2-master-1 Apr 30 21:32:37.519549 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6131f972-2db7-497b-94d5-987088a11f8e req-1aecb70a-7343-4302-937c-01a6232ae54f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076843 Apr 30 21:32:37.522716 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2411/4934] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:32:37.525547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-235238d7-4afd-49e8-b4b1-b76a42121e1f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:37.526255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-235238d7-4afd-49e8-b4b1-b76a42121e1f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:37.543947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:37.544789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:37.549880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-235238d7-4afd-49e8-b4b1-b76a42121e1f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:37.550352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-235238d7-4afd-49e8-b4b1-b76a42121e1f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.554602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-235238d7-4afd-49e8-b4b1-b76a42121e1f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:37.555857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-235238d7-4afd-49e8-b4b1-b76a42121e1f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.570060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:37.570828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.572853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:37.574128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:37.940713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:37.956418 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b4d26ff3-6cfe-4043-8152-f1d9cd7ef890 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.416305 Apr 30 21:32:37.958973 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-235238d7-4afd-49e8-b4b1-b76a42121e1f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 202 len: 0 microversion: 2.1 time: 0.449808 Apr 30 21:32:37.960146 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2524/4935] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:37 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:32:37.968890 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2412/4936] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:37 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:37.983469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:37.984421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:38.033620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:38.035659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:38.038780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:38.038780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:38.055205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:38.057135 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:38.070608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:38.071587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:38.072976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:38.073814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:38.469721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:38.482824 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce163ed9-a3f2-4f60-aeea-047e41205c7f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1502 microversion: 2.1 time: 0.517306 Apr 30 21:32:38.495886 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2525/4937] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:37 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1502 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:38.564668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:38.572469 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9144b926-3f27-4443-bf82-bf80c981f716 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.523679 Apr 30 21:32:38.573062 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2413/4938] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:38 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:38.992529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:38.993408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:39.014095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:39.018771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:39.019759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:39.020369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:39.301276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:39.312525 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-67fc45f4-e563-42b7-9b63-72398080c2cf tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.343594 Apr 30 21:32:39.325192 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2526/4939] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:38 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:39.503583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:39.504306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:39.531908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:39.532816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:39.533640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:39.534114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:39.592467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:39.594177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:39.604719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:39.605169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:39.606361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:39.607492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:39.861948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:39.865270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:39.879587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71ef93c9-f6a5-4b52-a2a5-ff67f372d99f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.292718 Apr 30 21:32:39.881029 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a04604d9-7680-4639-809a-ebdede1a4435 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1502 microversion: 2.1 time: 0.381736 Apr 30 21:32:39.892616 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2414/4940] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:39 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:39.892969 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2527/4941] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:39 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:40.331679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:40.332565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:40.339574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:40.340068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:40.341071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:40.342340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:40.534305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:40.549058 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-22d6dd6f-a0d0-4508-8e95-e74a8147be53 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.220465 Apr 30 21:32:40.550690 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2415/4942] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:40 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:40.901500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:40.903533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:40.910303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:40.912616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:40.929582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:40.930270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:40.930896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:40.931412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:40.932065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:40.933734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:40.934302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:40.934940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.280321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:41.285077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:41.289147 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-557ad51d-28fd-44bb-807a-254af9d340f6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.383951 Apr 30 21:32:41.290044 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2416/4943] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:40 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:41.305434 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4686ecd4-31eb-4870-b74e-42ebc837255e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.409033 Apr 30 21:32:41.306169 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2528/4944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:40 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:41.323507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:41.324152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:41.330438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.330849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.331615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.336198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.566945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:41.567619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:41.577397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.580257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.587415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.588267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.609674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:41.625591 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e3c5f3f3-8b4e-45d9-95dd-be0e2bd576aa tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.302584 Apr 30 21:32:41.626618 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2417/4945] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:41 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:41.648310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-40edc0c5-2e16-4b06-ac7b-0fc6f3a76a74 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:41.649550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-40edc0c5-2e16-4b06-ac7b-0fc6f3a76a74 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 6ba145ff-4486-4b4c-922d-2277cccaa56f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:41.668719 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-40edc0c5-2e16-4b06-ac7b-0fc6f3a76a74 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 6ba145ff-4486-4b4c-922d-2277cccaa56f could not be found. Apr 30 21:32:41.668719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-40edc0c5-2e16-4b06-ac7b-0fc6f3a76a74 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 6ba145ff-4486-4b4c-922d-2277cccaa56f could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:41.669534 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-40edc0c5-2e16-4b06-ac7b-0fc6f3a76a74 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/6ba145ff-4486-4b4c-922d-2277cccaa56f/action" status: 404 len: 111 microversion: 2.1 time: 0.031347 Apr 30 21:32:41.672799 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2418/4946] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:41 2022] POST /compute/v2.1/servers/6ba145ff-4486-4b4c-922d-2277cccaa56f/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:32:41.691479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:41.694643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:41.726255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.726720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.727699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.728145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.887716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:41.896791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8b367db5-60e5-4878-ab96-00c03b8c036b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.334301 Apr 30 21:32:41.897534 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2529/4947] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:41 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:41.921586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:41.929342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2c7e40b-f153-42b6-ad12-14edc389546b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.252437 Apr 30 21:32:41.929939 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2419/4948] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:41 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:41.947638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:41.948392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:41.955209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.955746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:41.956429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:41.956897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.306701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:42.307613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:42.328633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.333322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.334188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.334803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.504894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:42.518078 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c6122465-a064-44de-b3c4-406c895b1696 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.574280 Apr 30 21:32:42.519939 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2530/4949] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:41 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:42.538680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:42.540417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:42.550297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.551904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.553186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.553893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.589873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Cannot 'unpause' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active Apr 30 21:32:42.590172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:42.592297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 409 to user: Cannot 'unpause' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:42.593573 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-11584f61-0277-4e5d-b1f4-14c8f68eed16 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 409 len: 145 microversion: 2.1 time: 0.060276 Apr 30 21:32:42.594994 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2531/4950] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:42 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:32:42.605085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:42.606275 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b6a55281-c0dc-4000-b42d-e5a9782e2cca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.303698 Apr 30 21:32:42.607604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:42.610100 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2420/4951] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:42 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:42.615587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.616144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.617304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.618508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.904812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:42.914502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:42.915134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:42.930264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-51f13e83-1542-4a8e-bab7-c50f750d920c tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.329268 Apr 30 21:32:42.941064 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2532/4952] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:42 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:42.941357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.942060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.943089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.943857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.961815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:42.962455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:42.987983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.988444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:42.991047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:42.991708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.077916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:44.083674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:44.092047 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-caeb3cd7-39f4-45d6-88dc-9326ba2b6f9f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 1.140405 Apr 30 21:32:44.095010 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9158431f-2917-4b94-a155-4fd05f5101f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 1.184571 Apr 30 21:32:44.095906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2421/4953] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:42 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:44.102289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:44.103254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:44.103437 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2533/4954] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:42 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:44.113270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.114441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.115588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.126110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.126432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0034bfa6-1760-40b5-a303-88cc8776537d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:44.126432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0034bfa6-1760-40b5-a303-88cc8776537d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 1e9f5bf5-16ef-4acc-b824-4c4c3cc025f9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:44.134606 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0034bfa6-1760-40b5-a303-88cc8776537d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 1e9f5bf5-16ef-4acc-b824-4c4c3cc025f9 could not be found. Apr 30 21:32:44.135484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0034bfa6-1760-40b5-a303-88cc8776537d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 1e9f5bf5-16ef-4acc-b824-4c4c3cc025f9 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:44.136585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0034bfa6-1760-40b5-a303-88cc8776537d tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/1e9f5bf5-16ef-4acc-b824-4c4c3cc025f9/action" status: 404 len: 111 microversion: 2.1 time: 0.018638 Apr 30 21:32:44.137435 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2534/4955] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:44 2022] POST /compute/v2.1/servers/1e9f5bf5-16ef-4acc-b824-4c4c3cc025f9/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:32:44.159717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:44.160354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:44.176432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.177150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.178135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.178739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.526516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:44.542273 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98fed619-2f9e-42ae-8cb8-7d46fe8e8993 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.444704 Apr 30 21:32:44.552416 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2422/4956] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:44 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:44.578289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:44.598337 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-511f786b-1bcb-46df-9350-d47a90a18742 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.434563 Apr 30 21:32:44.598992 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2535/4957] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:44 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:44.615754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:44.616384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:44.633270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.634336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.635947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.636603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.904504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:44.913442 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0a7694ad-4f2c-4e5e-9e26-767db7c752f1 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.301621 Apr 30 21:32:44.914379 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2423/4958] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:44 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:44.929961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:44.930540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:44.937430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.938121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.939104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:44.939762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:44.967947 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Cannot 'unshelve' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active Apr 30 21:32:44.968773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 409 to user: Cannot 'unshelve' instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 while it is in vm_state active {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:44.969842 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca764eda-7e22-4afa-9167-b8eb24238fbb tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action" status: 409 len: 146 microversion: 2.1 time: 0.043926 Apr 30 21:32:44.974067 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2536/4959] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:32:44 2022] POST /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690/action => generated 146 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:32:44.979584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:44.981290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:45.000291 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.001178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.003049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.008512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.122948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:45.122948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:45.127685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.128151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.128965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.134503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.404694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:45.405469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:45.414842 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-212f9568-84cb-4aa7-8402-706759ad175b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.306735 Apr 30 21:32:45.423164 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-63354fc6-0eb4-4ace-940d-3d8544b1f68e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.447687 Apr 30 21:32:45.425920 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2537/4960] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:45 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:45.426307 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2424/4961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:44 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:45.452121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:45.453202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:45.461691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ac45e156-63ce-4004-a729-c94d6ed82892 req-f641fe03-6ddc-4a10-ba0c-4e32b7ad8f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89281bb-203e-4c4d-a650-8cebfbed3346", "name": "network-vif-plugged", "status": "completed", "tag": "3fba1066-dfcd-4d25-9f47-0d574a2347de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:45.475055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.475558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.477169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.478506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.480165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ac45e156-63ce-4004-a729-c94d6ed82892 req-f641fe03-6ddc-4a10-ba0c-4e32b7ad8f72 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.480634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ac45e156-63ce-4004-a729-c94d6ed82892 req-f641fe03-6ddc-4a10-ba0c-4e32b7ad8f72 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.497558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ac45e156-63ce-4004-a729-c94d6ed82892 req-f641fe03-6ddc-4a10-ba0c-4e32b7ad8f72 service nova] Creating event network-vif-plugged:3fba1066-dfcd-4d25-9f47-0d574a2347de for instance f89281bb-203e-4c4d-a650-8cebfbed3346 on nch2-master-1 Apr 30 21:32:45.504718 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ac45e156-63ce-4004-a729-c94d6ed82892 req-f641fe03-6ddc-4a10-ba0c-4e32b7ad8f72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046016 Apr 30 21:32:45.505927 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2425/4962] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:32:45.562681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:45.563688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:45.570923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.571681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.572697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.573359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.776451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:45.800199 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90053641-f97b-4b0a-a944-121e036e0604 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.354060 Apr 30 21:32:45.815785 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2538/4963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:45 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:45.828075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a803dc9d-528d-4132-b147-14707174d75f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1979018566_updated"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:45.836358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a803dc9d-528d-4132-b147-14707174d75f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: a30ceea6-2187-491f-b01c-45dd8b2408c0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:45.847763 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a803dc9d-528d-4132-b147-14707174d75f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance a30ceea6-2187-491f-b01c-45dd8b2408c0 could not be found. Apr 30 21:32:45.850118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a803dc9d-528d-4132-b147-14707174d75f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance a30ceea6-2187-491f-b01c-45dd8b2408c0 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:45.852036 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a803dc9d-528d-4132-b147-14707174d75f tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "PUT /compute/v2.1/servers/a30ceea6-2187-491f-b01c-45dd8b2408c0" status: 404 len: 111 microversion: 2.1 time: 0.029719 Apr 30 21:32:45.854001 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2539/4964] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:32:45 2022] PUT /compute/v2.1/servers/a30ceea6-2187-491f-b01c-45dd8b2408c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:32:45.866579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:45.875306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:45.883454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.884780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:45.885862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:45.886500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.050656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:46.078864 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4778d74c-e785-424d-a891-afa54498389d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.515870 Apr 30 21:32:46.079731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:46.079890 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2426/4965] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:45 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:46.088261 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3b667cd7-49d9-41da-a266-7c436417dec3 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.228057 Apr 30 21:32:46.090000 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2540/4966] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:45 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:46.126684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:46.127711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:46.134622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.135495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.136630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.137401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.329951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:46.353271 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a1668f18-d8e4-4ae1-b924-d59c25725c3b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.234188 Apr 30 21:32:46.354284 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2427/4967] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:46 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:46.371057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8dac32d8-c88a-403d-8188-42807a83c10b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:46.372868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8dac32d8-c88a-403d-8188-42807a83c10b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:46.373940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8dac32d8-c88a-403d-8188-42807a83c10b tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "PUT /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 400 len: 619 microversion: 2.1 time: 0.006820 Apr 30 21:32:46.374473 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2541/4968] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Apr 30 21:32:46 2022] PUT /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:32:46.385221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:46.386613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:46.394489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.395123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.396247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.396824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.432139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:46.433167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:46.448901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.449389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.451218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.464799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.594830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:46.607024 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e64e8845-97fa-4c56-a3c6-5d9193d5c2bc tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.227850 Apr 30 21:32:46.619606 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2428/4969] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:46 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:46.627077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:46.627864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:46.636842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.637495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.639182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.639742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.788825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:46.796885 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9461b75e-fa06-4b14-bb73-eb4d220fa00c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1371 microversion: 2.1 time: 0.368337 Apr 30 21:32:46.798033 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2542/4970] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:46 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:46.882200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:46.889173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2dc0891-14d1-40e0-85be-2c6116dfe072 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.267868 Apr 30 21:32:46.893036 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2429/4971] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:46 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:46.909541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da6d1a21-b917-4b84-b8af-941a36cfc498 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:46.911596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da6d1a21-b917-4b84-b8af-941a36cfc498 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:46.912871 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da6d1a21-b917-4b84-b8af-941a36cfc498 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "PUT /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 400 len: 108 microversion: 2.1 time: 0.008728 Apr 30 21:32:46.914437 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2543/4972] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:32:46 2022] PUT /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:32:46.922128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:46.922522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:46.938342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.938456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:46.939167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:46.939609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:47.104314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:47.108731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:47.131995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:47.138161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:47.139819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:47.151482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:47.219541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:47.230803 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-05c95211-d39a-45e7-b288-eaf48379fde0 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1505 microversion: 2.1 time: 0.312797 Apr 30 21:32:47.231422 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2430/4973] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:46 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:47.484604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:47.492429 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8756ad52-11d1-4e8f-a61f-389dfd9a42d7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.399773 Apr 30 21:32:47.493002 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2544/4974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:47 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:47.815207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:47.816880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:47.825839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:47.826630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:47.827636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:47.828293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:48.044587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:48.061092 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e24e812-4e67-4bd4-90c8-9f7c895d9e47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1565 microversion: 2.1 time: 0.248022 Apr 30 21:32:48.062003 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2431/4975] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:47 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:48.154256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-101fe710-3d50-4827-b231-8b639a8ed3ce tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:48.154879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-101fe710-3d50-4827-b231-8b639a8ed3ce tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:48.175164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-101fe710-3d50-4827-b231-8b639a8ed3ce tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:48.175164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-101fe710-3d50-4827-b231-8b639a8ed3ce tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:48.175164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-101fe710-3d50-4827-b231-8b639a8ed3ce tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:48.175164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-101fe710-3d50-4827-b231-8b639a8ed3ce tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:48.315776 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-101fe710-3d50-4827-b231-8b639a8ed3ce tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165457 Apr 30 21:32:48.318489 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2545/4976] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:32:48 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:32:48.518962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:48.520513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:48.550921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:48.552675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:48.554511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:48.558380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:49.181896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:49.194573 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-27b1c643-dd2a-4b0b-8c38-f96a07b86d91 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.688372 Apr 30 21:32:49.197593 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2432/4977] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:48 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:50.215734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:50.217813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:50.227351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:50.228198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:50.229209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:50.230030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:50.525779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:50.537112 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-32f55b60-a904-4d1f-987e-6501b09698ca tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.328580 Apr 30 21:32:50.538827 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2546/4978] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:50 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:50.650989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-94941289", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:50.775455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:32:51.024669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9cd87a0f-a8fb-459c-927e-4476bf121b0c req-50759723-35aa-407d-8a76-cd0978e24211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f89281bb-203e-4c4d-a650-8cebfbed3346", "tag": "3fba1066-dfcd-4d25-9f47-0d574a2347de"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:51.042932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9cd87a0f-a8fb-459c-927e-4476bf121b0c req-50759723-35aa-407d-8a76-cd0978e24211 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:51.043475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9cd87a0f-a8fb-459c-927e-4476bf121b0c req-50759723-35aa-407d-8a76-cd0978e24211 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:51.081376 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9cd87a0f-a8fb-459c-927e-4476bf121b0c req-50759723-35aa-407d-8a76-cd0978e24211 service nova] Creating event network-changed:3fba1066-dfcd-4d25-9f47-0d574a2347de for instance f89281bb-203e-4c4d-a650-8cebfbed3346 on nch2-master-1 Apr 30 21:32:51.095924 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9cd87a0f-a8fb-459c-927e-4476bf121b0c req-50759723-35aa-407d-8a76-cd0978e24211 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352663 Apr 30 21:32:51.099992 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2547/4979] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:32:51.556805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:51.558121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:51.579848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:32:51.580455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:32:51.581094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:32:51.581659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:32:51.582245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:32:51.586827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:51.587677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:51.589431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:51.591713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:51.605749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:51.606522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:51.610080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:51.610766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:51.659808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Getting quotas for project 280a6ce7a084421bbd267c7ac5c907ca. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:32:51.679721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Getting quotas for user 7757dd58d9db44f89d86bf2217719d09 and project 280a6ce7a084421bbd267c7ac5c907ca. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:32:51.723459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:32:51.733320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:32:51.952283 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab6a057e-2e1c-46d0-9036-ae834e639bef tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305784 Apr 30 21:32:51.953626 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2433/4980] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:32:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:32:51.966232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f030e329-c947-4aac-b863-0cb1d8291740 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:51.971689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f030e329-c947-4aac-b863-0cb1d8291740 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:52.257026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f030e329-c947-4aac-b863-0cb1d8291740 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:52.288496 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f030e329-c947-4aac-b863-0cb1d8291740 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1212 microversion: 2.1 time: 0.328974 Apr 30 21:32:52.289099 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2434/4981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:51 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1212 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:52.352832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:52.365087 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-47f7055b-f21a-4b63-9e30-dc20d5f404e1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.810580 Apr 30 21:32:52.366644 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2548/4982] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:51 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:53.305281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f89a2ade-a5d6-40dc-8893-7ebdf976ad2a tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:53.306609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f89a2ade-a5d6-40dc-8893-7ebdf976ad2a tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:53.382332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:53.383050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:53.408877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:53.408877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:53.410136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:53.412825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:53.508350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f89a2ade-a5d6-40dc-8893-7ebdf976ad2a tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:53.522281 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f89a2ade-a5d6-40dc-8893-7ebdf976ad2a tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1212 microversion: 2.1 time: 0.221153 Apr 30 21:32:53.523497 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2435/4983] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:53 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1212 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:53.853050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:53.861749 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-955c97f2-de36-4e7b-922e-9d68cf34be0f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.483837 Apr 30 21:32:53.871650 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2549/4984] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:53 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:32:54.540000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:54.540589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:54.548593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:54.549079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:54.549905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:54.550355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:54.723540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:54.759612 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2d4e7a0-a232-4009-b4ef-cabdf19e06f0 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1264 microversion: 2.1 time: 0.220949 Apr 30 21:32:54.759612 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2436/4985] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:54 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:54.887309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:54.888695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:54.901981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:54.904748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:54.924211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:54.927001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:55.195859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:55.205625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7a5365d6-94b4-413b-b3d8-9ccedf6a5b49 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.327921 Apr 30 21:32:55.223694 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2550/4986] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:54 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:55.773660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:55.776026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:55.782157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:55.782894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:55.784530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:55.785163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:55.857101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:55.865656 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5c624be4-79db-494f-ad07-b54b049fe160 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1270 microversion: 2.1 time: 0.095841 Apr 30 21:32:55.866611 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2437/4987] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:55 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:56.236115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:56.236115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:56.243950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:56.254695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:56.256403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:56.256847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:56.764104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:56.776888 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-442b7210-caf8-4d4e-a3a0-821754a3a9ba tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.549143 Apr 30 21:32:56.777848 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2551/4988] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:56 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:56.883867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:56.885679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:56.894108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:56.894569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:56.895370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:56.895817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:57.221987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:57.231931 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1cf260e1-8eaa-40b5-acc9-b3a57150b9c6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.351787 Apr 30 21:32:57.247488 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2438/4989] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:56 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:57.796993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:57.798790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:57.820127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:57.824523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:57.832396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:57.833244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:58.167287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:58.180264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff6b1faa-65d5-4118-9481-91a3c15a0898 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.389107 Apr 30 21:32:58.182825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2552/4990] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:57 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:58.251980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:58.252593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:58.259650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:58.260315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:58.261313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:58.261988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:58.561188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:58.573586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b51e7596-3a2c-47f6-8988-f41c773d8330 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.324872 Apr 30 21:32:58.575828 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2439/4991] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:58 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:58.881423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:58.881986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:58.893435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:58.896750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:58.897492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:58.897981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:58.927491 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. Apr 30 21:32:58.932007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:58.932915 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0eec0556-12ac-4008-be7e-358a415ffd05 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 404 len: 111 microversion: 2.1 time: 0.056340 Apr 30 21:32:58.941817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:58.942455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: f31cef50-72cc-494d-a5fe-64b4621e25f4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:58.947433 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2553/4992] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:32:58 2022] DELETE /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:32:58.955230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:58.955871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:58.956836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:58.957437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:58.978753 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. Apr 30 21:32:58.979779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance f31cef50-72cc-494d-a5fe-64b4621e25f4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:32:58.981586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-66b55793-fb1f-4aa2-bcb9-bae21b076c44 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4" status: 404 len: 111 microversion: 2.1 time: 0.043325 Apr 30 21:32:58.982703 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2440/4993] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:58 2022] GET /compute/v2.1/servers/f31cef50-72cc-494d-a5fe-64b4621e25f4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:32:58.996591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:58.997320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:59.008549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.009245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.010695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.013847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.048879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-396d4af7-0e8c-4a57-81ce-6e19d2e87560 req-3fc6c0e4-89f4-4983-b3a7-5b7f2b1e9038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7086fc5c-d8fd-42c0-b94a-955d40d7cbc6", "tag": "caf78fca-e838-4c8d-835a-f05fdc4c6122"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:32:59.064650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-396d4af7-0e8c-4a57-81ce-6e19d2e87560 req-3fc6c0e4-89f4-4983-b3a7-5b7f2b1e9038 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.069615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-396d4af7-0e8c-4a57-81ce-6e19d2e87560 req-3fc6c0e4-89f4-4983-b3a7-5b7f2b1e9038 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.124557 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-396d4af7-0e8c-4a57-81ce-6e19d2e87560 req-3fc6c0e4-89f4-4983-b3a7-5b7f2b1e9038 service nova] Creating event network-changed:caf78fca-e838-4c8d-835a-f05fdc4c6122 for instance 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 on nch1-master-1 Apr 30 21:32:59.125447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:32:59.137045 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-396d4af7-0e8c-4a57-81ce-6e19d2e87560 req-3fc6c0e4-89f4-4983-b3a7-5b7f2b1e9038 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092737 Apr 30 21:32:59.142341 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2441/4994] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:32:59.199772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:59.202797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:59.213892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.214364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.215171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.215649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.619566 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dbda73c0-f675-4e8e-ac62-4e19d28b386e tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 204 len: 0 microversion: 2.1 time: 0.628092 Apr 30 21:32:59.623736 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2554/4995] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:32:58 2022] DELETE /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:32:59.627498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:59.628197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:59.641438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.641922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.646943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.646943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.781688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:32:59.789635 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-084e807b-7e13-4866-b6aa-118dfa9d2d2a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.594280 Apr 30 21:32:59.790696 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2442/4996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:59 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:32:59.795398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:32:59.796016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:32:59.801973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.802443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:32:59.803245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:32:59.803695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:00.399472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:00.407790 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe614ec4-d57c-4307-b55d-a9239f75de28 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.786360 Apr 30 21:33:00.408459 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2555/4997] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:59 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:00.482689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:00.492826 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f9a1ade-65c2-48a8-9f3f-a0412a02bd9a tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.701315 Apr 30 21:33:00.495020 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2443/4998] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:32:59 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:00.807999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:00.808625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:00.818952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:00.819430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:00.820257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:00.823958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:01.046941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:01.057337 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ae86480a-dfc8-45e7-b2fa-95235ffe486e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.253766 Apr 30 21:33:01.058297 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2556/4999] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:00 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:01.428362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:01.428944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:01.437236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:01.438539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:01.439666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:01.440473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:01.514136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:01.515431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:01.523298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:01.524060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:01.525210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:01.525723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:02.029447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:02.037390 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db09ed2e-ba5e-4209-8e5d-6eda8b660bd9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1511 microversion: 2.1 time: 0.528706 Apr 30 21:33:02.038230 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2557/5000] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:01 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1511 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:02.039478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:02.049599 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-76ac2b18-d6f7-4ccf-a811-8b5464849253 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.628764 Apr 30 21:33:02.050365 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2444/5001] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:01 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:02.075388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:02.075938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:02.082338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:02.085556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:02.085556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:02.085556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:02.517356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:02.525395 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de0be6f7-875c-4beb-adc0-4638b76dd92a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.454574 Apr 30 21:33:02.530058 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2558/5002] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:02 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:02.807860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e7f1237a-0b49-4ee8-891b-1dd29611153e req-2d417b28-d3c3-466d-a5c8-238546cb6809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc46f81-a8bd-46ba-b2c4-6a859c458690", "name": "network-vif-deleted", "tag": "0909419b-0751-4574-88cd-5569bff0727a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:02.825520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e7f1237a-0b49-4ee8-891b-1dd29611153e req-2d417b28-d3c3-466d-a5c8-238546cb6809 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:02.825520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e7f1237a-0b49-4ee8-891b-1dd29611153e req-2d417b28-d3c3-466d-a5c8-238546cb6809 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:02.853368 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e7f1237a-0b49-4ee8-891b-1dd29611153e req-2d417b28-d3c3-466d-a5c8-238546cb6809 service nova] Creating event network-vif-deleted:0909419b-0751-4574-88cd-5569bff0727a for instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 on nch1-master-1 Apr 30 21:33:02.874912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e7f1237a-0b49-4ee8-891b-1dd29611153e req-2d417b28-d3c3-466d-a5c8-238546cb6809 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071402 Apr 30 21:33:02.876237 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2445/5003] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:33:03.056500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:03.057781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:03.075568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:03.076492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:03.085054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:03.086011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:03.086999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:03.087598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:03.092408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:03.098016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:03.099190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:03.100817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:03.279612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf1d13615bc491ab98d2a644e681c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3383c2433214484eb41e99aacb653b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:03.290453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc86b548-f02b-4afb-a487-2ac43a3ba9db tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 200 len: 1301 microversion: 2.1 time: 0.238951 Apr 30 21:33:03.290959 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2559/5004] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:03 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 1301 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:03.454894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:03.471552 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-326be318-3dc1-46ed-b2f1-fe0a961ce549 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.401604 Apr 30 21:33:03.472726 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2446/5005] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:03 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:03.549083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:03.549987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:03.561359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:03.561905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:03.562615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:03.564572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:03.935657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:03.943625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e937904e-7bf0-4acc-a361-cb6656a67b3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.399820 Apr 30 21:33:03.959902 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2560/5006] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:03 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:04.308318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:04.308989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] [instance: 7dc46f81-a8bd-46ba-b2c4-6a859c458690] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:04.320512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:04.320978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:04.321783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:04.324973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:04.354956 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] HTTP exception thrown: Instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 could not be found. Apr 30 21:33:04.355879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] Returning 404 to user: Instance 7dc46f81-a8bd-46ba-b2c4-6a859c458690 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:33:04.357340 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3310e9dc-fda3-4302-bddb-f527072d13b9 tempest-ServersNegativeTestJSON-461111943 tempest-ServersNegativeTestJSON-461111943-project] 10.222.0.23 "GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690" status: 404 len: 111 microversion: 2.1 time: 0.052884 Apr 30 21:33:04.358590 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2447/5007] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:04 2022] GET /compute/v2.1/servers/7dc46f81-a8bd-46ba-b2c4-6a859c458690 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:33:04.493538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:04.494566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:04.515915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:04.517786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:04.520231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:04.531219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:04.802483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:04.831015 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b0e257af-efc4-4e79-9e82-34a45815b495 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.342248 Apr 30 21:33:04.841897 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2561/5008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:04 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:04.980042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:04.987575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:04.998028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:04.998761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:05.000130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:05.000783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:05.395205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:05.410444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2563b14e-c331-4cd5-858a-3bf704b90062 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.449576 Apr 30 21:33:05.411515 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2448/5009] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:04 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:05.850811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:05.852330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:05.872893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:05.873618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:05.876053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:05.876768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:06.290771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:06.299772 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f4a8f29-e580-45e2-9162-14fe6c4fbe80 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.455031 Apr 30 21:33:06.300360 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2562/5010] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:05 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:06.427802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:06.428480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:06.436140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:06.436601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:06.437390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:06.438104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:06.711503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:06.724325 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f413008f-3f00-4eae-8390-a14bab3d5815 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.299887 Apr 30 21:33:06.730286 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2449/5011] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:06 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:07.317283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:07.318519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:07.331572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:07.332269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:07.333250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:07.333871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:07.693175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:07.705726 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8383507-eaf4-4c56-9ec7-e3571ec1963b tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.389796 Apr 30 21:33:07.718239 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2563/5012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:07 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:07.744698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:07.745924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:07.771985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:07.772735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:07.773946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:07.774821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:08.047714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:08.056421 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94a2ef4c-22ce-44a1-b562-2306ef1c2858 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.315578 Apr 30 21:33:08.057659 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2450/5013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:07 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:08.089946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e2eb6504-41a7-49e5-9c0d-9d39697d49e6 req-bac8fa5f-903f-45c5-ac58-f2a512b1e9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7086fc5c-d8fd-42c0-b94a-955d40d7cbc6", "name": "network-vif-plugged", "status": "completed", "tag": "caf78fca-e838-4c8d-835a-f05fdc4c6122"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:08.101305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e2eb6504-41a7-49e5-9c0d-9d39697d49e6 req-bac8fa5f-903f-45c5-ac58-f2a512b1e9c2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:08.101305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e2eb6504-41a7-49e5-9c0d-9d39697d49e6 req-bac8fa5f-903f-45c5-ac58-f2a512b1e9c2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:08.134226 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e2eb6504-41a7-49e5-9c0d-9d39697d49e6 req-bac8fa5f-903f-45c5-ac58-f2a512b1e9c2 service nova] Creating event network-vif-plugged:caf78fca-e838-4c8d-835a-f05fdc4c6122 for instance 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 on nch1-master-1 Apr 30 21:33:08.141743 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e2eb6504-41a7-49e5-9c0d-9d39697d49e6 req-bac8fa5f-903f-45c5-ac58-f2a512b1e9c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055314 Apr 30 21:33:08.145728 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2564/5014] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:33:08.491904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8bc518c-5a7e-452b-99cb-51d233ab9acd tempest-ExtensionsTest-2114320731 tempest-ExtensionsTest-2114320731-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:08.495640 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8bc518c-5a7e-452b-99cb-51d233ab9acd tempest-ExtensionsTest-2114320731 tempest-ExtensionsTest-2114320731-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.183796 Apr 30 21:33:08.496939 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2451/5015] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Apr 30 21:33:08 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:33:08.508768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d359c070-d2c9-46a3-917e-efc40c05b461 tempest-ExtensionsTest-2114320731 tempest-ExtensionsTest-2114320731-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:08.511778 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d359c070-d2c9-46a3-917e-efc40c05b461 tempest-ExtensionsTest-2114320731 tempest-ExtensionsTest-2114320731-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008368 Apr 30 21:33:08.512636 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2565/5016] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:33:08 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:33:08.722524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:08.723149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:08.730193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:08.731486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:08.732704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:08.733223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:08.945098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:08.956600 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96252c00-c586-47d6-83b9-cb74f9f9d4d6 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.237682 Apr 30 21:33:08.957847 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2452/5017] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:08 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:09.075165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:09.076015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:09.092736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:09.093377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:09.094327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:09.097154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:09.611843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:09.623964 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-68b073ec-e12e-4e3b-a08b-ad94f8f3f947 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.553459 Apr 30 21:33:09.637649 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2566/5018] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:09 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:09.974729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:09.975464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:09.986077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:09.986659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:09.987663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:09.988353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:10.266547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:10.276540 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ef15314c-14cd-4c44-99bf-1f7e349f086c tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1312 microversion: 2.1 time: 0.306252 Apr 30 21:33:10.291253 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2453/5019] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:09 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1312 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:10.659907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:10.662383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:10.688597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:10.689881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:10.690954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:10.692811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:11.212801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:11.231592 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-04d0d8a2-3286-449d-9272-990629acf234 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1504 microversion: 2.1 time: 0.581882 Apr 30 21:33:11.232450 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2567/5020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:10 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:11.295431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:11.296064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:11.302908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:11.303377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:11.304174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:11.304624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:11.938169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:11.951175 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16295c53-d8db-4f44-b789-b085727ac7be tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1462 microversion: 2.1 time: 0.657158 Apr 30 21:33:11.953999 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2454/5021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:11 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1462 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:11.967869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd599d51-49e1-4afe-93ba-b62c35e94506 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75ec996f-b0b5-4141-a09f-8a7066dc3547", "device": "/dev/sdb"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:11.969016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd599d51-49e1-4afe-93ba-b62c35e94506 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:11.986125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd599d51-49e1-4afe-93ba-b62c35e94506 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:11.986582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd599d51-49e1-4afe-93ba-b62c35e94506 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:11.987379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd599d51-49e1-4afe-93ba-b62c35e94506 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:11.987829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd599d51-49e1-4afe-93ba-b62c35e94506 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:12.249076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:12.249709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:12.264208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:12.264614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:12.265417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:12.266068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:12.848330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:12.857014 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c502f2d4-4064-4800-ac8a-d9adb0d15187 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1484 microversion: 2.1 time: 0.612258 Apr 30 21:33:12.876036 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2455/5022] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:12 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1484 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:12.882390 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd599d51-49e1-4afe-93ba-b62c35e94506 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "POST /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912514 Apr 30 21:33:12.882390 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2568/5023] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:33:11 2022] POST /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:33:13.296968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1732498291", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:13.351818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] validate_networks() for [('a09f59df-65ff-4e7f-b7ad-b8a3d18c2fb3', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:33:14.682596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:33:14.683186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:33:14.683714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:33:14.684223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:33:14.684780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:33:14.704771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:14.705322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:14.706264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:14.706930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:14.756073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Getting quotas for project 7328d5d6d45a4e80820e1a57f9f9a81c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:33:14.770347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Getting quotas for user f5f04392a4c94046bc7da53b4dffb0e3 and project 7328d5d6d45a4e80820e1a57f9f9a81c. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:33:14.801130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:33:14.804808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:33:15.021552 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d7522ef5-05b4-4f64-ae33-11042970e434 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.757616 Apr 30 21:33:15.024396 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2456/5024] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:33:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:33:15.037837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-125717ae-5056-4ddb-8a27-874f1ec0a37f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:15.051371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-125717ae-5056-4ddb-8a27-874f1ec0a37f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:15.211625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-125717ae-5056-4ddb-8a27-874f1ec0a37f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:15.220604 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-125717ae-5056-4ddb-8a27-874f1ec0a37f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1214 microversion: 2.1 time: 0.189587 Apr 30 21:33:15.224120 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2569/5025] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:15 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:16.241975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2263bc8-0269-4ba9-8bc9-2ac151fe8082 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:16.243123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f2263bc8-0269-4ba9-8bc9-2ac151fe8082 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:16.470065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f2263bc8-0269-4ba9-8bc9-2ac151fe8082 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:16.487645 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2263bc8-0269-4ba9-8bc9-2ac151fe8082 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1214 microversion: 2.1 time: 0.251277 Apr 30 21:33:16.497071 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2457/5026] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:16 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:17.510682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:17.512884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:17.521310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:17.521788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:17.522656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:17.523282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:17.683022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:17.700634 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a2f8c5a7-f7a7-48e0-8705-72ad5412c14b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1266 microversion: 2.1 time: 0.192823 Apr 30 21:33:17.701490 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2570/5027] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:17 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:18.719419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:18.720557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:18.738994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:18.739471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:18.740388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:18.740724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:19.005622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:19.020965 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ee394ffb-3e9b-440c-8f4c-d71e34f0b86a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1274 microversion: 2.1 time: 0.305929 Apr 30 21:33:19.023269 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2458/5028] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:18 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:20.041097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:20.043003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:20.051170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:20.051844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:20.052949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:20.053545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:20.651067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:20.673342 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-855b6b8d-76c1-4085-8e73-86570c4ecfd5 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.636445 Apr 30 21:33:20.702634 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2571/5029] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:20 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:21.712618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:21.713424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:21.726710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:21.734188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:21.735145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:21.735808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:22.065349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:22.078007 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f79e2ce-683e-47a1-a43f-541c7112d589 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.369313 Apr 30 21:33:22.080414 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2459/5030] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:21 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:22.843801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-dd646d1a-0dd0-4160-b016-5d8708fe9873 req-101f3691-b20f-4031-9032-838c4eefcee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15397ace-76c0-43f0-a04b-0f6ffdc2cab3", "tag": "94cfe8ca-d48c-43aa-9182-603cbe2dcef4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:22.889730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dd646d1a-0dd0-4160-b016-5d8708fe9873 req-101f3691-b20f-4031-9032-838c4eefcee0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:22.895682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dd646d1a-0dd0-4160-b016-5d8708fe9873 req-101f3691-b20f-4031-9032-838c4eefcee0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:22.934156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-dd646d1a-0dd0-4160-b016-5d8708fe9873 req-101f3691-b20f-4031-9032-838c4eefcee0 service nova] Creating event network-changed:94cfe8ca-d48c-43aa-9182-603cbe2dcef4 for instance 15397ace-76c0-43f0-a04b-0f6ffdc2cab3 on nch2-master-1 Apr 30 21:33:22.942328 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-dd646d1a-0dd0-4160-b016-5d8708fe9873 req-101f3691-b20f-4031-9032-838c4eefcee0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104221 Apr 30 21:33:22.943393 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2572/5031] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:33:23.100136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:23.100784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:23.117326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:23.118105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:23.119111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:23.123401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:23.819397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:23.844102 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78a8be59-dc58-4f57-b168-f443c0b822d8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.748300 Apr 30 21:33:23.844721 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2460/5032] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:23 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:24.863256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:24.864536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:24.884126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:24.884126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:24.884126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:24.884126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:25.248373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:25.258355 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b02d080-5be3-4aae-a6de-361926f091cf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.401150 Apr 30 21:33:25.269145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2573/5033] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:24 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:25.518007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca62eb96-1d18-41e0-87f4-a39e2df2917c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "145fbe2b-80e0-425d-8ae1-fb6fd5400018"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:25.519204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ca62eb96-1d18-41e0-87f4-a39e2df2917c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:25.528594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca62eb96-1d18-41e0-87f4-a39e2df2917c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:25.529110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca62eb96-1d18-41e0-87f4-a39e2df2917c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:25.529957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca62eb96-1d18-41e0-87f4-a39e2df2917c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:25.530415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca62eb96-1d18-41e0-87f4-a39e2df2917c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:26.276292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:26.277779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:26.285472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:26.286849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:26.287686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:26.288129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:26.479781 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca62eb96-1d18-41e0-87f4-a39e2df2917c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966583 Apr 30 21:33:26.484756 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2461/5034] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:33:25 2022] POST /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:33:26.820641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:26.837681 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5fe0f31-3152-4484-b892-bf55e17c34b2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.557441 Apr 30 21:33:26.846081 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2574/5035] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:26 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:27.862563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:27.863376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:27.883447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:27.883447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:27.883447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:27.883447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:28.098506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:28.107002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d3f87a5-83e5-4cdc-9e33-91b840b5e833 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.249267 Apr 30 21:33:28.108771 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2462/5036] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:27 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:29.125324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:29.126690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:29.143856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:29.148925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:29.148925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:29.148925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:29.397259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:29.408011 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-edcf9524-a900-41da-a4dc-cb1cc2f94be9 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.287325 Apr 30 21:33:29.411883 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2575/5037] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:29 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:30.436324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:30.436324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:30.442254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:30.442959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:30.444383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:30.449346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:30.808247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:30.828839 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-91002a27-73ab-4842-8892-d54352063a31 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.406078 Apr 30 21:33:30.848375 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2463/5038] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:30 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:30.969436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:30.970755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:30.981733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:30.989581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:30.989581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:30.989581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:31.042096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lazy-loading 'flavor' on Instance uuid f89281bb-203e-4c4d-a650-8cebfbed3346 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:33:31.504394 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6cadeb69-0ff5-4d85-9787-eb8a589945f5 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/action" status: 200 len: 32 microversion: 2.1 time: 0.539077 Apr 30 21:33:31.510996 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2576/5039] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:33:30 2022] POST /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/action => generated 32 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:33:31.514927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:31.516852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:31.527071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:31.527538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:31.528754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:31.529450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:31.639101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1599f822-4834-4ae7-add6-b6cda37e5c6c req-1978ca9c-956d-4cc6-894c-bfe8053cfbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15397ace-76c0-43f0-a04b-0f6ffdc2cab3", "name": "network-vif-plugged", "status": "completed", "tag": "94cfe8ca-d48c-43aa-9182-603cbe2dcef4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:31.654716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1599f822-4834-4ae7-add6-b6cda37e5c6c req-1978ca9c-956d-4cc6-894c-bfe8053cfbbb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:31.654716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1599f822-4834-4ae7-add6-b6cda37e5c6c req-1978ca9c-956d-4cc6-894c-bfe8053cfbbb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:31.670250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1599f822-4834-4ae7-add6-b6cda37e5c6c req-1978ca9c-956d-4cc6-894c-bfe8053cfbbb service nova] Creating event network-vif-plugged:94cfe8ca-d48c-43aa-9182-603cbe2dcef4 for instance 15397ace-76c0-43f0-a04b-0f6ffdc2cab3 on nch2-master-1 Apr 30 21:33:31.675611 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1599f822-4834-4ae7-add6-b6cda37e5c6c req-1978ca9c-956d-4cc6-894c-bfe8053cfbbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045743 Apr 30 21:33:31.678664 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2577/5040] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:33:31.850309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:31.851258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:31.852308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:31.863253 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-50f5d25c-4f12-4f14-8b3f-c62bedd3be47 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.352108 Apr 30 21:33:31.870685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:31.871647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2464/5041] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:31 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:31.874257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:31.877956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:31.880340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:32.239138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:32.255482 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2e1b007-68f7-49a9-a9f7-6ee9bac50032 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.409878 Apr 30 21:33:32.256471 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2578/5042] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:31 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:32.891772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:32.892313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:32.914986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:32.919305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:32.919305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:32.920053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:33.286977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:33.288215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:33.300325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:33.305596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:33.306489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:33.309518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:33.890534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:33.898560 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51bb2ac2-cf3d-4a49-8d68-0dd3cacf4abe tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 1.010653 Apr 30 21:33:33.908931 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2465/5043] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:32 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:33.984246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:33.994400 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b21e1a98-c1ed-4891-925e-4f0ebacbca46 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1314 microversion: 2.1 time: 0.711186 Apr 30 21:33:34.005066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2579/5044] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:33 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:34.112326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:34.119492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:34.126382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:34.129637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:34.133725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:34.136552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:34.241010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lazy-loading 'services' on Instance uuid 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:33:34.487865 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6/os-volume_attachments/75ec996f-b0b5-4141-a09f-8a7066dc3547" status: 202 len: 0 microversion: 2.1 time: 0.379724 Apr 30 21:33:34.488490 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2466/5045] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:33:34 2022] DELETE /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6/os-volume_attachments/75ec996f-b0b5-4141-a09f-8a7066dc3547 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:33:34.915710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:34.917098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:34.930462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:34.930949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:34.934045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:34.934691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:35.014000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:35.014925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:35.021459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:35.022219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:35.023214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:35.023827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:35.490162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:35.502135 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f961310e-125e-4e39-8167-2500c8653962 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.590555 Apr 30 21:33:35.524445 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2580/5046] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:34 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:35.532220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:35.546762 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec7c8c24-1a2b-4535-9b39-df0622985fdf tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1499 microversion: 2.1 time: 0.537471 Apr 30 21:33:35.547444 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2467/5047] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:35 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1499 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:35.564796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:35.565858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:35.573587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:35.574084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:35.574912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:35.575363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:35.654935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lazy-loading 'flavor' on Instance uuid 15397ace-76c0-43f0-a04b-0f6ffdc2cab3 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:33:35.681751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:35.684480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:35.691328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:35.691795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:35.692603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:35.693256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:35.749931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:33:36.079611 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ae1f1bc0-1bd4-4034-8372-17f53cddbcfe tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "POST /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3/action" status: 200 len: 32 microversion: 2.1 time: 0.519046 Apr 30 21:33:36.086435 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2581/5048] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:33:35 2022] POST /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:33:36.097802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:36.098885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:36.116574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:36.117043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:36.117951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:36.123628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:36.343519 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-715537fc-9ed5-41ad-9ad4-7cb42f6c3514 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 204 len: 0 microversion: 2.1 time: 0.662048 Apr 30 21:33:36.347325 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2468/5049] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:33:35 2022] DELETE /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:33:36.363697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:36.366373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:36.382968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:36.384905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:36.388993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:36.389926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:37.008883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:37.017371 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de668dd7-679c-4303-aa7d-26966ab0b02b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.929458 Apr 30 21:33:37.021385 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2582/5050] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:36 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:37.034578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:37.035560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:37.048976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:37.049518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:37.050429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:37.050952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:37.294532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:37.303000 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8525445b-e63f-4cdf-aa92-51b0ec727d13 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1468 microversion: 2.1 time: 0.951338 Apr 30 21:33:37.304908 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2469/5051] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:36 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1468 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:37.483539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:37.493941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a6f0265-4693-4ec8-a0df-72994bed8cf9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.470848 Apr 30 21:33:37.495509 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2583/5052] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:37 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:38.043000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:38.044987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:38.052895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:38.053663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:38.062005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:38.062005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:38.326428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:38.329236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:38.350382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:38.351595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:38.355601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:38.358156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:38.609990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:38.664207 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8550a772-bf84-48e3-9d63-9b2bb5e365b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.627728 Apr 30 21:33:38.665472 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2470/5053] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:38 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:38.694375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:38.696279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:38.710254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:38.712024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:38.713345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:38.714826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:38.897054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:38.908684 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee87cf48-6c13-4073-9172-b71f22284aa3 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1468 microversion: 2.1 time: 0.591301 Apr 30 21:33:38.917739 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2584/5054] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:38 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1468 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:39.045015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:39.065329 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-745c7842-9a22-436c-8d94-7108d3392184 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.398294 Apr 30 21:33:39.066258 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2471/5055] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:38 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:39.424415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4d971e3b-f3b9-49c2-ab13-2030bd19e2e0 req-efd0f1bc-d99d-43e2-b1de-7976396cc773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7086fc5c-d8fd-42c0-b94a-955d40d7cbc6", "name": "network-vif-deleted", "tag": "caf78fca-e838-4c8d-835a-f05fdc4c6122"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:39.433969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d971e3b-f3b9-49c2-ab13-2030bd19e2e0 req-efd0f1bc-d99d-43e2-b1de-7976396cc773 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:39.434419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4d971e3b-f3b9-49c2-ab13-2030bd19e2e0 req-efd0f1bc-d99d-43e2-b1de-7976396cc773 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:39.446826 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4d971e3b-f3b9-49c2-ab13-2030bd19e2e0 req-efd0f1bc-d99d-43e2-b1de-7976396cc773 service nova] Creating event network-vif-deleted:caf78fca-e838-4c8d-835a-f05fdc4c6122 for instance 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 on nch1-master-1 Apr 30 21:33:39.452653 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4d971e3b-f3b9-49c2-ab13-2030bd19e2e0 req-efd0f1bc-d99d-43e2-b1de-7976396cc773 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 Apr 30 21:33:39.453585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2585/5056] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:33:39.689046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:39.691880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:39.705279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:39.707211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:39.710705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:39.711419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:39.935930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:39.937328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:39.944387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:39.945178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:39.946219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:39.946876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:39.990989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:39.991544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:39.992069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lazy-loading 'fault' on Instance uuid 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:33:40.088804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7757dd58d9db44f89d86bf2217719d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a6ce7a084421bbd267c7ac5c907ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:40.108138 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3dbe824b-9221-4972-bcd0-e6349f412eba tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 200 len: 1302 microversion: 2.1 time: 0.176506 Apr 30 21:33:40.108899 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2586/5057] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:39 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 1302 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:40.114998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:40.115791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:40.124324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:40.125224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:40.127364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:40.127990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:40.158093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:40.165866 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca71b4fb-9c65-44cf-b007-ad40559ab614 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.487126 Apr 30 21:33:40.166460 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2472/5058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:39 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:40.388009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:40.395801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-34171a08-fa72-4d68-a5eb-85890d16a3d8 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.285729 Apr 30 21:33:40.398661 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2587/5059] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:40 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:41.127933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:41.128941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] [instance: 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:41.140237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:41.141144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:41.142209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:41.142878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:41.167084 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] HTTP exception thrown: Instance 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 could not be found. Apr 30 21:33:41.168450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] Returning 404 to user: Instance 7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:33:41.169550 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a9f96dbc-d591-4124-9fd4-59095470fe73 tempest-VolumesBackupsTest-2062082737 tempest-VolumesBackupsTest-2062082737-project] 10.222.0.23 "GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6" status: 404 len: 111 microversion: 2.1 time: 0.046615 Apr 30 21:33:41.170680 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2473/5060] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:41 2022] GET /compute/v2.1/servers/7086fc5c-d8fd-42c0-b94a-955d40d7cbc6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:33:41.184219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:41.184787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:41.203961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:41.214843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:41.216607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:41.217089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:41.414683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:41.415592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:41.442843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:41.443314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:41.444128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:41.444569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:41.649046 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:41.652113 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aaa3e4d2-7a7c-43cb-bd68-0d845ed7bd6f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.470081 Apr 30 21:33:41.669637 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2588/5061] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:41 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:41.778184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:41.787257 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c5b5938f-351c-483c-8f75-191b0876b82a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.377722 Apr 30 21:33:41.787841 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2474/5062] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:41 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:42.675036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:42.676385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:42.684206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:42.685003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:42.686089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:42.686816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:42.808018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:42.818080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:42.833965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:42.835591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:42.838894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:42.840657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:43.524102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:43.533508 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-824b1b6c-751a-48e1-991e-0a720e16487f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.867530 Apr 30 21:33:43.534128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2589/5063] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:42 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:43.725091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:43.740028 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9236e38b-5944-4af0-a798-2da61ea88b00 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.939415 Apr 30 21:33:43.741211 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2475/5064] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:42 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:44.551005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:44.551537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:44.559703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:44.560075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:44.560856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:44.563062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:44.761304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:44.762192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:44.788490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:44.788957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:44.789777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:44.794257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:45.018361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:45.030046 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6de61f6d-649e-45e8-bb9f-d08ddec5365c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.482874 Apr 30 21:33:45.031418 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2590/5065] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:44 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:45.170151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:45.178401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-817b24bb-6745-4c9c-a222-2b79130e4eac tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.423463 Apr 30 21:33:45.179341 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2476/5066] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:44 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:46.048438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:46.049067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:46.056814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:46.057686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:46.058613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:46.059244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:46.196019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:46.196654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:46.203962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:46.204430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:46.205408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:46.205889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:46.366295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:46.380705 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d915cfe5-6d92-4d24-aca4-87a01d59e8dd tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.336123 Apr 30 21:33:46.383720 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2591/5067] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:46 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:46.459817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:46.469992 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd0843f9-f1f7-401f-9719-549eb18e6839 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.277758 Apr 30 21:33:46.481831 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2477/5068] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:46 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:47.399387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:47.401122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:47.408981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:47.409946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:47.411104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:47.411625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:47.492549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:47.494963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:47.515493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:47.517138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:47.519296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:47.519919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:47.708132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:47.716292 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8fc60f6-294f-4f81-94d6-78cdf441ef69 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.320753 Apr 30 21:33:47.716879 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2592/5069] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:47 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:47.760244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:47.770617 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd760445-797b-44bb-a5ec-f47098b4e353 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.285583 Apr 30 21:33:47.771547 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2478/5070] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:47 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:48.734563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:48.735191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:48.741695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:48.742183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:48.743664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:48.743664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:48.787530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:48.788727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:48.798478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:48.798932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:48.799888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:48.800337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:49.459230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:49.469472 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e234121-ab56-49a1-9e27-39ff5ce187d3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.738662 Apr 30 21:33:49.471221 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2593/5071] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:48 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:49.485650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:49.496217 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3374cd80-9123-436e-ae72-66cc0b8538e7 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.712168 Apr 30 21:33:49.507222 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2479/5072] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:48 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:50.490129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:50.490753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:50.514354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:50.515071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:50.529371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:50.534337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:50.536154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:50.536955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:50.537282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:50.538772 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:50.539334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:50.540041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:50.872885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:50.882691 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f1d92f7-997c-41dd-88ab-284ca15e8e7e tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.373227 Apr 30 21:33:50.883983 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2480/5073] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:50 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:50.917276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:50.944468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a71fb6f7-591e-4da2-a90d-afa2440d581e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.460466 Apr 30 21:33:50.955059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2594/5074] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:50 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:51.900653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:51.901593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:51.909699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:51.910184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:51.910979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:51.912081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:51.962121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:51.962744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:51.973107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:51.973579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:51.975756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:51.976395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:52.321228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:52.343095 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7fb3a5ed-bc84-4622-924d-aa14be657d2e tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.384652 Apr 30 21:33:52.346856 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2595/5075] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:51 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:52.347338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:52.356255 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d279fd69-27b1-4c62-99d4-0f69540db1a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.459419 Apr 30 21:33:52.356847 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2481/5076] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:51 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:53.364834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:53.371881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:53.382264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:53.383286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:53.389313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:53.390207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:53.391699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:53.392369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:53.393204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:53.393911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:53.394675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:53.395762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:53.720019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:53.724761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:53.738350 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a2795ce-038e-446e-a592-38a9e0722eb6 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.378467 Apr 30 21:33:53.749909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2596/5077] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:53 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:53.750049 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-79918db4-e19a-4422-936b-bd41f1b80403 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.363744 Apr 30 21:33:53.750049 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2482/5078] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:53 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:54.757925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:54.759475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:54.765047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:54.768839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:54.778311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:54.788750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:54.792238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:54.799932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:54.799932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:54.799932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:54.800687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:54.801929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:56.052778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:56.064705 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cbdf736d-c931-4af0-afc2-868252868f6f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 1.305882 Apr 30 21:33:56.065634 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2483/5079] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:54 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:56.075610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:56.083741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99ea804c-6dc5-4771-8d11-73be00c96e09 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 1.330971 Apr 30 21:33:56.085179 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2597/5080] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:54 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:57.083972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:57.085965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:57.099450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:57.101572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:57.102867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:57.103538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:57.105806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:57.106439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:57.117585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:57.118275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:57.119826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:57.121359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:57.538793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:57.550184 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c6f4dd6-a10b-485f-9442-c1ae93d51051 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.450983 Apr 30 21:33:57.552089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:57.562940 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2598/5081] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:57 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:33:57.568366 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a8e566a4-4a73-44da-a069-f92a9d3b7262 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1735 microversion: 2.1 time: 0.489617 Apr 30 21:33:57.577855 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2484/5082] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:57 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1735 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:58.568551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:58.569288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:58.576339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:58.582115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:58.582115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:58.582115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:58.588722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:58.590048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:58.625503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:58.626010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:58.626816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:58.627267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:59.047384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:59.053324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:33:59.065330 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ccfb6fd3-b636-4b65-8180-44c33be64144 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.500507 Apr 30 21:33:59.074041 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2599/5083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:58 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:59.085333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a03980e4-0a13-44f0-9a35-cce5c52703a3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1715 microversion: 2.1 time: 0.500896 Apr 30 21:33:59.100226 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2485/5084] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:58 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1715 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:59.246472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:59.247280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:59.253395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:59.253901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:59.254692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:59.255668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:59.358524 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Cannot 'detach_volume' instance f89281bb-203e-4c4d-a650-8cebfbed3346 while it is in vm_state rescued Apr 30 21:33:59.364192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 409 to user: Cannot 'detach_volume' instance f89281bb-203e-4c4d-a650-8cebfbed3346 while it is in vm_state rescued {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:33:59.364192 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-54d98ea7-ef58-42dd-b769-23c397d54589 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments/145fbe2b-80e0-425d-8ae1-fb6fd5400018" status: 409 len: 152 microversion: 2.1 time: 0.118878 Apr 30 21:33:59.364192 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2600/5085] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:33:59 2022] DELETE /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments/145fbe2b-80e0-425d-8ae1-fb6fd5400018 => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:33:59.369993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0292fe18-a63c-4e83-8251-7e1ed47a8709 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:33:59.370542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0292fe18-a63c-4e83-8251-7e1ed47a8709 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:59.377960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0292fe18-a63c-4e83-8251-7e1ed47a8709 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:59.378668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0292fe18-a63c-4e83-8251-7e1ed47a8709 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:59.379630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0292fe18-a63c-4e83-8251-7e1ed47a8709 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:59.380076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0292fe18-a63c-4e83-8251-7e1ed47a8709 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:59.633304 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0292fe18-a63c-4e83-8251-7e1ed47a8709 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/action" status: 202 len: 0 microversion: 2.1 time: 0.267630 Apr 30 21:33:59.638303 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2486/5086] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:33:59 2022] POST /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:33:59.644072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:33:59.645677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:33:59.662122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:59.663035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:33:59.664113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:33:59.666852 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:00.098430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:00.099312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:00.110803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:00.115643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:00.119539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:00.120943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:00.211686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:00.224238 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d95d8b21-5f4c-4bbb-bd9f-7d5a01d24a8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1723 microversion: 2.1 time: 0.584211 Apr 30 21:34:00.236449 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2601/5087] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:59 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:34:00.604369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:00.617514 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-25236ba9-2c4a-474b-8c55-5a40f1dc1072 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.532633 Apr 30 21:34:00.618660 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2487/5088] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:00 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:34:01.251398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:01.252028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:01.258392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:01.258853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:01.260205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:01.260650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:01.470183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:01.480330 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b79ca4a2-6bee-46be-a7f2-d37cc22d8e6a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1723 microversion: 2.1 time: 0.233592 Apr 30 21:34:01.486105 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2602/5089] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:01 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:01.636724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:01.638089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:01.646789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:01.647405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:01.648346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:01.649127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:01.870565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:01.888783 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-257d736a-6f10-419e-9860-09917607006c tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.255955 Apr 30 21:34:01.897654 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2488/5090] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:01 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:02.498545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:02.499169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:02.506198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:02.507316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:02.508140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:02.508596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:02.683902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:02.693196 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6246d99b-0609-4749-a8d3-1bac92c66cd3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1723 microversion: 2.1 time: 0.199061 Apr 30 21:34:02.693926 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2603/5091] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:02 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:02.912991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:02.917264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:02.921126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:02.921815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:02.922805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:02.923559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:03.126839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:03.136267 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-428ca267-4c33-4d4e-961b-370222d439e2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.228802 Apr 30 21:34:03.138063 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2489/5092] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:02 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:03.710605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:03.711343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:03.718797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:03.719271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:03.720047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:03.720488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:03.937641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:03.952941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-713e3a72-a6cd-41c4-b970-9bbe8b505108 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1729 microversion: 2.1 time: 0.246024 Apr 30 21:34:03.953956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2604/5093] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:03 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:03.970889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ddf1e9d6-e3c2-4551-a8cf-3774ba37a93b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:03.971415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ddf1e9d6-e3c2-4551-a8cf-3774ba37a93b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:03.979271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d6-e3c2-4551-a8cf-3774ba37a93b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:03.980271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d6-e3c2-4551-a8cf-3774ba37a93b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:03.981108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d6-e3c2-4551-a8cf-3774ba37a93b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:03.981741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d6-e3c2-4551-a8cf-3774ba37a93b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:04.131092 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ddf1e9d6-e3c2-4551-a8cf-3774ba37a93b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164544 Apr 30 21:34:04.137812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2490/5094] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:34:03 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:34:04.156909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:04.157530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:04.165397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:04.167890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:04.168705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:04.171870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:04.491409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:04.502991 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-604b7753-3abf-46e9-aa95-8c46184c8d3f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.350488 Apr 30 21:34:04.504769 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2605/5095] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:04 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:05.398746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-48950fa3-fb22-49e2-920b-277feca1e09e req-f175b65b-ab5d-4da7-a5a5-723e7c17e400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f89281bb-203e-4c4d-a650-8cebfbed3346", "tag": "3fba1066-dfcd-4d25-9f47-0d574a2347de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:05.414027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-48950fa3-fb22-49e2-920b-277feca1e09e req-f175b65b-ab5d-4da7-a5a5-723e7c17e400 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:05.424549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-48950fa3-fb22-49e2-920b-277feca1e09e req-f175b65b-ab5d-4da7-a5a5-723e7c17e400 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:05.440962 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-48950fa3-fb22-49e2-920b-277feca1e09e req-f175b65b-ab5d-4da7-a5a5-723e7c17e400 service nova] Creating event network-changed:3fba1066-dfcd-4d25-9f47-0d574a2347de for instance f89281bb-203e-4c4d-a650-8cebfbed3346 on nch2-master-1 Apr 30 21:34:05.447644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-48950fa3-fb22-49e2-920b-277feca1e09e req-f175b65b-ab5d-4da7-a5a5-723e7c17e400 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052954 Apr 30 21:34:05.449018 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2491/5096] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:34:05.520765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:05.522070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:05.530132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:05.530581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:05.531546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:05.532152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:05.937511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:05.945102 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d995e8d2-96c2-4bd7-be09-d7b5decc3a37 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.428212 Apr 30 21:34:05.955933 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2606/5097] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:05 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:06.964007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:06.964908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:06.972895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:06.973908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:06.975234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:06.976049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:07.160387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:07.168475 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d4d067e0-ad1f-4230-930f-2e8bdb1959c1 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1485 microversion: 2.1 time: 0.209430 Apr 30 21:34:07.169221 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2492/5098] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:06 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1485 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:07.187985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3b1a373d-594a-4722-a91e-5e782381672f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:07.188614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3b1a373d-594a-4722-a91e-5e782381672f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:07.198595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1a373d-594a-4722-a91e-5e782381672f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:07.199564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1a373d-594a-4722-a91e-5e782381672f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:07.203469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1a373d-594a-4722-a91e-5e782381672f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:07.203469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3b1a373d-594a-4722-a91e-5e782381672f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:07.475125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c81fce18-98ce-4aba-b34d-380ce70c1290 req-0cbe3907-708d-43ea-ac64-b6f7e52dc991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f89281bb-203e-4c4d-a650-8cebfbed3346", "tag": "3fba1066-dfcd-4d25-9f47-0d574a2347de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:07.488012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c81fce18-98ce-4aba-b34d-380ce70c1290 req-0cbe3907-708d-43ea-ac64-b6f7e52dc991 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:07.488929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c81fce18-98ce-4aba-b34d-380ce70c1290 req-0cbe3907-708d-43ea-ac64-b6f7e52dc991 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:07.512573 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c81fce18-98ce-4aba-b34d-380ce70c1290 req-0cbe3907-708d-43ea-ac64-b6f7e52dc991 service nova] Creating event network-changed:3fba1066-dfcd-4d25-9f47-0d574a2347de for instance f89281bb-203e-4c4d-a650-8cebfbed3346 on nch2-master-1 Apr 30 21:34:07.522002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c81fce18-98ce-4aba-b34d-380ce70c1290 req-0cbe3907-708d-43ea-ac64-b6f7e52dc991 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050214 Apr 30 21:34:07.523819 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3b1a373d-594a-4722-a91e-5e782381672f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "POST /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3/action" status: 202 len: 0 microversion: 2.1 time: 0.339747 Apr 30 21:34:07.525902 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2493/5100] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:34:07.541735 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2607/5100] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:34:07 2022] POST /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:34:07.546506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:07.551264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:07.561854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:07.565692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:07.566863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:07.569748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:08.660235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:08.674567 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e3dd3da2-60d3-4c8c-a13a-ed0ea6f8f5c2 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1493 microversion: 2.1 time: 1.143075 Apr 30 21:34:08.675932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2494/5101] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:07 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1493 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:09.693581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:09.695359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:09.708661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:09.709115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:09.711726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:09.712823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:10.006709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:10.011552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f12f2191-5709-4564-82f6-1733197591ea tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1493 microversion: 2.1 time: 0.322665 Apr 30 21:34:10.012713 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2608/5102] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:09 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1493 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:11.035238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:11.037913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:11.052940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:11.054600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:11.055570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:11.057584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:11.302160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:11.315502 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75431630-11e8-4e89-8e22-86fac913c580 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1493 microversion: 2.1 time: 0.289587 Apr 30 21:34:11.316301 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2495/5103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:11 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1493 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:12.332566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:12.333185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:12.362301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:12.363838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:12.373350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:12.373985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:12.765260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:12.772912 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-76529a0d-8f4a-4158-87e2-6161c99d1e03 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1499 microversion: 2.1 time: 0.444392 Apr 30 21:34:12.782215 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2609/5104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:12 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1499 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:12.816001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:12.816530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:12.831444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:12.831951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:12.833003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:12.833454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:12.871438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:34:13.242184 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3c19dc57-8bc9-498c-b980-3185d47fcaa7 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 204 len: 0 microversion: 2.1 time: 0.422774 Apr 30 21:34:13.242184 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2496/5105] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:34:12 2022] DELETE /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:34:13.249516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:13.250497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:13.257288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:13.257858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:13.259536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:13.259991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:13.503112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:13.514100 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5fd4b49f-f4b4-4076-8878-d0a5249f5c0a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.268926 Apr 30 21:34:13.515628 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2610/5106] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:13 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:14.533082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:14.534338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:14.543319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:14.543864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:14.544904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:14.545425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:14.767292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:14.778801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49c4d851-3528-4249-a394-dd5143ba58f3 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.250909 Apr 30 21:34:14.780889 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2497/5107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:14 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:15.802250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:15.802708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:15.852212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:15.853240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:15.854070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:15.857445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:16.031170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:16.039254 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c6cf6d8-8434-4687-b3f9-7e29716fc4df tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.246244 Apr 30 21:34:16.039851 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2611/5108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:15 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:34:17.057455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:17.058149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:17.078081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:17.085813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:17.085813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:17.085813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:17.401802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c588d7fb-44ec-4dd3-94eb-ab8c99689f1c req-da7033fc-3dd1-4d6c-83fa-b24971c2453f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15397ace-76c0-43f0-a04b-0f6ffdc2cab3", "name": "network-vif-deleted", "tag": "94cfe8ca-d48c-43aa-9182-603cbe2dcef4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:17.418652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:17.419713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c588d7fb-44ec-4dd3-94eb-ab8c99689f1c req-da7033fc-3dd1-4d6c-83fa-b24971c2453f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:17.420378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c588d7fb-44ec-4dd3-94eb-ab8c99689f1c req-da7033fc-3dd1-4d6c-83fa-b24971c2453f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:17.427577 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-03d20da9-9358-4df5-b659-1cc99e5d524f tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1505 microversion: 2.1 time: 0.375031 Apr 30 21:34:17.431179 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2498/5109] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:17 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:17.445878 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c588d7fb-44ec-4dd3-94eb-ab8c99689f1c req-da7033fc-3dd1-4d6c-83fa-b24971c2453f service nova] Creating event network-vif-deleted:94cfe8ca-d48c-43aa-9182-603cbe2dcef4 for instance 15397ace-76c0-43f0-a04b-0f6ffdc2cab3 on nch2-master-1 Apr 30 21:34:17.456771 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c588d7fb-44ec-4dd3-94eb-ab8c99689f1c req-da7033fc-3dd1-4d6c-83fa-b24971c2453f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054904 Apr 30 21:34:17.475656 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2612/5110] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:34:18.449793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:18.467128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:18.467128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:18.467128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:18.467128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:18.467128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:18.496755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:18.497222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:18.497689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lazy-loading 'fault' on Instance uuid 15397ace-76c0-43f0-a04b-0f6ffdc2cab3 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:34:18.876039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:18.883212 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b66de53-9e0b-475c-b3a4-cba738092778 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 200 len: 1304 microversion: 2.1 time: 0.437345 Apr 30 21:34:18.884680 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2499/5111] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:18 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 1304 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:19.903076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:19.904770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: 15397ace-76c0-43f0-a04b-0f6ffdc2cab3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:19.911338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:19.912118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:19.913117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:19.913784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:19.928941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] HTTP exception thrown: Instance 15397ace-76c0-43f0-a04b-0f6ffdc2cab3 could not be found. Apr 30 21:34:19.929934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Returning 404 to user: Instance 15397ace-76c0-43f0-a04b-0f6ffdc2cab3 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:34:19.931120 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01fe734b-ed45-41e5-bde6-fa0a1b6296b8 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3" status: 404 len: 111 microversion: 2.1 time: 0.034031 Apr 30 21:34:19.935276 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2613/5112] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:19 2022] GET /compute/v2.1/servers/15397ace-76c0-43f0-a04b-0f6ffdc2cab3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:34:19.940416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:19.940969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:19.949118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:19.950211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:19.951289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:19.951893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:19.981173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:34:20.332486 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59cb2c9e-da02-423f-9284-d61b65f1782b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 204 len: 0 microversion: 2.1 time: 0.395585 Apr 30 21:34:20.337812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2500/5113] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:34:19 2022] DELETE /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:34:20.342887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:20.343871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:20.351908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:20.353384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:20.354440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:20.354895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:20.583743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:20.591418 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad777009-97e8-40ed-8a26-9c4446f41cd4 tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1490 microversion: 2.1 time: 0.252867 Apr 30 21:34:20.591999 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2614/5114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:20 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1490 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:34:21.613195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:21.614692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:21.622926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:21.623501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:21.624630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:21.625283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:21.802464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:21.812331 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7750c039-d234-4a50-826b-4f2f0703271a tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1490 microversion: 2.1 time: 0.204631 Apr 30 21:34:21.814623 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2501/5115] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:21 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1490 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:22.830488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:22.831271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:22.845740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:22.846492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:22.849623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:22.850284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:23.144475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:23.152176 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d83912fe-1b78-4561-8a6c-be647086366b tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1490 microversion: 2.1 time: 0.325999 Apr 30 21:34:23.152758 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2615/5116] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:22 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1490 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:23.521325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-de1bd62c-07cd-48d2-8401-7db4a4a39eb9 req-5c39c9cf-bfa6-4ce5-b7b5-3f7e2b7a8911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd620d0-2e66-4144-8ff1-59e3f2f377f1", "name": "network-vif-deleted", "tag": "3baf3b06-fafa-4bc0-a0fc-3b5bcaba856d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:23.532073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-de1bd62c-07cd-48d2-8401-7db4a4a39eb9 req-5c39c9cf-bfa6-4ce5-b7b5-3f7e2b7a8911 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:23.535697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-de1bd62c-07cd-48d2-8401-7db4a4a39eb9 req-5c39c9cf-bfa6-4ce5-b7b5-3f7e2b7a8911 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:23.547405 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-de1bd62c-07cd-48d2-8401-7db4a4a39eb9 req-5c39c9cf-bfa6-4ce5-b7b5-3f7e2b7a8911 service nova] Creating event network-vif-deleted:3baf3b06-fafa-4bc0-a0fc-3b5bcaba856d for instance ecd620d0-2e66-4144-8ff1-59e3f2f377f1 on nch1-master-1 Apr 30 21:34:23.554174 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-de1bd62c-07cd-48d2-8401-7db4a4a39eb9 req-5c39c9cf-bfa6-4ce5-b7b5-3f7e2b7a8911 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036570 Apr 30 21:34:23.558905 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2502/5117] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:34:24.170068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:24.171613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:24.206375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:24.207376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:24.215017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:24.215903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:24.294552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:24.295103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:24.295635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lazy-loading 'fault' on Instance uuid ecd620d0-2e66-4144-8ff1-59e3f2f377f1 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:34:24.348915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f04392a4c94046bc7da53b4dffb0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328d5d6d45a4e80820e1a57f9f9a81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:24.359747 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b048e201-01a3-45a1-96c1-3420e6052c5d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 200 len: 1302 microversion: 2.1 time: 0.193376 Apr 30 21:34:24.360529 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2616/5118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:24 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:25.380759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:25.382456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] [instance: ecd620d0-2e66-4144-8ff1-59e3f2f377f1] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:25.391145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:25.392320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:25.394099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:25.395374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:25.419433 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] HTTP exception thrown: Instance ecd620d0-2e66-4144-8ff1-59e3f2f377f1 could not be found. Apr 30 21:34:25.420928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] Returning 404 to user: Instance ecd620d0-2e66-4144-8ff1-59e3f2f377f1 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:34:25.423144 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-614a5fcc-b459-42dd-8b0e-dc5da581f81d tempest-ServerRescueTestJSON-241397276 tempest-ServerRescueTestJSON-241397276-project] 10.222.0.23 "GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1" status: 404 len: 111 microversion: 2.1 time: 0.048375 Apr 30 21:34:25.424541 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2503/5119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:25 2022] GET /compute/v2.1/servers/ecd620d0-2e66-4144-8ff1-59e3f2f377f1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:34:37.736708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:37.737362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:37.751794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:37.752636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:37.754696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:37.755354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:37.854210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lazy-loading 'services' on Instance uuid f89281bb-203e-4c4d-a650-8cebfbed3346 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:34:38.141482 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-746b9efe-c372-4808-bfe3-4355d0701bd9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments/145fbe2b-80e0-425d-8ae1-fb6fd5400018" status: 202 len: 0 microversion: 2.1 time: 0.409320 Apr 30 21:34:38.142427 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2617/5120] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:34:37 2022] DELETE /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments/145fbe2b-80e0-425d-8ae1-fb6fd5400018 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:34:38.152187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-976e2ae7-26f0-420e-9c9e-58924684e70a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:38.154271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-976e2ae7-26f0-420e-9c9e-58924684e70a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:38.165340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-976e2ae7-26f0-420e-9c9e-58924684e70a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:38.166085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-976e2ae7-26f0-420e-9c9e-58924684e70a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:38.166952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-976e2ae7-26f0-420e-9c9e-58924684e70a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:38.168000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-976e2ae7-26f0-420e-9c9e-58924684e70a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:38.205556 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-976e2ae7-26f0-420e-9c9e-58924684e70a tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057902 Apr 30 21:34:38.206593 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2504/5121] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:34:38 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:34:38.749312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-847672444", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "dbb5c33e-f665-4a8f-a70c-5f8dfdcbb8e1"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:38.812033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] validate_networks() for [('dbb5c33e-f665-4a8f-a70c-5f8dfdcbb8e1', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:34:39.228464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e8dffca-b586-4ef4-8312-aacc0b50d115 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:39.229553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9e8dffca-b586-4ef4-8312-aacc0b50d115 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:39.246230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8dffca-b586-4ef4-8312-aacc0b50d115 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.246775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8dffca-b586-4ef4-8312-aacc0b50d115 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.249074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8dffca-b586-4ef4-8312-aacc0b50d115 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.250058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e8dffca-b586-4ef4-8312-aacc0b50d115 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.345047 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9e8dffca-b586-4ef4-8312-aacc0b50d115 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130594 Apr 30 21:34:39.352209 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2505/5122] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:34:39 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:34:39.455345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:39.456822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:39.468615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.469378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.470460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.471212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.506996 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Cannot 'reboot' instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 while it is in vm_state rescued Apr 30 21:34:39.508298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 409 to user: Cannot 'reboot' instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 while it is in vm_state rescued {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:34:39.509517 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d1e4d9b7-92be-4fc0-8db2-2ee0e81c019f tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8/action" status: 409 len: 145 microversion: 2.1 time: 0.060946 Apr 30 21:34:39.515210 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2506/5123] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:34:39 2022] POST /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8/action => generated 145 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 30 21:34:39.521228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:39.530274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:39.531384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.531963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.533985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.534624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.570644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Cannot 'rebuild' instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 while it is in vm_state rescued Apr 30 21:34:39.571356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 409 to user: Cannot 'rebuild' instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 while it is in vm_state rescued {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:34:39.573067 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bffbfa3c-d2f4-4aa6-b2e0-e5604a46e306 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "POST /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8/action" status: 409 len: 146 microversion: 2.1 time: 0.055798 Apr 30 21:34:39.574599 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2507/5124] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:34:39 2022] POST /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8/action => generated 146 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 21:34:39.585519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:39.586576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:39.595442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.595937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.597302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.597302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.645993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:34:39.859683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:34:39.860474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:34:39.861021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:34:39.861958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:34:39.863016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:34:39.878909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.879438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.880329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:39.880853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:39.902002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Getting quotas for project e374475a40f64506bf36664ff452ea96. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:34:39.908011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Getting quotas for user bde6c559633341eab2d1241f79f7a3dc and project e374475a40f64506bf36664ff452ea96. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:34:39.923925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:34:39.926505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:34:40.059117 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20aff8ff-619f-4aa1-af74-c06d7cc1ce8e tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494635 Apr 30 21:34:40.060058 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2618/5125] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:34:40.072590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-def4827d-02e5-492a-86bd-0f9d298d5ba9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:40.073695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-def4827d-02e5-492a-86bd-0f9d298d5ba9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:40.101393 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d3a9368e-8a8a-41b1-92a9-41586b1ce059 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 204 len: 0 microversion: 2.1 time: 0.518610 Apr 30 21:34:40.102481 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2508/5126] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:34:39 2022] DELETE /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:34:40.111191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:40.112827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:40.124625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:40.138358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:40.139650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:40.140019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:40.214539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-def4827d-02e5-492a-86bd-0f9d298d5ba9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:40.227984 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-def4827d-02e5-492a-86bd-0f9d298d5ba9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1227 microversion: 2.1 time: 0.161743 Apr 30 21:34:40.229500 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2619/5127] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:40 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1227 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:40.382890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:40.390729 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dea867cf-70d5-43d0-81f3-d8085cfb1157 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1689 microversion: 2.1 time: 0.284040 Apr 30 21:34:40.391481 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2509/5128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:40 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:41.248967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f667cc3a-fe26-4644-ba71-0c201e0bc56a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:41.248967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f667cc3a-fe26-4644-ba71-0c201e0bc56a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:41.409833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f667cc3a-fe26-4644-ba71-0c201e0bc56a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:41.412698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:41.414421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:41.430604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:41.431068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:41.431860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:41.432309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:41.432892 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f667cc3a-fe26-4644-ba71-0c201e0bc56a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1227 microversion: 2.1 time: 0.184642 Apr 30 21:34:41.433517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2620/5129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:41 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1227 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:41.801930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:41.814413 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-61594670-b0f8-4a39-bd01-2932228a7282 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1689 microversion: 2.1 time: 0.408841 Apr 30 21:34:41.815199 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2510/5130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:41 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1689 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:42.450598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:42.451523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:42.459420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:42.460391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:42.461426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:42.461898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:42.609955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:42.625492 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-46b3b178-2090-4dfd-bd84-202b6184184a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1279 microversion: 2.1 time: 0.178607 Apr 30 21:34:42.626379 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2621/5131] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:42 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:42.833260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:42.833901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:42.846093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:42.846927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:42.847946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:42.848606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:43.367735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:43.376312 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-34dfb95e-d342-4229-8651-3aa9494bde57 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1689 microversion: 2.1 time: 0.547642 Apr 30 21:34:43.377812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2511/5132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:42 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1689 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:43.648967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:43.651151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:43.668429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:43.668906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:43.669744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:43.670934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:43.837169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:43.855861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ed76378b-b164-4365-936a-88e77dd33efc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1285 microversion: 2.1 time: 0.214337 Apr 30 21:34:43.857908 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2622/5133] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:43 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:44.395564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:44.397180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:44.422120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:44.426486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:44.427403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:44.427861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:44.875338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:44.876031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:44.885444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:44.886251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:44.887301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:44.888126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:44.976081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:44.988426 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ee240396-138a-4a73-b272-df50c9b74c90 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1689 microversion: 2.1 time: 0.596945 Apr 30 21:34:44.989609 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2512/5134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:44 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1689 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:45.022252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:45.031479 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bdf2fd1e-9199-4ec8-ae93-ba874b3058cc tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1285 microversion: 2.1 time: 0.161481 Apr 30 21:34:45.034632 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2623/5135] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:44 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:45.919695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e0f75ae2-8b69-4662-b264-07b7112dc39f req-26122871-ff33-45f2-87a5-ae6cf6d5801b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89281bb-203e-4c4d-a650-8cebfbed3346", "name": "network-vif-deleted", "tag": "3fba1066-dfcd-4d25-9f47-0d574a2347de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:45.930531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e0f75ae2-8b69-4662-b264-07b7112dc39f req-26122871-ff33-45f2-87a5-ae6cf6d5801b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:45.931244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e0f75ae2-8b69-4662-b264-07b7112dc39f req-26122871-ff33-45f2-87a5-ae6cf6d5801b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:45.944038 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e0f75ae2-8b69-4662-b264-07b7112dc39f req-26122871-ff33-45f2-87a5-ae6cf6d5801b service nova] Creating event network-vif-deleted:3fba1066-dfcd-4d25-9f47-0d574a2347de for instance f89281bb-203e-4c4d-a650-8cebfbed3346 on nch2-master-1 Apr 30 21:34:45.951499 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e0f75ae2-8b69-4662-b264-07b7112dc39f req-26122871-ff33-45f2-87a5-ae6cf6d5801b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Apr 30 21:34:45.952099 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2513/5136] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:34:46.012498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:46.012498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:46.026272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:46.026723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:46.027896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:46.028502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:46.051813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:46.052910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:46.065453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:46.066337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:46.067949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:46.068610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:46.272631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:46.284901 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dbb92c25-6e14-41dc-a500-c0d75e5f3b6c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 200 len: 1621 microversion: 2.1 time: 0.282249 Apr 30 21:34:46.299863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2624/5137] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:46 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 1621 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:46.411280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:46.450586 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75bfc7f7-55e7-4948-b12e-75254940ce30 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.392330 Apr 30 21:34:46.450586 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2514/5138] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:46 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:47.322397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:47.337569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: f89281bb-203e-4c4d-a650-8cebfbed3346] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:47.359522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:47.360729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:47.361796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:47.362469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:47.410033 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Instance f89281bb-203e-4c4d-a650-8cebfbed3346 could not be found. Apr 30 21:34:47.410980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 404 to user: Instance f89281bb-203e-4c4d-a650-8cebfbed3346 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:34:47.412441 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce08e5aa-ae75-4cf9-97e1-30252834a7a4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346" status: 404 len: 111 microversion: 2.1 time: 0.099400 Apr 30 21:34:47.413619 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2625/5139] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:47 2022] GET /compute/v2.1/servers/f89281bb-203e-4c4d-a650-8cebfbed3346 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:34:47.423299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a801d8e-f5e5-4292-8cd5-ad193d56b63c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '.version_select at 0x7fdc139fa4c0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:47.462316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:47.463716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:47.474666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:47.475398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:47.476601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:47.477213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:47.531256 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a801d8e-f5e5-4292-8cd5-ad193d56b63c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914487521" status: 202 len: 0 microversion: 2.1 time: 0.112862 Apr 30 21:34:47.534001 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2515/5140] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914487521 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:34:47.862110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:47.872668 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a748180-1df9-4d2a-907d-8cdcd9edbde9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.419794 Apr 30 21:34:47.873268 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2626/5141] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:47 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:48.061333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0e44b76a-a526-4dbb-b332-c1f79da37007 req-9235eed6-9a15-49fb-9d3f-93637b092f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fbf4a5-8fe0-479f-be91-4fa09639faab", "tag": "7035c887-82ce-424d-ac8c-c53f09a9c6fe"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:48.083813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0e44b76a-a526-4dbb-b332-c1f79da37007 req-9235eed6-9a15-49fb-9d3f-93637b092f37 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:48.084489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0e44b76a-a526-4dbb-b332-c1f79da37007 req-9235eed6-9a15-49fb-9d3f-93637b092f37 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:48.111553 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0e44b76a-a526-4dbb-b332-c1f79da37007 req-9235eed6-9a15-49fb-9d3f-93637b092f37 service nova] Creating event network-changed:7035c887-82ce-424d-ac8c-c53f09a9c6fe for instance e9fbf4a5-8fe0-479f-be91-4fa09639faab on nch1-master-1 Apr 30 21:34:48.125526 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0e44b76a-a526-4dbb-b332-c1f79da37007 req-9235eed6-9a15-49fb-9d3f-93637b092f37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068832 Apr 30 21:34:48.127838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2516/5142] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:34:48.911185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:48.912050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:48.935680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:48.936424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:48.937522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:48.940336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:49.496371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:49.534656 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7bae3f3d-242d-4fe2-a263-107ae1b63fe9 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.644449 Apr 30 21:34:49.536585 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2627/5143] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:48 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:50.552998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:50.554537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:50.563123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:50.563826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:50.564991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:50.565855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:50.947909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:50.970050 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8e225d46-16d3-48b4-8178-326347ad2960 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.421082 Apr 30 21:34:50.976438 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2517/5144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:50 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:51.994043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:51.996196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:52.008618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:52.010497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:52.013849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:52.014386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:52.220387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:52.237640 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c8cf9a5-180d-406b-9522-c6d15040e140 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.249857 Apr 30 21:34:52.241807 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2628/5145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:51 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:53.262460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:53.262460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:53.268817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:53.268817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:53.268817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:53.288306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:53.558611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:53.569005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ee732f0a-70d1-4620-8cb8-17c33b13cd8d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.316791 Apr 30 21:34:53.580733 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2518/5146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:53 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:54.330342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5b459685-83ff-4a2b-b09c-d70e3ed8cb46 req-90201d90-9e40-4c5d-bc67-c8dd67292e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fbf4a5-8fe0-479f-be91-4fa09639faab", "name": "network-vif-plugged", "status": "completed", "tag": "7035c887-82ce-424d-ac8c-c53f09a9c6fe"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:54.348058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5b459685-83ff-4a2b-b09c-d70e3ed8cb46 req-90201d90-9e40-4c5d-bc67-c8dd67292e6e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:54.348525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5b459685-83ff-4a2b-b09c-d70e3ed8cb46 req-90201d90-9e40-4c5d-bc67-c8dd67292e6e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:54.379902 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5b459685-83ff-4a2b-b09c-d70e3ed8cb46 req-90201d90-9e40-4c5d-bc67-c8dd67292e6e service nova] Creating event network-vif-plugged:7035c887-82ce-424d-ac8c-c53f09a9c6fe for instance e9fbf4a5-8fe0-479f-be91-4fa09639faab on nch1-master-1 Apr 30 21:34:54.387575 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5b459685-83ff-4a2b-b09c-d70e3ed8cb46 req-90201d90-9e40-4c5d-bc67-c8dd67292e6e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062259 Apr 30 21:34:54.388567 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2629/5147] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:34:54.588944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:54.589648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:54.620104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:54.620590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:54.622124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:54.623939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:54.867528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:54.876375 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c12e2a81-cc21-4d37-b2d9-2703dc6f4731 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.293114 Apr 30 21:34:54.877309 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2519/5148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:54 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:55.895140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:55.895664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:55.910600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:55.911264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:55.917062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:55.917062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:56.607392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:56.627909 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cee8f76a-8435-4a6a-9a42-0b45529edf40 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1327 microversion: 2.1 time: 0.725707 Apr 30 21:34:56.627909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2630/5149] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:55 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1327 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:57.636171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:57.641023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:57.643813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:57.644275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:57.645060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:57.645508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:57.845025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:57.861298 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6374ffb4-1cf3-4b58-ac0c-c4536b75e160 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1526 microversion: 2.1 time: 0.226874 Apr 30 21:34:57.875895 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2520/5150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:57 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1526 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:57.887431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:57.888612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:57.901268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:57.902403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:57.904603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:57.905473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:58.353936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:58.369420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b35600f-f8ba-44b9-9049-3b131e806a64 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1526 microversion: 2.1 time: 0.490002 Apr 30 21:34:58.370852 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2631/5151] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:57 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1526 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:58.612829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:58.624511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:58.624511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:58.624511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:58.624511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:58.624511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:58.640089 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] HTTP exception thrown: Instance e9fbf4a5-8fe0-479f-be91-4fa09639faab could not be found. Apr 30 21:34:58.640800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Returning 404 to user: Instance e9fbf4a5-8fe0-479f-be91-4fa09639faab could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:34:58.642776 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3670aac7-7f3b-415f-b244-7a6bc76e74f8 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 404 len: 111 microversion: 2.1 time: 0.259244 Apr 30 21:34:58.647701 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2521/5152] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:34:58 2022] DELETE /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:34:58.653959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:58.654869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:58.661116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:58.661821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:58.662616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:58.663788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:59.058588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:59.068872 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01150bd3-f5b3-4962-9ca4-e784708ec89d tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1526 microversion: 2.1 time: 0.419338 Apr 30 21:34:59.070371 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2632/5153] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:58 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1526 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:34:59.090872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Action: 'update', calling method: >, body: {"server": {"name": "e9fbf4a5-8fe0-479f-be91-4fa09639faab_new"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:34:59.099448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:59.114982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:59.118130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:59.119277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:59.119964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:59.135598 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] HTTP exception thrown: Instance e9fbf4a5-8fe0-479f-be91-4fa09639faab could not be found. Apr 30 21:34:59.136585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] Returning 404 to user: Instance e9fbf4a5-8fe0-479f-be91-4fa09639faab could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:34:59.137708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cdb5de61-0b2c-41ae-b806-02156234e675 tempest-ServersNegativeTestMultiTenantJSON-962079091 tempest-ServersNegativeTestMultiTenantJSON-962079091-project] 10.222.0.23 "PUT /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 404 len: 111 microversion: 2.1 time: 0.053848 Apr 30 21:34:59.143101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2522/5154] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:34:59 2022] PUT /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:34:59.148596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:59.149114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:59.156592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:59.157000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:59.158011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:59.158670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:59.222064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:34:59.588291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cf21959-56e5-41e1-b240-4a8043a8364a tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 204 len: 0 microversion: 2.1 time: 0.444008 Apr 30 21:34:59.589788 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2633/5155] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:34:59 2022] DELETE /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:34:59.600818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:34:59.601885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:34:59.618777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:59.622150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:59.624578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:34:59.626259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:34:59.946806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:34:59.969130 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ee533b4a-b338-4993-8f00-23947bdf50c0 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1532 microversion: 2.1 time: 0.374500 Apr 30 21:34:59.981713 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2523/5156] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:34:59 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1532 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:01.000186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:01.001878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:01.014971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:01.017444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:01.017444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:01.018445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:01.339737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:01.356284 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9b6a2e8e-ea54-490e-9b36-fbda7a0a2dd2 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1532 microversion: 2.1 time: 0.362815 Apr 30 21:35:01.361997 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2634/5157] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:00 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1532 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:02.118328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9347d3ae-f634-4b49-a410-30dbdb15e788 req-0aebcf3b-2f28-4a9c-9655-c33154e34874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fbf4a5-8fe0-479f-be91-4fa09639faab", "name": "network-vif-deleted", "tag": "7035c887-82ce-424d-ac8c-c53f09a9c6fe"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:02.145640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9347d3ae-f634-4b49-a410-30dbdb15e788 req-0aebcf3b-2f28-4a9c-9655-c33154e34874 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:02.146501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9347d3ae-f634-4b49-a410-30dbdb15e788 req-0aebcf3b-2f28-4a9c-9655-c33154e34874 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:02.172041 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9347d3ae-f634-4b49-a410-30dbdb15e788 req-0aebcf3b-2f28-4a9c-9655-c33154e34874 service nova] Creating event network-vif-deleted:7035c887-82ce-424d-ac8c-c53f09a9c6fe for instance e9fbf4a5-8fe0-479f-be91-4fa09639faab on nch1-master-1 Apr 30 21:35:02.183631 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9347d3ae-f634-4b49-a410-30dbdb15e788 req-0aebcf3b-2f28-4a9c-9655-c33154e34874 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069430 Apr 30 21:35:02.189658 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2524/5158] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:35:02.374293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:02.374932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:02.385531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:02.386023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:02.386818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:02.387258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:02.543962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6c559633341eab2d1241f79f7a3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374475a40f64506bf36664ff452ea96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:02.571154 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e2802ab-60f5-4f70-a47a-7a6f22bff434 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 200 len: 1312 microversion: 2.1 time: 0.200861 Apr 30 21:35:02.581897 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2635/5159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:02 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:03.590534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:03.591488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] [instance: e9fbf4a5-8fe0-479f-be91-4fa09639faab] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:03.599898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:03.601055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:03.602130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:03.603343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:03.616912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] HTTP exception thrown: Instance e9fbf4a5-8fe0-479f-be91-4fa09639faab could not be found. Apr 30 21:35:03.617664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] Returning 404 to user: Instance e9fbf4a5-8fe0-479f-be91-4fa09639faab could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:35:03.618627 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d070cbb0-68f7-450d-a325-a061f31a2b92 tempest-ServersNegativeTestMultiTenantJSON-1987947798 tempest-ServersNegativeTestMultiTenantJSON-1987947798-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab" status: 404 len: 111 microversion: 2.1 time: 0.033988 Apr 30 21:35:03.619414 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2525/5160] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:03 2022] GET /compute/v2.1/servers/e9fbf4a5-8fe0-479f-be91-4fa09639faab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:35:13.063218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:13.063969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:13.090602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:13.092803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:13.094302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:13.096658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:13.141149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:35:13.656629 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc9493ad-6f29-450e-8b5d-1811e1d594b4 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 204 len: 0 microversion: 2.1 time: 0.600952 Apr 30 21:35:13.659073 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2636/5161] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:35:13 2022] DELETE /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:35:13.667006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:13.669466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:13.689671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:13.690172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:13.691251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:13.691868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:14.082272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:14.101013 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9afeaf64-40dd-42cd-8321-f87ee2fc2944 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1507 microversion: 2.1 time: 0.437970 Apr 30 21:35:14.103195 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2526/5162] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:13 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:15.122156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:15.129214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:15.172164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:15.174870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:15.177072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:15.183113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:15.612765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:15.626421 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6ef46445-a857-4eb9-a54b-47e088f7713b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1507 microversion: 2.1 time: 0.511217 Apr 30 21:35:15.628371 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2637/5163] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:15 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:16.654707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:16.657372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:16.679961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:16.680603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:16.681472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:16.682241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:17.270428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:17.298414 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c8a9c2be-c71f-4727-ba2f-ebe1ba0f3f2c tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1507 microversion: 2.1 time: 0.642070 Apr 30 21:35:17.303889 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2527/5164] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:16 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1507 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:17.350114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3157b02b-5666-4fce-a228-8f4338cdcc32 req-4b7e3089-4db2-4c92-b424-038e59aea71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972883b8-db95-40bb-bec0-6e16a9ee35d8", "name": "network-vif-deleted", "tag": "d5503947-830f-4d9d-94cc-e5a9c55e9a7c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:17.369668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3157b02b-5666-4fce-a228-8f4338cdcc32 req-4b7e3089-4db2-4c92-b424-038e59aea71c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:17.370144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3157b02b-5666-4fce-a228-8f4338cdcc32 req-4b7e3089-4db2-4c92-b424-038e59aea71c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:17.386682 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3157b02b-5666-4fce-a228-8f4338cdcc32 req-4b7e3089-4db2-4c92-b424-038e59aea71c service nova] Creating event network-vif-deleted:d5503947-830f-4d9d-94cc-e5a9c55e9a7c for instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 on nch2-master-1 Apr 30 21:35:17.392475 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3157b02b-5666-4fce-a228-8f4338cdcc32 req-4b7e3089-4db2-4c92-b424-038e59aea71c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048151 Apr 30 21:35:17.393624 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2638/5165] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:35:17.989724 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:35:17.991784 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 21:35:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:35:18.323491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:18.324118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:18.336021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:18.339849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:18.339849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:18.340192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:18.419398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:18.421250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:18.421786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lazy-loading 'fault' on Instance uuid 972883b8-db95-40bb-bec0-6e16a9ee35d8 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:35:18.497317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:18.508082 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-addb2100-2328-454a-9ef8-c7f01e07cb34 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 200 len: 1312 microversion: 2.1 time: 0.188555 Apr 30 21:35:18.510788 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2528/5166] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:18 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:19.531538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:19.538359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: 972883b8-db95-40bb-bec0-6e16a9ee35d8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:19.548117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:19.549828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:19.551345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:19.552016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:19.603142 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 could not be found. Apr 30 21:35:19.604025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 404 to user: Instance 972883b8-db95-40bb-bec0-6e16a9ee35d8 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:35:19.617073 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce51439d-a4af-4284-b98a-17c070a53631 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8" status: 404 len: 111 microversion: 2.1 time: 0.081478 Apr 30 21:35:19.618024 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2639/5167] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:19 2022] GET /compute/v2.1/servers/972883b8-db95-40bb-bec0-6e16a9ee35d8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:35:19.626806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:19.628412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:19.636387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:19.637255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:19.645360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:19.645360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:19.687051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:35:20.191723 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c372fb2e-9026-44b4-8422-da1f92de094d tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 204 len: 0 microversion: 2.1 time: 0.568669 Apr 30 21:35:20.193311 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2529/5168] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:35:19 2022] DELETE /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:35:20.203324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:20.204255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:20.213656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:20.214935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:20.216155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:20.216930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:20.761984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:20.801879 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-25f45cc4-6228-4434-9e50-a106a7e4ec8b tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.604029 Apr 30 21:35:20.803159 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2640/5169] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:20 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:21.821223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:21.822371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:21.831971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:21.832438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:21.833241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:21.834240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:22.420587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:22.436677 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6607be42-d716-41ed-b8d2-4e417e2cd179 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 0.620321 Apr 30 21:35:22.437665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2530/5170] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:21 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:23.454909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:23.456198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:23.471099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:23.471571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:23.475975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:23.476749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:24.619575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ba93aa9c-3113-4d8d-8557-84762c83ea8a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'create', calling method: .version_select at 0x7fdc139819d0>, body: {"keypair": {"name": "tempest-keypair-1005453377"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:24.660179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ba93aa9c-3113-4d8d-8557-84762c83ea8a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:35:24.666472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ba93aa9c-3113-4d8d-8557-84762c83ea8a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for user e9fa67fb4ad4472183b95067597f043e and project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:35:24.867451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:24.877161 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0cf36f8f-73f4-4420-bb38-b096aa1d27c9 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1521 microversion: 2.1 time: 1.426905 Apr 30 21:35:24.893097 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2641/5171] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:23 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1521 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:25.214370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ba93aa9c-3113-4d8d-8557-84762c83ea8a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:35:25.222462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-ba93aa9c-3113-4d8d-8557-84762c83ea8a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for user e9fa67fb4ad4472183b95067597f043e and project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:35:25.255212 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ba93aa9c-3113-4d8d-8557-84762c83ea8a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.758118 Apr 30 21:35:25.256982 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2531/5172] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:35:24 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:25.745551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1cd4e958-8514-4e83-a45e-617023a4881d req-188f61a0-8339-4c36-ba01-24c687a9d378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7e10f1-c515-4ca6-9d45-1dadb182b495", "name": "network-vif-deleted", "tag": "f6dea3ed-49b0-46d6-a0a1-fd1777349430"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:25.757706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1cd4e958-8514-4e83-a45e-617023a4881d req-188f61a0-8339-4c36-ba01-24c687a9d378 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:25.760165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1cd4e958-8514-4e83-a45e-617023a4881d req-188f61a0-8339-4c36-ba01-24c687a9d378 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:25.786095 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1cd4e958-8514-4e83-a45e-617023a4881d req-188f61a0-8339-4c36-ba01-24c687a9d378 service nova] Creating event network-vif-deleted:f6dea3ed-49b0-46d6-a0a1-fd1777349430 for instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 on nch2-master-1 Apr 30 21:35:25.800260 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1cd4e958-8514-4e83-a45e-617023a4881d req-188f61a0-8339-4c36-ba01-24c687a9d378 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058487 Apr 30 21:35:25.801598 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2642/5173] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:35:25.903875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:25.904500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:25.922400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:25.923538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:25.927957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:25.935450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:26.162429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:26.168419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:26.170971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lazy-loading 'fault' on Instance uuid ae7e10f1-c515-4ca6-9d45-1dadb182b495 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:35:26.493468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a26877b24c4687a0c8cc4ffc6d69dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef2f32360be4d6c87d31bb5307ad696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:26.504012 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c85aea62-817b-4fcd-9fe3-c6902011d0c3 tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 200 len: 1311 microversion: 2.1 time: 0.606851 Apr 30 21:35:26.519638 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2532/5174] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:25 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 1311 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:27.524211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:27.527205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] [instance: ae7e10f1-c515-4ca6-9d45-1dadb182b495] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:27.541124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:27.542184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:27.543254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:27.544490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:27.577346 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] HTTP exception thrown: Instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 could not be found. Apr 30 21:35:27.579545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] Returning 404 to user: Instance ae7e10f1-c515-4ca6-9d45-1dadb182b495 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:35:27.581735 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c30ff46-e2b0-4398-abbc-345c3623c3cb tempest-ServerRescueNegativeTestJSON-1665530689 tempest-ServerRescueNegativeTestJSON-1665530689-project] 10.222.0.23 "GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495" status: 404 len: 111 microversion: 2.1 time: 0.063611 Apr 30 21:35:27.584336 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2643/5175] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:27 2022] GET /compute/v2.1/servers/ae7e10f1-c515-4ca6-9d45-1dadb182b495 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:35:31.771930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-760697059", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f67bfdda-ee73-4dcc-b5af-432ce9957ea8"}], "security_groups": [{"name": "tempest-securitygroup--1731334148"}], "key_name": "tempest-keypair-1005453377", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:32.629281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] validate_networks() for [('f67bfdda-ee73-4dcc-b5af-432ce9957ea8', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:35:33.527520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:35:33.528119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:35:33.528787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:35:33.529213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:35:33.529650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:35:33.548436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:33.549261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:33.551632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:33.555164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:33.600673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:35:33.610907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for user e9fa67fb4ad4472183b95067597f043e and project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:35:33.624961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:35:33.627591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:35:33.808692 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1c5d4aaa-3c9a-428e-be9f-c23d026497d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.047075 Apr 30 21:35:33.816149 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2533/5176] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:35:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:35:33.819645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aea0977b-fd10-4ea6-9990-755c8c361e27 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:33.820286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aea0977b-fd10-4ea6-9990-755c8c361e27 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:33.962244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-aea0977b-fd10-4ea6-9990-755c8c361e27 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:33.970028 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aea0977b-fd10-4ea6-9990-755c8c361e27 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1237 microversion: 2.1 time: 0.154439 Apr 30 21:35:33.971081 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2644/5177] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:33 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1237 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:35:34.990296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71d0b920-63d7-4d7d-b9d3-d52add26affd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:34.990985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-71d0b920-63d7-4d7d-b9d3-d52add26affd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:35.091564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-71d0b920-63d7-4d7d-b9d3-d52add26affd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:35.099786 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71d0b920-63d7-4d7d-b9d3-d52add26affd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1237 microversion: 2.1 time: 0.115762 Apr 30 21:35:35.100366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2534/5178] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:34 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:35:36.117568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:36.118293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:36.131354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:36.146147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:36.147014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:36.150028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:36.344687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:36.353623 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96ec93b8-3c58-4f70-9bcc-e71e304ad301 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1233 microversion: 2.1 time: 0.240913 Apr 30 21:35:36.356641 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2645/5179] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:36 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1233 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:37.373495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:37.374187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:37.384026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:37.384672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:37.385958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:37.386643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:37.506261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:37.514594 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-28ca81c7-5462-47f2-8aac-4c53a900bd35 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1297 microversion: 2.1 time: 0.145820 Apr 30 21:35:37.522176 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2535/5180] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:37 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:38.535637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:38.537635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:38.563688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:38.563688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:38.563688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:38.563688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:38.733357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:38.742574 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-86f9a009-948c-43fe-a146-313823e34d0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1295 microversion: 2.1 time: 0.213565 Apr 30 21:35:38.743354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2646/5181] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:38 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1295 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:39.759999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:39.760643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:39.787190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:39.788335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:39.789205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:39.789671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:40.271642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:40.295358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cc780bcb-5afd-47db-afe5-15fd9b444ee2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.538385 Apr 30 21:35:40.297321 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2536/5182] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:39 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:41.315717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:41.317834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:41.345621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:41.345621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:41.345621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:41.345917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:41.372573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0d94f072-a7b6-4211-90c4-b29761130863 req-e684736b-bbaa-4b71-ae23-41116393aeee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fcbb4e2-1923-405f-a669-b3d5d68bfda6", "tag": "fd24ae95-dc99-4dc2-a542-b9359163c4e9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:41.411553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0d94f072-a7b6-4211-90c4-b29761130863 req-e684736b-bbaa-4b71-ae23-41116393aeee service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:41.414446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0d94f072-a7b6-4211-90c4-b29761130863 req-e684736b-bbaa-4b71-ae23-41116393aeee service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:41.447195 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0d94f072-a7b6-4211-90c4-b29761130863 req-e684736b-bbaa-4b71-ae23-41116393aeee service nova] Creating event network-changed:fd24ae95-dc99-4dc2-a542-b9359163c4e9 for instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 on nch1-master-1 Apr 30 21:35:41.455856 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0d94f072-a7b6-4211-90c4-b29761130863 req-e684736b-bbaa-4b71-ae23-41116393aeee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087669 Apr 30 21:35:41.460123 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2537/5183] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:35:42.038167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:42.055631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-98c9fd6e-4baf-460f-8495-8daabd928358 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.746758 Apr 30 21:35:42.059853 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2647/5184] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:41 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:43.075411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:43.076364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:43.093666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:43.096080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:43.098473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:43.099789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:43.289888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:43.298608 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-150f60a8-bff4-4147-b74c-784aad046f89 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.228378 Apr 30 21:35:43.299741 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2538/5185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:43 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:44.319450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:44.320078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:44.328349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:44.329132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:44.330348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:44.331050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:44.540210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:44.567974 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c66573c-a1c2-4a2f-8a12-6fe8441c1193 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.246691 Apr 30 21:35:44.567974 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2648/5186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:44 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:35:44.903915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1197661474", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "1f8b2cc3-45fd-4393-b8b3-c09491d04968"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:44.970303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:35:45.572961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:35:45.573404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:35:45.575826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:35:45.577497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:35:45.578063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:35:45.587620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:45.588254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:45.593461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:45.595480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:45.596731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:45.597908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:45.610583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:45.611048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:45.611866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:45.612329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:45.631281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:35:45.640761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:35:45.661888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:35:45.667827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:35:45.855452 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e1891e2-431a-45dc-a909-ce4035144ad2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109713 Apr 30 21:35:45.856438 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2539/5187] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:35:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:35:45.866569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78d38173-324f-4e79-b6f5-45f41458dce1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:45.867297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78d38173-324f-4e79-b6f5-45f41458dce1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:45.981062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78d38173-324f-4e79-b6f5-45f41458dce1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:45.992308 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78d38173-324f-4e79-b6f5-45f41458dce1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1193 microversion: 2.1 time: 0.130154 Apr 30 21:35:46.002146 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2540/5188] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:45 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:46.117433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:46.128660 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c788de18-fa25-4526-aefb-09f154d8689f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.546032 Apr 30 21:35:46.129275 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2649/5189] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:45 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:35:47.010549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bba978d7-f64c-421d-81cb-8df0c2b8a647 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:47.012903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bba978d7-f64c-421d-81cb-8df0c2b8a647 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:47.111364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bba978d7-f64c-421d-81cb-8df0c2b8a647 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:47.119115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bba978d7-f64c-421d-81cb-8df0c2b8a647 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1193 microversion: 2.1 time: 0.112335 Apr 30 21:35:47.131481 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2541/5190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:47 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:47.146955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:47.147566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:47.155793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:47.156527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:47.157483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:47.158170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:47.313258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:47.321644 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7aac8a7-eddb-46ac-a611-4f9ba5515bea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.178583 Apr 30 21:35:47.322865 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2650/5191] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:47 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:48.138299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:48.139739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:48.152775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:48.153739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:48.154954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:48.156000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:48.247280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:48.256791 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e58d038-839c-4275-819e-adb34cddb007 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1245 microversion: 2.1 time: 0.123570 Apr 30 21:35:48.257076 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2542/5192] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:48 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:48.349340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:48.350922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:48.363139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:48.366734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:48.366734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:48.366734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:48.591040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:48.616906 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-faad3f80-641f-4c60-9cb0-26c3bf5c9e4c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.280909 Apr 30 21:35:48.620293 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2651/5193] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:48 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:35:49.284646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:49.285062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:49.294913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:49.295609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:49.296893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:49.303297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:49.452073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:49.461837 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-50fee5ef-5cd0-402f-a5c8-8e398826993c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1263 microversion: 2.1 time: 0.183135 Apr 30 21:35:49.462440 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2543/5194] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:49 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:49.637221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:49.637991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:49.653425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:49.654205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:49.655113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:49.655819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:50.077491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-aa971cb6-acd5-4f4a-b1f3-649730ce63aa req-8ed4ee8b-b90b-4f5e-b530-29478b38bc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcbb4e2-1923-405f-a669-b3d5d68bfda6", "name": "network-vif-plugged", "status": "completed", "tag": "fd24ae95-dc99-4dc2-a542-b9359163c4e9"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:50.090669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aa971cb6-acd5-4f4a-b1f3-649730ce63aa req-8ed4ee8b-b90b-4f5e-b530-29478b38bc7f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:50.091128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-aa971cb6-acd5-4f4a-b1f3-649730ce63aa req-8ed4ee8b-b90b-4f5e-b530-29478b38bc7f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:50.114631 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-aa971cb6-acd5-4f4a-b1f3-649730ce63aa req-8ed4ee8b-b90b-4f5e-b530-29478b38bc7f service nova] Creating event network-vif-plugged:fd24ae95-dc99-4dc2-a542-b9359163c4e9 for instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 on nch1-master-1 Apr 30 21:35:50.138417 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-aa971cb6-acd5-4f4a-b1f3-649730ce63aa req-8ed4ee8b-b90b-4f5e-b530-29478b38bc7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063337 Apr 30 21:35:50.139549 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2544/5195] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:35:50.483205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:50.494323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:50.494323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:50.494323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:50.498707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:50.499294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:50.866368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:50.881107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14d0fd37-0b32-49eb-93db-ea58e781b3e9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1251 microversion: 2.1 time: 0.404519 Apr 30 21:35:50.882757 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2545/5196] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:50 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1251 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:35:50.918970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:50.934178 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-705a5249-0bfd-4008-92e9-0ba52da2e4f6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 1.298933 Apr 30 21:35:50.938545 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2652/5197] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:49 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:51.899620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:51.900241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:51.908907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:51.909619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:51.911364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:51.911980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:51.956292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:51.958460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:51.970789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:51.973365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:51.973365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:51.974034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:52.455038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:52.464894 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-863414a0-c05a-40de-b6cf-063c9073beef tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1363 microversion: 2.1 time: 0.514012 Apr 30 21:35:52.475912 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2653/5198] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:51 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1363 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:52.482764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:52.492436 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0a2ce09a-531c-476b-ba49-47f1ed923cf7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.597595 Apr 30 21:35:52.493679 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2546/5199] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:51 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:53.482746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:53.483375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:53.490576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:53.491058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:53.491847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:53.492296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:53.509903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:53.511021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:53.518028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:53.518489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:53.519337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:53.520311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:53.851543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:53.860156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f4a2abe-4f2c-4c69-abeb-1f08c52f3f29 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1547 microversion: 2.1 time: 0.381445 Apr 30 21:35:53.860856 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2654/5200] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:53 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1547 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:53.876628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:53.881391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-03ed63c6-736b-446c-86c2-4548306fb560 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:53.881872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-03ed63c6-736b-446c-86c2-4548306fb560 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:53.886623 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a9c0e5a8-c478-48c1-9674-6731ea502524 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.381384 Apr 30 21:35:53.888474 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2547/5201] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:53 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:35:53.891607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ed63c6-736b-446c-86c2-4548306fb560 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:53.892143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ed63c6-736b-446c-86c2-4548306fb560 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:53.893019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ed63c6-736b-446c-86c2-4548306fb560 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:53.893585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ed63c6-736b-446c-86c2-4548306fb560 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:53.999348 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-03ed63c6-736b-446c-86c2-4548306fb560 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123144 Apr 30 21:35:53.999348 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2655/5202] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:35:53 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:35:54.161905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-192476db-3e60-4b4f-8471-b6ef8479338b req-62d321d1-8c13-41a5-9eaa-a395820ac581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5c62d2-9e47-4691-822d-dcb5d1e9f962", "tag": "9538c9d6-9da4-4005-a64a-486657fccea6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:54.186128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-192476db-3e60-4b4f-8471-b6ef8479338b req-62d321d1-8c13-41a5-9eaa-a395820ac581 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:54.186128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-192476db-3e60-4b4f-8471-b6ef8479338b req-62d321d1-8c13-41a5-9eaa-a395820ac581 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:54.198931 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-192476db-3e60-4b4f-8471-b6ef8479338b req-62d321d1-8c13-41a5-9eaa-a395820ac581 service nova] Creating event network-changed:9538c9d6-9da4-4005-a64a-486657fccea6 for instance 2d5c62d2-9e47-4691-822d-dcb5d1e9f962 on nch2-master-1 Apr 30 21:35:54.207357 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-192476db-3e60-4b4f-8471-b6ef8479338b req-62d321d1-8c13-41a5-9eaa-a395820ac581 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049577 Apr 30 21:35:54.208809 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2548/5203] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:35:54.905726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:54.906389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:54.918220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:54.921335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:54.922331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:54.922853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:55.622392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:55.637096 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dbe30d5b-0eeb-48e4-bb15-2fe774feb228 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.734104 Apr 30 21:35:55.637096 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2656/5204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:54 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:56.657226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:56.658669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:56.665946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:56.667450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:56.668491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:56.669150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:56.877507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-26535c9f-6cc4-4501-a0a3-73303cc3e5fe req-d724c355-c78f-40b3-ab2e-14d311dd41db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fcbb4e2-1923-405f-a669-b3d5d68bfda6", "tag": "fd24ae95-dc99-4dc2-a542-b9359163c4e9"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:35:56.888327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-26535c9f-6cc4-4501-a0a3-73303cc3e5fe req-d724c355-c78f-40b3-ab2e-14d311dd41db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:56.888948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-26535c9f-6cc4-4501-a0a3-73303cc3e5fe req-d724c355-c78f-40b3-ab2e-14d311dd41db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:56.902409 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-26535c9f-6cc4-4501-a0a3-73303cc3e5fe req-d724c355-c78f-40b3-ab2e-14d311dd41db service nova] Creating event network-changed:fd24ae95-dc99-4dc2-a542-b9359163c4e9 for instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 on nch1-master-1 Apr 30 21:35:56.909931 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-26535c9f-6cc4-4501-a0a3-73303cc3e5fe req-d724c355-c78f-40b3-ab2e-14d311dd41db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035970 Apr 30 21:35:56.918456 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2657/5205] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:35:56.998354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:57.012923 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ce18bdcb-bb1a-400b-b66b-19499ca11271 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.364740 Apr 30 21:35:57.023451 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2549/5206] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:56 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:58.030764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:58.031490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:58.039602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:58.040319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:58.041306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:58.041950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:58.649366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:58.658678 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c727de44-ea1c-49f7-9d19-89fb08c20f52 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.632394 Apr 30 21:35:58.660041 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2658/5207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:58 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:35:59.676022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:35:59.677606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:35:59.685974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:59.686722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:59.688653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:35:59.689162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:35:59.918211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:35:59.926811 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b0425247-62e0-48aa-b0ca-cd7f9a2cabe0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.254788 Apr 30 21:35:59.933915 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2550/5208] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:35:59 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:00.944818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:00.945606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:00.958555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:00.959007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:00.959804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:00.960247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:01.194012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:01.207903 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2d7f250b-be94-463b-b316-367d4ed9472e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.267427 Apr 30 21:36:01.208496 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2659/5209] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:00 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:02.021456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-53484eff-2415-4e5b-8af2-34f53a1129bf req-16b2acd2-5698-416f-899a-b653a07d53c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5c62d2-9e47-4691-822d-dcb5d1e9f962", "name": "network-vif-plugged", "status": "completed", "tag": "9538c9d6-9da4-4005-a64a-486657fccea6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:02.038744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-53484eff-2415-4e5b-8af2-34f53a1129bf req-16b2acd2-5698-416f-899a-b653a07d53c7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:02.041268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-53484eff-2415-4e5b-8af2-34f53a1129bf req-16b2acd2-5698-416f-899a-b653a07d53c7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:02.075060 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-53484eff-2415-4e5b-8af2-34f53a1129bf req-16b2acd2-5698-416f-899a-b653a07d53c7 service nova] Creating event network-vif-plugged:9538c9d6-9da4-4005-a64a-486657fccea6 for instance 2d5c62d2-9e47-4691-822d-dcb5d1e9f962 on nch2-master-1 Apr 30 21:36:02.083080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-53484eff-2415-4e5b-8af2-34f53a1129bf req-16b2acd2-5698-416f-899a-b653a07d53c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066165 Apr 30 21:36:02.101641 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2551/5210] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:02.225284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:02.225859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:02.242695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:02.243456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:02.244440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:02.245904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:02.577913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:02.577913 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a7ba0b3d-e6c7-407a-8819-76585af38d6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.348288 Apr 30 21:36:02.577913 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2660/5211] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:02 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:03.587818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:03.588576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:03.595788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:03.596257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:03.597055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:03.598154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:03.913254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:03.924257 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-33f2eade-1c4e-486e-ad02-72a17377e6fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1293 microversion: 2.1 time: 0.339570 Apr 30 21:36:03.932845 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2552/5212] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:03 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1293 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:04.939871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:04.941963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:04.952879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:04.953547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:04.954740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:04.955395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:05.222282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:05.238966 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e67844a5-0579-4f0f-bf9a-82d7e58d13ea tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1475 microversion: 2.1 time: 0.302989 Apr 30 21:36:05.240168 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2661/5213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:04 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1475 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:05.389623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-433983056", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:05.453249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:36:06.011116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:36:06.011912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:36:06.012962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:36:06.013397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:36:06.013854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:36:06.049269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:06.050014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:06.052933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:06.054036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:06.103327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:36:06.110874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:36:06.129471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:36:06.134022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:36:06.387514 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e71ad35b-b990-4b7e-a58d-3b54ca59fc9a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002406 Apr 30 21:36:06.393947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2553/5214] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:36:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:36:06.399679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-086b195f-70b5-4ae9-b30a-5b26f69ff82e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:06.400672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-086b195f-70b5-4ae9-b30a-5b26f69ff82e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:06.424135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-086b195f-70b5-4ae9-b30a-5b26f69ff82e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:36:06.781297 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-086b195f-70b5-4ae9-b30a-5b26f69ff82e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23" status: 204 len: 0 microversion: 2.1 time: 0.386106 Apr 30 21:36:06.782407 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2662/5215] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:36:06 2022] DELETE /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:36:06.793393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d342b1f2-a5c2-4420-bc20-c03b92465fa5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:06.794756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d342b1f2-a5c2-4420-bc20-c03b92465fa5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:06.819837 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d342b1f2-a5c2-4420-bc20-c03b92465fa5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 could not be found. Apr 30 21:36:06.820476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d342b1f2-a5c2-4420-bc20-c03b92465fa5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:36:06.821339 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d342b1f2-a5c2-4420-bc20-c03b92465fa5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23" status: 404 len: 111 microversion: 2.1 time: 0.033929 Apr 30 21:36:06.821976 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2554/5216] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:06 2022] GET /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:36:06.886481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-630423908", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "1f8b2cc3-45fd-4393-b8b3-c09491d04968"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:06.941530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:36:07.516231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:36:07.516904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:36:07.517133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:36:07.517557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:36:07.518009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:36:07.530377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:07.531109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:07.532090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:07.532714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:07.553390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:36:07.565880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:36:07.605529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:36:07.611945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:36:07.780436 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43bcb10b-5e97-4dd8-86dc-1e581e7fd480 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897874 Apr 30 21:36:07.782330 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2663/5217] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:36:07.804321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b6c93e2-7069-4267-b7ab-c945cd3fab8a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:07.804884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6b6c93e2-7069-4267-b7ab-c945cd3fab8a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:07.969891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6b6c93e2-7069-4267-b7ab-c945cd3fab8a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:08.002506 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b6c93e2-7069-4267-b7ab-c945cd3fab8a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1220 microversion: 2.1 time: 0.205017 Apr 30 21:36:08.007536 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2555/5218] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:07 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:36:09.021832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:09.022586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:09.030250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:09.030708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:09.031733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:09.032933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:09.100771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:09.110455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f639eb45-7699-45d6-b650-72fe0330049b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1224 microversion: 2.1 time: 0.093431 Apr 30 21:36:09.111650 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2664/5219] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:09 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:10.128983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:10.130234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:10.141257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:10.141734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:10.142576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:10.143205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:10.242041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:10.252821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f437be4-0d1e-46c1-b270-31c51236e4c4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1272 microversion: 2.1 time: 0.128720 Apr 30 21:36:10.262375 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2556/5220] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:10 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:11.270522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:11.271734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:11.279244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:11.279922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:11.280903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:11.281534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:11.561341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:11.579743 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3577f22-030d-4c22-9e72-d6330cbde55e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.313837 Apr 30 21:36:11.581942 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2665/5221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:11 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:12.600443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:12.602008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:12.610880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:12.611438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:12.619046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:12.622125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:12.893607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:12.902445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f987df6-101b-472a-b8b8-4ff762235f2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.309617 Apr 30 21:36:12.910594 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2557/5222] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:12 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:13.357547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-0a33b7bb-e0d4-4fad-8378-d5a37a42389c req-18df8210-6a22-410e-9beb-5500da91fef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63432ab8-4cf4-46ee-b4ee-7b4b22401a52", "tag": "145080e7-2268-4f9c-8e4f-73be79bd501b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:13.375800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0a33b7bb-e0d4-4fad-8378-d5a37a42389c req-18df8210-6a22-410e-9beb-5500da91fef4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:13.376284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0a33b7bb-e0d4-4fad-8378-d5a37a42389c req-18df8210-6a22-410e-9beb-5500da91fef4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:13.411316 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-0a33b7bb-e0d4-4fad-8378-d5a37a42389c req-18df8210-6a22-410e-9beb-5500da91fef4 service nova] Creating event network-changed:145080e7-2268-4f9c-8e4f-73be79bd501b for instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 on nch1-master-1 Apr 30 21:36:13.411316 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-0a33b7bb-e0d4-4fad-8378-d5a37a42389c req-18df8210-6a22-410e-9beb-5500da91fef4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277447 Apr 30 21:36:13.411316 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2666/5223] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:13.921009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:13.924001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:13.939602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:13.940631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:13.940913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:13.941366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:14.209399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:14.234424 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e8172f5b-400b-4a1a-9143-844a45b9bc14 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.314100 Apr 30 21:36:14.238466 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2558/5224] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:13 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:15.257639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:15.257639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:15.317357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:15.336384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:15.337497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:15.338080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:15.820352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:15.828523 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56af7829-a987-41a7-ad5f-ddb1a719e053 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.577842 Apr 30 21:36:15.829967 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2667/5225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:15 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:16.846255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:16.848463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:16.860463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:16.861017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:16.861927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:16.863147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:17.015614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:17.026266 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a8c19675-926f-4dae-ae33-34f6f422981d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.183783 Apr 30 21:36:17.027187 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2559/5226] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:16 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:18.043950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:18.044739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:18.064063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:18.064785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:18.067187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:18.068269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:18.287754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:18.303184 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab49f2d2-c479-47b2-b474-c2411df1413f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.263221 Apr 30 21:36:18.313232 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2668/5227] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:18 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:19.320176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:19.320916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:19.329568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:19.330244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:19.331553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:19.332112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:19.612759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:19.636819 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eddf8719-cc86-48fb-8b64-090ed2497084 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.312670 Apr 30 21:36:19.636819 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2560/5228] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:19 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:20.511108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-6489e116-1ca5-4c2c-ae62-2fb3ff4ad6d4 req-e4da799d-7b2d-4756-a8fa-5e73457cfe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63432ab8-4cf4-46ee-b4ee-7b4b22401a52", "name": "network-vif-plugged", "status": "completed", "tag": "145080e7-2268-4f9c-8e4f-73be79bd501b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:20.520837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6489e116-1ca5-4c2c-ae62-2fb3ff4ad6d4 req-e4da799d-7b2d-4756-a8fa-5e73457cfe6e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:20.521514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6489e116-1ca5-4c2c-ae62-2fb3ff4ad6d4 req-e4da799d-7b2d-4756-a8fa-5e73457cfe6e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:20.543496 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-6489e116-1ca5-4c2c-ae62-2fb3ff4ad6d4 req-e4da799d-7b2d-4756-a8fa-5e73457cfe6e service nova] Creating event network-vif-plugged:145080e7-2268-4f9c-8e4f-73be79bd501b for instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 on nch1-master-1 Apr 30 21:36:20.560742 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-6489e116-1ca5-4c2c-ae62-2fb3ff4ad6d4 req-e4da799d-7b2d-4756-a8fa-5e73457cfe6e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197107 Apr 30 21:36:20.562101 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2669/5229] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:20.648164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:20.648795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:20.669475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:20.671093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:20.671919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:20.672369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:20.977973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:20.988270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad81107b-aad4-4413-8e74-49dc006288bc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.346684 Apr 30 21:36:20.989950 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2561/5230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:20 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:22.007151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:22.007932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:22.015669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:22.016227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:22.017282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:22.017821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:22.318661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:22.329929 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d41e1ef6-fa9f-495a-9a7f-947f00ae570e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1320 microversion: 2.1 time: 0.327629 Apr 30 21:36:22.334462 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2670/5231] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:22 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:23.349330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:23.350582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:23.361390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:23.367132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:23.368317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:23.368965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:23.602103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:23.611045 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-33fa71fc-081e-4140-8ce9-9c200d0535e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1501 microversion: 2.1 time: 0.267649 Apr 30 21:36:23.612605 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2562/5232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:23 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:23.635270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:23.635270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:23.639789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:23.641196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:23.642358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:23.650385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:23.862899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:23.871263 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0142cc6b-7bf5-4017-868e-51c0a820ed2f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1501 microversion: 2.1 time: 0.246724 Apr 30 21:36:23.871962 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2671/5233] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:23 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1501 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:23.890868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:23.891749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:23.900765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:23.908683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:23.908683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:23.908683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:23.937867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:36:24.361671 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae7cb613-3c6e-4afa-a973-0063fe3244f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 204 len: 0 microversion: 2.1 time: 0.475513 Apr 30 21:36:24.362994 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2563/5234] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:36:23 2022] DELETE /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:36:24.376428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:24.378400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:24.394312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:24.397709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:24.401045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:24.403478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:24.908492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:24.922226 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f698ea4-8641-486c-94c5-dc616db08bd3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1507 microversion: 2.1 time: 0.554286 Apr 30 21:36:24.922827 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2672/5235] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:24 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:25.943055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:25.943055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:25.952429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:25.954301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:25.955362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:25.956556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:26.690562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:26.698881 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e65e5c0-7fd1-4299-a523-4550e4519666 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1507 microversion: 2.1 time: 0.763183 Apr 30 21:36:26.699954 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2564/5236] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:25 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1507 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:26.956558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-05f5e912-8769-4e2a-8f06-4ced1d7fa4f8 req-a16ddb50-287b-42a4-b564-2a5e8c713d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63432ab8-4cf4-46ee-b4ee-7b4b22401a52", "name": "network-vif-deleted", "tag": "145080e7-2268-4f9c-8e4f-73be79bd501b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:26.966502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-05f5e912-8769-4e2a-8f06-4ced1d7fa4f8 req-a16ddb50-287b-42a4-b564-2a5e8c713d53 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:26.967200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-05f5e912-8769-4e2a-8f06-4ced1d7fa4f8 req-a16ddb50-287b-42a4-b564-2a5e8c713d53 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:26.980962 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-05f5e912-8769-4e2a-8f06-4ced1d7fa4f8 req-a16ddb50-287b-42a4-b564-2a5e8c713d53 service nova] Creating event network-vif-deleted:145080e7-2268-4f9c-8e4f-73be79bd501b for instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 on nch1-master-1 Apr 30 21:36:26.987289 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-05f5e912-8769-4e2a-8f06-4ced1d7fa4f8 req-a16ddb50-287b-42a4-b564-2a5e8c713d53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Apr 30 21:36:26.988177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2673/5237] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:36:27.718309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:27.719587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:27.729046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:27.733081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:27.733081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:27.733081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:27.770028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:27.770489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:27.770952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lazy-loading 'fault' on Instance uuid 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:36:27.814422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:27.837056 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9f5fb70-d330-45fe-a994-2cac49fb158f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 200 len: 1310 microversion: 2.1 time: 0.115064 Apr 30 21:36:27.852215 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2565/5238] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:27 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 1310 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:28.859638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:28.861164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:28.872505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:28.875814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:28.876832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:28.878327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:28.899196 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 could not be found. Apr 30 21:36:28.899816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:36:28.901541 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1dcd8994-2c65-4f01-adc1-57c2ecd5402d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 404 len: 111 microversion: 2.1 time: 0.047337 Apr 30 21:36:28.907661 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2674/5239] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:28 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:36:28.917258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d7b132d1-8770-45fb-8fbc-d67c0e645d5d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: .version_select at 0x7fdc139b2b80>, body: {"keypair": {"name": "tempest-key-1825068934"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:28.944967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d7b132d1-8770-45fb-8fbc-d67c0e645d5d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:36:28.950179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d7b132d1-8770-45fb-8fbc-d67c0e645d5d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:36:29.306955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d7b132d1-8770-45fb-8fbc-d67c0e645d5d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:36:29.314888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d7b132d1-8770-45fb-8fbc-d67c0e645d5d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:36:29.336702 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d7b132d1-8770-45fb-8fbc-d67c0e645d5d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.428233 Apr 30 21:36:29.338270 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2566/5240] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:36:28 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:29.348496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-533bb73f-4232-4eaf-a8aa-d2fdd53c19a3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '.version_select at 0x7fdc13cfef70>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:29.356240 ncdv-master-1 devstack@n-api.service[130671]: WARNING oslo_db.sqlalchemy.utils [None req-533bb73f-4232-4eaf-a8aa-d2fdd53c19a3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 30 21:36:29.362525 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-533bb73f-4232-4eaf-a8aa-d2fdd53c19a3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.018707 Apr 30 21:36:29.363925 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2675/5241] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 21:36:29 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:29.590579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-796050122", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "key_name": "tempest-key-1825068934", "networks": [{"uuid": "1f8b2cc3-45fd-4393-b8b3-c09491d04968"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:29.654703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:36:30.505227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:36:30.505838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:36:30.506470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:36:30.506899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:36:30.507407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:36:30.528742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:30.529469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:30.530728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:30.531365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:30.555534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:36:30.567239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:36:30.635884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:36:30.639869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:36:30.808073 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-65bf9540-68cd-4bb0-9590-cc186f7ae4d3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226003 Apr 30 21:36:30.808901 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2567/5242] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:36:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:36:30.820930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f33f7395-1b0c-4bfd-89e6-3453f08518fe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:30.820930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f33f7395-1b0c-4bfd-89e6-3453f08518fe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:30.922374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f33f7395-1b0c-4bfd-89e6-3453f08518fe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:30.936568 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f33f7395-1b0c-4bfd-89e6-3453f08518fe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1228 microversion: 2.1 time: 0.116022 Apr 30 21:36:30.946681 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2676/5243] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:30 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1228 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:31.080265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb1b34e9-8d9d-40b5-978b-b98e9bd4cc83 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:31.084283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb1b34e9-8d9d-40b5-978b-b98e9bd4cc83 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:31.092257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb1b34e9-8d9d-40b5-978b-b98e9bd4cc83 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:31.092718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb1b34e9-8d9d-40b5-978b-b98e9bd4cc83 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:31.093524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb1b34e9-8d9d-40b5-978b-b98e9bd4cc83 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:31.093996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb1b34e9-8d9d-40b5-978b-b98e9bd4cc83 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:31.155360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb1b34e9-8d9d-40b5-978b-b98e9bd4cc83 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/ips" status: 200 len: 144 microversion: 2.1 time: 0.085305 Apr 30 21:36:31.156021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2568/5244] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:36:31 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/ips => generated 144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:31.955017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b6327d51-0d20-45b5-8fdd-075819ea1fe8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:31.956553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b6327d51-0d20-45b5-8fdd-075819ea1fe8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:32.032956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b6327d51-0d20-45b5-8fdd-075819ea1fe8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:32.047312 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b6327d51-0d20-45b5-8fdd-075819ea1fe8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1228 microversion: 2.1 time: 0.097604 Apr 30 21:36:32.047993 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2677/5245] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:31 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:33.068010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:33.069226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:33.090531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:33.094444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:33.099949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:33.101470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:33.288128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:33.299801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6589c664-a1f6-4dc7-9048-1a2098345ea2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1280 microversion: 2.1 time: 0.237626 Apr 30 21:36:33.305804 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2569/5246] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:33 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:34.330211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:34.332344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:34.365859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:34.366305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:34.368047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:34.368342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:34.457983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:34.469156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-049ce069-82b0-431c-9702-11c484692121 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1286 microversion: 2.1 time: 0.142971 Apr 30 21:36:34.477871 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2678/5247] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:34 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:35.340188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-257b27a7-8bd6-4383-b443-2eda65ef9afb tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f48d4d5-94cc-4387-97f6-69de0a01a3d8"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:35.342109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-257b27a7-8bd6-4383-b443-2eda65ef9afb tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:35.366509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257b27a7-8bd6-4383-b443-2eda65ef9afb tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:35.368631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257b27a7-8bd6-4383-b443-2eda65ef9afb tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:35.370157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257b27a7-8bd6-4383-b443-2eda65ef9afb tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:35.370611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-257b27a7-8bd6-4383-b443-2eda65ef9afb tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:35.487952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:35.488562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:35.499695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:35.500153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:35.500952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:35.508706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:35.791909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:35.800814 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42379180-4b78-4687-bfef-188aad361743 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.317699 Apr 30 21:36:35.820284 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2679/5248] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:35 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:36.509060 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-257b27a7-8bd6-4383-b443-2eda65ef9afb tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.172715 Apr 30 21:36:36.510155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2570/5249] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:36:35 2022] POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:36.784879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d52c6182-e196-4190-a484-d90680025822 req-9024b742-bfb8-41cd-a07b-11c4e1d5d8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39780c08-4194-4809-8ad4-49294acfef91", "tag": "40b845ce-e8af-4c88-9454-24ca22f85327"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:36.799697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d52c6182-e196-4190-a484-d90680025822 req-9024b742-bfb8-41cd-a07b-11c4e1d5d8da service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:36.800154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d52c6182-e196-4190-a484-d90680025822 req-9024b742-bfb8-41cd-a07b-11c4e1d5d8da service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:36.823441 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d52c6182-e196-4190-a484-d90680025822 req-9024b742-bfb8-41cd-a07b-11c4e1d5d8da service nova] Creating event network-changed:40b845ce-e8af-4c88-9454-24ca22f85327 for instance 39780c08-4194-4809-8ad4-49294acfef91 on nch1-master-1 Apr 30 21:36:36.824525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:36.828456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:36.842213 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d52c6182-e196-4190-a484-d90680025822 req-9024b742-bfb8-41cd-a07b-11c4e1d5d8da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061420 Apr 30 21:36:36.843865 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2680/5250] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:36.846665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:36.847430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:36.848554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:36.849232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:37.742631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:37.767341 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8c439ff-a7ee-45a8-84b8-f7f0fd82ce7f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.949901 Apr 30 21:36:37.784529 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2571/5251] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:36 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:36:38.797793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:38.799422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:38.813154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:38.814138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:38.815834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:38.816727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:38.982095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:38.991985 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a8bf669-9538-41e3-a0a9-b7a2d11908a7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.201750 Apr 30 21:36:38.993841 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2681/5252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:38 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:40.008993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:40.009676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:40.020659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:40.025520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:40.025520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:40.025520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:40.483571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:40.499871 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-056222f8-14b9-465c-9108-c5c68817b12c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.494532 Apr 30 21:36:40.500397 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2572/5253] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:40 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:41.531737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:41.531737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:41.546940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:41.562451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:41.565660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:41.568607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:41.889937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:41.901075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7acda3fc-7b7d-4228-92a4-3f99fa52dc4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.384685 Apr 30 21:36:41.901665 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2682/5254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:41 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:42.501458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96e30d1e-14fe-488b-b7e7-e8a36a2e15b4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:42.519698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96e30d1e-14fe-488b-b7e7-e8a36a2e15b4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:42.520426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96e30d1e-14fe-488b-b7e7-e8a36a2e15b4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:42.592101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96e30d1e-14fe-488b-b7e7-e8a36a2e15b4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Going to try to stop instance {{(pid=130670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:36:42.801276 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96e30d1e-14fe-488b-b7e7-e8a36a2e15b4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action" status: 202 len: 0 microversion: 2.1 time: 0.305799 Apr 30 21:36:42.802568 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2573/5255] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:36:42 2022] POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:36:42.812541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:42.813468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:42.824078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:42.839052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:42.840485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:42.841057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:42.920632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:42.922152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:42.940591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:42.941059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:42.942814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:42.943521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:43.352427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:43.362858 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fa1fdfa-3dff-407e-9a58-03fb02e7e10f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.448187 Apr 30 21:36:43.363711 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2574/5256] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:42 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:36:43.429176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:43.442603 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ecbf82eb-9e01-4fc2-b9d1-60f651801d95 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.635003 Apr 30 21:36:43.449481 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2683/5257] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:42 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:44.382382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:44.385132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:44.403259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:44.406130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:44.409894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:44.411191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:44.468268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:44.469817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:44.483121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:44.484791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:44.487947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:44.489247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:44.746190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:44.758095 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4d95b013-1dcf-4d2e-ab64-e8ef8ed9d36e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.380475 Apr 30 21:36:44.759317 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2575/5258] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:44 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:44.913677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:44.922974 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-87c34625-e2df-4b86-ac03-5583d1742f81 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.459182 Apr 30 21:36:44.930119 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2684/5259] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:44 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:45.776036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:45.776645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:45.784221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:45.784683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:45.786371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:45.786881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:45.947544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:45.951790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:45.962881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:45.963154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:45.963979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:45.965338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:46.102659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:46.121597 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8b7c849b-0129-4c6a-8f9c-768284aee52b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.341261 Apr 30 21:36:46.121597 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2576/5260] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:45 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:46.299531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:46.312370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-decf27c1-6ae3-42f6-8e8a-ec820c961663 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.368600 Apr 30 21:36:46.313049 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2685/5261] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:45 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:36:46.672756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2628da2f-bf48-477c-b2dc-39bc5af482b7 req-8f1ea8ab-223f-4e29-8b98-9ce41f50f456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39780c08-4194-4809-8ad4-49294acfef91", "name": "network-vif-plugged", "status": "completed", "tag": "40b845ce-e8af-4c88-9454-24ca22f85327"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:46.697321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2628da2f-bf48-477c-b2dc-39bc5af482b7 req-8f1ea8ab-223f-4e29-8b98-9ce41f50f456 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:46.697321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2628da2f-bf48-477c-b2dc-39bc5af482b7 req-8f1ea8ab-223f-4e29-8b98-9ce41f50f456 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:46.757539 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2628da2f-bf48-477c-b2dc-39bc5af482b7 req-8f1ea8ab-223f-4e29-8b98-9ce41f50f456 service nova] Creating event network-vif-plugged:40b845ce-e8af-4c88-9454-24ca22f85327 for instance 39780c08-4194-4809-8ad4-49294acfef91 on nch1-master-1 Apr 30 21:36:46.768906 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2628da2f-bf48-477c-b2dc-39bc5af482b7 req-8f1ea8ab-223f-4e29-8b98-9ce41f50f456 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095098 Apr 30 21:36:46.768906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2577/5262] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:47.133629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:47.134300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:47.161106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:47.161570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:47.166786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:47.168022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:47.335711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:47.338054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:47.356597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:47.361848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:47.362700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:47.363155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:47.444242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:47.457828 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ce73e9f-4864-445d-bc32-65bd2388ed59 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.328634 Apr 30 21:36:47.458659 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2686/5263] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:47 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:47.556165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:47.564916 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-01204351-57dd-4ea5-b08f-30c480bb4505 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.236490 Apr 30 21:36:47.565491 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2578/5264] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:47 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:48.475590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:48.476216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:48.503944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:48.507361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:48.507361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:48.507361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:48.585699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:48.586413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:48.597992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:48.614091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:48.614963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:48.615417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:48.808728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:48.825528 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c296bb7-59de-4836-aed9-c34bdb760504 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1328 microversion: 2.1 time: 0.353436 Apr 30 21:36:48.831885 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2687/5265] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:48 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1328 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:48.890903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:48.914141 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0afb5212-cb37-4475-89e0-873b6bc609dd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.332789 Apr 30 21:36:48.917297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2579/5266] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:48 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:49.843491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:49.844270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:49.852076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:49.852596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:49.853443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:49.854128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:49.935744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:49.936997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:49.969527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:49.973487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:49.974609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:49.975076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:50.216557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:50.232468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9c2c5f16-9381-420c-bcc9-ea896b7c068a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1509 microversion: 2.1 time: 0.393471 Apr 30 21:36:50.233051 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2688/5267] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:49 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:50.250163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:50.251614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:50.262980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:50.263652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:50.265209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:50.265865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:50.440719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:50.449592 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-41561ec2-bea5-4642-b909-3f27400483e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.517642 Apr 30 21:36:50.450278 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2580/5268] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:49 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:36:50.616547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:50.645720 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d5965082-f8b8-4c60-8926-47c2275e0074 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1509 microversion: 2.1 time: 0.398408 Apr 30 21:36:50.655584 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2689/5269] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:50 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:50.682508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:50.683024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:50.701313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:50.702327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:50.703542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:50.704402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:50.756946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:36:51.098494 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-119ef855-5d67-4cd7-9a52-79abc43a2c16 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 204 len: 0 microversion: 2.1 time: 0.422305 Apr 30 21:36:51.098494 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2581/5270] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:36:50 2022] DELETE /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:36:51.106444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:51.109142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:51.118134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:51.118962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:51.119919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:51.127297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:51.370753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:51.386429 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-93227cae-db87-49eb-a5ea-3200b314787e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1515 microversion: 2.1 time: 0.284918 Apr 30 21:36:51.388342 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2690/5271] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:51 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:51.476331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:51.480292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:51.496389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:51.496875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:51.497969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:51.498725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:51.765904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:51.793946 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55e7b172-9a34-40a1-8499-2c128526398e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.329137 Apr 30 21:36:51.794577 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2582/5272] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:51 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:52.404813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:52.405822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:52.414243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:52.414990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:52.416153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:52.416595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:52.812937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:52.813616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:52.820437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:52.820888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:52.821672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:52.822139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:53.115081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:53.130493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c79fa0f-cea1-4664-aea9-59d8d8064e4a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1515 microversion: 2.1 time: 0.726926 Apr 30 21:36:53.131828 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2691/5273] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:52 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1515 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:53.202120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:53.210766 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b4edab6b-92ca-45fb-8430-1d3e03a1a0f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.401767 Apr 30 21:36:53.211354 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2583/5274] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:52 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:53.707307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-88f6ca45-52c7-4444-bfd4-af219257e02d req-578962bd-05f2-4d5c-9a48-50dca769637a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39780c08-4194-4809-8ad4-49294acfef91", "name": "network-vif-deleted", "tag": "40b845ce-e8af-4c88-9454-24ca22f85327"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:53.716947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-88f6ca45-52c7-4444-bfd4-af219257e02d req-578962bd-05f2-4d5c-9a48-50dca769637a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:53.717401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-88f6ca45-52c7-4444-bfd4-af219257e02d req-578962bd-05f2-4d5c-9a48-50dca769637a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:53.729595 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-88f6ca45-52c7-4444-bfd4-af219257e02d req-578962bd-05f2-4d5c-9a48-50dca769637a service nova] Creating event network-vif-deleted:40b845ce-e8af-4c88-9454-24ca22f85327 for instance 39780c08-4194-4809-8ad4-49294acfef91 on nch1-master-1 Apr 30 21:36:53.734973 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-88f6ca45-52c7-4444-bfd4-af219257e02d req-578962bd-05f2-4d5c-9a48-50dca769637a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Apr 30 21:36:53.735646 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2692/5275] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:36:54.152427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:54.153258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:54.162120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:54.162594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:54.163381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:54.163829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:54.206295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:54.207520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:54.208316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lazy-loading 'fault' on Instance uuid 39780c08-4194-4809-8ad4-49294acfef91 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:36:54.232453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:54.240268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:54.255018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:54.255769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:54.256576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:54.257205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:54.290488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:54.298635 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c582ed02-b3d5-409d-a7c4-79edc465119a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 200 len: 1318 microversion: 2.1 time: 0.153850 Apr 30 21:36:54.299228 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2584/5276] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:54 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:54.477978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:54.492438 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f023e3dc-cc9f-4bd1-9469-e5143a32dd84 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.267222 Apr 30 21:36:54.493933 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2693/5277] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:54 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:55.340908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:55.344186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:55.363954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:55.367712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:55.373538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:55.374709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:55.413450 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 39780c08-4194-4809-8ad4-49294acfef91 could not be found. Apr 30 21:36:55.416578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 39780c08-4194-4809-8ad4-49294acfef91 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:36:55.419356 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a220d30-968c-4fe7-9778-ff15d91e455c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 404 len: 111 microversion: 2.1 time: 0.087009 Apr 30 21:36:55.421075 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2585/5278] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:55 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:36:55.436293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7854f0f1-4cc9-4bd1-93d7-6240c39f9d3e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '.version_select at 0x7fdc13d7d700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:55.514025 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7854f0f1-4cc9-4bd1-93d7-6240c39f9d3e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-1825068934" status: 202 len: 0 microversion: 2.1 time: 0.087290 Apr 30 21:36:55.514897 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2694/5279] 10.222.0.23 () {58 vars in 1208 bytes} [Sat Apr 30 21:36:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1825068934 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:36:55.515642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:55.516370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:55.524229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:55.525013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:55.526586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:55.527246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:55.750357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:55.764035 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d2d2124-012e-4532-8296-525f16b6e414 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.254427 Apr 30 21:36:55.764803 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2586/5280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:55 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:55.858470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-137753426", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "1f8b2cc3-45fd-4393-b8b3-c09491d04968"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:36:55.963497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:36:56.658446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:36:56.661041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:36:56.663885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:36:56.664579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:36:56.666429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:36:56.685486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:56.685997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:56.686819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:56.688131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:56.716305 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:36:56.730110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:36:56.750321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:36:56.753595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:36:56.784248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:56.785871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:56.797441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:56.800681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:56.805183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:56.807164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:56.904945 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d48656a-7500-4a0e-9745-86f9a434a4aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051983 Apr 30 21:36:56.910468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2695/5281] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:36:56.924464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-997f099d-9e40-494b-98be-5eb5fe6fe9cb tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:56.928725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-997f099d-9e40-494b-98be-5eb5fe6fe9cb tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:57.075131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-997f099d-9e40-494b-98be-5eb5fe6fe9cb tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:57.082534 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-997f099d-9e40-494b-98be-5eb5fe6fe9cb tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1208 microversion: 2.1 time: 0.164176 Apr 30 21:36:57.085904 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2696/5282] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:56 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1208 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:57.192142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:57.206191 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b0b3505c-691a-4f9c-b2d1-3c6a6270f9f1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.427336 Apr 30 21:36:57.207241 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2587/5283] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:56 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:36:58.100337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-00d081f9-4eff-419f-9b30-f27988d90341 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:58.100949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-00d081f9-4eff-419f-9b30-f27988d90341 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:58.192500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-00d081f9-4eff-419f-9b30-f27988d90341 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:58.199866 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-00d081f9-4eff-419f-9b30-f27988d90341 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1208 microversion: 2.1 time: 0.103326 Apr 30 21:36:58.200448 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2697/5284] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:58 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1208 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:58.224491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:58.225121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:58.236704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:58.240251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:58.240251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:58.240251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:58.530456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:58.558670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-27c4b4b8-6578-4343-b80a-f53a029610e5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.337500 Apr 30 21:36:58.570657 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2588/5285] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:58 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:59.217493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:59.218099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:59.228353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:59.229019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:59.230365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:59.231457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:59.334210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:59.346798 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99c53cc9-847c-4e00-8e82-71280733ad7b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1260 microversion: 2.1 time: 0.130903 Apr 30 21:36:59.357791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2698/5286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:59 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1260 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:36:59.579750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:36:59.580454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:36:59.594789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:59.594789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:59.594789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:36:59.594789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:36:59.880378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:36:59.897685 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-308a88f8-f06e-48c6-931b-de18056e20d0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.322460 Apr 30 21:36:59.901637 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2589/5287] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:36:59 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:00.387748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:00.388601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:00.423691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:00.425579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:00.427219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:00.431846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:00.598781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:00.613327 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-74cb3477-2407-480b-890e-bc4352575769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1266 microversion: 2.1 time: 0.241939 Apr 30 21:37:00.616031 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2699/5288] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:00 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:00.918953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:00.919570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:00.927630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:00.930221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:00.934777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:00.935491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:01.341672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:01.358137 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5351ac31-b667-4e54-a957-ab5c8f0c4b5e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.443244 Apr 30 21:37:01.361593 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2590/5289] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:00 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:01.636249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:01.636863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:01.645195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:01.648960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:01.648960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:01.648960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:01.979771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:01.989137 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1d026e2-7aa5-4596-bdc7-6c7997dc9c1f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.356813 Apr 30 21:37:01.989956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2700/5290] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:01 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:02.378866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:02.380305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:02.387580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:02.388109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:02.388920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:02.389341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:02.578207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:02.587376 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e4bd54b-8867-465e-a54d-dfbf13d7ce42 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1722 microversion: 2.1 time: 0.213021 Apr 30 21:37:02.588465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2591/5291] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:02 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:02.649771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-15616ca2-d9c1-4d3a-9935-f797cd0b1e34 req-608ed252-66e0-4b2c-95c7-067ff2f17085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2413c0-c352-4dea-8bb7-f396cbdabacb", "tag": "27b2784b-2015-4af5-a62e-a6476b448db6"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:02.664342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-15616ca2-d9c1-4d3a-9935-f797cd0b1e34 req-608ed252-66e0-4b2c-95c7-067ff2f17085 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:02.664900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-15616ca2-d9c1-4d3a-9935-f797cd0b1e34 req-608ed252-66e0-4b2c-95c7-067ff2f17085 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:02.681540 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-15616ca2-d9c1-4d3a-9935-f797cd0b1e34 req-608ed252-66e0-4b2c-95c7-067ff2f17085 service nova] Creating event network-changed:27b2784b-2015-4af5-a62e-a6476b448db6 for instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb on nch1-master-1 Apr 30 21:37:02.690965 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-15616ca2-d9c1-4d3a-9935-f797cd0b1e34 req-608ed252-66e0-4b2c-95c7-067ff2f17085 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047067 Apr 30 21:37:02.695653 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2701/5292] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:03.006818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:03.007433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:03.016166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:03.016901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:03.018363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:03.018972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:03.234771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:03.242840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ddade16b-ff96-4146-960c-691714d31a62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.239820 Apr 30 21:37:03.243454 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2592/5293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:03 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:03.605699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:03.606748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:03.615242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:03.616131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:03.617149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:03.617649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:04.024553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:04.035824 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55c40f95-e3ab-47b5-91aa-b360f696885b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1699 microversion: 2.1 time: 0.434652 Apr 30 21:37:04.036749 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2702/5294] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:03 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1699 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:04.053261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d353261-7349-4a57-892e-dd318f0faf62 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:04.061354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d353261-7349-4a57-892e-dd318f0faf62 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:04.061354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d353261-7349-4a57-892e-dd318f0faf62 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:04.087013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d353261-7349-4a57-892e-dd318f0faf62 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Going to try to start instance {{(pid=130670) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 30 21:37:04.261600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:04.262416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:04.273804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:04.274711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:04.275867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:04.276402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:04.277132 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d353261-7349-4a57-892e-dd318f0faf62 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action" status: 202 len: 0 microversion: 2.1 time: 0.227432 Apr 30 21:37:04.280805 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2593/5295] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:37:04 2022] POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:37:04.288384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:04.289108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:04.298658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:04.299119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:04.299917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:04.300513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:04.439465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:04.451881 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7a9e0c1-c5a0-411e-8084-7082976d2bad tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.194772 Apr 30 21:37:04.457940 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2703/5296] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:04 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:04.701576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:04.711805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c774b519-59db-40cc-9282-f9f92d2e5205 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1708 microversion: 2.1 time: 0.428644 Apr 30 21:37:04.718464 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2594/5297] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:04 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1708 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:05.468919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:05.470744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:05.479604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:05.480369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:05.481169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:05.481615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:05.687389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:05.700252 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18045e67-a152-42b8-bea0-9a1e4a64fdd1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.233680 Apr 30 21:37:05.700252 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2704/5298] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:05 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:05.731114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:05.733618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:05.743726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:05.744603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:05.746435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:05.747068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:05.970791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:05.980978 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a715d044-413d-4164-861d-7148e845fb08 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1708 microversion: 2.1 time: 0.253774 Apr 30 21:37:05.991348 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2595/5299] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:05 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1708 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:06.717163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:06.718586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:06.726887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:06.727660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:06.728553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:06.742940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:06.913901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:06.922582 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9d1ea8d1-94e1-4fd1-b045-6c8055fcab6e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.210229 Apr 30 21:37:06.924111 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2705/5300] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:06 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:07.000075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:07.001309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:07.009110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:07.009885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:07.010833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:07.011433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:07.174255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:07.185409 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d276a46b-ce73-4079-b6c2-a3c9aad45b76 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1712 microversion: 2.1 time: 0.189564 Apr 30 21:37:07.186190 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2596/5301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:06 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1712 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:07.943861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:07.944473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:07.951528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:07.951984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:07.952766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:07.953192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:08.102414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:08.122871 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff6c8afc-2cac-4a5b-9c2a-92c5eec8fc1c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.182786 Apr 30 21:37:08.130840 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2706/5302] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:07 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:09.147333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:09.148012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:09.155158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:09.155610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:09.156381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:09.156880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:09.316886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:09.324279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-689d89de-b7b8-4e17-808d-5cb9cd7be793 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.181043 Apr 30 21:37:09.324786 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2597/5303] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:09 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:10.350431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:10.350431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:10.351273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e166983c-4ae1-4f70-b272-d3f2e8238fcd req-51efd0b9-5997-4d1c-993e-72be8af523fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2413c0-c352-4dea-8bb7-f396cbdabacb", "name": "network-vif-plugged", "status": "completed", "tag": "27b2784b-2015-4af5-a62e-a6476b448db6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:10.359368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e166983c-4ae1-4f70-b272-d3f2e8238fcd req-51efd0b9-5997-4d1c-993e-72be8af523fd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:10.359906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e166983c-4ae1-4f70-b272-d3f2e8238fcd req-51efd0b9-5997-4d1c-993e-72be8af523fd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:10.362243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:10.362697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:10.363487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:10.364424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:10.371369 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e166983c-4ae1-4f70-b272-d3f2e8238fcd req-51efd0b9-5997-4d1c-993e-72be8af523fd service nova] Creating event network-vif-plugged:27b2784b-2015-4af5-a62e-a6476b448db6 for instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb on nch1-master-1 Apr 30 21:37:10.381107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e166983c-4ae1-4f70-b272-d3f2e8238fcd req-51efd0b9-5997-4d1c-993e-72be8af523fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032019 Apr 30 21:37:10.381107 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2598/5304] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:10.574501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:10.584143 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18b2eca6-7ae6-4c5d-a4e7-46f0ab196e19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.242736 Apr 30 21:37:10.584835 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2707/5305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:10 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:11.603236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:11.603927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:11.610112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:11.610646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:11.614323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:11.614323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:11.806381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:11.815871 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7126e127-7ca4-46d8-9506-d79629a57f46 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1308 microversion: 2.1 time: 0.217119 Apr 30 21:37:11.817299 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2599/5306] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:11 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:12.832478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:12.833732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:12.840581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:12.841038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:12.841862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:12.842315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:12.977291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:12.984168 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55a94313-3313-40fa-bcda-63e0b61b2dae tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1489 microversion: 2.1 time: 0.155323 Apr 30 21:37:12.985141 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2708/5307] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:12 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1489 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:13.097054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-137753426", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "1f8b2cc3-45fd-4393-b8b3-c09491d04968"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:13.155624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:37:13.531762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:37:13.532115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:37:13.533672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:37:13.533672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:37:13.534014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:37:13.543136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:13.543605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:13.544438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:13.544887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:13.562145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:37:13.567439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:37:13.580553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:37:13.582898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:37:13.745072 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-760b2e1c-313a-46f9-9589-df50d91081a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652575 Apr 30 21:37:13.745744 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2600/5308] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:37:13.756137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-91d4d8e0-790c-46ec-adb5-31e39c667c3e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:13.756764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-91d4d8e0-790c-46ec-adb5-31e39c667c3e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:13.830197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-91d4d8e0-790c-46ec-adb5-31e39c667c3e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:13.838010 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-91d4d8e0-790c-46ec-adb5-31e39c667c3e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1208 microversion: 2.1 time: 0.085483 Apr 30 21:37:13.838753 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2709/5309] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:13 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:14.856171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:14.856733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:14.882790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:14.885373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:14.886902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:14.887363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:14.970513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:14.979877 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-186fef15-f4e3-4c92-b9e6-13703c512633 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1212 microversion: 2.1 time: 0.128697 Apr 30 21:37:14.982520 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2601/5310] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:14 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:15.999288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:16.005529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:16.007555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:16.008007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:16.008821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:16.009272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:16.083159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:16.112689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30c7f810-334c-4319-ab30-26befeb05e84 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1268 microversion: 2.1 time: 0.117254 Apr 30 21:37:16.113745 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2710/5311] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:15 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:17.135116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:17.136516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:17.145547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:17.146040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:17.147940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:17.148591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:17.322601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:17.330278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-be58cc72-e6a5-4fd6-a80e-400dbd5b307a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.202733 Apr 30 21:37:17.331306 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2602/5312] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:17 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:17.698513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-448310c6-493d-410e-8b9e-f6e187ea9e26 req-e2419f27-44f8-42d4-882f-71d2d1064b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5264be76-41fe-45e0-ad36-d1d18049033c", "tag": "3a3870b7-e97b-4782-aebc-56d44aaee790"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:17.712548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-448310c6-493d-410e-8b9e-f6e187ea9e26 req-e2419f27-44f8-42d4-882f-71d2d1064b93 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:17.717118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-448310c6-493d-410e-8b9e-f6e187ea9e26 req-e2419f27-44f8-42d4-882f-71d2d1064b93 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:17.739223 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-448310c6-493d-410e-8b9e-f6e187ea9e26 req-e2419f27-44f8-42d4-882f-71d2d1064b93 service nova] Creating event network-changed:3a3870b7-e97b-4782-aebc-56d44aaee790 for instance 5264be76-41fe-45e0-ad36-d1d18049033c on nch2-master-1 Apr 30 21:37:17.746055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-448310c6-493d-410e-8b9e-f6e187ea9e26 req-e2419f27-44f8-42d4-882f-71d2d1064b93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051838 Apr 30 21:37:17.746164 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2711/5313] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:37:18.358438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:18.359635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:18.371461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:18.372403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:18.373235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:18.373887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:18.547527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:18.557048 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d4cde5c-5c9b-4c3a-9760-282ea296b17c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.205125 Apr 30 21:37:18.557647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2603/5314] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:18 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:19.582817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:19.583937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:19.593718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:19.604019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:19.604019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:19.604019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:19.728747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:19.736192 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-240e6056-0acf-4bb2-8fb8-7e2b81961a48 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.165523 Apr 30 21:37:19.736765 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2712/5315] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:19 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:20.754978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:20.755659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:20.763770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:20.764229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:20.765018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:20.765461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:20.935491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:20.943223 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1cfbc05b-cead-47a1-bad7-f608d635c90c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.193392 Apr 30 21:37:20.943809 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2604/5316] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:20 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:21.959498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:21.960228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:21.967825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:21.968287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:21.969071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:21.970061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:22.097476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:22.105082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a649ca79-af09-4088-935b-5a7402ab06b0 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.149515 Apr 30 21:37:22.105857 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2713/5317] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:21 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:23.122644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:23.123272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:23.133161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:23.133161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:23.133161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:23.133561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:23.265967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:23.274328 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-30c9df09-a994-4eda-ae12-f7e4684ba2c9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.155252 Apr 30 21:37:23.283355 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2605/5318] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:23 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:24.090869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-397aa611-0df7-491c-a523-c32126cc63c1 req-caeabbe9-e886-49bd-9a92-76cf21307cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5264be76-41fe-45e0-ad36-d1d18049033c", "name": "network-vif-plugged", "status": "completed", "tag": "3a3870b7-e97b-4782-aebc-56d44aaee790"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:24.100775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-397aa611-0df7-491c-a523-c32126cc63c1 req-caeabbe9-e886-49bd-9a92-76cf21307cdd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:24.101232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-397aa611-0df7-491c-a523-c32126cc63c1 req-caeabbe9-e886-49bd-9a92-76cf21307cdd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:24.112057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-397aa611-0df7-491c-a523-c32126cc63c1 req-caeabbe9-e886-49bd-9a92-76cf21307cdd service nova] Creating event network-vif-plugged:3a3870b7-e97b-4782-aebc-56d44aaee790 for instance 5264be76-41fe-45e0-ad36-d1d18049033c on nch2-master-1 Apr 30 21:37:24.116831 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-397aa611-0df7-491c-a523-c32126cc63c1 req-caeabbe9-e886-49bd-9a92-76cf21307cdd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030708 Apr 30 21:37:24.117450 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2714/5319] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:24.294158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:24.294790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:24.302855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:24.303315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:24.304106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:24.304582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:24.444916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:24.452663 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e4ed6bd0-4110-4c0f-a48c-45a7eb2aa725 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.162488 Apr 30 21:37:24.453250 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2606/5320] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:24 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:25.472164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:25.472881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:25.479259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:25.479721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:25.480512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:25.480961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:25.622137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:25.630348 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55419bbe-52c8-4faa-817d-fdc181b4a180 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1308 microversion: 2.1 time: 0.163991 Apr 30 21:37:25.630927 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2715/5321] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:25 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:26.647192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:26.647849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:26.654853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:26.655320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:26.656100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:26.656548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:26.783180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:26.790669 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82af0701-c8f7-4b1a-b7a0-c60beb1da256 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1489 microversion: 2.1 time: 0.147439 Apr 30 21:37:26.791239 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2607/5322] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:26 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1489 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:26.806433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:26.807190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:26.820050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:26.820050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:26.820050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:26.820050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:26.949818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:26.958224 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6d98b98b-a8c0-4e00-a8e6-a468f4dbaee6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1489 microversion: 2.1 time: 0.155694 Apr 30 21:37:26.958792 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2716/5323] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:26 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1489 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:26.975748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:26.976408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:26.985113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:26.985647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:26.986459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:26.986903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:27.122838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:27.131005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd90cd53-39df-49d3-b594-63070ecebc74 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1489 microversion: 2.1 time: 0.159142 Apr 30 21:37:27.131575 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2608/5324] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:26 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1489 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:27.147765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:27.148301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:27.154966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:27.155424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:27.156263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:27.156778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:27.186460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:37:27.480046 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2031df9-d1aa-4b11-bf2a-cafd578814f1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 204 len: 0 microversion: 2.1 time: 0.335910 Apr 30 21:37:27.480934 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2717/5325] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:37:27 2022] DELETE /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:37:27.489489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:27.491658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:27.496909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:27.497412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:27.498401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:27.498895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:27.634854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:27.650941 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fd6ac8a-42c8-464b-a75a-9cb9af99c246 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1495 microversion: 2.1 time: 0.165436 Apr 30 21:37:27.652202 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2609/5326] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:27 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1495 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:28.674632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:28.675448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:28.682644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:28.683157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:28.684012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:28.684547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:28.913816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:28.921933 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0df91692-67a4-474f-9de0-090b4bcac537 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1495 microversion: 2.1 time: 0.252021 Apr 30 21:37:28.922531 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2718/5327] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:28 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1495 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:29.437585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-048f6745-acef-4758-a744-12fba47c7ecd req-9bf91add-770c-498f-8b2c-4c946249c3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5264be76-41fe-45e0-ad36-d1d18049033c", "name": "network-vif-deleted", "tag": "3a3870b7-e97b-4782-aebc-56d44aaee790"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:29.450735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-048f6745-acef-4758-a744-12fba47c7ecd req-9bf91add-770c-498f-8b2c-4c946249c3aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:29.451215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-048f6745-acef-4758-a744-12fba47c7ecd req-9bf91add-770c-498f-8b2c-4c946249c3aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:29.464302 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-048f6745-acef-4758-a744-12fba47c7ecd req-9bf91add-770c-498f-8b2c-4c946249c3aa service nova] Creating event network-vif-deleted:3a3870b7-e97b-4782-aebc-56d44aaee790 for instance 5264be76-41fe-45e0-ad36-d1d18049033c on nch2-master-1 Apr 30 21:37:29.469737 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-048f6745-acef-4758-a744-12fba47c7ecd req-9bf91add-770c-498f-8b2c-4c946249c3aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035999 Apr 30 21:37:29.474795 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2610/5328] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:29.938552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:29.939204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:29.947173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:29.947640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:29.948437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:29.948890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:29.984829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:29.985296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:29.985884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lazy-loading 'fault' on Instance uuid 5264be76-41fe-45e0-ad36-d1d18049033c {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:37:30.027749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:30.036551 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bff57499-4ab4-49c7-97d1-d8c7f18176d7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 200 len: 1298 microversion: 2.1 time: 0.101942 Apr 30 21:37:30.037224 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2719/5329] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:29 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:31.057112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:31.057968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:31.067218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:31.067682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:31.068561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:31.068915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:31.083113 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 5264be76-41fe-45e0-ad36-d1d18049033c could not be found. Apr 30 21:37:31.083721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 5264be76-41fe-45e0-ad36-d1d18049033c could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:37:31.084563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-22551cd0-ab19-4b6a-98be-a4d87a4028e6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 404 len: 111 microversion: 2.1 time: 0.032919 Apr 30 21:37:31.085400 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2611/5330] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:31 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:37:31.094082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:31.096018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:31.102235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:31.102687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:31.103592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:31.104070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:31.131791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:37:31.417251 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f5bbdb5-6b65-4043-a9e3-7248247aae62 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 204 len: 0 microversion: 2.1 time: 0.327153 Apr 30 21:37:31.417887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2720/5331] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:37:31 2022] DELETE /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:37:31.426209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:31.426827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:31.432806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:31.433270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:31.434068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:31.434515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:31.570942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:31.578468 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dac76276-c138-4846-b0d5-f4b3459e0a36 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1495 microversion: 2.1 time: 0.156282 Apr 30 21:37:31.579027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2612/5332] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:31 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:32.596472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:32.597259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:32.604487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:32.608612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:32.608612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:32.608612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:32.743563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:32.751274 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-721199b6-67d9-4515-a999-dd79af116b2d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1495 microversion: 2.1 time: 0.159746 Apr 30 21:37:32.751858 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2721/5333] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:32 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1495 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:33.549260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-98cb5179-94dd-46fc-acd7-3105926fb34c req-844ef9d2-053e-4794-86b2-b665a01668e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2413c0-c352-4dea-8bb7-f396cbdabacb", "name": "network-vif-deleted", "tag": "27b2784b-2015-4af5-a62e-a6476b448db6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:33.560047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-98cb5179-94dd-46fc-acd7-3105926fb34c req-844ef9d2-053e-4794-86b2-b665a01668e0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:33.560842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-98cb5179-94dd-46fc-acd7-3105926fb34c req-844ef9d2-053e-4794-86b2-b665a01668e0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:33.573728 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-98cb5179-94dd-46fc-acd7-3105926fb34c req-844ef9d2-053e-4794-86b2-b665a01668e0 service nova] Creating event network-vif-deleted:27b2784b-2015-4af5-a62e-a6476b448db6 for instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb on nch1-master-1 Apr 30 21:37:33.579408 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-98cb5179-94dd-46fc-acd7-3105926fb34c req-844ef9d2-053e-4794-86b2-b665a01668e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034458 Apr 30 21:37:33.580966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2613/5334] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:33.768676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:33.769262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:33.776913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:33.777369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:33.778268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:33.778738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:33.845807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:33.854965 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3803e3a9-b24c-4efd-a878-52d18877d797 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 200 len: 1293 microversion: 2.1 time: 0.090468 Apr 30 21:37:33.868851 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2722/5335] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:33 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:34.874035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:34.874659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:34.881432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:34.881946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:34.882722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:34.883168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:34.896909 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb could not be found. Apr 30 21:37:34.905042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:37:34.905042 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-73e0fe82-a2f5-44a6-a5f8-d8c66f1934d4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 404 len: 111 microversion: 2.1 time: 0.029562 Apr 30 21:37:34.905042 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2614/5336] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:34 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:37:35.008899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-987677081", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "1f8b2cc3-45fd-4393-b8b3-c09491d04968"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:35.066734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:37:35.778504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:37:35.779037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:37:35.779654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:37:35.780185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:37:35.780725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:37:35.790567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:35.791136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:35.792398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:35.793030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:35.810323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:37:35.815683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:37:35.828045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:37:35.830873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:37:35.932838 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-46720528-bc3c-4810-a47f-2ca1e50716f3 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927774 Apr 30 21:37:35.933735 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2723/5337] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:37:35.943808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f3c0c769-5c69-4762-bd7d-0f43294c619d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:35.944511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f3c0c769-5c69-4762-bd7d-0f43294c619d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:36.009256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3c0c769-5c69-4762-bd7d-0f43294c619d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:36.029486 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f3c0c769-5c69-4762-bd7d-0f43294c619d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1208 microversion: 2.1 time: 0.080187 Apr 30 21:37:36.029486 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2615/5338] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:35 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:37.039371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:37.039994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:37.046510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:37.047039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:37.047913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:37.048552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:37.113118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:37.120552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-738eed3e-c427-4c7f-a5e5-8ddaeaa72f82 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1212 microversion: 2.1 time: 0.087996 Apr 30 21:37:37.121126 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2724/5339] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:37 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:38.136694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:38.137267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:38.144982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:38.145553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:38.146479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:38.146937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:38.245064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:38.253853 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e1c8572-6083-4772-bfcf-bf8dafa567a1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1278 microversion: 2.1 time: 0.120952 Apr 30 21:37:38.255026 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2616/5340] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:38 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:39.274583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:39.274583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:39.281986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:39.282528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:39.283525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:39.288303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:39.518679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:39.525188 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b10505de-4458-493d-82ff-15ecb04eb26a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1308 microversion: 2.1 time: 0.255903 Apr 30 21:37:39.525719 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2725/5341] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:39 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:39.735978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-410c60e2-9da5-4afa-85dd-27d05d1b60b9 req-41cfcbf9-1db6-4d83-a5f5-c0a41f1deeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83ad08ef-8014-40ae-a620-c599ddd9258b", "tag": "a5f01d34-df0b-48ac-b00a-1a0e117792d1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:39.746701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-410c60e2-9da5-4afa-85dd-27d05d1b60b9 req-41cfcbf9-1db6-4d83-a5f5-c0a41f1deeb4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:39.747368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-410c60e2-9da5-4afa-85dd-27d05d1b60b9 req-41cfcbf9-1db6-4d83-a5f5-c0a41f1deeb4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:39.759888 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-410c60e2-9da5-4afa-85dd-27d05d1b60b9 req-41cfcbf9-1db6-4d83-a5f5-c0a41f1deeb4 service nova] Creating event network-changed:a5f01d34-df0b-48ac-b00a-1a0e117792d1 for instance 83ad08ef-8014-40ae-a620-c599ddd9258b on nch2-master-1 Apr 30 21:37:39.764600 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-410c60e2-9da5-4afa-85dd-27d05d1b60b9 req-41cfcbf9-1db6-4d83-a5f5-c0a41f1deeb4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Apr 30 21:37:39.765210 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2617/5342] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:40.054583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:40.055597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:40.064204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:40.065060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:40.066548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:40.067451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:40.193085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lazy-loading 'services' on Instance uuid 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:37:40.466520 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-volume_attachments/1f48d4d5-94cc-4387-97f6-69de0a01a3d8" status: 202 len: 0 microversion: 2.1 time: 0.414925 Apr 30 21:37:40.466520 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2726/5343] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:37:40 2022] DELETE /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-volume_attachments/1f48d4d5-94cc-4387-97f6-69de0a01a3d8 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:37:40.544668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:40.545132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:40.551890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:40.552425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:40.553275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:40.553808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:40.742249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:40.753596 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a38235f9-2376-4a62-ab6f-8d780e18ee3a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1308 microversion: 2.1 time: 0.213886 Apr 30 21:37:40.754361 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2618/5344] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:40 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:41.586425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a63dce56-69bd-4a56-9735-7b2b373c5ec5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:41.593777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a63dce56-69bd-4a56-9735-7b2b373c5ec5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:41.594328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a63dce56-69bd-4a56-9735-7b2b373c5ec5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:41.620637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a63dce56-69bd-4a56-9735-7b2b373c5ec5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Going to try to stop instance {{(pid=130671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:37:41.776075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a63dce56-69bd-4a56-9735-7b2b373c5ec5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action" status: 202 len: 0 microversion: 2.1 time: 0.194515 Apr 30 21:37:41.776592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:41.777524 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2727/5345] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:37:41 2022] POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:37:41.780170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:41.789848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:41.790524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:41.791531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:41.792157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:41.803993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:41.804740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:41.823179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:41.825661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:41.826693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:41.828128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:42.061326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:42.069692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:42.071736 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb05ac60-1817-4635-96e1-3af739e8a4f8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1308 microversion: 2.1 time: 0.304506 Apr 30 21:37:42.083168 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2619/5346] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:41 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:42.086016 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8de0ff67-673f-49d4-8064-5622ad737490 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1676 microversion: 2.1 time: 0.304604 Apr 30 21:37:42.086793 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2728/5347] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:41 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1676 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:43.091095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:43.091718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:43.098116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:43.098576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:43.099350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:43.099795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:43.105836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:43.106542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:43.114328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:43.116169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:43.116169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:43.116169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:43.313425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:43.323825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:43.326508 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9299c18d-4c5c-4dc2-ab2c-e1cb0c2c613b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1308 microversion: 2.1 time: 0.239342 Apr 30 21:37:43.334293 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-64729d53-ee9b-4d58-8958-05772fd89ad4 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1676 microversion: 2.1 time: 0.232460 Apr 30 21:37:43.334877 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2729/5348] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:43 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:43.340029 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2620/5349] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:43 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:44.344968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:44.344968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:44.351075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:44.351537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:44.352329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:44.352776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:44.355943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:44.356679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:44.364423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:44.364943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:44.366780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:44.367286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:44.571414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:44.574783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:44.580974 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ab142d5-a2af-4bc8-890f-50695ce70a40 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1308 microversion: 2.1 time: 0.241268 Apr 30 21:37:44.583321 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2730/5350] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:44 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:44.587001 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e35ba268-d00c-43f5-8440-2b83e4e1e676 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1676 microversion: 2.1 time: 0.235134 Apr 30 21:37:44.596692 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2621/5351] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:44 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:45.597276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:45.597971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:45.603923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:45.611595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:45.611720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:45.611720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:45.611720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:45.611720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:45.612082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:45.612525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:45.613316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:45.613777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:45.807791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:45.816569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:45.819669 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0d02101d-8a11-42d0-9153-c6b9ef2f0597 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1308 microversion: 2.1 time: 0.226135 Apr 30 21:37:45.820717 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2731/5352] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:45 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:45.829596 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93525ede-b802-4129-92c4-891b89ed9abc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1676 microversion: 2.1 time: 0.229313 Apr 30 21:37:45.830675 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2622/5353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:45 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:46.352748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-502ebe2d-7aad-4031-b53a-4ccce32b72d0 req-075e5ce2-3531-4b67-86fe-d06a927793d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ad08ef-8014-40ae-a620-c599ddd9258b", "name": "network-vif-plugged", "status": "completed", "tag": "a5f01d34-df0b-48ac-b00a-1a0e117792d1"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:46.361524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-502ebe2d-7aad-4031-b53a-4ccce32b72d0 req-075e5ce2-3531-4b67-86fe-d06a927793d5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:46.362149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-502ebe2d-7aad-4031-b53a-4ccce32b72d0 req-075e5ce2-3531-4b67-86fe-d06a927793d5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:46.373227 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-502ebe2d-7aad-4031-b53a-4ccce32b72d0 req-075e5ce2-3531-4b67-86fe-d06a927793d5 service nova] Creating event network-vif-plugged:a5f01d34-df0b-48ac-b00a-1a0e117792d1 for instance 83ad08ef-8014-40ae-a620-c599ddd9258b on nch2-master-1 Apr 30 21:37:46.378715 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-502ebe2d-7aad-4031-b53a-4ccce32b72d0 req-075e5ce2-3531-4b67-86fe-d06a927793d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030012 Apr 30 21:37:46.379380 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2732/5354] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:46.842174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:46.842800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:46.848429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:46.849140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:46.850271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:46.850748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:46.851524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:46.851970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:46.855424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:46.861445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:46.861445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:46.861445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:47.047469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:47.056190 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-96d76afa-04c0-4237-b6f9-51688a9c1baf tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1308 microversion: 2.1 time: 0.218039 Apr 30 21:37:47.057156 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2623/5355] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:46 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:47.060775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:47.069930 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b137ed94-a9ff-4b9c-afb1-5835a0bd559b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1676 microversion: 2.1 time: 0.226623 Apr 30 21:37:47.072921 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2733/5356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:46 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:48.075245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:48.075874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:48.084021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.084607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.085413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.085890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.092652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:48.092652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:48.102619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.103538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.104986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.106004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.368548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:48.375662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:48.379205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d7d39962-4dc9-44eb-838c-2d0575a52b7e tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1653 microversion: 2.1 time: 0.294933 Apr 30 21:37:48.383873 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2734/5357] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:48 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1653 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:48.388308 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8cc8ae87-4fac-4e9d-a8e0-b72c9289088c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1490 microversion: 2.1 time: 0.318458 Apr 30 21:37:48.400009 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2624/5358] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:48 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1490 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:48.405048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3ee69b3-d3bd-484f-9be1-fff4ad883ac3 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:48.411906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3ee69b3-d3bd-484f-9be1-fff4ad883ac3 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.412587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-175b41e0-8c84-40d7-8c5a-3787e0c658ff tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:48.412724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3ee69b3-d3bd-484f-9be1-fff4ad883ac3 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.413680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-175b41e0-8c84-40d7-8c5a-3787e0c658ff tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:48.421906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-175b41e0-8c84-40d7-8c5a-3787e0c658ff tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.422452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-175b41e0-8c84-40d7-8c5a-3787e0c658ff tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.423169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-175b41e0-8c84-40d7-8c5a-3787e0c658ff tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.423737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-175b41e0-8c84-40d7-8c5a-3787e0c658ff tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.440773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3ee69b3-d3bd-484f-9be1-fff4ad883ac3 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Going to try to start instance {{(pid=130671) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 30 21:37:48.575765 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-175b41e0-8c84-40d7-8c5a-3787e0c658ff tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "PUT /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1085 microversion: 2.1 time: 0.170949 Apr 30 21:37:48.577625 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2625/5359] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:37:48 2022] PUT /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1085 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:48.590302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:48.591159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:48.597902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.598370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.599167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.599617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.660100 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3ee69b3-d3bd-484f-9be1-fff4ad883ac3 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action" status: 202 len: 0 microversion: 2.1 time: 0.263182 Apr 30 21:37:48.660718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2735/5360] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:37:48 2022] POST /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:37:48.669335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:48.670432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:48.681095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.681095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.682901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.683465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.920251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:48.931378 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b2c8174-4b47-4b07-989e-86209aff0b7d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1511 microversion: 2.1 time: 0.344709 Apr 30 21:37:48.932601 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2626/5361] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:48 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:48.949594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:48.950451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:48.957479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.958182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.961673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:48.961673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:48.963029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:48.971643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6e175098-9e9d-4ce9-a8d7-3918d2819855 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1662 microversion: 2.1 time: 0.306496 Apr 30 21:37:48.972222 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2736/5362] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:48 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1662 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:49.235564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:49.253334 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e8d2fe5-e800-4d21-87f5-a2699bed488e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1511 microversion: 2.1 time: 0.299933 Apr 30 21:37:49.253334 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2627/5363] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:48 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:49.267790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:49.268385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:49.280910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:49.281613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:49.283007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:49.284287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:49.317113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:37:49.686724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fd3f52cd-e2de-4d24-b69f-fa4ee313e25f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 204 len: 0 microversion: 2.1 time: 0.421329 Apr 30 21:37:49.686724 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2737/5364] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:37:49 2022] DELETE /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:37:49.694301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:49.694928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:49.701093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:49.701557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:49.702384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:49.702863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:49.863098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:49.872476 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f563dcf-66d5-46cd-a045-9aa0d120aa6a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1517 microversion: 2.1 time: 0.182005 Apr 30 21:37:49.874722 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2628/5365] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:49 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:49.998972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:49.998972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:50.003045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:50.003825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:50.004889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:50.005557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:50.225044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:50.234374 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8a5d1b4-a4b4-42d2-a277-c28d49387730 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1662 microversion: 2.1 time: 0.249650 Apr 30 21:37:50.235310 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2738/5366] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:49 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1662 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:50.890845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:50.892211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:50.915911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:50.916387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:50.917201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:50.917652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:51.254901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:51.255420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:51.267803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:51.276173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:51.276173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:51.276173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:51.288341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:51.296455 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9d36efe4-659f-4361-9e22-8b827bfc7aac tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1517 microversion: 2.1 time: 0.409737 Apr 30 21:37:51.299717 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2629/5367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:50 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1517 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:51.607096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:51.615175 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9203cb95-d820-4d7c-9c65-87e219f8c6f5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1666 microversion: 2.1 time: 0.366801 Apr 30 21:37:51.616971 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2739/5368] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:51 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1666 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:37:51.937088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-60c477b3-0889-4c21-bc17-19e19b3bf955 req-9c1c481e-145e-4e51-a593-d0042a1456d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ad08ef-8014-40ae-a620-c599ddd9258b", "name": "network-vif-deleted", "tag": "a5f01d34-df0b-48ac-b00a-1a0e117792d1"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:51.949334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60c477b3-0889-4c21-bc17-19e19b3bf955 req-9c1c481e-145e-4e51-a593-d0042a1456d2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:51.950379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60c477b3-0889-4c21-bc17-19e19b3bf955 req-9c1c481e-145e-4e51-a593-d0042a1456d2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:51.966017 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-60c477b3-0889-4c21-bc17-19e19b3bf955 req-9c1c481e-145e-4e51-a593-d0042a1456d2 service nova] Creating event network-vif-deleted:a5f01d34-df0b-48ac-b00a-1a0e117792d1 for instance 83ad08ef-8014-40ae-a620-c599ddd9258b on nch2-master-1 Apr 30 21:37:51.973732 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-60c477b3-0889-4c21-bc17-19e19b3bf955 req-9c1c481e-145e-4e51-a593-d0042a1456d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042235 Apr 30 21:37:51.981519 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2630/5369] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:37:52.315774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:52.317496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:52.323455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:52.324741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:52.325071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:52.325701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:52.361224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:52.361224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:52.361617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lazy-loading 'fault' on Instance uuid 83ad08ef-8014-40ae-a620-c599ddd9258b {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:37:52.445140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:52.452420 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f5450079-824e-4eae-ab62-77c4b7e93a58 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 200 len: 1319 microversion: 2.1 time: 0.141403 Apr 30 21:37:52.453016 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2740/5370] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:52 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:53.470326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:53.471914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:53.489984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:53.490459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:53.491272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:53.506699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:53.543669 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 83ad08ef-8014-40ae-a620-c599ddd9258b could not be found. Apr 30 21:37:53.545555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 83ad08ef-8014-40ae-a620-c599ddd9258b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:37:53.547019 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3419bd62-be97-44c8-bf17-ea1b77eb8382 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 404 len: 111 microversion: 2.1 time: 0.081226 Apr 30 21:37:53.549665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2631/5371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:53 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:37:53.715592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-454184783", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "1f8b2cc3-45fd-4393-b8b3-c09491d04968"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:53.779913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] validate_networks() for [('1f8b2cc3-45fd-4393-b8b3-c09491d04968', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:37:54.439125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:37:54.440467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:37:54.441488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:37:54.442100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:37:54.442683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:37:54.455542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:54.456113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:54.457168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:54.457898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:54.489446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:37:54.502072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Getting quotas for user 3107c6d79451405a963c5816d92055b3 and project e02e106ab99f4decadf747b3ebf025c7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:37:54.542666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:37:54.545187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:37:54.686694 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e45e2e57-000f-40a2-8b5f-6700a55ba49a tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976644 Apr 30 21:37:54.690306 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2741/5372] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:37:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:37:54.699268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe095d46-9d69-47a9-bc3b-23de85f8acce tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:54.699911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fe095d46-9d69-47a9-bc3b-23de85f8acce tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:54.834046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fe095d46-9d69-47a9-bc3b-23de85f8acce tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:54.845876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fe095d46-9d69-47a9-bc3b-23de85f8acce tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1208 microversion: 2.1 time: 0.152122 Apr 30 21:37:54.847776 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2632/5373] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:54 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:55.864554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:55.867406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:55.878059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:55.879038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:55.880261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:55.890376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:55.975830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:55.990292 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84e49641-40da-4faa-b066-ae1dd4b80ed6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1212 microversion: 2.1 time: 0.125155 Apr 30 21:37:55.991695 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2742/5374] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:55 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:57.013451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:57.014107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:57.022289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:57.023003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:57.031033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:57.031033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:57.137967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:57.147402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bca26ce8-2af5-4c41-8fd5-1ba70fe3a651 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1268 microversion: 2.1 time: 0.137777 Apr 30 21:37:57.148502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2633/5375] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:57 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1268 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:58.172205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:58.172860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:58.181833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:58.187398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:58.192144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:58.193035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:58.686155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:37:58.706361 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9192cfc3-ea38-49d4-adb9-0ea9df4993fc tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1308 microversion: 2.1 time: 0.537629 Apr 30 21:37:58.720539 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2743/5376] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:58 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:37:59.725004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:37:59.725696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:37:59.744431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:59.744942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:59.755935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:59.756768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:59.768764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-26c3af39-ad5c-400a-a275-da10e76fa66f req-c2b03bb4-7a99-4224-8f3c-b5fbd9008460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86105f2-66a2-415d-a4d9-c596ddf49f14", "tag": "58482845-e5d1-43e4-a931-3b0f5a1c46a8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:37:59.788619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-26c3af39-ad5c-400a-a275-da10e76fa66f req-c2b03bb4-7a99-4224-8f3c-b5fbd9008460 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:37:59.789363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-26c3af39-ad5c-400a-a275-da10e76fa66f req-c2b03bb4-7a99-4224-8f3c-b5fbd9008460 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:37:59.829448 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-26c3af39-ad5c-400a-a275-da10e76fa66f req-c2b03bb4-7a99-4224-8f3c-b5fbd9008460 service nova] Creating event network-changed:58482845-e5d1-43e4-a931-3b0f5a1c46a8 for instance d86105f2-66a2-415d-a4d9-c596ddf49f14 on nch2-master-1 Apr 30 21:37:59.842579 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-26c3af39-ad5c-400a-a275-da10e76fa66f req-c2b03bb4-7a99-4224-8f3c-b5fbd9008460 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091106 Apr 30 21:37:59.843501 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2744/5377] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 30 21:38:00.102805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:00.123792 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c68f6558-96ab-41d9-bbb9-5c070d70dfb8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1308 microversion: 2.1 time: 0.400706 Apr 30 21:38:00.123792 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2634/5378] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:37:59 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1308 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:01.140789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:01.142079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:01.148843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:01.151049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:01.151049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:01.151049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:01.352024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:01.382071 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5d1a13fc-2f46-4539-851c-e9754275f064 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1308 microversion: 2.1 time: 0.236274 Apr 30 21:38:01.382071 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2745/5379] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:01 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:02.392980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:02.394763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:02.412179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:02.412855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:02.414024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:02.415557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:02.636989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:02.646380 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d09e92fb-57de-4754-ba23-30daa4303ed8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1308 microversion: 2.1 time: 0.261724 Apr 30 21:38:02.648788 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2635/5380] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:02 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:03.671356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:03.671975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:03.680503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:03.682541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:03.682541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:03.684358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:03.874488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:03.884925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30c4281c-9158-4744-985b-d934aca32348 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1308 microversion: 2.1 time: 0.216259 Apr 30 21:38:03.884925 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2746/5381] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:03 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:04.869693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8ebfd7ba-c5c9-4b64-b606-538f510133b9 req-f756d016-b0be-4b9e-84b8-6ea8c9829f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86105f2-66a2-415d-a4d9-c596ddf49f14", "name": "network-vif-plugged", "status": "completed", "tag": "58482845-e5d1-43e4-a931-3b0f5a1c46a8"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:04.908715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8ebfd7ba-c5c9-4b64-b606-538f510133b9 req-f756d016-b0be-4b9e-84b8-6ea8c9829f6d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:04.909157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8ebfd7ba-c5c9-4b64-b606-538f510133b9 req-f756d016-b0be-4b9e-84b8-6ea8c9829f6d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:04.937442 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8ebfd7ba-c5c9-4b64-b606-538f510133b9 req-f756d016-b0be-4b9e-84b8-6ea8c9829f6d service nova] Creating event network-vif-plugged:58482845-e5d1-43e4-a931-3b0f5a1c46a8 for instance d86105f2-66a2-415d-a4d9-c596ddf49f14 on nch2-master-1 Apr 30 21:38:04.944025 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8ebfd7ba-c5c9-4b64-b606-538f510133b9 req-f756d016-b0be-4b9e-84b8-6ea8c9829f6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077961 Apr 30 21:38:04.945020 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2747/5382] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:38:04.957780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:04.958879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:04.968954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:04.973297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:04.974424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:04.978540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:04.981211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9aed4a4a-52aa-4c91-9853-7b155142561e tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Action: 'create', calling method: .version_select at 0x7fdc13e5d0d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-615660911"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:05.013025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9aed4a4a-52aa-4c91-9853-7b155142561e tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for project ede1fc028b654b819f147b9e5dde458e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:05.024439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9aed4a4a-52aa-4c91-9853-7b155142561e tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for user ae2e100e385e40fb9139cc6316c92159 and project ede1fc028b654b819f147b9e5dde458e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:05.218002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:05.227243 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ced66c1f-f147-4ba2-bf63-e06df63c5576 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1308 microversion: 2.1 time: 0.280567 Apr 30 21:38:05.228064 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2748/5383] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:04 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:05.295475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9aed4a4a-52aa-4c91-9853-7b155142561e tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for project ede1fc028b654b819f147b9e5dde458e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:05.301121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9aed4a4a-52aa-4c91-9853-7b155142561e tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for user ae2e100e385e40fb9139cc6316c92159 and project ede1fc028b654b819f147b9e5dde458e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:05.316973 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9aed4a4a-52aa-4c91-9853-7b155142561e tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.560754 Apr 30 21:38:05.317589 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2636/5384] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:38:04 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:06.246435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:06.247104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:06.265263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:06.266071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:06.267650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:06.268324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:06.459652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:06.478076 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f7f85af-dde2-4c87-81fe-d99facd2dbc5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1308 microversion: 2.1 time: 0.228779 Apr 30 21:38:06.479115 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2749/5385] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:06 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:07.497207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:07.498926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:07.519351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:07.520118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:07.521303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:07.523511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:07.696790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:07.705441 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4eef7378-5b0e-4ded-9595-a059de1e3942 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1489 microversion: 2.1 time: 0.213637 Apr 30 21:38:07.721947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2637/5386] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:07 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1489 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:07.725116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-10237bd7-3a46-47ba-a020-9dbde7e51d0c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1369166704"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:07.726930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-10237bd7-3a46-47ba-a020-9dbde7e51d0c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:07.734404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10237bd7-3a46-47ba-a020-9dbde7e51d0c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:07.760166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10237bd7-3a46-47ba-a020-9dbde7e51d0c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:07.760166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10237bd7-3a46-47ba-a020-9dbde7e51d0c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:07.760166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-10237bd7-3a46-47ba-a020-9dbde7e51d0c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:07.872850 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-10237bd7-3a46-47ba-a020-9dbde7e51d0c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "PUT /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1075 microversion: 2.1 time: 0.153175 Apr 30 21:38:07.873575 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2750/5387] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:38:07 2022] PUT /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1075 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:07.888101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:07.888846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:07.895237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:07.895703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:07.896590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:07.897043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.072804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:08.075036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2029883883", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-615660911", "security_groups": [{"name": "tempest-secgroup-smoke-1834317848"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "1a35949a-03eb-4847-aba7-c5eaeefc6d24"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:08.095690 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2450bf4d-bffe-4ed3-84a9-61ca859ae8df tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1501 microversion: 2.1 time: 0.211558 Apr 30 21:38:08.096887 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2638/5388] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:07 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:08.121335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:08.123757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:08.136460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:08.145929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.146817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:08.147275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.250401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] validate_networks() for [('1a35949a-03eb-4847-aba7-c5eaeefc6d24', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:38:08.454677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:08.464869 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94c2df78-4078-444c-a590-a0c17a6b6efe tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1501 microversion: 2.1 time: 0.351645 Apr 30 21:38:08.471146 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2639/5389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:08 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1501 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:08.483585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-38c4359d-279f-4dd0-bb5d-64212550974f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:08.491121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38c4359d-279f-4dd0-bb5d-64212550974f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:08.493595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38c4359d-279f-4dd0-bb5d-64212550974f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.520871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-38c4359d-279f-4dd0-bb5d-64212550974f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Going to try to stop instance {{(pid=130670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 21:38:08.773412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for project ede1fc028b654b819f147b9e5dde458e. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:08.779108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for user ae2e100e385e40fb9139cc6316c92159 and project ede1fc028b654b819f147b9e5dde458e. Resources: dict_keys(['metadata_items']) {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:08.791398 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-38c4359d-279f-4dd0-bb5d-64212550974f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "POST /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14/action" status: 202 len: 0 microversion: 2.1 time: 0.311292 Apr 30 21:38:08.791899 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2640/5390] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:38:08 2022] POST /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:38:08.795789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:38:08.795789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:38:08.795789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:38:08.795789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:38:08.795789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:38:08.803677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:08.804403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:08.805640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:08.806203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.807100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:08.807848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.827381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:08.830720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.832833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:08.833458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:08.834336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for project ede1fc028b654b819f147b9e5dde458e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:08.850456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Getting quotas for user ae2e100e385e40fb9139cc6316c92159 and project ede1fc028b654b819f147b9e5dde458e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:08.868853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:38:08.872123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:38:08.979663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:08.988247 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d4f15a87-85f8-41af-b4f6-3e5804025684 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.189378 Apr 30 21:38:08.988841 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2641/5391] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:08 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:09.144058 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e01e3a02-fcd1-40f5-954a-a247e802aed0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.074986 Apr 30 21:38:09.145176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2751/5392] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:38:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:38:09.154938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10fa1391-543d-4888-8c2c-bab8159e96f8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:09.155642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-10fa1391-543d-4888-8c2c-bab8159e96f8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:09.226623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10fa1391-543d-4888-8c2c-bab8159e96f8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:09.233808 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10fa1391-543d-4888-8c2c-bab8159e96f8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1302 microversion: 2.1 time: 0.082670 Apr 30 21:38:09.234296 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2642/5393] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:09 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:10.007298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:10.007951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:10.015094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:10.015551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:10.016944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:10.017389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:10.154048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:10.161211 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7722d6a5-9cbf-4bc0-bb61-57a7ddb34832 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.158778 Apr 30 21:38:10.167241 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2752/5394] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:10 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:10.255877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:10.257356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:10.266972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:10.267450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:10.277445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:10.279915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:10.380714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:10.388626 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2153f43-368c-4dd8-b114-124caa6694cb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1306 microversion: 2.1 time: 0.139999 Apr 30 21:38:10.389285 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2643/5395] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:10 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1306 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:11.183404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:11.183404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:11.186947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:11.187412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:11.188871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:11.189357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:11.334801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:11.342911 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5031a22c-ca58-46ae-ad20-3b297ae833c7 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.167934 Apr 30 21:38:11.345833 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2753/5396] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:11 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:11.406424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:11.407607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:11.414519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:11.414987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:11.415789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:11.416236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:11.526646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:11.535230 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a1fe028-0ae4-44d3-8840-44bd386add5c tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1362 microversion: 2.1 time: 0.133322 Apr 30 21:38:11.550094 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2644/5397] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:11 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:12.364811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:12.365441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:12.372693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:12.373134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:12.374191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:12.374660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:12.568201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:12.568966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:12.577266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:12.580921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:12.580921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:12.580921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:12.631053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:12.642284 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fd8db4ff-f6fe-4645-8a1e-4da082a8ae19 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.281445 Apr 30 21:38:12.643700 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2754/5398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:12 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:12.700684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:12.712318 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2be4959d-fd4b-4c7e-a200-7c0b70aa10b0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1360 microversion: 2.1 time: 0.149647 Apr 30 21:38:12.714214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2645/5399] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:12 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:13.664726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:13.665873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:13.676682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:13.677302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:13.678382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:13.679291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:13.738276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:13.739246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:13.771014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:13.771501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:13.776920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:13.777383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:14.121651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:14.131335 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b703ede-b205-4f6a-a01f-78f227fd8e99 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.473520 Apr 30 21:38:14.138087 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2755/5400] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:13 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:14.200252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:14.208464 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-230c97f4-6e34-4eb3-8561-2a40a5074144 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1428 microversion: 2.1 time: 0.476164 Apr 30 21:38:14.214836 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2646/5401] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:13 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1428 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:14.387923 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a6d94520-d337-4a41-9e7f-443907f1cb3f req-54434855-3b67-4df1-ab60-29f36c0a348e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6e31e3-d94b-4292-9669-c2ed8f9c6180", "tag": "d24f8b2f-d431-4caa-98b1-e20fd7c178a2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:14.408646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a6d94520-d337-4a41-9e7f-443907f1cb3f req-54434855-3b67-4df1-ab60-29f36c0a348e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:14.409110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a6d94520-d337-4a41-9e7f-443907f1cb3f req-54434855-3b67-4df1-ab60-29f36c0a348e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:14.423137 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a6d94520-d337-4a41-9e7f-443907f1cb3f req-54434855-3b67-4df1-ab60-29f36c0a348e service nova] Creating event network-changed:d24f8b2f-d431-4caa-98b1-e20fd7c178a2 for instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 on nch1-master-1 Apr 30 21:38:14.429240 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a6d94520-d337-4a41-9e7f-443907f1cb3f req-54434855-3b67-4df1-ab60-29f36c0a348e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047268 Apr 30 21:38:14.430321 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2756/5402] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:15.154685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:15.155281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:15.164507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:15.166048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:15.167175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:15.167852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:15.227849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:15.228579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:15.236166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:15.237905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:15.248797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:15.249323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:15.395976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:15.408158 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df6a8a55-fb89-48ff-81e3-2ae3980d4d11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.254292 Apr 30 21:38:15.408158 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2647/5403] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:15 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:15.444979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:15.452918 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4a26025b-357d-45e1-9cd6-6a2b958320e9 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1428 microversion: 2.1 time: 0.231133 Apr 30 21:38:15.457918 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2757/5404] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:15 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1428 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:16.421211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:16.421855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:16.428817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:16.429332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:16.430140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:16.430630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:16.470239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:16.470885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:16.477942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:16.478490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:16.483482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:16.483482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:16.620371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:16.628784 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-358ba02e-c1a3-4a82-9655-22ba1b6a6769 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.211376 Apr 30 21:38:16.629683 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2648/5405] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:16 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:16.654112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:16.661498 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5988fdb5-7694-409f-aebc-090b32469eab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1428 microversion: 2.1 time: 0.195814 Apr 30 21:38:16.662092 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2758/5406] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:16 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1428 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:17.646339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:17.646902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:17.654007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:17.654470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:17.655252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:17.655702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:17.678921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:17.679565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:17.687109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:17.687790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:17.688577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:17.689196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:17.844715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:17.854248 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c1cb15f8-9f69-4b5e-96cd-9331ed59e492 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.211778 Apr 30 21:38:17.870825 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2649/5407] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:17 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:17.878903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:17.887477 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6da2b587-2720-44d2-934e-9e108db1cf02 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1428 microversion: 2.1 time: 0.212558 Apr 30 21:38:17.888061 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2759/5408] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:17 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1428 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:18.872562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:18.873332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:18.880192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:18.880734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:18.881515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:18.881983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:18.905127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:18.905744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:18.913218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:18.913667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:18.914478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:18.915112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:19.120668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:19.138090 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2b30a86b-96d0-4ec9-80e3-0b67f8414058 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.260029 Apr 30 21:38:19.138090 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2650/5409] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:18 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:19.138429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:19.138429 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d120c4a7-3a2e-4221-92df-42cb31c3ff0b tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1428 microversion: 2.1 time: 0.236046 Apr 30 21:38:19.138429 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2760/5410] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:18 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1428 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:20.147398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:20.148178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:20.160237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:20.160733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:20.160863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:20.160961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:20.160961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:20.160961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:20.165510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:20.166519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:20.167848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:20.168645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:20.391227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:20.392482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:20.401277 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1e034b51-98b3-452e-bddc-37434075c490 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1428 microversion: 2.1 time: 0.250037 Apr 30 21:38:20.401947 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec5dfea8-dc28-411f-8e9b-72cb4f38d562 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.259369 Apr 30 21:38:20.402392 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2761/5411] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:20 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1428 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:20.402939 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2651/5412] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:20 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:20.596951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-00ef2549-3f23-4098-a982-d253176ddc07 req-f704250e-24ef-4aa8-91ae-f9adfad43181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6e31e3-d94b-4292-9669-c2ed8f9c6180", "name": "network-vif-plugged", "status": "completed", "tag": "d24f8b2f-d431-4caa-98b1-e20fd7c178a2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:20.608232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-00ef2549-3f23-4098-a982-d253176ddc07 req-f704250e-24ef-4aa8-91ae-f9adfad43181 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:20.608693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-00ef2549-3f23-4098-a982-d253176ddc07 req-f704250e-24ef-4aa8-91ae-f9adfad43181 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:20.627198 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-00ef2549-3f23-4098-a982-d253176ddc07 req-f704250e-24ef-4aa8-91ae-f9adfad43181 service nova] Creating event network-vif-plugged:d24f8b2f-d431-4caa-98b1-e20fd7c178a2 for instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 on nch1-master-1 Apr 30 21:38:20.633684 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-00ef2549-3f23-4098-a982-d253176ddc07 req-f704250e-24ef-4aa8-91ae-f9adfad43181 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040686 Apr 30 21:38:20.639523 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2762/5413] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:21.216964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9670145f-4b48-4fc3-a692-0b33cef38f6c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Action: 'create', calling method: .version_select at 0x7fdc13ffec10>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1558320002"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:21.231371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9670145f-4b48-4fc3-a692-0b33cef38f6c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for project 4e3f82b1b832495896f59d90477f6e44. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:21.237772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9670145f-4b48-4fc3-a692-0b33cef38f6c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for user 63517d4efe294384832f5674aadc0c63 and project 4e3f82b1b832495896f59d90477f6e44. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:21.420430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:21.421231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:21.428549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:21.429081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:21.430166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:21.430614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:21.559075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9670145f-4b48-4fc3-a692-0b33cef38f6c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for project 4e3f82b1b832495896f59d90477f6e44. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:21.564244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-9670145f-4b48-4fc3-a692-0b33cef38f6c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for user 63517d4efe294384832f5674aadc0c63 and project 4e3f82b1b832495896f59d90477f6e44. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:21.570481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:21.579343 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a90d9cf-d65a-4883-be7a-05ce5e634cab tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1428 microversion: 2.1 time: 0.164085 Apr 30 21:38:21.579495 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9670145f-4b48-4fc3-a692-0b33cef38f6c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.548061 Apr 30 21:38:21.579868 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2763/5414] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:21 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1428 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:21.589751 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2652/5415] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:38:21 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:21.589751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:21.589751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:21.591355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:21.591823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:21.592676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:21.593043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:21.754815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:21.762993 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fb77170-574d-415f-b840-176eb74afeba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.182098 Apr 30 21:38:21.763691 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2653/5416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:21 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:22.596868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:22.597495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:22.604541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:22.605003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:22.605856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:22.606300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:22.781222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:22.781979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:22.789079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:22.789927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:22.790714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:22.791401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:22.813421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:22.823016 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4946acdc-7580-4d72-94f5-4573d46e80a2 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1608 microversion: 2.1 time: 0.230667 Apr 30 21:38:22.835373 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2764/5417] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:22 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1608 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:22.841517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:22.843679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:22.848633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:22.849150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:22.850029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:22.850482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:23.142692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:23.148681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:23.152642 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-34f1bcc8-599f-4c66-81fb-eb53db46764b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.375705 Apr 30 21:38:23.153418 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2654/5418] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:22 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:23.162782 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-85e3daad-1a52-4f00-bdc7-250c823972cc tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1608 microversion: 2.1 time: 0.318784 Apr 30 21:38:23.162782 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2765/5419] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:22 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1608 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:23.176005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:23.176618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:23.183212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:23.183692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:23.184508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:23.184951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:23.394213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:23.403088 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2dbe4f56-b373-43a9-83ae-62cd9f376633 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1608 microversion: 2.1 time: 0.229877 Apr 30 21:38:23.403088 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2766/5420] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:23 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1608 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:24.141467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c5efca8-27c6-440c-ac5d-59bb40b156af tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:24.142572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6c5efca8-27c6-440c-ac5d-59bb40b156af tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:24.163519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c5efca8-27c6-440c-ac5d-59bb40b156af tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.165963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c5efca8-27c6-440c-ac5d-59bb40b156af tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.167841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c5efca8-27c6-440c-ac5d-59bb40b156af tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.168721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c5efca8-27c6-440c-ac5d-59bb40b156af tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.172027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:24.172784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:24.183417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.188818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.190081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.190740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.219623 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c5efca8-27c6-440c-ac5d-59bb40b156af tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082467 Apr 30 21:38:24.225390 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2655/5421] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:38:24 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:38:24.312032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:24.312768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:24.319820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.320554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.321737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.322486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.351718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:38:24.646121 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2c2c55da-c789-433d-be41-a93c05d5a7aa tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 204 len: 0 microversion: 2.1 time: 0.338959 Apr 30 21:38:24.650307 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2656/5422] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:24 2022] DELETE /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:38:24.658736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:24.661435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:24.668252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.668972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.671933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:24.672645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:24.686491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:24.697276 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31bce693-3cc8-478d-bdb2-bb64537101e1 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.528817 Apr 30 21:38:24.708613 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2767/5423] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:24 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:24.941957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:24.952477 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a1252ac2-e7ed-4834-8b10-b8fc9bbc8d43 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1672 microversion: 2.1 time: 0.298467 Apr 30 21:38:24.955034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2657/5424] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:24 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1672 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:25.717285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:25.717916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:25.741175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:25.741632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:25.742791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:25.743459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:25.972600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:25.973218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:25.987662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:25.988196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:25.989029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:25.989476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:26.190429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:26.211794 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6914a65c-2cfa-438d-b119-269d689adc11 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.498966 Apr 30 21:38:26.228528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2768/5425] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:25 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:26.246929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:26.255357 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-197dc1e4-5f77-4e91-9650-059e4b66d8bd tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1672 microversion: 2.1 time: 0.288148 Apr 30 21:38:26.256311 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2658/5426] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:25 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1672 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:27.036018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b9e23fec-faf8-4811-93d5-dd3b5dd1fc30 req-ca4e42ac-d094-4e5b-9ab7-02f4d57a7fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6e31e3-d94b-4292-9669-c2ed8f9c6180", "tag": "d24f8b2f-d431-4caa-98b1-e20fd7c178a2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:27.046075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b9e23fec-faf8-4811-93d5-dd3b5dd1fc30 req-ca4e42ac-d094-4e5b-9ab7-02f4d57a7fd3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:27.046865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b9e23fec-faf8-4811-93d5-dd3b5dd1fc30 req-ca4e42ac-d094-4e5b-9ab7-02f4d57a7fd3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:27.072713 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b9e23fec-faf8-4811-93d5-dd3b5dd1fc30 req-ca4e42ac-d094-4e5b-9ab7-02f4d57a7fd3 service nova] Creating event network-changed:d24f8b2f-d431-4caa-98b1-e20fd7c178a2 for instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 on nch1-master-1 Apr 30 21:38:27.080703 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b9e23fec-faf8-4811-93d5-dd3b5dd1fc30 req-ca4e42ac-d094-4e5b-9ab7-02f4d57a7fd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255928 Apr 30 21:38:27.081592 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2769/5427] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:38:27.253633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:27.254841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:27.295920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:27.296279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:27.296757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:27.297647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:27.297800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:27.300340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:27.307064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:27.307723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:27.308877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:27.311097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:27.868338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:27.882644 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08ac77cb-7935-4185-8d6f-c7cbb2595608 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1672 microversion: 2.1 time: 0.606159 Apr 30 21:38:27.884350 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2770/5428] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:27 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1672 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:27.925749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:27.941119 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4b37dae2-e867-4af3-ac3f-c3d6ba092486 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.693270 Apr 30 21:38:27.948052 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2659/5429] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:27 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:28.912744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:28.914019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:28.948685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:28.950391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:28.952462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:28.956106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:28.966023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:28.966653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:28.990038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:28.992252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:28.999821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:29.002735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:29.244929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:29.260500 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-370c2cda-cbfa-436e-b532-d1fcc8415345 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 200 len: 1604 microversion: 2.1 time: 0.353129 Apr 30 21:38:29.261652 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2771/5430] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:28 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 1604 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:29.278472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4b521ae5-07e3-4423-a38a-185a6efd65a2 req-00d66f0f-dadd-48e7-a684-9f914e39fbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcbb4e2-1923-405f-a669-b3d5d68bfda6", "name": "network-vif-deleted", "tag": "fd24ae95-dc99-4dc2-a542-b9359163c4e9"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:29.302708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4b521ae5-07e3-4423-a38a-185a6efd65a2 req-00d66f0f-dadd-48e7-a684-9f914e39fbac service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:29.307155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4b521ae5-07e3-4423-a38a-185a6efd65a2 req-00d66f0f-dadd-48e7-a684-9f914e39fbac service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:29.333320 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4b521ae5-07e3-4423-a38a-185a6efd65a2 req-00d66f0f-dadd-48e7-a684-9f914e39fbac service nova] Creating event network-vif-deleted:fd24ae95-dc99-4dc2-a542-b9359163c4e9 for instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 on nch1-master-1 Apr 30 21:38:29.359183 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4b521ae5-07e3-4423-a38a-185a6efd65a2 req-00d66f0f-dadd-48e7-a684-9f914e39fbac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095507 Apr 30 21:38:29.360041 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2772/5431] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:29.467173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:29.488944 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9dfb3daa-2b34-456c-bab1-b1b9d300e66f tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.527065 Apr 30 21:38:29.504014 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2660/5432] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:28 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:30.313728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:30.318659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:30.330978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:30.331767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:30.332868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:30.333400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:30.350528 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] HTTP exception thrown: Instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 could not be found. Apr 30 21:38:30.351218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Returning 404 to user: Instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:30.352142 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3bde79cb-9d1d-42b3-a850-7a624f773404 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 404 len: 111 microversion: 2.1 time: 0.077296 Apr 30 21:38:30.352944 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2773/5433] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:30 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:30.362939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-afe5e87c-24eb-4d24-b93d-db28a052c9cf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '.version_select at 0x7fdc13fb3f70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:30.485175 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-afe5e87c-24eb-4d24-b93d-db28a052c9cf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005453377" status: 202 len: 0 microversion: 2.1 time: 0.127292 Apr 30 21:38:30.486255 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2661/5434] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005453377 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:38:30.507688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:30.508337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:30.520659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:30.521119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:30.527634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:30.527634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:30.749734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:30.759952 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-815d4edb-9094-4441-9141-fb42b63b5e95 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.256418 Apr 30 21:38:30.760724 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2774/5435] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:30 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:31.598605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1273059939", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:31.703908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] validate_networks() for None {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:38:31.778365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:31.778986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:31.797464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:31.798756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:31.804875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:31.805638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:32.382233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:32.391363 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-98025e95-b0e6-4300-bd9c-80d895680ec6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.618079 Apr 30 21:38:32.404237 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2775/5436] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:31 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:32.411455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3a03a6d8-b277-4d28-b2c5-5babc96b1fc8 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'create', calling method: .version_select at 0x7fdc20d52280>, body: {"keypair": {"name": "tempest-keypair-1008603690"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:32.432199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3a03a6d8-b277-4d28-b2c5-5babc96b1fc8 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:32.440841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3a03a6d8-b277-4d28-b2c5-5babc96b1fc8 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for user e9fa67fb4ad4472183b95067597f043e and project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:32.464538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:38:32.465072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:38:32.465594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:38:32.468309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:38:32.468780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:38:32.482004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:32.482600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:32.483695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:32.484288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:32.512105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Getting quotas for project f19b8cfdb2ea490ebcb51f4f67262300. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:32.519409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Getting quotas for user d6185d1aa50a4dcd919fb3410d4f30df and project f19b8cfdb2ea490ebcb51f4f67262300. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:32.537306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:38:32.540269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:38:32.668755 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-51bf99c0-e54b-4fd1-9df4-5a881ab9c84a tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079560 Apr 30 21:38:32.669891 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2662/5437] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:38:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:38:32.681101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c0e806b5-0665-47ed-9540-b4c6e44f4d4c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:32.690731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c0e806b5-0665-47ed-9540-b4c6e44f4d4c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:32.751823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c0e806b5-0665-47ed-9540-b4c6e44f4d4c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:32.759716 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c0e806b5-0665-47ed-9540-b4c6e44f4d4c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1215 microversion: 2.1 time: 0.083791 Apr 30 21:38:32.760635 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2663/5438] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:32 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:32.786187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3a03a6d8-b277-4d28-b2c5-5babc96b1fc8 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:32.792895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3a03a6d8-b277-4d28-b2c5-5babc96b1fc8 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for user e9fa67fb4ad4472183b95067597f043e and project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:32.825545 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3a03a6d8-b277-4d28-b2c5-5babc96b1fc8 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.415140 Apr 30 21:38:32.828047 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2776/5439] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:38:32 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:33.293458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1014845365-access_point-1698248930", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "ab03ba7a-b1de-487f-8bf8-6720348bf85d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1558320002", "security_groups": [{"name": "tempest-secgroup_access--736353933"}, {"name": "tempest-secgroup_general--1568082316"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:33.411144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:33.412099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:33.420221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:33.420928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:33.421980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:33.422630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:33.500638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] validate_networks() for [('ab03ba7a-b1de-487f-8bf8-6720348bf85d', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:38:33.712169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:33.717118 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9cd83f20-3fb4-4307-8767-ee1156e16a41 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1511 microversion: 2.1 time: 0.310739 Apr 30 21:38:33.718426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2777/5440] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:33 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:33.776893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18adcde1-6d4d-4a3a-b844-ae5ff13eefc9 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:33.777784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18adcde1-6d4d-4a3a-b844-ae5ff13eefc9 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:33.897962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18adcde1-6d4d-4a3a-b844-ae5ff13eefc9 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:33.914204 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18adcde1-6d4d-4a3a-b844-ae5ff13eefc9 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1215 microversion: 2.1 time: 0.139829 Apr 30 21:38:33.925799 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2778/5441] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:33 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:34.071177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:38:34.072192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:38:34.072953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:38:34.073724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:38:34.074373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:38:34.083444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.084044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:34.084971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.085522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:34.104860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for project 4e3f82b1b832495896f59d90477f6e44. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:34.116322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for user 63517d4efe294384832f5674aadc0c63 and project 4e3f82b1b832495896f59d90477f6e44. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:34.132786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:38:34.134938 ncdv-master-1 devstack@n-api.service[130670]: WARNING nova.utils [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1014845365-access_point-1698248930 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1014845365-ac Apr 30 21:38:34.135684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:38:34.280095 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3710a8a3-78d4-4343-8769-5a9b99a2376c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.990792 Apr 30 21:38:34.280762 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2664/5442] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:38:33 2022] POST /compute/v2.1/servers => generated 457 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:38:34.301347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1cc97feb-42e3-4544-aeb5-4589b8fca320 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:34.307411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1cc97feb-42e3-4544-aeb5-4589b8fca320 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:34.382204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1cc97feb-42e3-4544-aeb5-4589b8fca320 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:34.390824 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1cc97feb-42e3-4544-aeb5-4589b8fca320 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1295 microversion: 2.1 time: 0.099889 Apr 30 21:38:34.393727 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2779/5443] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:34 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:34.735197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:34.735823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:34.743101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.743566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:34.744479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.744940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:34.915977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:34.928541 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ea4feb4-85fc-411d-8e24-e9fb9c32b735 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1488 microversion: 2.1 time: 0.198153 Apr 30 21:38:34.929706 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2665/5444] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:34 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1488 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:34.932337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:34.933369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:34.941905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.942684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:34.950276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.950276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:34.951279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b25f619-ec8d-4662-b8bf-fe7ebe091516 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1346573256"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:34.958427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b25f619-ec8d-4662-b8bf-fe7ebe091516 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:34.960322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b25f619-ec8d-4662-b8bf-fe7ebe091516 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.960954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b25f619-ec8d-4662-b8bf-fe7ebe091516 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:34.961901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b25f619-ec8d-4662-b8bf-fe7ebe091516 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:34.962447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b25f619-ec8d-4662-b8bf-fe7ebe091516 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:35.040499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:35.049248 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-50514b1e-2086-436e-902d-51c5e96cb1c8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1267 microversion: 2.1 time: 0.120505 Apr 30 21:38:35.050321 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2780/5445] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:34 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:35.124225 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b25f619-ec8d-4662-b8bf-fe7ebe091516 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "PUT /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1061 microversion: 2.1 time: 0.181910 Apr 30 21:38:35.125220 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2666/5446] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:38:34 2022] PUT /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1061 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:35.139595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:35.140684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:35.148190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:35.148779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:35.149696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:35.150309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:35.416520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb80e12b-42d9-4797-a13b-8842f17ff300 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:35.424870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb80e12b-42d9-4797-a13b-8842f17ff300 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:35.482258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:35.501586 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41bb409a-4679-415f-832f-aad3bef51cf2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1488 microversion: 2.1 time: 0.365817 Apr 30 21:38:35.502812 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2781/5447] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:35 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1488 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:35.523856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:35.524683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:35.527698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fb80e12b-42d9-4797-a13b-8842f17ff300 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:35.550054 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb80e12b-42d9-4797-a13b-8842f17ff300 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1295 microversion: 2.1 time: 0.135047 Apr 30 21:38:35.551088 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2667/5448] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:35 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1295 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:35.555746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:35.558955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:35.565156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:35.569210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:35.670435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2036636627", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f67bfdda-ee73-4dcc-b5af-432ce9957ea8"}], "security_groups": [{"name": "tempest-securitygroup--497158621"}], "key_name": "tempest-keypair-1008603690", "user_data": "}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:35.787749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:35.799280 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-962e8b0b-17d7-4435-8b77-5567bdbdfda5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1488 microversion: 2.1 time: 0.280157 Apr 30 21:38:35.799887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2782/5449] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:35 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1488 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:35.823216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:35.824329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:35.832541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:35.833008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] validate_networks() for [('f67bfdda-ee73-4dcc-b5af-432ce9957ea8', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:38:35.833995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:35.835184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:35.835847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:35.866317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:38:36.181802 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3ec55eb-7936-46cb-a970-dc7861a592aa tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 204 len: 0 microversion: 2.1 time: 0.369071 Apr 30 21:38:36.182547 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2783/5450] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:35 2022] DELETE /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:38:36.195944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:36.197270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:36.206084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.207018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.208066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.208810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.342782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:36.351057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4504c765-9014-4d00-a688-3254fd012e25 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1273 microversion: 2.1 time: 0.167245 Apr 30 21:38:36.352006 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2784/5451] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:36 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:36.357276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:36.358334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:36.365919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.366729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.367883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.368503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.486574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:38:36.487096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:38:36.488132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:38:36.488564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:38:36.488997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:38:36.499112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.499654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.500396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.502357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.522635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:36.529069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Getting quotas for user e9fa67fb4ad4472183b95067597f043e and project b74e36d3bb384eeb92da16d1b201fc9a. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:36.542822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:38:36.545243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:38:36.615213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:36.622814 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59013cdb-9627-4933-8de1-14afc9a9a5b5 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1494 microversion: 2.1 time: 0.269479 Apr 30 21:38:36.623476 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2785/5452] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:36 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1494 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:36.637130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:36.637737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:36.643801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.644258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.645033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:36.645471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:36.674246 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-522415d4-d546-46e4-b039-418d1656afb9 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.008376 Apr 30 21:38:36.682181 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2668/5453] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:38:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:38:36.693997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f06e10f7-7739-4f42-8862-620649bc8f0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:36.694626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f06e10f7-7739-4f42-8862-620649bc8f0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:36.728510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:36.737163 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bddac782-c552-4c88-9c81-9c14342a9e86 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1347 microversion: 2.1 time: 0.103601 Apr 30 21:38:36.737863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2786/5454] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:36 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1347 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:36.769792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f06e10f7-7739-4f42-8862-620649bc8f0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:36.777273 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f06e10f7-7739-4f42-8862-620649bc8f0a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1238 microversion: 2.1 time: 0.088879 Apr 30 21:38:36.778097 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2669/5455] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:36 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:37.369026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:37.369648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:37.377049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:37.378975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:37.379801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:37.380259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:37.640102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:37.640904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:37.648627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:37.649092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:37.649913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:37.650381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:37.698643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:37.706876 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d18b06bd-cf9b-420c-989a-8d3eab684934 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1315 microversion: 2.1 time: 0.342134 Apr 30 21:38:37.707468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2787/5456] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:37 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:37.755815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:37.756961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:37.763367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:37.764044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:37.764984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:37.767926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:38.202307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:38.210791 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-abdd90de-07bf-46c0-bc84-dc3b10e72e8e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1355 microversion: 2.1 time: 0.459830 Apr 30 21:38:38.211491 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2788/5457] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:37 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1355 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:38.217841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:38.218655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:38.226163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:38.226650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:38.227685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:38.228145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:38.367588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:38.377498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:38.377943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-300b4cb6-4499-4d5d-9436-7dadb96b951b tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1290 microversion: 2.1 time: 0.164630 Apr 30 21:38:38.379101 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2789/5458] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:38 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1290 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:38.392641 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8b734066-1715-493d-b629-dd4b28dcea04 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1494 microversion: 2.1 time: 0.756392 Apr 30 21:38:38.393310 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2670/5459] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:37 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1494 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:38.725200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:38.725855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:38.732173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:38.732638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:38.733987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:38.734473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.056131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3f931116-ac3d-430b-b553-db74d7642e2e req-f3d9b701-7062-4266-80cc-81f4c9a002ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86105f2-66a2-415d-a4d9-c596ddf49f14", "name": "network-vif-deleted", "tag": "58482845-e5d1-43e4-a931-3b0f5a1c46a8"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:39.066749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3f931116-ac3d-430b-b553-db74d7642e2e req-f3d9b701-7062-4266-80cc-81f4c9a002ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:39.067126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3f931116-ac3d-430b-b553-db74d7642e2e req-f3d9b701-7062-4266-80cc-81f4c9a002ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.079954 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3f931116-ac3d-430b-b553-db74d7642e2e req-f3d9b701-7062-4266-80cc-81f4c9a002ed service nova] Creating event network-vif-deleted:58482845-e5d1-43e4-a931-3b0f5a1c46a8 for instance d86105f2-66a2-415d-a4d9-c596ddf49f14 on nch2-master-1 Apr 30 21:38:39.085942 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3f931116-ac3d-430b-b553-db74d7642e2e req-f3d9b701-7062-4266-80cc-81f4c9a002ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033226 Apr 30 21:38:39.086840 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2671/5460] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:39.215063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:39.222643 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-66e242ce-e06f-4520-b866-126931f14464 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1315 microversion: 2.1 time: 0.502059 Apr 30 21:38:39.223521 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2790/5461] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:38 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:39.230309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:39.231344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:39.238343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:39.240270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.240270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:39.240270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.324044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:39.333475 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d15e2053-b8e3-4e04-b763-1151548aad37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1353 microversion: 2.1 time: 0.108266 Apr 30 21:38:39.334187 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2672/5462] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:39 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:39.406282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:39.407195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:39.414984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:39.415781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:39.426569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:39.429609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:39.430191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.431085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:39.431663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.432183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.433040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:39.436456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:39.535856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:39.543632 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b8658fd5-ebfc-4379-8444-3485abe658d5 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1296 microversion: 2.1 time: 0.150829 Apr 30 21:38:39.555456 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2791/5463] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:39 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:39.632952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:39.642279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5feba45-00cc-44a3-8606-bf537b6799a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 200 len: 1292 microversion: 2.1 time: 0.231022 Apr 30 21:38:39.642941 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2673/5464] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:39 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 1292 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:40.240062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:40.240931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:40.251368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.254786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.255904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.256359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.350634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:40.351272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:40.358432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.359043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.360606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.360832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.671692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:40.680259 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80abe6a1-a11f-4282-aa37-7d848d1ce02f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1315 microversion: 2.1 time: 0.444067 Apr 30 21:38:40.680888 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2792/5465] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:40 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:40.685704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:40.686346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:40.692641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.694450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.694450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.694666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.838100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:40.846554 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46a378b8-e9a1-4135-bbc4-e9b5d2460cd5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1472 microversion: 2.1 time: 0.499852 Apr 30 21:38:40.847227 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2674/5466] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:40 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:40.853611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:40.854450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:40.863345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.863857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.864640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.865114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.883000 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance d86105f2-66a2-415d-a4d9-c596ddf49f14 could not be found. Apr 30 21:38:40.883000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance d86105f2-66a2-415d-a4d9-c596ddf49f14 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:40.883000 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7a2cb0ef-2cc4-448f-a3db-fb18efaacd1b tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 404 len: 111 microversion: 2.1 time: 0.033752 Apr 30 21:38:40.883805 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2675/5467] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:40 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:40.899074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:40.899584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:40.906312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.907469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.908431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.908904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.924393 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance d86105f2-66a2-415d-a4d9-c596ddf49f14 could not be found. Apr 30 21:38:40.924948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance d86105f2-66a2-415d-a4d9-c596ddf49f14 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:40.925827 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4f94a81b-a31f-433d-8e66-c7028142e242 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 404 len: 111 microversion: 2.1 time: 0.032411 Apr 30 21:38:40.926389 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2676/5468] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:40 2022] DELETE /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:40.934827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:40.940155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: d86105f2-66a2-415d-a4d9-c596ddf49f14] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:40.942815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.943275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.944115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.944562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.963668 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance d86105f2-66a2-415d-a4d9-c596ddf49f14 could not be found. Apr 30 21:38:40.964706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance d86105f2-66a2-415d-a4d9-c596ddf49f14 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:40.966184 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14672f25-9181-4772-b8fd-c64b5020b75c tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14" status: 404 len: 111 microversion: 2.1 time: 0.035058 Apr 30 21:38:40.972838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2677/5469] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:40 2022] GET /compute/v2.1/servers/d86105f2-66a2-415d-a4d9-c596ddf49f14 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:40.978617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:40.979449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:40.986611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.990468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:40.990468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:40.990468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.004649 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 83ad08ef-8014-40ae-a620-c599ddd9258b could not be found. Apr 30 21:38:41.005370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 83ad08ef-8014-40ae-a620-c599ddd9258b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.006465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-19d89459-24ff-48bb-868a-7e826c21be1e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 404 len: 111 microversion: 2.1 time: 0.032336 Apr 30 21:38:41.007162 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2678/5470] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:40 2022] DELETE /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:41.015389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.016957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 83ad08ef-8014-40ae-a620-c599ddd9258b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.024461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.025076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.026043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.026570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.044877 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 83ad08ef-8014-40ae-a620-c599ddd9258b could not be found. Apr 30 21:38:41.045489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 83ad08ef-8014-40ae-a620-c599ddd9258b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.046426 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a1afe7b1-2e13-4c49-8100-33aec6d2ef8e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b" status: 404 len: 111 microversion: 2.1 time: 0.035094 Apr 30 21:38:41.047008 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2679/5471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/83ad08ef-8014-40ae-a620-c599ddd9258b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:41.055488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.056152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.063471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.066150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.066150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.066150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.082148 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 5264be76-41fe-45e0-ad36-d1d18049033c could not be found. Apr 30 21:38:41.082919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 5264be76-41fe-45e0-ad36-d1d18049033c could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.083890 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-795f281b-d441-43cc-9b9f-0e0fe43fb20e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 404 len: 111 microversion: 2.1 time: 0.032501 Apr 30 21:38:41.084916 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2680/5472] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:41 2022] DELETE /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:41.092654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.095025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 5264be76-41fe-45e0-ad36-d1d18049033c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.101069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.101676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.102829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.103303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.119195 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 5264be76-41fe-45e0-ad36-d1d18049033c could not be found. Apr 30 21:38:41.119802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 5264be76-41fe-45e0-ad36-d1d18049033c could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.120661 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ed4afac9-060e-4ddd-8507-4160a0390d44 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c" status: 404 len: 111 microversion: 2.1 time: 0.032012 Apr 30 21:38:41.121244 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2681/5473] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/5264be76-41fe-45e0-ad36-d1d18049033c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:41.130110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.130624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.137284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.137787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.138608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.139083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.155172 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb could not be found. Apr 30 21:38:41.155688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.156578 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-07a40397-4fb7-406a-a3e0-6fdc8739150e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 404 len: 111 microversion: 2.1 time: 0.030940 Apr 30 21:38:41.157640 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2682/5474] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:41 2022] DELETE /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:41.165543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.166182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 7e2413c0-c352-4dea-8bb7-f396cbdabacb] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.173306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.173786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.174624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.175016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.190811 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb could not be found. Apr 30 21:38:41.191425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 7e2413c0-c352-4dea-8bb7-f396cbdabacb could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.192278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-61e06889-d83f-4cb5-9153-edf385a8c5a8 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb" status: 404 len: 111 microversion: 2.1 time: 0.030640 Apr 30 21:38:41.192843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2683/5475] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/7e2413c0-c352-4dea-8bb7-f396cbdabacb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:41.200710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.201251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.207865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.208435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.209242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.209922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.227322 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 39780c08-4194-4809-8ad4-49294acfef91 could not be found. Apr 30 21:38:41.227940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 39780c08-4194-4809-8ad4-49294acfef91 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.228806 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1cb900a0-3b0e-4375-9120-607b20b07bd6 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 404 len: 111 microversion: 2.1 time: 0.031910 Apr 30 21:38:41.229395 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2684/5476] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:41 2022] DELETE /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:41.248202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.248202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 39780c08-4194-4809-8ad4-49294acfef91] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.248202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.248202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.248202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.248202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.264411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 39780c08-4194-4809-8ad4-49294acfef91 could not be found. Apr 30 21:38:41.265223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 39780c08-4194-4809-8ad4-49294acfef91 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.266435 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8bcacc48-ab0e-495e-97f1-fbd7a5fc92ba tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91" status: 404 len: 111 microversion: 2.1 time: 0.032731 Apr 30 21:38:41.267015 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2685/5477] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/39780c08-4194-4809-8ad4-49294acfef91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:41.279405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6257c949-ceb4-4308-ba9f-007e88becf5d req-419737ae-f1f8-4d95-b920-de0aaf7b96df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6ce777-0769-47cf-bfb8-26ef8630648e", "tag": "6cc9a171-8ede-4929-8fd6-67941443391d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:41.290695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6257c949-ceb4-4308-ba9f-007e88becf5d req-419737ae-f1f8-4d95-b920-de0aaf7b96df service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.290695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6257c949-ceb4-4308-ba9f-007e88becf5d req-419737ae-f1f8-4d95-b920-de0aaf7b96df service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.304008 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6257c949-ceb4-4308-ba9f-007e88becf5d req-419737ae-f1f8-4d95-b920-de0aaf7b96df service nova] Creating event network-changed:6cc9a171-8ede-4929-8fd6-67941443391d for instance 0d6ce777-0769-47cf-bfb8-26ef8630648e on nch2-master-1 Apr 30 21:38:41.310120 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6257c949-ceb4-4308-ba9f-007e88becf5d req-419737ae-f1f8-4d95-b920-de0aaf7b96df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041737 Apr 30 21:38:41.310760 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2686/5478] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:41.316049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.316645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.323170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.323584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.324384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.324832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.338872 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 could not be found. Apr 30 21:38:41.339480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.340327 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e5ec552-55d8-4318-a497-f72dbd2b314e tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 404 len: 111 microversion: 2.1 time: 0.028424 Apr 30 21:38:41.341076 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2687/5479] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:41 2022] DELETE /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:41.350234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.350863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 63432ab8-4cf4-46ee-b4ee-7b4b22401a52] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.357959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.358427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.359224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.359718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.374746 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 could not be found. Apr 30 21:38:41.375630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 63432ab8-4cf4-46ee-b4ee-7b4b22401a52 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.376505 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9f5605e7-387d-4ce7-8cfb-33e1844a7534 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52" status: 404 len: 111 microversion: 2.1 time: 0.030759 Apr 30 21:38:41.377064 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2688/5480] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/63432ab8-4cf4-46ee-b4ee-7b4b22401a52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:41.385787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a15ae8b-887d-429e-9e78-a80dcb0f9ef4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.386382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a15ae8b-887d-429e-9e78-a80dcb0f9ef4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.391870 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-4a15ae8b-887d-429e-9e78-a80dcb0f9ef4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 could not be found. Apr 30 21:38:41.392523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a15ae8b-887d-429e-9e78-a80dcb0f9ef4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.393355 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a15ae8b-887d-429e-9e78-a80dcb0f9ef4 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23" status: 404 len: 111 microversion: 2.1 time: 0.011701 Apr 30 21:38:41.394060 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2689/5481] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:41 2022] DELETE /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:41.395889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:41.404004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a7919a0-156f-4fb0-bd4c-7f5d63bb12a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.404629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a7919a0-156f-4fb0-bd4c-7f5d63bb12a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.406236 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8941e065-2c10-44b8-864e-b6517fbcbe86 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.724147 Apr 30 21:38:41.407564 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2793/5482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:40 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:41.421030 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-9a7919a0-156f-4fb0-bd4c-7f5d63bb12a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 could not be found. Apr 30 21:38:41.421712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a7919a0-156f-4fb0-bd4c-7f5d63bb12a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:41.423720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a7919a0-156f-4fb0-bd4c-7f5d63bb12a9 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23" status: 404 len: 111 microversion: 2.1 time: 0.023802 Apr 30 21:38:41.424317 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2690/5483] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/0b6f69d1-d9c6-4b4d-b103-45f3fba33d23 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:41.432594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.433106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.439997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.440458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.441249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.441690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.471087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:38:41.697677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.700092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.715243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.715730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.725635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.725635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.838554 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b19ae12c-08f5-421f-bee7-d34dae9c5b4d tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 204 len: 0 microversion: 2.1 time: 0.409464 Apr 30 21:38:41.845090 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2794/5484] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:41 2022] DELETE /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:38:41.853566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:41.854585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:41.866781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.867734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:41.868032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:41.868478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:42.217144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:42.225235 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aaee7b61-9ffc-4320-bd2c-59386a4d2b5f tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1315 microversion: 2.1 time: 0.531893 Apr 30 21:38:42.226559 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2691/5485] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:42.231163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:42.231780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:42.238177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:42.238703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:42.239499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:42.239947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:42.266029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:42.275534 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cab24a6b-a450-45d6-8ca0-bcf70ff68116 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1481 microversion: 2.1 time: 0.431498 Apr 30 21:38:42.276178 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2795/5486] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:41 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1481 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:42.426610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:42.427913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:42.435427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:42.436332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:42.437364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:42.438709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:42.564799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:42.580369 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a1543433-fc0e-45c2-aa27-8939ff9335f7 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1472 microversion: 2.1 time: 0.352551 Apr 30 21:38:42.591217 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2692/5487] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:42 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:42.759485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:42.787804 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1af70f90-4622-45ae-9bd9-5194ab61e9be tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.367326 Apr 30 21:38:42.800266 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2796/5488] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:42 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:43.247595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:43.248151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:43.255729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:43.256265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:43.257279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:43.259052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:43.294703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:43.295350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:43.303518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:43.305976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:43.307436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:43.308254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:44.196128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:44.204527 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-14cc598b-1df4-430e-904d-9d7e35fe1ff8 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1315 microversion: 2.1 time: 0.965502 Apr 30 21:38:44.205115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2693/5489] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:43 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:44.218325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-609dc894-60fe-43ac-bd63-2b72472508a3 req-1ebbe978-003b-42fb-9675-bf010452ad47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52562d91-9a05-4808-beff-dcf77ba8bb1d", "tag": "d898f6bb-ce69-41c8-89a5-a1b9c295ea2f"}, {"name": "network-changed", "server_uuid": "686ca208-0f15-455b-acdf-cdd63ffaee03", "tag": "944ded8a-0542-4be0-87c6-04783f30015e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:44.227309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-609dc894-60fe-43ac-bd63-2b72472508a3 req-1ebbe978-003b-42fb-9675-bf010452ad47 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:44.227771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-609dc894-60fe-43ac-bd63-2b72472508a3 req-1ebbe978-003b-42fb-9675-bf010452ad47 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:44.233323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:44.241481 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-609dc894-60fe-43ac-bd63-2b72472508a3 req-1ebbe978-003b-42fb-9675-bf010452ad47 service nova] Creating event network-changed:d898f6bb-ce69-41c8-89a5-a1b9c295ea2f for instance 52562d91-9a05-4808-beff-dcf77ba8bb1d on nch2-master-1 Apr 30 21:38:44.242310 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-609dc894-60fe-43ac-bd63-2b72472508a3 req-1ebbe978-003b-42fb-9675-bf010452ad47 service nova] Creating event network-changed:944ded8a-0542-4be0-87c6-04783f30015e for instance 686ca208-0f15-455b-acdf-cdd63ffaee03 on nch1-master-1 Apr 30 21:38:44.246272 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c3e4f12-6e33-4a82-a7a4-3d4568c9f374 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1481 microversion: 2.1 time: 0.956789 Apr 30 21:38:44.247052 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2797/5490] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:43 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1481 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:44.251479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-609dc894-60fe-43ac-bd63-2b72472508a3 req-1ebbe978-003b-42fb-9675-bf010452ad47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036010 Apr 30 21:38:44.252208 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2694/5491] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:44.256413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:44.257048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:44.258257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:44.259137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:44.263668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:44.264147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:44.265067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:44.265520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:44.266121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:44.266679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:44.267982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:44.268609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:44.759110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:44.767473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:44.769981 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f959c626-5372-401e-921b-6e2c4a61c54a tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.516372 Apr 30 21:38:44.771705 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2695/5492] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:44 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:44.777612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d4444973-318c-4586-a373-3df53d6167e0 req-7ca00cd4-8dcf-4502-bb05-e6d1f81d4427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6ce777-0769-47cf-bfb8-26ef8630648e", "name": "network-vif-plugged", "status": "completed", "tag": "6cc9a171-8ede-4929-8fd6-67941443391d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:44.787965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d4444973-318c-4586-a373-3df53d6167e0 req-7ca00cd4-8dcf-4502-bb05-e6d1f81d4427 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:44.788423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d4444973-318c-4586-a373-3df53d6167e0 req-7ca00cd4-8dcf-4502-bb05-e6d1f81d4427 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:44.790790 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f6877f8-1762-4549-b7a7-c9d825bf4693 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1472 microversion: 2.1 time: 0.540881 Apr 30 21:38:44.792271 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2798/5493] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:44 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1472 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:44.810452 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d4444973-318c-4586-a373-3df53d6167e0 req-7ca00cd4-8dcf-4502-bb05-e6d1f81d4427 service nova] Creating event network-vif-plugged:6cc9a171-8ede-4929-8fd6-67941443391d for instance 0d6ce777-0769-47cf-bfb8-26ef8630648e on nch2-master-1 Apr 30 21:38:44.816329 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d4444973-318c-4586-a373-3df53d6167e0 req-7ca00cd4-8dcf-4502-bb05-e6d1f81d4427 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042373 Apr 30 21:38:44.817300 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2696/5494] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:45.221290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:45.221953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:45.232414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.232875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:45.233670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.234164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:45.264517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:45.265251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:45.273163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.274056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:45.274426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.274868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:45.360023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:45.364477 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-906319a9-276a-434d-a0f5-35ee4594fd49 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1439 microversion: 2.1 time: 0.104200 Apr 30 21:38:45.365057 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2697/5495] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:45 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:45.392040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:45.399549 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-306439e9-a437-4d1e-92ca-287d2d662e5d tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1315 microversion: 2.1 time: 0.182258 Apr 30 21:38:45.400121 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2799/5496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:45 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:45.788861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:45.789604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:45.796016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.796615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:45.798086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.798543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:45.810968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:45.812126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:45.819890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.820521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:45.821569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:45.822142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:46.157433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:46.167287 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74b64a23-2fa2-42fc-904a-509a7b438062 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.382347 Apr 30 21:38:46.172748 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2698/5497] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:45 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:46.231144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:46.239520 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9ade0b25-fd54-4128-b59a-79975df3028d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1472 microversion: 2.1 time: 0.434731 Apr 30 21:38:46.240111 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2800/5498] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:45 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:46.299545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-89a21df7-3143-494d-9a6c-c12f04a1fbae req-7d570c6a-67e5-4e37-a13d-c16f9d942667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5c62d2-9e47-4691-822d-dcb5d1e9f962", "name": "network-vif-deleted", "tag": "9538c9d6-9da4-4005-a64a-486657fccea6"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:46.308602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-89a21df7-3143-494d-9a6c-c12f04a1fbae req-7d570c6a-67e5-4e37-a13d-c16f9d942667 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:46.309054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-89a21df7-3143-494d-9a6c-c12f04a1fbae req-7d570c6a-67e5-4e37-a13d-c16f9d942667 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:46.321102 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-89a21df7-3143-494d-9a6c-c12f04a1fbae req-7d570c6a-67e5-4e37-a13d-c16f9d942667 service nova] Creating event network-vif-deleted:9538c9d6-9da4-4005-a64a-486657fccea6 for instance 2d5c62d2-9e47-4691-822d-dcb5d1e9f962 on nch2-master-1 Apr 30 21:38:46.326420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-89a21df7-3143-494d-9a6c-c12f04a1fbae req-7d570c6a-67e5-4e37-a13d-c16f9d942667 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030870 Apr 30 21:38:46.327016 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2699/5499] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:46.380543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:46.381198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:46.387511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:46.388009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:46.388803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:46.389307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:46.418293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:46.419483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:46.423996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:46.424471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:46.424939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lazy-loading 'fault' on Instance uuid 2d5c62d2-9e47-4691-822d-dcb5d1e9f962 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:38:46.428968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:46.430461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:46.431597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:46.432271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:46.488334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107c6d79451405a963c5816d92055b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e106ab99f4decadf747b3ebf025c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:46.496387 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b23b4d41-14cd-4e66-b0a6-98bf13c02b70 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 200 len: 1283 microversion: 2.1 time: 0.119752 Apr 30 21:38:46.497277 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2801/5500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:46 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 1283 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:46.698835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:46.706810 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a36cee37-a30b-49e1-a31f-8fc672a1ff8c tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1315 microversion: 2.1 time: 0.293924 Apr 30 21:38:46.707402 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2700/5501] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:46 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:47.184916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:47.185547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:47.193047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.193501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.194330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.194771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.260756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:47.262021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:47.277540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.278039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.278843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.279294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.402386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:47.410924 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4cdb9eae-7bdb-4f12-b61d-71b988cfb686 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.230058 Apr 30 21:38:47.420607 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2802/5502] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:47 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:47.467984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:47.476080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0351eee0-27c7-4ec2-97e2-bfb9a72017d3 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1472 microversion: 2.1 time: 0.219929 Apr 30 21:38:47.476735 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2701/5503] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:47 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:47.513291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:47.513953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] [instance: 2d5c62d2-9e47-4691-822d-dcb5d1e9f962] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:47.519992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.520449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.521495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.521978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.536016 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] HTTP exception thrown: Instance 2d5c62d2-9e47-4691-822d-dcb5d1e9f962 could not be found. Apr 30 21:38:47.536646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] Returning 404 to user: Instance 2d5c62d2-9e47-4691-822d-dcb5d1e9f962 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:47.537477 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5b2d425e-8628-4bfb-b4eb-99203b1f34f2 tempest-ServersTestJSON-497705186 tempest-ServersTestJSON-497705186-project] 10.222.0.23 "GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962" status: 404 len: 111 microversion: 2.1 time: 0.028126 Apr 30 21:38:47.538069 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2803/5504] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:47 2022] GET /compute/v2.1/servers/2d5c62d2-9e47-4691-822d-dcb5d1e9f962 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:47.725266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:47.725974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:47.731991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.732503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.733292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.733745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.872187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:47.902922 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3311413d-becd-4d14-a77c-3ca0893f544b tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1465 microversion: 2.1 time: 0.181099 Apr 30 21:38:47.904054 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2702/5505] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:47 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:47.948099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:47.948604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:47.965530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.966014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.966813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:47.967259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:47.995742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:38:48.428773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:48.429541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:48.438574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:48.439230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:48.440045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:48.440658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:48.569104 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9beab9e7-373a-4422-a651-609e9f12ac5e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 204 len: 0 microversion: 2.1 time: 0.624650 Apr 30 21:38:48.570363 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2804/5506] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:38:47 2022] DELETE /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:38:48.581225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:48.582253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:48.592400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:48.592837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:48.596219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:48.600382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:48.604739 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-43d40554-4c25-46ec-89a0-2d48f6eb341c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.180467 Apr 30 21:38:48.605998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:48.610067 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2703/5507] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:48 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:48.615557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:48.619831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:48.634245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:48.634658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:48.635449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:48.635889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:48.874551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:48.879255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:48.883516 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a8a7eb72-6578-4d4b-b1ee-cd83c4093fc8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1472 microversion: 2.1 time: 0.307509 Apr 30 21:38:48.884115 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2805/5508] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:48 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:48.889498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d0c92ab1-0e45-40af-a219-0ee5380671c9 req-71bf2ebf-8817-45d9-b8f6-04df10ab98df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52562d91-9a05-4808-beff-dcf77ba8bb1d", "name": "network-vif-plugged", "status": "completed", "tag": "d898f6bb-ce69-41c8-89a5-a1b9c295ea2f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:48.901145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0c92ab1-0e45-40af-a219-0ee5380671c9 req-71bf2ebf-8817-45d9-b8f6-04df10ab98df service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:48.903725 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bb9b12c6-93b6-4174-99cb-9a5fae64cb36 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1471 microversion: 2.1 time: 0.289430 Apr 30 21:38:48.903866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0c92ab1-0e45-40af-a219-0ee5380671c9 req-71bf2ebf-8817-45d9-b8f6-04df10ab98df service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:48.903989 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2704/5509] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:48 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:48.919579 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d0c92ab1-0e45-40af-a219-0ee5380671c9 req-71bf2ebf-8817-45d9-b8f6-04df10ab98df service nova] Creating event network-vif-plugged:d898f6bb-ce69-41c8-89a5-a1b9c295ea2f for instance 52562d91-9a05-4808-beff-dcf77ba8bb1d on nch2-master-1 Apr 30 21:38:48.925741 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d0c92ab1-0e45-40af-a219-0ee5380671c9 req-71bf2ebf-8817-45d9-b8f6-04df10ab98df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040310 Apr 30 21:38:48.926405 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2806/5510] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:49.621922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:49.622545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:49.629887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:49.630355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:49.636060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:49.636060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:49.808918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:49.816806 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2e88cc2-a463-40eb-ab1e-df668e44a0bf tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.198759 Apr 30 21:38:49.826496 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2705/5511] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:49 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:49.901272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:49.902068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:49.909100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:49.909626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:49.910486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:49.910936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:49.921857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:49.923051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:49.930084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:49.930552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:49.931397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:49.931969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:50.200996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:50.209310 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-846c9516-36bb-4e57-b147-e15a2b2af17c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1472 microversion: 2.1 time: 0.312439 Apr 30 21:38:50.209897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:50.214385 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2807/5512] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:49 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:50.219796 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24cb995d-e6f6-4549-9292-b4c5cdb8505e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1471 microversion: 2.1 time: 0.302391 Apr 30 21:38:50.220479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2706/5513] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:49 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:50.344332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-597012917", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": "none"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:50.398851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:38:50.399278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:38:50.399778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:38:50.400259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:38:50.400629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:38:50.412417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:50.412887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:50.413711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:50.414223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:50.433146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Getting quotas for project 7232aa02ba6444b5a0acb5ffe699e2bc. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:38:50.443910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Getting quotas for user 49a3c47bfc674540927a9360790a838a and project 7232aa02ba6444b5a0acb5ffe699e2bc. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:38:50.457856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:38:50.460284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:38:50.768914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-61c21be4-4e6b-4772-bffd-d320cc44c828 req-29728b52-2ecc-4cff-bd4f-235aadb15c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6ce777-0769-47cf-bfb8-26ef8630648e", "name": "network-vif-deleted", "tag": "6cc9a171-8ede-4929-8fd6-67941443391d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:50.782363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-61c21be4-4e6b-4772-bffd-d320cc44c828 req-29728b52-2ecc-4cff-bd4f-235aadb15c9f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:50.782819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-61c21be4-4e6b-4772-bffd-d320cc44c828 req-29728b52-2ecc-4cff-bd4f-235aadb15c9f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:50.798051 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-61c21be4-4e6b-4772-bffd-d320cc44c828 req-29728b52-2ecc-4cff-bd4f-235aadb15c9f service nova] Creating event network-vif-deleted:6cc9a171-8ede-4929-8fd6-67941443391d for instance 0d6ce777-0769-47cf-bfb8-26ef8630648e on nch2-master-1 Apr 30 21:38:50.803653 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-61c21be4-4e6b-4772-bffd-d320cc44c828 req-29728b52-2ecc-4cff-bd4f-235aadb15c9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040337 Apr 30 21:38:50.804487 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2707/5514] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:38:50.835243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:50.836256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:50.843705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:50.845139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:50.846099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:50.846820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:50.864808 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b7f3f36d-e783-415b-b886-d1aa8176a595 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.649010 Apr 30 21:38:50.870934 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2808/5515] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Apr 30 21:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 21:38:50.877213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3f7f850-fea3-4d75-9756-755f2f90b199 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:50.878237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3f7f850-fea3-4d75-9756-755f2f90b199 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:51.270227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f3f7f850-fea3-4d75-9756-755f2f90b199 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:51.280751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f3f7f850-fea3-4d75-9756-755f2f90b199 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:51.282464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f3f7f850-fea3-4d75-9756-755f2f90b199 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:51.286319 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3f7f850-fea3-4d75-9756-755f2f90b199 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1277 microversion: 2.57 time: 0.411575 Apr 30 21:38:51.286319 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2809/5516] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:50 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1277 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:38:51.289447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4e39841a-ebbb-4147-a6b4-428d4db50e16 req-5f86f7eb-21ac-4c05-b9e7-887b016a048a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686ca208-0f15-455b-acdf-cdd63ffaee03", "name": "network-vif-plugged", "status": "completed", "tag": "944ded8a-0542-4be0-87c6-04783f30015e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:51.298611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4e39841a-ebbb-4147-a6b4-428d4db50e16 req-5f86f7eb-21ac-4c05-b9e7-887b016a048a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.299341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4e39841a-ebbb-4147-a6b4-428d4db50e16 req-5f86f7eb-21ac-4c05-b9e7-887b016a048a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.317221 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4e39841a-ebbb-4147-a6b4-428d4db50e16 req-5f86f7eb-21ac-4c05-b9e7-887b016a048a service nova] Creating event network-vif-plugged:944ded8a-0542-4be0-87c6-04783f30015e for instance 686ca208-0f15-455b-acdf-cdd63ffaee03 on nch1-master-1 Apr 30 21:38:51.322655 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4e39841a-ebbb-4147-a6b4-428d4db50e16 req-5f86f7eb-21ac-4c05-b9e7-887b016a048a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036584 Apr 30 21:38:51.323270 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2810/5517] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:51.333022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:51.333188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:51.334416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:51.341508 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a85e48f7-ae4b-437f-aa60-6ebd1d2ff9bc tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.510628 Apr 30 21:38:51.342151 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2708/5518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:50 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:51.342546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.343268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.345319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.345946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.347147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:51.347958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:51.355844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.356572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.357773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.358492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.393887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.394357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.394834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lazy-loading 'fault' on Instance uuid 0d6ce777-0769-47cf-bfb8-26ef8630648e {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:38:51.484935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6185d1aa50a4dcd919fb3410d4f30df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19b8cfdb2ea490ebcb51f4f67262300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:51.492696 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a2c8585a-9481-4bf5-8e5b-9f22f30229d2 tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 200 len: 1305 microversion: 2.1 time: 0.149293 Apr 30 21:38:51.493611 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2709/5519] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:51 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 1305 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:51.590636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:51.598066 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7a23f423-4944-44f6-8404-a1d56d9c2943 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1643 microversion: 2.1 time: 0.271021 Apr 30 21:38:51.598638 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2811/5520] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:51 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1643 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:51.616786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:51.617416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:51.623885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.624353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.626051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.626640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.789392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:51.797986 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-abddcfca-b074-4015-a453-a4cb4f80528e tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1643 microversion: 2.1 time: 0.185248 Apr 30 21:38:51.798705 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2710/5521] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:51 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1643 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:51.813805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c2617b73-1c9e-4fee-9f5b-f8183f4e6333 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:51.814586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c2617b73-1c9e-4fee-9f5b-f8183f4e6333 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:51.820833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2617b73-1c9e-4fee-9f5b-f8183f4e6333 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.821373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2617b73-1c9e-4fee-9f5b-f8183f4e6333 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:51.822273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2617b73-1c9e-4fee-9f5b-f8183f4e6333 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:51.822908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2617b73-1c9e-4fee-9f5b-f8183f4e6333 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:52.110811 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c2617b73-1c9e-4fee-9f5b-f8183f4e6333 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1794 microversion: 2.1 time: 0.300149 Apr 30 21:38:52.111383 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2812/5522] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:51 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1794 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:52.301744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:52.302639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:52.308653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:52.309111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:52.310366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:52.310994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:52.362370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:52.363231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:52.369612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:52.370210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:52.371092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:52.371536 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:52.390162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:52.399127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:52.400902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:52.402089 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9e0eb1f0-5d69-48de-bc0d-d731017465ac tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1281 microversion: 2.57 time: 0.104497 Apr 30 21:38:52.402848 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2711/5523] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:52 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:38:52.510401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:52.511034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] [instance: 0d6ce777-0769-47cf-bfb8-26ef8630648e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:52.518323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:52.519037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:52.519843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:52.520294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:52.535338 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] HTTP exception thrown: Instance 0d6ce777-0769-47cf-bfb8-26ef8630648e could not be found. Apr 30 21:38:52.535953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] Returning 404 to user: Instance 0d6ce777-0769-47cf-bfb8-26ef8630648e could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:38:52.536809 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47f334e0-d952-4614-88b3-8e5d2d5ed85e tempest-VolumesNegativeTest-109917746 tempest-VolumesNegativeTest-109917746-project] 10.222.0.23 "GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e" status: 404 len: 111 microversion: 2.1 time: 0.030762 Apr 30 21:38:52.537372 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2712/5524] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:52 2022] GET /compute/v2.1/servers/0d6ce777-0769-47cf-bfb8-26ef8630648e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:38:52.582134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:52.591595 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c628f9d-c95c-4c7f-9ef5-a562f042258c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1363 microversion: 2.1 time: 0.233389 Apr 30 21:38:52.592197 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2813/5525] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:52 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:38:53.423141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:53.424761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:53.433949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:53.433949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:53.435072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:53.435956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:53.509654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:53.518704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:53.520322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:53.521954 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e58573ab-c587-4243-b244-3bb049d03264 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1329 microversion: 2.57 time: 0.103820 Apr 30 21:38:53.522624 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2713/5526] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:53 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:38:53.610702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:53.611600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:53.628661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:53.628661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:53.634032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:53.634771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:53.858511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:53.872461 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8b9b271-571c-4083-a14a-7a857ed7742d tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1547 microversion: 2.1 time: 0.267542 Apr 30 21:38:53.873339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2814/5527] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:38:53 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1547 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:38:53.889310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb150bf7-d7f1-4d28-a79c-1d0e5bc584ff tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:53.889836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb150bf7-d7f1-4d28-a79c-1d0e5bc584ff tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:53.895790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb150bf7-d7f1-4d28-a79c-1d0e5bc584ff tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:53.896510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb150bf7-d7f1-4d28-a79c-1d0e5bc584ff tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:53.897288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb150bf7-d7f1-4d28-a79c-1d0e5bc584ff tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:53.897735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb150bf7-d7f1-4d28-a79c-1d0e5bc584ff tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:54.045406 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb150bf7-d7f1-4d28-a79c-1d0e5bc584ff tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159582 Apr 30 21:38:54.047023 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2714/5528] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:38:53 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:54.540948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:54.541568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:54.548134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:54.548587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:54.549376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:54.549847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:54.770080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:54.778903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:54.780459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:54.783216 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70291bb5-eb9d-4eaf-ba68-3be81be1f4f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1335 microversion: 2.57 time: 0.244865 Apr 30 21:38:54.783216 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2815/5529] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:54 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1335 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:38:55.530956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-455e854a-2a83-4dce-aa65-077b509b0e68 req-6a274bcd-24a7-48a3-88e7-aafc9f70bd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52562d91-9a05-4808-beff-dcf77ba8bb1d", "tag": "d898f6bb-ce69-41c8-89a5-a1b9c295ea2f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:55.539736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-455e854a-2a83-4dce-aa65-077b509b0e68 req-6a274bcd-24a7-48a3-88e7-aafc9f70bd05 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:55.540441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-455e854a-2a83-4dce-aa65-077b509b0e68 req-6a274bcd-24a7-48a3-88e7-aafc9f70bd05 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:55.553065 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-455e854a-2a83-4dce-aa65-077b509b0e68 req-6a274bcd-24a7-48a3-88e7-aafc9f70bd05 service nova] Creating event network-changed:d898f6bb-ce69-41c8-89a5-a1b9c295ea2f for instance 52562d91-9a05-4808-beff-dcf77ba8bb1d on nch2-master-1 Apr 30 21:38:55.558558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-455e854a-2a83-4dce-aa65-077b509b0e68 req-6a274bcd-24a7-48a3-88e7-aafc9f70bd05 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032352 Apr 30 21:38:55.560826 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2715/5530] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:38:55.801399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:55.804405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:55.814533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:55.815214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:55.816347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:55.816953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:55.930166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:55.944829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:55.947297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:55.951359 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-938ac64f-ddb0-4468-ad9e-6774a55197af tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1335 microversion: 2.57 time: 0.154088 Apr 30 21:38:55.954270 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2816/5531] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:55 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1335 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:38:56.972020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:56.972729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:56.979013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:56.979480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:56.980263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:56.980713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.048411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:57.058736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:57.060249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:57.061735 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bfe72cd4-642e-4596-9c84-830c40c3f939 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1356 microversion: 2.57 time: 0.095050 Apr 30 21:38:57.062877 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2716/5532] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:56 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:38:57.086827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:57.089931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:57.101236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:57.103094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.104314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:57.105026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.200678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:38:57.200678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:38:57.200678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:38:57.200678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:38:57.200678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:38:57.423056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:57.429867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:57.430412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.431214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:57.431655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.478852 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ad999ce-4bea-4b42-81bd-0f4b6bc9452c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "POST /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f/action" status: 202 len: 1137 microversion: 2.57 time: 0.397021 Apr 30 21:38:57.479494 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2817/5533] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Apr 30 21:38:57 2022] POST /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f/action => generated 1137 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 30 21:38:57.495208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:57.495845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:57.502375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:57.503080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.503901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:57.504532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.582813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:57.596819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:57.609490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:57.610888 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad3aab98-1acc-45cf-b35d-75f3fdec0c85 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.120062 Apr 30 21:38:57.614011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9afdbdc2-5ec4-4547-ba78-afd98aa1dceb req-69506631-ff7b-4845-b8a7-d1c0e74ae94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686ca208-0f15-455b-acdf-cdd63ffaee03", "tag": "944ded8a-0542-4be0-87c6-04783f30015e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:38:57.618840 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2717/5534] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:57 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:38:57.623209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9afdbdc2-5ec4-4547-ba78-afd98aa1dceb req-69506631-ff7b-4845-b8a7-d1c0e74ae94d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:57.625341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9afdbdc2-5ec4-4547-ba78-afd98aa1dceb req-69506631-ff7b-4845-b8a7-d1c0e74ae94d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:57.635282 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9afdbdc2-5ec4-4547-ba78-afd98aa1dceb req-69506631-ff7b-4845-b8a7-d1c0e74ae94d service nova] Creating event network-changed:944ded8a-0542-4be0-87c6-04783f30015e for instance 686ca208-0f15-455b-acdf-cdd63ffaee03 on nch1-master-1 Apr 30 21:38:57.640275 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9afdbdc2-5ec4-4547-ba78-afd98aa1dceb req-69506631-ff7b-4845-b8a7-d1c0e74ae94d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030606 Apr 30 21:38:57.641112 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2818/5535] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:38:58.630385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:58.630996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:58.639047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:58.639047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:58.639274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:58.639625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:58.704138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:58.712169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:58.713687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:58.715047 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b242a52c-bac1-4adf-aae6-d0acd116212c tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.088596 Apr 30 21:38:58.715613 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2718/5536] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:58 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:38:59.735653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:38:59.736389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:38:59.742637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:59.743100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:59.743877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:38:59.744319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:38:59.807841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:59.816291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:59.817812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:38:59.819486 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-020d5375-9b7e-45a9-ab0a-c42764d959f4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.089103 Apr 30 21:38:59.819819 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2819/5537] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:38:59 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:00.836989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:00.837620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:00.845151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:00.845625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:00.846492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:00.846952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:00.918333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:00.927043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:00.928570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:00.929794 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c504314e-a811-4ac7-9e86-3dfffa249bd9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.097063 Apr 30 21:39:00.930660 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2719/5538] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:00 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:01.947226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:01.947850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:01.954620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:01.955084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:01.956164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:01.956413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:02.023797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:02.031764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:02.033311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:02.037417 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9c3445b-17e3-4f1a-ac34-9b554b95e83f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.091283 Apr 30 21:39:02.037417 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2820/5539] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:01 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:03.052396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:03.053101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:03.060080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:03.060976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:03.061870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:03.062501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:03.138806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:03.139968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:03.141533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:03.143882 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f6e992ed-e19e-437e-ace8-db19bed0f044 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.095027 Apr 30 21:39:03.144542 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2720/5540] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:03 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:04.084870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-613090aa-fe13-488a-b96e-dbe9c190dcd7 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:04.085411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-613090aa-fe13-488a-b96e-dbe9c190dcd7 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:04.092351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-613090aa-fe13-488a-b96e-dbe9c190dcd7 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:04.092811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-613090aa-fe13-488a-b96e-dbe9c190dcd7 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:04.093596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-613090aa-fe13-488a-b96e-dbe9c190dcd7 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:04.094086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-613090aa-fe13-488a-b96e-dbe9c190dcd7 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:04.128473 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-613090aa-fe13-488a-b96e-dbe9c190dcd7 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042067 Apr 30 21:39:04.128473 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2821/5541] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:39:04 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180/os-server-password => generated 116 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:04.163129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:04.163760 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:04.170964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:04.171426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:04.172217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:04.172692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:04.238670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:04.246508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:04.248043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:04.249237 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb809682-725f-4f82-95a8-9a1c40f64d8d tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.090245 Apr 30 21:39:04.258838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2721/5542] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:04 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:05.280694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:05.281360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:05.289382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:05.290114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:05.290897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:05.291372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:05.371041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:05.380021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:05.381695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:05.383087 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c055b88a-83a5-4027-8264-2525a552e93f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.110541 Apr 30 21:39:05.384374 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2822/5543] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:05 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:06.407569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:06.408206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:06.421111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:06.422120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:06.425023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:06.425639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:06.491920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:06.500532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:06.502164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:06.504107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0930265c-fdd0-4b88-b080-da727dcdd428 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.101198 Apr 30 21:39:06.504681 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2722/5544] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:06 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:07.523393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:07.524012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:07.530843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:07.531297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:07.532147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:07.532593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:07.599593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:07.607621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:07.609123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:07.610330 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e953989e-0986-499d-8262-e9b6dd3bb1e5 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.091272 Apr 30 21:39:07.610896 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2823/5545] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:07 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:08.629524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:08.630291 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:08.637079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:08.637547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:08.638363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:08.638813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:08.702090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:08.710273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:08.712118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:08.713704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9a06be3-9539-43e8-ad9f-2c27c03d3ba4 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.088795 Apr 30 21:39:08.714619 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2723/5546] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:08 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:09.732285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:09.732878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:09.739894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:09.740355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:09.741134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:09.741579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:09.805509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:09.813478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:09.815042 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:09.817140 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d652c956-68a1-458e-bf6b-44dcef1aa972 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.088431 Apr 30 21:39:09.822053 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2824/5547] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:09 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:10.835895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:10.836552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:10.843508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:10.844460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:10.844821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:10.845265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:10.911526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:10.919567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:10.921178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:10.922563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-90986508-3674-43d6-b2f2-f13f6980914e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.091339 Apr 30 21:39:10.923377 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2724/5548] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:10 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:11.940475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:11.941088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:11.949207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:11.949652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:11.950465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:11.950894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:12.014668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:12.022866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:12.024535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:12.025815 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0d847ee3-39f9-43b5-9935-9e632af652b6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.089307 Apr 30 21:39:12.026403 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2825/5549] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:11 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:13.046468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:13.047697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:13.061891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:13.061891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:13.061891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:13.061891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:13.487079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:13.496196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:13.497696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:13.499009 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5e2c5af3-76f4-47d3-bc79-298c44692b80 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.458210 Apr 30 21:39:13.499894 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2725/5550] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:13 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:14.522079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:14.529583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:14.529781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:14.530273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:14.531071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:14.531522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:14.600743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:14.608610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:14.610185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:14.611315 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9cdcf8c0-5dd7-403b-9d4d-03907ffa373f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.097820 Apr 30 21:39:14.611882 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2826/5551] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:14 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:15.630513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:15.631152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:15.638224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:15.638694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:15.639556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:15.640016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:15.711120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:15.719266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:15.720780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:15.721993 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f7afeb7e-734f-4420-aa76-73f3aa940468 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.096155 Apr 30 21:39:15.722565 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2726/5552] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:15 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:16.741409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:16.742128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:16.749503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:16.750001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:16.750803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:16.751630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:16.826345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:16.835805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:16.837372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:16.838632 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-829d9ad5-41a8-4d63-831b-90bf076ef68e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.102013 Apr 30 21:39:16.850741 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2827/5553] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:16 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:17.858686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:17.860107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:17.868777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:17.869480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:17.870460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:17.870916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:17.955330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:17.964608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:17.966698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:17.968891 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-edfa4395-956a-4c77-ae68-3aa186759ef7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.114443 Apr 30 21:39:17.971137 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2727/5554] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:17 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:18.999499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:19.000144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:19.007178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:19.007636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:19.008429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:19.008882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:19.087127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:19.095171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:19.096711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:19.097959 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f975afe-98cc-4a54-b709-57931f9f0912 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.107856 Apr 30 21:39:19.098517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2828/5555] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:18 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:20.116533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:20.117214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:20.127568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:20.127866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:20.128665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:20.135597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:20.297027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:20.317570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:20.325212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:20.333738 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ab69c0b-aae7-4b65-94ae-03e3aa92b6f9 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.221446 Apr 30 21:39:20.334378 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2728/5556] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:20 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:21.358252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:21.358915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:21.367045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:21.367510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:21.368303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:21.368919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:21.443440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:21.452150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:21.454079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:21.455284 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be5d00ac-6369-4a42-a922-da9663c32e38 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.101523 Apr 30 21:39:21.455859 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2829/5557] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:21 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:22.473916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:22.476103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:22.483083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:22.483554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:22.484354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:22.484804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:22.551006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:22.559092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:22.560592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:22.561784 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-54357791-ae7e-4b32-9027-cd871f96efc6 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.092391 Apr 30 21:39:22.562354 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2729/5558] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:22 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:23.580655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:23.582141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:23.590717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:23.596486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:23.596486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:23.596486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:23.708332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:23.717978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:23.720006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:23.721453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-969b2db7-8dec-415a-91e7-b4b0693f3886 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.144803 Apr 30 21:39:23.722240 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2830/5559] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:23 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:24.741492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:24.746208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:24.750048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:24.750627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:24.751545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:24.752111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:24.870295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:24.879451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:24.881219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:24.882480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-582437a3-1167-45fd-a3e5-3e10ddd2b5cc tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.145611 Apr 30 21:39:24.883061 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2730/5560] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:24 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:25.902803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:25.904532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:25.918277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:25.920304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:25.921273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:25.923635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:26.037541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:26.048641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:26.051413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:26.053619 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35e9c7f1-71cd-43ed-bab8-91ba9c8e73d3 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.156781 Apr 30 21:39:26.054741 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2831/5561] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:25 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:27.085748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:27.089552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:27.107565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:27.108026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:27.108816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:27.111126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:27.208171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:27.224273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:27.226210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:27.228527 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8fb10610-5f90-4d76-af06-a300ec621feb tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.158734 Apr 30 21:39:27.241055 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2731/5562] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:27 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:27.769350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-95c3f1d9-d764-470e-a907-ff7c72c8f6c5 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1581030219", "availability_zone": "foo_zone"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:27.771014 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:27.771014 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:39:27.772239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.aggregate [None req-95c3f1d9-d764-470e-a907-ff7c72c8f6c5 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Generated uuid 3b9b2467-c51a-48df-920a-575e623d8fc4 for aggregate {{(pid=130671) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 30 21:39:27.888252 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-95c3f1d9-d764-470e-a907-ff7c72c8f6c5 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.252290 Apr 30 21:39:27.888825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2832/5563] 10.222.0.23 () {60 vars in 1163 bytes} [Sat Apr 30 21:39:27 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:27.899626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1896b238-4d4f-4a08-aef6-f7d880c7325d tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:27.901069 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:27.901069 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:39:27.997037 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1896b238-4d4f-4a08-aef6-f7d880c7325d tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.101702 Apr 30 21:39:28.000450 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2732/5564] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:39:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:28.007950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d71d337-6893-4e8b-b74a-6a20c86c0dac tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:28.009224 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.009224 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:39:28.010478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d71d337-6893-4e8b-b74a-6a20c86c0dac tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:28.010950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d71d337-6893-4e8b-b74a-6a20c86c0dac tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:28.011782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d71d337-6893-4e8b-b74a-6a20c86c0dac tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:28.012238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d71d337-6893-4e8b-b74a-6a20c86c0dac tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:28.037655 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d71d337-6893-4e8b-b74a-6a20c86c0dac tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033448 Apr 30 21:39:28.040569 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2833/5565] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Apr 30 21:39:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:28.049698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7462f7e5-4602-4761-95ac-c3a7307ecf18 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:28.050435 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.050435 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:39:28.058704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7462f7e5-4602-4761-95ac-c3a7307ecf18 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013015 Apr 30 21:39:28.059245 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2733/5566] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:39:28 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:28.069183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-21f7d5ea-da66-480c-8644-593b51dd0010 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:28.070502 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.070502 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:39:28.078759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f7d5ea-da66-480c-8644-593b51dd0010 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:28.079231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-21f7d5ea-da66-480c-8644-593b51dd0010 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:28.248075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:28.249891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:28.257695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:28.258661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:28.259903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:28.260357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:28.354058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:28.363099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:28.364855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:28.366334 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-137f23bf-3014-48cf-930b-c28d6a9af6c8 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.122279 Apr 30 21:39:28.366686 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2734/5567] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:28 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:39:28.496697 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-21f7d5ea-da66-480c-8644-593b51dd0010 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.431292 Apr 30 21:39:28.497303 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2834/5568] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:39:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:28.510942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca84c040-d342-4166-b310-3a97f0868906 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:28.511708 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.511708 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:39:28.519034 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca84c040-d342-4166-b310-3a97f0868906 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.011793 Apr 30 21:39:28.519588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2735/5569] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:39:28 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:28.529973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1e0e435d-0bab-428f-bcbd-df3527105b32 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-432874780", "availability_zone": "foo_zone"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:28.531399 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.531399 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:39:28.724612 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1e0e435d-0bab-428f-bcbd-df3527105b32 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.198360 Apr 30 21:39:28.725875 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2835/5570] 10.222.0.23 () {60 vars in 1172 bytes} [Sat Apr 30 21:39:28 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:28.736114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c6c5945-53d5-49e4-8600-c73b98905d5d tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:28.737430 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.737430 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:39:28.865258 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c6c5945-53d5-49e4-8600-c73b98905d5d tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.132875 Apr 30 21:39:28.866260 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2736/5571] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:39:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:39:28.877626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe1c4ba4-2c7d-4f8a-85cb-56871281a654 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:28.878553 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.878553 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:39:28.887641 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe1c4ba4-2c7d-4f8a-85cb-56871281a654 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.014702 Apr 30 21:39:28.888230 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2836/5572] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:39:28 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:28.899356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ffdd8735-226d-40be-831b-8368bf018653 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:28.900801 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:28.900801 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:39:28.909605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffdd8735-226d-40be-831b-8368bf018653 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:28.910116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ffdd8735-226d-40be-831b-8368bf018653 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:29.247863 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ffdd8735-226d-40be-831b-8368bf018653 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.353107 Apr 30 21:39:29.248609 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2737/5573] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Apr 30 21:39:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:29.259811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fd0ebb01-90c0-42b1-8b08-4f368ef10905 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:29.260863 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:39:29.260863 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 21:39:29.371983 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fd0ebb01-90c0-42b1-8b08-4f368ef10905 tempest-TestAggregatesBasicOps-369192365 tempest-TestAggregatesBasicOps-369192365-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.116177 Apr 30 21:39:29.372879 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2837/5574] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:39:29 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 30 21:39:29.392316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:29.393250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:29.402619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:29.402619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:29.403639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:29.404598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:29.492514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:29.502786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:29.505222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:29.512352 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-afa5613d-4c07-4b09-9752-bc2ded496f6e tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1365 microversion: 2.57 time: 0.127728 Apr 30 21:39:29.513913 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2738/5575] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:29 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:30.546645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:30.548044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:30.568417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:30.570404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:30.571496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:30.572080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:30.695325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:30.709223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:30.711303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:30.713256 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43df2d01-2988-4dc9-8a73-0d47d68f5464 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1371 microversion: 2.57 time: 0.174367 Apr 30 21:39:30.730351 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2838/5576] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:30 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:31.423568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4eb7efaf-f96d-48db-9bc4-e50ad9b55141 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:31.424068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4eb7efaf-f96d-48db-9bc4-e50ad9b55141 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:31.431925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eb7efaf-f96d-48db-9bc4-e50ad9b55141 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:31.433660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eb7efaf-f96d-48db-9bc4-e50ad9b55141 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:31.433660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eb7efaf-f96d-48db-9bc4-e50ad9b55141 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:31.433660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4eb7efaf-f96d-48db-9bc4-e50ad9b55141 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:31.483992 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4eb7efaf-f96d-48db-9bc4-e50ad9b55141 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/ips" status: 200 len: 143 microversion: 2.1 time: 0.064270 Apr 30 21:39:31.485196 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2739/5577] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:39:31 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/ips => generated 143 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:31.734464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:31.735787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:31.748009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:31.748476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:31.749260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:31.749701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:31.885157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:31.904580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:31.906747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:31.908326 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31e2b687-8d18-4d55-bf98-7076cd1d1c87 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1371 microversion: 2.57 time: 0.178271 Apr 30 21:39:31.921988 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2839/5578] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:31 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:32.930279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:32.931206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:32.939548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:32.940413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:32.941232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:32.942565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:33.007993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:33.016152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:33.017683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:33.018928 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98971af2-2042-454c-8f9f-5af73da8f284 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1356 microversion: 2.57 time: 0.093211 Apr 30 21:39:33.019474 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2740/5579] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:32 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:39:33.052194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:33.052783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:33.059608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:33.060354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:33.061153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:33.061787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:33.091190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:39:33.387348 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9eba7738-c109-4863-ba29-ed782384246b tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 204 len: 0 microversion: 2.57 time: 0.344862 Apr 30 21:39:33.391705 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2840/5580] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Apr 30 21:39:33 2022] DELETE /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 21:39:33.396256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:33.397383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:33.409030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:33.409800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:33.410884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:33.412120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:33.591516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:33.605580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:33.608325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:33.609844 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6a7683dd-e4c2-420c-8dde-86dded7ede8f tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1362 microversion: 2.57 time: 0.217594 Apr 30 21:39:33.610907 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2741/5581] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:33 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:34.330567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c899b854-e3f9-4a55-a1a7-2d557b80cc44"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:34.333573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:34.341356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:34.342185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:34.344303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:34.344973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:34.629369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:34.630044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:34.637958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:34.638413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:34.639262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:34.640182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:34.745899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:34.758078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:34.760128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:34.761613 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97a7c468-b589-4a05-9957-7ecc12a457de tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1362 microversion: 2.57 time: 0.136939 Apr 30 21:39:34.774173 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2742/5582] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:34 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 21:39:35.648878 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.323384 Apr 30 21:39:35.657247 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2841/5583] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:39:34 2022] POST /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments => generated 194 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:35.780618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:35.786466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:35.794358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:35.794813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:35.795609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:35.799233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:35.872520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:35.873359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:35.875245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lazy-loading 'fault' on Instance uuid 2d284c9a-bab0-47e1-afb0-1d63c3fada5f {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:39:35.945187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:35.958419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:35.960724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a3c47bfc674540927a9360790a838a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232aa02ba6444b5a0acb5ffe699e2bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:35.962661 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f78a3363-14b0-4258-941e-1196e34d387a tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 200 len: 1367 microversion: 2.57 time: 0.185719 Apr 30 21:39:35.975867 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2743/5584] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:35 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 21:39:36.985606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:36.986446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] [instance: 2d284c9a-bab0-47e1-afb0-1d63c3fada5f] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:37.009169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:37.011448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:37.012358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:37.013426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:37.052564 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] HTTP exception thrown: Instance 2d284c9a-bab0-47e1-afb0-1d63c3fada5f could not be found. Apr 30 21:39:37.053197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] Returning 404 to user: Instance 2d284c9a-bab0-47e1-afb0-1d63c3fada5f could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:39:37.054156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af91761e-1149-493b-98d1-1313550d95c7 tempest-ServerShowV257Test-697411991 tempest-ServerShowV257Test-697411991-project] 10.222.0.23 "GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f" status: 404 len: 111 microversion: 2.57 time: 0.075600 Apr 30 21:39:37.054739 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2842/5585] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Apr 30 21:39:36 2022] GET /compute/v2.1/servers/2d284c9a-bab0-47e1-afb0-1d63c3fada5f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 21:39:38.421434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1240647616", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "42dfdf48-c6c6-46a0-a63e-be5c81eb3294"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1558320002", "security_groups": []}, "os:scheduler_hints": {"different_host": ["52562d91-9a05-4808-beff-dcf77ba8bb1d"]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:38.569912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] validate_networks() for [('42dfdf48-c6c6-46a0-a63e-be5c81eb3294', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:39:39.270896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:39:39.271600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:39:39.277825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:39:39.277825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:39:39.277825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:39:39.295267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:39.298456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:39.299902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:39.300529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:39.343400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for project 4e3f82b1b832495896f59d90477f6e44. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:39:39.368811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Getting quotas for user 63517d4efe294384832f5674aadc0c63 and project 4e3f82b1b832495896f59d90477f6e44. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:39:39.391521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:39:39.397534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:39:39.604379 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d591a077-461d-43b7-9f83-4474d022ff10 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.186251 Apr 30 21:39:39.605084 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2744/5586] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:39:38 2022] POST /compute/v2.1/servers => generated 361 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:39:39.617571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-617f4952-e3c9-4118-9037-487764255062 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:39.619116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-617f4952-e3c9-4118-9037-487764255062 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:39.716457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-617f4952-e3c9-4118-9037-487764255062 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:39.727705 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-617f4952-e3c9-4118-9037-487764255062 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1242 microversion: 2.1 time: 0.116134 Apr 30 21:39:39.728300 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2843/5587] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:39 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:40.360339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:40.361932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:40.369613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:40.370440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:40.371432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:40.371889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:40.404270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048241 Apr 30 21:39:40.404986 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2745/5588] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:39:40 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:40.415108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-671dd9a6-cb26-4150-aa5d-9138c6918764 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:40.415623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-671dd9a6-cb26-4150-aa5d-9138c6918764 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:40.423560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-671dd9a6-cb26-4150-aa5d-9138c6918764 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:40.424928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-671dd9a6-cb26-4150-aa5d-9138c6918764 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:40.426893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-671dd9a6-cb26-4150-aa5d-9138c6918764 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:40.433374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-671dd9a6-cb26-4150-aa5d-9138c6918764 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:40.536339 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-671dd9a6-cb26-4150-aa5d-9138c6918764 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/c899b854-e3f9-4a55-a1a7-2d557b80cc44" status: 200 len: 194 microversion: 2.1 time: 0.124944 Apr 30 21:39:40.537653 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2844/5589] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Apr 30 21:39:40 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/c899b854-e3f9-4a55-a1a7-2d557b80cc44 => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:40.710231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:40.711443 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b2cfd85-102e-495e-a1ca-c1431141b982 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002891 Apr 30 21:39:40.712803 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2746/5590] 10.222.0.23 () {56 vars in 885 bytes} [Sat Apr 30 21:39:40 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 30 21:39:40.749149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:40.756151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:40.771674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:40.772731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:40.775215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:40.775215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:40.869488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:40.877306 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-714cee67-1138-4623-ad44-b46985f91862 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1246 microversion: 2.1 time: 0.135213 Apr 30 21:39:40.880600 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2845/5591] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:40 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1246 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:41.897425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:41.898886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:41.908166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:41.908826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:41.909862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:41.910487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:42.022666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:42.038173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-22532a9d-26f6-4ddd-8455-a33e60d18bb6 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1294 microversion: 2.1 time: 0.146466 Apr 30 21:39:42.050009 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2747/5592] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:41 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1294 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:43.056836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:43.057472 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:43.070519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:43.070983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:43.074197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:43.074669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:43.181320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:43.229294 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16319569-9766-4c27-880b-9c4549e2a812 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.175810 Apr 30 21:39:43.243280 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2846/5593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:43 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:43.609896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb7c739b-a5e5-42b4-9411-768c5b32f40f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7defae2-9b5f-4f22-bbe5-a7f93f245557"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:43.612272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb7c739b-a5e5-42b4-9411-768c5b32f40f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:43.620971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb7c739b-a5e5-42b4-9411-768c5b32f40f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:43.621886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb7c739b-a5e5-42b4-9411-768c5b32f40f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:43.623198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb7c739b-a5e5-42b4-9411-768c5b32f40f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:43.623945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb7c739b-a5e5-42b4-9411-768c5b32f40f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:44.258622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:44.260086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:44.267410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:44.271283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:44.271283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:44.271283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:44.444745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:44.453127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-881c6798-c4e0-442e-b482-37bf57d77017 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.199796 Apr 30 21:39:44.453721 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2847/5594] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:44 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:44.609598 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb7c739b-a5e5-42b4-9411-768c5b32f40f tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "POST /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004458 Apr 30 21:39:44.610529 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2748/5595] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:39:43 2022] POST /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments => generated 194 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:39:45.059348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-cc1b2c05-3df2-4a09-ac2d-e3b6200236c6 req-3420cf66-3b56-40dc-b48d-df05b84da37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d531ff4-d4c6-4598-bf79-07833728a9dd", "tag": "ed3932ce-fe6c-4757-9579-d58a8422a738"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:45.074202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cc1b2c05-3df2-4a09-ac2d-e3b6200236c6 req-3420cf66-3b56-40dc-b48d-df05b84da37e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:45.074726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cc1b2c05-3df2-4a09-ac2d-e3b6200236c6 req-3420cf66-3b56-40dc-b48d-df05b84da37e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:45.087610 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-cc1b2c05-3df2-4a09-ac2d-e3b6200236c6 req-3420cf66-3b56-40dc-b48d-df05b84da37e service nova] Creating event network-changed:ed3932ce-fe6c-4757-9579-d58a8422a738 for instance 9d531ff4-d4c6-4598-bf79-07833728a9dd on nch1-master-1 Apr 30 21:39:45.094398 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-cc1b2c05-3df2-4a09-ac2d-e3b6200236c6 req-3420cf66-3b56-40dc-b48d-df05b84da37e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038620 Apr 30 21:39:45.095578 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2848/5596] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:45.472195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:45.473511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:45.498814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:45.500090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:45.501099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:45.501890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:45.603633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:45.618935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-158718ae-667c-4b89-b578-7f78239add3c tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.151335 Apr 30 21:39:45.620626 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2749/5597] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:45 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:46.638048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:46.638660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:46.644884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:46.645401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:46.646232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:46.646675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:46.732413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:46.740578 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08c3092b-3607-4d00-9333-32da087743a0 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.107775 Apr 30 21:39:46.741156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2849/5598] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:46 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:47.757890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:47.758476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:47.765300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:47.766304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:47.766732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:47.767189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:47.870347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:47.878008 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9de6300a-7e13-4b90-b203-dc65451f1cfc tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.124855 Apr 30 21:39:47.878686 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2750/5599] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:47 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:48.895809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:48.896446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:48.906676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:48.907143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:48.907953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:48.908403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:49.061411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:49.070831 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6366cff4-2763-4bfa-8eb7-1f94abac4b00 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.179604 Apr 30 21:39:49.072641 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2850/5600] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:48 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:50.089030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec38215e-6502-4c60-8887-a08fe80dbd45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:50.089609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:50.091357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ec38215e-6502-4c60-8887-a08fe80dbd45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:50.091938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:50.100739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.101560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.102476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.102986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.109644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec38215e-6502-4c60-8887-a08fe80dbd45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.110568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec38215e-6502-4c60-8887-a08fe80dbd45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.111593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec38215e-6502-4c60-8887-a08fe80dbd45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.112252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec38215e-6502-4c60-8887-a08fe80dbd45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.166090 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec38215e-6502-4c60-8887-a08fe80dbd45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.080583 Apr 30 21:39:50.175248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2751/5601] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:39:50 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:50.213836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:50.231139 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5e7e33b-0a74-4750-9fc7-dbd71081de0b tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.145768 Apr 30 21:39:50.236692 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2851/5602] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:50 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:50.337356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8f3bfd83-e79d-4371-837a-59faacef99c6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:50.339728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8f3bfd83-e79d-4371-837a-59faacef99c6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:50.353181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3bfd83-e79d-4371-837a-59faacef99c6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.353710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3bfd83-e79d-4371-837a-59faacef99c6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.354654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3bfd83-e79d-4371-837a-59faacef99c6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.355224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3bfd83-e79d-4371-837a-59faacef99c6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.426598 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8f3bfd83-e79d-4371-837a-59faacef99c6 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/c899b854-e3f9-4a55-a1a7-2d557b80cc44" status: 200 len: 194 microversion: 2.1 time: 0.093650 Apr 30 21:39:50.426598 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2752/5603] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Apr 30 21:39:50 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/c899b854-e3f9-4a55-a1a7-2d557b80cc44 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:50.436047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:50.436917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:50.444699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.448144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.449264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:50.451739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:50.587293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lazy-loading 'services' on Instance uuid 686ca208-0f15-455b-acdf-cdd63ffaee03 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:39:50.855226 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fee69417-9096-42a6-95fb-a2b4f9187586 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/c899b854-e3f9-4a55-a1a7-2d557b80cc44" status: 202 len: 0 microversion: 2.1 time: 0.424688 Apr 30 21:39:50.859265 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2852/5604] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:39:50 2022] DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/c899b854-e3f9-4a55-a1a7-2d557b80cc44 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:39:51.094260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c1c2d950-35ec-4514-a841-fdeab8cfc442 req-649b51e0-2ce1-43c4-ae6a-8e2a9b94dfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d531ff4-d4c6-4598-bf79-07833728a9dd", "name": "network-vif-plugged", "status": "completed", "tag": "ed3932ce-fe6c-4757-9579-d58a8422a738"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:51.117028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c1c2d950-35ec-4514-a841-fdeab8cfc442 req-649b51e0-2ce1-43c4-ae6a-8e2a9b94dfe9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:51.117540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c1c2d950-35ec-4514-a841-fdeab8cfc442 req-649b51e0-2ce1-43c4-ae6a-8e2a9b94dfe9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:51.134564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c1c2d950-35ec-4514-a841-fdeab8cfc442 req-649b51e0-2ce1-43c4-ae6a-8e2a9b94dfe9 service nova] Creating event network-vif-plugged:ed3932ce-fe6c-4757-9579-d58a8422a738 for instance 9d531ff4-d4c6-4598-bf79-07833728a9dd on nch1-master-1 Apr 30 21:39:51.141409 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c1c2d950-35ec-4514-a841-fdeab8cfc442 req-649b51e0-2ce1-43c4-ae6a-8e2a9b94dfe9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054477 Apr 30 21:39:51.149248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2753/5605] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:51.253884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:51.256221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:51.265596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:51.267256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:51.268841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:51.269594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:51.390632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:51.399999 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-365b649e-084d-47ec-b3da-1b58118f64aa tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.152213 Apr 30 21:39:51.402426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2853/5606] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:51 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:52.435752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:52.436455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:52.453842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:52.453842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:52.454578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:52.455239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:52.579019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:52.588274 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-add5da0d-dcf0-42e7-8099-0e7d8bb213d1 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1300 microversion: 2.1 time: 0.166659 Apr 30 21:39:52.590095 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2754/5607] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:52 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:53.052670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd4cdd09-056f-4ba5-a8a8-b94156afe15c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:53.053331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd4cdd09-056f-4ba5-a8a8-b94156afe15c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:53.079601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4cdd09-056f-4ba5-a8a8-b94156afe15c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.086048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4cdd09-056f-4ba5-a8a8-b94156afe15c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.087212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4cdd09-056f-4ba5-a8a8-b94156afe15c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.091248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd4cdd09-056f-4ba5-a8a8-b94156afe15c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.184738 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd4cdd09-056f-4ba5-a8a8-b94156afe15c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/a7defae2-9b5f-4f22-bbe5-a7f93f245557" status: 200 len: 194 microversion: 2.1 time: 0.139555 Apr 30 21:39:53.191654 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2854/5608] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Apr 30 21:39:53 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/a7defae2-9b5f-4f22-bbe5-a7f93f245557 => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:53.197636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:53.201150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:53.205189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.205646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.216502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.216972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.340363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lazy-loading 'services' on Instance uuid 686ca208-0f15-455b-acdf-cdd63ffaee03 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:39:53.606815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:53.607490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:53.614468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.615156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.615961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.616405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.626428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5d29590f-16e5-456c-ad88-cf9b6ce03871 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/a7defae2-9b5f-4f22-bbe5-a7f93f245557" status: 202 len: 0 microversion: 2.1 time: 0.432538 Apr 30 21:39:53.631774 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2755/5609] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:39:53 2022] DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments/a7defae2-9b5f-4f22-bbe5-a7f93f245557 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:39:53.733459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:53.742147 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-878e961e-a6ce-46cc-a538-aa5937858c3a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1472 microversion: 2.1 time: 0.139597 Apr 30 21:39:53.742959 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2855/5610] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:53 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1472 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:39:53.760063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:53.760783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:53.767659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.768336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.769655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.771295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.870266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:53.882348 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-915a0d9c-3d0c-4d2d-9138-bf4ad2628c06 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1472 microversion: 2.1 time: 0.123619 Apr 30 21:39:53.882348 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2756/5611] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:53 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1472 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:53.895618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88e300c7-ed77-4452-acd4-a6c2ac89dfd5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:53.896245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-88e300c7-ed77-4452-acd4-a6c2ac89dfd5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:53.904150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88e300c7-ed77-4452-acd4-a6c2ac89dfd5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.904593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88e300c7-ed77-4452-acd4-a6c2ac89dfd5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:53.905392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88e300c7-ed77-4452-acd4-a6c2ac89dfd5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:53.905858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88e300c7-ed77-4452-acd4-a6c2ac89dfd5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.005940 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-88e300c7-ed77-4452-acd4-a6c2ac89dfd5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1623 microversion: 2.1 time: 0.113862 Apr 30 21:39:54.014962 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2856/5612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:53 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1623 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:54.023148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-43458bfd-08d8-4be8-a9a4-d7f95cd278d5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:54.023771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-43458bfd-08d8-4be8-a9a4-d7f95cd278d5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:54.037980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43458bfd-08d8-4be8-a9a4-d7f95cd278d5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.040703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43458bfd-08d8-4be8-a9a4-d7f95cd278d5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.040703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43458bfd-08d8-4be8-a9a4-d7f95cd278d5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.040703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43458bfd-08d8-4be8-a9a4-d7f95cd278d5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.208835 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-43458bfd-08d8-4be8-a9a4-d7f95cd278d5 tempest-TestSecurityGroupsBasicOps-657194775 tempest-TestSecurityGroupsBasicOps-657194775-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1913 microversion: 2.1 time: 0.190532 Apr 30 21:39:54.210249 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2757/5613] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:54 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1913 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:54.281530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:54.283217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:54.293449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.294181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.295365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.295995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.328951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:39:54.801179 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cad26d61-41c5-4e4a-9f5e-c639166c8a37 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 204 len: 0 microversion: 2.1 time: 0.523439 Apr 30 21:39:54.803543 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2857/5614] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:39:54 2022] DELETE /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:39:54.811344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:54.812556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:54.819623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.819876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.830362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.831208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.841551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d141cb6-8862-4da8-806e-d031b7402b3c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:54.843157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d141cb6-8862-4da8-806e-d031b7402b3c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:54.858977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d141cb6-8862-4da8-806e-d031b7402b3c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.861182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d141cb6-8862-4da8-806e-d031b7402b3c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.862614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d141cb6-8862-4da8-806e-d031b7402b3c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:54.863075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d141cb6-8862-4da8-806e-d031b7402b3c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:54.911619 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d141cb6-8862-4da8-806e-d031b7402b3c tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075962 Apr 30 21:39:54.912230 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2858/5615] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:39:54 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:39:54.937676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:54.945968 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-029d4eee-4b84-45a8-86a4-5567c52fb542 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1478 microversion: 2.1 time: 0.138522 Apr 30 21:39:54.947089 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2758/5616] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:54 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1478 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:39:55.024377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d78a309e-3c04-425f-9209-75e31c1e7968 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:55.025902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d78a309e-3c04-425f-9209-75e31c1e7968 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:55.036181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d78a309e-3c04-425f-9209-75e31c1e7968 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.036877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d78a309e-3c04-425f-9209-75e31c1e7968 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:55.037882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d78a309e-3c04-425f-9209-75e31c1e7968 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.038458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d78a309e-3c04-425f-9209-75e31c1e7968 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:55.070114 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d78a309e-3c04-425f-9209-75e31c1e7968 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050295 Apr 30 21:39:55.070814 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2859/5617] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:39:55 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 21:39:55.136436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:55.136927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:55.145934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.146829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:55.147881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.148683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:55.179832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:39:55.505133 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b0aa51b6-edc5-4e38-a496-2b0edb91c3a0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 204 len: 0 microversion: 2.1 time: 0.373944 Apr 30 21:39:55.506714 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2759/5618] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:39:55 2022] DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:39:55.514862 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:55.516211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:55.525477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.526316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:55.527929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.528667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:55.684656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:55.693540 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2e2c4296-97d7-4f76-8fc4-0cca141c11b1 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1671 microversion: 2.1 time: 0.182812 Apr 30 21:39:55.697944 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2860/5619] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:55 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1671 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:39:55.965021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:55.966437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:55.975366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.976143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:55.977146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:55.978350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:56.065283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:56.074309 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f23235e6-6c11-4cdd-8f31-e23b3d765e5a tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1478 microversion: 2.1 time: 0.113482 Apr 30 21:39:56.075001 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2760/5620] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:55 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1478 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:56.712376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:56.713008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:56.720180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:56.720646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:56.721703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:56.722240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:56.947223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:56.956677 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b51ccec-f358-477d-bd76-690fce987ea2 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1671 microversion: 2.1 time: 0.249044 Apr 30 21:39:56.958095 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2861/5621] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:56 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:57.096835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:57.097307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:57.105452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:57.105941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:57.106905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:57.107371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:57.290470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:57.302734 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6215114c-65da-4e81-80de-150e67bb407d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1478 microversion: 2.1 time: 0.214032 Apr 30 21:39:57.303465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2761/5622] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:57 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:57.975958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:57.976589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:57.984567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:57.985276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:57.986301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:57.987008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:58.288738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:58.308518 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1806691d-99e7-4fc7-aef8-1838901b2060 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1671 microversion: 2.1 time: 0.337189 Apr 30 21:39:58.309125 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2862/5623] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:57 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1671 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:39:58.325609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:58.326355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:58.339638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:58.340184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:58.341035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:58.341493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:58.509287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:39:58.520876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74c5fff7-5a7a-43d4-ac7e-ea116a417df5 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1478 microversion: 2.1 time: 0.200493 Apr 30 21:39:58.535097 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2762/5624] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:58 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:39:58.739867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-41dde2a9-abf9-4055-adca-1a5a721e46d6 req-5c2f43f1-d557-4d8f-8fc1-b313de4c5f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d531ff4-d4c6-4598-bf79-07833728a9dd", "name": "network-vif-deleted", "tag": "ed3932ce-fe6c-4757-9579-d58a8422a738"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:39:58.761431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-41dde2a9-abf9-4055-adca-1a5a721e46d6 req-5c2f43f1-d557-4d8f-8fc1-b313de4c5f6c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:58.761932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-41dde2a9-abf9-4055-adca-1a5a721e46d6 req-5c2f43f1-d557-4d8f-8fc1-b313de4c5f6c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:58.789630 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-41dde2a9-abf9-4055-adca-1a5a721e46d6 req-5c2f43f1-d557-4d8f-8fc1-b313de4c5f6c service nova] Creating event network-vif-deleted:ed3932ce-fe6c-4757-9579-d58a8422a738 for instance 9d531ff4-d4c6-4598-bf79-07833728a9dd on nch1-master-1 Apr 30 21:39:58.807061 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-41dde2a9-abf9-4055-adca-1a5a721e46d6 req-5c2f43f1-d557-4d8f-8fc1-b313de4c5f6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070464 Apr 30 21:39:58.807702 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2863/5625] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:39:59.329595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:59.331078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:59.339151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:59.341457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:59.342728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:59.343501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:59.544779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:39:59.544779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:39:59.558974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:59.559439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:59.575219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:59.575689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:59.677389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:39:59.678123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:39:59.679528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lazy-loading 'fault' on Instance uuid 9d531ff4-d4c6-4598-bf79-07833728a9dd {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:40:00.009178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa67fb4ad4472183b95067597f043e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74e36d3bb384eeb92da16d1b201fc9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:40:00.020216 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55b72fa8-0c87-4e1c-bd9a-5d88ff2637ed tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 200 len: 1604 microversion: 2.1 time: 0.696550 Apr 30 21:40:00.033113 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2763/5626] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:59 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 1604 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:00.044509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-632ba054-8d21-487f-aebc-9b80843ed863 req-01183b70-a00d-4ab7-a871-7867fb9a802c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686ca208-0f15-455b-acdf-cdd63ffaee03", "name": "network-vif-deleted", "tag": "944ded8a-0542-4be0-87c6-04783f30015e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:00.055250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-632ba054-8d21-487f-aebc-9b80843ed863 req-01183b70-a00d-4ab7-a871-7867fb9a802c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:00.056146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-632ba054-8d21-487f-aebc-9b80843ed863 req-01183b70-a00d-4ab7-a871-7867fb9a802c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:00.073749 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-632ba054-8d21-487f-aebc-9b80843ed863 req-01183b70-a00d-4ab7-a871-7867fb9a802c service nova] Creating event network-vif-deleted:944ded8a-0542-4be0-87c6-04783f30015e for instance 686ca208-0f15-455b-acdf-cdd63ffaee03 on nch1-master-1 Apr 30 21:40:00.075894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:40:00.079321 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-632ba054-8d21-487f-aebc-9b80843ed863 req-01183b70-a00d-4ab7-a871-7867fb9a802c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044814 Apr 30 21:40:00.080467 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2764/5627] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:00.083980 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-11a7c749-17df-4919-8f13-8897899a8576 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 200 len: 1332 microversion: 2.1 time: 0.546204 Apr 30 21:40:00.095887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2864/5628] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:39:59 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 1332 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:01.040145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:01.040855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:01.048829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:01.049898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:01.051059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:01.052316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:01.069659 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] HTTP exception thrown: Instance 686ca208-0f15-455b-acdf-cdd63ffaee03 could not be found. Apr 30 21:40:01.070621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Returning 404 to user: Instance 686ca208-0f15-455b-acdf-cdd63ffaee03 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:01.071658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e127684a-1003-4ca3-ac0c-c43df209e970 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 404 len: 111 microversion: 2.1 time: 0.036458 Apr 30 21:40:01.072885 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2765/5629] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:01 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:01.081300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20969614-6ebb-4b76-8422-05a9f1acdd54 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '.version_select at 0x7fdc2063c790>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:01.112979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:01.114677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 9d531ff4-d4c6-4598-bf79-07833728a9dd] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:01.127077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:01.127077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:01.127077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:01.127077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:01.143126 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] HTTP exception thrown: Instance 9d531ff4-d4c6-4598-bf79-07833728a9dd could not be found. Apr 30 21:40:01.143736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Returning 404 to user: Instance 9d531ff4-d4c6-4598-bf79-07833728a9dd could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:01.144640 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dcf67011-b883-4352-9d37-0adb1a3ae75f tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd" status: 404 len: 111 microversion: 2.1 time: 0.036376 Apr 30 21:40:01.150446 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2766/5630] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:01 2022] GET /compute/v2.1/servers/9d531ff4-d4c6-4598-bf79-07833728a9dd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:01.186918 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20969614-6ebb-4b76-8422-05a9f1acdd54 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008603690" status: 202 len: 0 microversion: 2.1 time: 0.109472 Apr 30 21:40:01.193798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2865/5631] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:40:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008603690 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:40:02.644706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-91912473-d9ea-415c-a955-a7153551862d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:02.646267 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:40:02.646267 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:40:02.647997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91912473-d9ea-415c-a955-a7153551862d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:02.648577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91912473-d9ea-415c-a955-a7153551862d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:02.649508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91912473-d9ea-415c-a955-a7153551862d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:02.650095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-91912473-d9ea-415c-a955-a7153551862d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:02.682128 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-91912473-d9ea-415c-a955-a7153551862d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.205132 Apr 30 21:40:02.683483 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2767/5632] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Apr 30 21:40:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:02.843388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-975053353", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "17cfa9c0-17fc-46c0-8bcb-3651574af537"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:02.920394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] validate_networks() for [('17cfa9c0-17fc-46c0-8bcb-3651574af537', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:40:03.551961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:40:03.551961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:40:03.551961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:40:03.551961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:40:03.551961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:40:03.564111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:03.564578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:03.565416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:03.565910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:03.599814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Getting quotas for project af2dd6efb5894815bdd924b6dc6a5426. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:40:03.606438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Getting quotas for user c8667af135e44ce897538df8d12982b5 and project af2dd6efb5894815bdd924b6dc6a5426. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:40:03.625087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:40:03.627590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:40:03.757632 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35309a0d-9160-4c22-acee-5c14d0cfa7a6 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917917 Apr 30 21:40:03.760236 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2866/5633] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:40:03.773675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8542a4d0-6092-4b55-8ed7-f850fba10fc5 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:03.773675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8542a4d0-6092-4b55-8ed7-f850fba10fc5 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:03.846982 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8542a4d0-6092-4b55-8ed7-f850fba10fc5 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1328 microversion: 2.1 time: 0.080350 Apr 30 21:40:03.848746 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2768/5634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:03 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1328 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:04.865907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f477573-af9a-421d-95d6-c417263b198a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:04.867111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7f477573-af9a-421d-95d6-c417263b198a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:04.937019 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7f477573-af9a-421d-95d6-c417263b198a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1328 microversion: 2.1 time: 0.075205 Apr 30 21:40:04.951082 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2867/5635] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:04 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:05.963086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f36d4773-528f-454e-97a3-7a5e562bf2cf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:05.964016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f36d4773-528f-454e-97a3-7a5e562bf2cf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:05.975313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f36d4773-528f-454e-97a3-7a5e562bf2cf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:05.976087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f36d4773-528f-454e-97a3-7a5e562bf2cf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:05.984909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f36d4773-528f-454e-97a3-7a5e562bf2cf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:05.984909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f36d4773-528f-454e-97a3-7a5e562bf2cf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:06.280068 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f36d4773-528f-454e-97a3-7a5e562bf2cf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1337 microversion: 2.1 time: 0.326802 Apr 30 21:40:06.289667 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2769/5636] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:05 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1337 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:07.302766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a5564b0-0402-4b4f-9ab1-f717f3eb5b2c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:07.303404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a5564b0-0402-4b4f-9ab1-f717f3eb5b2c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:07.312066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a5564b0-0402-4b4f-9ab1-f717f3eb5b2c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:07.312496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a5564b0-0402-4b4f-9ab1-f717f3eb5b2c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:07.313303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a5564b0-0402-4b4f-9ab1-f717f3eb5b2c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:07.313786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a5564b0-0402-4b4f-9ab1-f717f3eb5b2c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:07.410663 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a5564b0-0402-4b4f-9ab1-f717f3eb5b2c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1433 microversion: 2.1 time: 0.112390 Apr 30 21:40:07.414124 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2868/5637] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:07 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1433 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:07.931573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:07.937554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:07.947359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-52a0da4d-6f85-4604-8f21-68df8b254be3 req-c12a2b27-36bf-44b3-bfdb-790e43dc7225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52562d91-9a05-4808-beff-dcf77ba8bb1d", "tag": "d898f6bb-ce69-41c8-89a5-a1b9c295ea2f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:07.960530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:07.969694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:07.969694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:07.969694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:07.970349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-52a0da4d-6f85-4604-8f21-68df8b254be3 req-c12a2b27-36bf-44b3-bfdb-790e43dc7225 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:07.970349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-52a0da4d-6f85-4604-8f21-68df8b254be3 req-c12a2b27-36bf-44b3-bfdb-790e43dc7225 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:07.997487 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-52a0da4d-6f85-4604-8f21-68df8b254be3 req-c12a2b27-36bf-44b3-bfdb-790e43dc7225 service nova] Creating event network-changed:d898f6bb-ce69-41c8-89a5-a1b9c295ea2f for instance 52562d91-9a05-4808-beff-dcf77ba8bb1d on nch2-master-1 Apr 30 21:40:08.021303 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-52a0da4d-6f85-4604-8f21-68df8b254be3 req-c12a2b27-36bf-44b3-bfdb-790e43dc7225 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076955 Apr 30 21:40:08.021948 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2869/5638] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:40:08.033095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:40:08.436103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bd054520-8c0a-49ab-bff1-2d67f2abe82d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:08.436856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bd054520-8c0a-49ab-bff1-2d67f2abe82d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:08.439794 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70f46d4e-5d2e-4022-a15f-eef9b3a31d6d tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 204 len: 0 microversion: 2.1 time: 0.515920 Apr 30 21:40:08.440797 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2770/5639] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:40:07 2022] DELETE /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:40:08.452532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd054520-8c0a-49ab-bff1-2d67f2abe82d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:08.452997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd054520-8c0a-49ab-bff1-2d67f2abe82d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:08.453219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:08.454313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd054520-8c0a-49ab-bff1-2d67f2abe82d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:08.455788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bd054520-8c0a-49ab-bff1-2d67f2abe82d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:08.455935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:08.465608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:08.466459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:08.467403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:08.468069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:08.753778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:40:08.756603 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bd054520-8c0a-49ab-bff1-2d67f2abe82d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1463 microversion: 2.1 time: 0.329238 Apr 30 21:40:08.759303 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2870/5640] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:08 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:08.762081 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e60a6df-58ed-4ebc-aa73-db6a602d05bf tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1768 microversion: 2.1 time: 0.316167 Apr 30 21:40:08.773306 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2771/5641] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:08 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1768 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:40:09.344986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-61d3ba97-7e12-4ea4-bb54-5c6686d824dd req-056cfffe-00bb-47bb-8a37-3dc6600c0c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6bc37e-bf6b-430b-8b66-31cad7d44aa8", "tag": "34aaf1e3-0ee3-4f7a-9896-612382bee0eb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:09.356420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-61d3ba97-7e12-4ea4-bb54-5c6686d824dd req-056cfffe-00bb-47bb-8a37-3dc6600c0c1f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:09.356913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-61d3ba97-7e12-4ea4-bb54-5c6686d824dd req-056cfffe-00bb-47bb-8a37-3dc6600c0c1f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:09.375539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-61d3ba97-7e12-4ea4-bb54-5c6686d824dd req-056cfffe-00bb-47bb-8a37-3dc6600c0c1f service nova] Creating event network-changed:34aaf1e3-0ee3-4f7a-9896-612382bee0eb for instance 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 on nch1-master-1 Apr 30 21:40:09.380234 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-61d3ba97-7e12-4ea4-bb54-5c6686d824dd req-056cfffe-00bb-47bb-8a37-3dc6600c0c1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040404 Apr 30 21:40:09.381461 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2871/5642] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:09.782287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44b53468-deda-4750-91ef-4d105fb6d1ff tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:09.785210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:09.786965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:09.791304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44b53468-deda-4750-91ef-4d105fb6d1ff tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:09.797055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:09.797540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:09.798861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:09.799498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:09.807271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44b53468-deda-4750-91ef-4d105fb6d1ff tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:09.809225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44b53468-deda-4750-91ef-4d105fb6d1ff tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:09.816345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44b53468-deda-4750-91ef-4d105fb6d1ff tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:09.816345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44b53468-deda-4750-91ef-4d105fb6d1ff tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:10.491455 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44b53468-deda-4750-91ef-4d105fb6d1ff tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1463 microversion: 2.1 time: 0.719337 Apr 30 21:40:10.494144 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2772/5643] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:09 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1463 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:10.503726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:40:10.516128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15ae8cbd-f5f2-46f3-b128-be75935900ea tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1768 microversion: 2.1 time: 0.739105 Apr 30 21:40:10.517387 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2872/5644] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:09 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1768 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:40:10.863528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d0be9f6c-0874-46d1-bf6b-fe935df7c3d7 req-5fd6657b-2c82-43f6-95ff-9810950842f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52562d91-9a05-4808-beff-dcf77ba8bb1d", "name": "network-vif-deleted", "tag": "d898f6bb-ce69-41c8-89a5-a1b9c295ea2f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:10.877513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d0be9f6c-0874-46d1-bf6b-fe935df7c3d7 req-5fd6657b-2c82-43f6-95ff-9810950842f1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:10.877513 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d0be9f6c-0874-46d1-bf6b-fe935df7c3d7 req-5fd6657b-2c82-43f6-95ff-9810950842f1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:10.885463 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d0be9f6c-0874-46d1-bf6b-fe935df7c3d7 req-5fd6657b-2c82-43f6-95ff-9810950842f1 service nova] Creating event network-vif-deleted:d898f6bb-ce69-41c8-89a5-a1b9c295ea2f for instance 52562d91-9a05-4808-beff-dcf77ba8bb1d on nch2-master-1 Apr 30 21:40:10.890712 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d0be9f6c-0874-46d1-bf6b-fe935df7c3d7 req-5fd6657b-2c82-43f6-95ff-9810950842f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030858 Apr 30 21:40:10.891469 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2773/5645] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:11.508071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-faa7b8c3-ecfa-4f34-ba87-73ef7041a6ea tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:11.509784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-faa7b8c3-ecfa-4f34-ba87-73ef7041a6ea tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:11.517220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa7b8c3-ecfa-4f34-ba87-73ef7041a6ea tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:11.519634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa7b8c3-ecfa-4f34-ba87-73ef7041a6ea tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:11.519634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa7b8c3-ecfa-4f34-ba87-73ef7041a6ea tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:11.519634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-faa7b8c3-ecfa-4f34-ba87-73ef7041a6ea tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:11.535616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:11.536912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:11.544932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:11.545399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:11.546263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:11.546718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:11.579511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:11.579981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:11.580382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lazy-loading 'fault' on Instance uuid 52562d91-9a05-4808-beff-dcf77ba8bb1d {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:40:11.630492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63517d4efe294384832f5674aadc0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3f82b1b832495896f59d90477f6e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:40:11.640896 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4a1da04-b5fd-47ad-9799-ec4cbc7f06c8 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 200 len: 1385 microversion: 2.1 time: 0.109993 Apr 30 21:40:11.651884 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2774/5646] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:11 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 1385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:11.688524 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-faa7b8c3-ecfa-4f34-ba87-73ef7041a6ea tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1463 microversion: 2.1 time: 0.184207 Apr 30 21:40:11.689337 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2873/5647] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:11 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:12.674216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:12.674776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] [instance: 52562d91-9a05-4808-beff-dcf77ba8bb1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:12.684225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:12.684966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:12.685533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:12.686028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:12.703421 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] HTTP exception thrown: Instance 52562d91-9a05-4808-beff-dcf77ba8bb1d could not be found. Apr 30 21:40:12.704229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Returning 404 to user: Instance 52562d91-9a05-4808-beff-dcf77ba8bb1d could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:12.705216 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eae25c53-f0bc-40d8-ba84-ba3bea4fb412 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d" status: 404 len: 111 microversion: 2.1 time: 0.035332 Apr 30 21:40:12.705803 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2775/5648] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:12 2022] GET /compute/v2.1/servers/52562d91-9a05-4808-beff-dcf77ba8bb1d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:12.707289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3156bf00-4a41-462b-a56d-0ab6b16d5efd tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:12.707919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3156bf00-4a41-462b-a56d-0ab6b16d5efd tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:12.722928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3156bf00-4a41-462b-a56d-0ab6b16d5efd tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:12.723902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3156bf00-4a41-462b-a56d-0ab6b16d5efd tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:12.726528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3156bf00-4a41-462b-a56d-0ab6b16d5efd tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:12.727510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3156bf00-4a41-462b-a56d-0ab6b16d5efd tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:12.906065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3156bf00-4a41-462b-a56d-0ab6b16d5efd tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1463 microversion: 2.1 time: 0.202983 Apr 30 21:40:12.906644 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2874/5649] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:12 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:13.186064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:13.186517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:13.201858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:13.202169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:13.202983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:13.203435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:13.226623 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] HTTP exception thrown: Instance 686ca208-0f15-455b-acdf-cdd63ffaee03 could not be found. Apr 30 21:40:13.227289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Returning 404 to user: Instance 686ca208-0f15-455b-acdf-cdd63ffaee03 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:13.228139 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8275267-b306-4683-94f9-a15057e56110 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 404 len: 111 microversion: 2.1 time: 0.047389 Apr 30 21:40:13.228703 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2776/5650] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:40:13 2022] DELETE /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:13.239029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:13.239738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 686ca208-0f15-455b-acdf-cdd63ffaee03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:13.246398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:13.247107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:13.248771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:13.249847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:13.294303 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] HTTP exception thrown: Instance 686ca208-0f15-455b-acdf-cdd63ffaee03 could not be found. Apr 30 21:40:13.294917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Returning 404 to user: Instance 686ca208-0f15-455b-acdf-cdd63ffaee03 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:13.295814 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9670171f-2482-4eaa-8670-29ff2a0c41fe tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03" status: 404 len: 111 microversion: 2.1 time: 0.061219 Apr 30 21:40:13.296571 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2875/5651] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:13 2022] GET /compute/v2.1/servers/686ca208-0f15-455b-acdf-cdd63ffaee03 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:13.926958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb7229c2-b477-42ca-bbb8-9e9e2cb242fb tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:13.926958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb7229c2-b477-42ca-bbb8-9e9e2cb242fb tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:13.945962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb7229c2-b477-42ca-bbb8-9e9e2cb242fb tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:13.949125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb7229c2-b477-42ca-bbb8-9e9e2cb242fb tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:13.949125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb7229c2-b477-42ca-bbb8-9e9e2cb242fb tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:13.949125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb7229c2-b477-42ca-bbb8-9e9e2cb242fb tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:14.106772 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb7229c2-b477-42ca-bbb8-9e9e2cb242fb tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1463 microversion: 2.1 time: 0.186579 Apr 30 21:40:14.107337 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2777/5652] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:13 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1463 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:40:15.125582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c3ee1294-4f07-4372-a333-a89e5d6d8e9b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:15.126961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c3ee1294-4f07-4372-a333-a89e5d6d8e9b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:15.133803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3ee1294-4f07-4372-a333-a89e5d6d8e9b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:15.134677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3ee1294-4f07-4372-a333-a89e5d6d8e9b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:15.135729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3ee1294-4f07-4372-a333-a89e5d6d8e9b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:15.136402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c3ee1294-4f07-4372-a333-a89e5d6d8e9b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:15.197324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-294561ae-58e8-42ec-875f-db88ab183823 req-dc717517-de0d-4fb4-baf6-637888620f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6bc37e-bf6b-430b-8b66-31cad7d44aa8", "name": "network-vif-plugged", "status": "completed", "tag": "34aaf1e3-0ee3-4f7a-9896-612382bee0eb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:15.211072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-294561ae-58e8-42ec-875f-db88ab183823 req-dc717517-de0d-4fb4-baf6-637888620f40 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:15.211834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-294561ae-58e8-42ec-875f-db88ab183823 req-dc717517-de0d-4fb4-baf6-637888620f40 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:15.225965 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-294561ae-58e8-42ec-875f-db88ab183823 req-dc717517-de0d-4fb4-baf6-637888620f40 service nova] Creating event network-vif-plugged:34aaf1e3-0ee3-4f7a-9896-612382bee0eb for instance 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 on nch1-master-1 Apr 30 21:40:15.231983 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-294561ae-58e8-42ec-875f-db88ab183823 req-dc717517-de0d-4fb4-baf6-637888620f40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038250 Apr 30 21:40:15.233555 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2778/5653] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:15.406228 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c3ee1294-4f07-4372-a333-a89e5d6d8e9b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1463 microversion: 2.1 time: 0.286050 Apr 30 21:40:15.416477 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2876/5654] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:15 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1463 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:16.424986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e17bf87-3540-43b1-9011-cb02994a44cc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:16.427320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e17bf87-3540-43b1-9011-cb02994a44cc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:16.433829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e17bf87-3540-43b1-9011-cb02994a44cc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:16.435913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e17bf87-3540-43b1-9011-cb02994a44cc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:16.435913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e17bf87-3540-43b1-9011-cb02994a44cc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:16.435913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e17bf87-3540-43b1-9011-cb02994a44cc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:16.831179 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e17bf87-3540-43b1-9011-cb02994a44cc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1463 microversion: 2.1 time: 0.411126 Apr 30 21:40:16.831779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2779/5655] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:16 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1463 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:17.431751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-601fe93d-8335-4929-8770-c1611508b524 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] Calling method '.version_select at 0x7fdc2041cee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:17.556015 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-601fe93d-8335-4929-8770-c1611508b524 tempest-TestSecurityGroupsBasicOps-1014845365 tempest-TestSecurityGroupsBasicOps-1014845365-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1558320002" status: 202 len: 0 microversion: 2.1 time: 0.128232 Apr 30 21:40:17.556702 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2877/5656] 10.222.0.23 () {58 vars in 1277 bytes} [Sat Apr 30 21:40:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1558320002 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:40:17.849640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-905eb0a9-476d-489a-99d7-4ebaa2eb7524 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:17.850616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-905eb0a9-476d-489a-99d7-4ebaa2eb7524 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:17.854017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:17.854557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:17.859578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-905eb0a9-476d-489a-99d7-4ebaa2eb7524 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:17.860256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-905eb0a9-476d-489a-99d7-4ebaa2eb7524 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:17.861598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:17.862099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:17.862889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:17.863334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:17.865527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-905eb0a9-476d-489a-99d7-4ebaa2eb7524 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:17.867590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-905eb0a9-476d-489a-99d7-4ebaa2eb7524 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:17.882281 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] HTTP exception thrown: Instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 could not be found. Apr 30 21:40:17.883276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Returning 404 to user: Instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:17.884354 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bdac2958-4ea6-44c0-8848-db7a69b98f45 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 404 len: 111 microversion: 2.1 time: 0.034282 Apr 30 21:40:17.885409 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2878/5657] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:40:17 2022] DELETE /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:17.893333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:17.894647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] [instance: 8fcbb4e2-1923-405f-a669-b3d5d68bfda6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:17.901342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:17.901636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:17.902461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:17.902910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:17.920731 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] HTTP exception thrown: Instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 could not be found. Apr 30 21:40:17.921343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] Returning 404 to user: Instance 8fcbb4e2-1923-405f-a669-b3d5d68bfda6 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:17.922418 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3ca2b76b-1d6d-4f6e-abb5-e1b511bee6f0 tempest-AttachVolumeTestJSON-628843456 tempest-AttachVolumeTestJSON-628843456-project] 10.222.0.23 "GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6" status: 404 len: 111 microversion: 2.1 time: 0.032936 Apr 30 21:40:17.925904 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2879/5658] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:17 2022] GET /compute/v2.1/servers/8fcbb4e2-1923-405f-a669-b3d5d68bfda6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:18.128819 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-905eb0a9-476d-489a-99d7-4ebaa2eb7524 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1649 microversion: 2.1 time: 0.283457 Apr 30 21:40:18.141711 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2780/5659] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:17 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1649 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:18.149359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab70e9d8-9a11-428f-8323-7768d61b896b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:18.150014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab70e9d8-9a11-428f-8323-7768d61b896b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:18.160327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab70e9d8-9a11-428f-8323-7768d61b896b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:18.162311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab70e9d8-9a11-428f-8323-7768d61b896b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:18.164722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab70e9d8-9a11-428f-8323-7768d61b896b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:18.165179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab70e9d8-9a11-428f-8323-7768d61b896b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:18.353610 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab70e9d8-9a11-428f-8323-7768d61b896b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1649 microversion: 2.1 time: 0.208897 Apr 30 21:40:18.354248 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2880/5660] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:18 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1649 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:18.371262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c667892c-e57b-45ab-92bf-6b0cb2e79688 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:18.372096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c667892c-e57b-45ab-92bf-6b0cb2e79688 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:18.378655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c667892c-e57b-45ab-92bf-6b0cb2e79688 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:18.379211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c667892c-e57b-45ab-92bf-6b0cb2e79688 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:18.381304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c667892c-e57b-45ab-92bf-6b0cb2e79688 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:18.381935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c667892c-e57b-45ab-92bf-6b0cb2e79688 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:18.776679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c667892c-e57b-45ab-92bf-6b0cb2e79688 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1649 microversion: 2.1 time: 0.290560 Apr 30 21:40:18.776679 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2781/5661] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:18 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1649 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:18.787634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-252985291", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "17cfa9c0-17fc-46c0-8bcb-3651574af537"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:18.872433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] validate_networks() for [('17cfa9c0-17fc-46c0-8bcb-3651574af537', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:40:19.259939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:40:19.260481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:40:19.261003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:40:19.261571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:40:19.262034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:40:19.273590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:19.274148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:19.274966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:19.275485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:19.296764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Getting quotas for project af2dd6efb5894815bdd924b6dc6a5426. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:40:19.302626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Getting quotas for user c8667af135e44ce897538df8d12982b5 and project af2dd6efb5894815bdd924b6dc6a5426. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:40:19.317670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:40:19.319838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:40:19.447807 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9524145f-19be-4014-af3d-f47c0b2d15fc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666272 Apr 30 21:40:19.454267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2881/5662] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:40:19.459869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e68ba20-7012-42b1-99d3-4de5ef536417 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:19.460555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e68ba20-7012-42b1-99d3-4de5ef536417 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:19.560480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e68ba20-7012-42b1-99d3-4de5ef536417 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1328 microversion: 2.1 time: 0.105119 Apr 30 21:40:19.565565 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2782/5663] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:19 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:40:20.597937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-027bc1f5-199b-4fa1-9648-a775219f2e11 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:20.597937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-027bc1f5-199b-4fa1-9648-a775219f2e11 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:20.606933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-027bc1f5-199b-4fa1-9648-a775219f2e11 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:20.613645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-027bc1f5-199b-4fa1-9648-a775219f2e11 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:20.613645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-027bc1f5-199b-4fa1-9648-a775219f2e11 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:20.613645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-027bc1f5-199b-4fa1-9648-a775219f2e11 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:20.711619 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-027bc1f5-199b-4fa1-9648-a775219f2e11 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1345 microversion: 2.1 time: 0.133010 Apr 30 21:40:20.712208 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2882/5664] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:20 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:21.730780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dfccdc45-e919-4ad7-90bd-0332e3f128ec tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:21.731486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dfccdc45-e919-4ad7-90bd-0332e3f128ec tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:21.741799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfccdc45-e919-4ad7-90bd-0332e3f128ec tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:21.741799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfccdc45-e919-4ad7-90bd-0332e3f128ec tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:21.742291 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfccdc45-e919-4ad7-90bd-0332e3f128ec tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:21.742894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dfccdc45-e919-4ad7-90bd-0332e3f128ec tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:21.859074 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dfccdc45-e919-4ad7-90bd-0332e3f128ec tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1423 microversion: 2.1 time: 0.130867 Apr 30 21:40:21.869357 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2783/5665] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:21 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:22.878309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-29727a16-accd-4d1b-8fd8-8eb0e1f73fbf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:22.880192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-29727a16-accd-4d1b-8fd8-8eb0e1f73fbf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:22.890952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29727a16-accd-4d1b-8fd8-8eb0e1f73fbf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:22.891628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29727a16-accd-4d1b-8fd8-8eb0e1f73fbf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:22.892535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29727a16-accd-4d1b-8fd8-8eb0e1f73fbf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:22.893054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29727a16-accd-4d1b-8fd8-8eb0e1f73fbf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:22.969736 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-29727a16-accd-4d1b-8fd8-8eb0e1f73fbf tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1421 microversion: 2.1 time: 0.096493 Apr 30 21:40:22.970349 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2883/5666] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:22 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:23.987959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c5fa089f-9f56-4a57-8fe2-1817e7a4f775 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:23.988720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c5fa089f-9f56-4a57-8fe2-1817e7a4f775 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:24.004474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5fa089f-9f56-4a57-8fe2-1817e7a4f775 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:24.005111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5fa089f-9f56-4a57-8fe2-1817e7a4f775 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:24.005998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5fa089f-9f56-4a57-8fe2-1817e7a4f775 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:24.006454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c5fa089f-9f56-4a57-8fe2-1817e7a4f775 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:24.191148 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c5fa089f-9f56-4a57-8fe2-1817e7a4f775 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1463 microversion: 2.1 time: 0.207890 Apr 30 21:40:24.192452 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2784/5667] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:23 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1463 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:24.234110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-63c6fad5-4073-4d97-b9b6-37b43ad0fb39 req-eca0011b-a708-452e-b32f-b295ac92b74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe6375b-31f0-4a9f-9cf6-357e9667a986", "tag": "578e460d-1625-4088-bd45-f1ae521cc7de"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:24.244623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-63c6fad5-4073-4d97-b9b6-37b43ad0fb39 req-eca0011b-a708-452e-b32f-b295ac92b74f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:24.245316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-63c6fad5-4073-4d97-b9b6-37b43ad0fb39 req-eca0011b-a708-452e-b32f-b295ac92b74f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:24.269350 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-63c6fad5-4073-4d97-b9b6-37b43ad0fb39 req-eca0011b-a708-452e-b32f-b295ac92b74f service nova] Creating event network-changed:578e460d-1625-4088-bd45-f1ae521cc7de for instance 8fe6375b-31f0-4a9f-9cf6-357e9667a986 on nch2-master-1 Apr 30 21:40:24.279559 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-63c6fad5-4073-4d97-b9b6-37b43ad0fb39 req-eca0011b-a708-452e-b32f-b295ac92b74f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051209 Apr 30 21:40:24.280753 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2884/5668] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:25.177014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d9b1580f-2865-489b-9da7-9393fc82fe70 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Action: 'create', calling method: .version_select at 0x7fdc20a741f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-374081725"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:25.212237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e397e4c3-701b-4df4-96ef-c6dd8abe7626 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:25.213106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e397e4c3-701b-4df4-96ef-c6dd8abe7626 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:25.219887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e397e4c3-701b-4df4-96ef-c6dd8abe7626 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:25.220349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e397e4c3-701b-4df4-96ef-c6dd8abe7626 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:25.221163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e397e4c3-701b-4df4-96ef-c6dd8abe7626 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:25.221610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e397e4c3-701b-4df4-96ef-c6dd8abe7626 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:25.481434 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e397e4c3-701b-4df4-96ef-c6dd8abe7626 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1463 microversion: 2.1 time: 0.273776 Apr 30 21:40:25.482121 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2885/5669] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:25 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:40:25.825941 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d9b1580f-2865-489b-9da7-9393fc82fe70 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.782182 Apr 30 21:40:25.826661 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2785/5670] 10.222.0.23 () {60 vars in 1154 bytes} [Sat Apr 30 21:40:25 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 784 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 21:40:25.838062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2a127b94-5a0e-4514-a7d8-94b4c99f491b tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc20458280>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:25.890720 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2a127b94-5a0e-4514-a7d8-94b4c99f491b tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 200 len: 337 microversion: 2.1 time: 0.056423 Apr 30 21:40:25.891308 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2886/5671] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:25 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 337 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:26.498818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad02d695-d383-45c8-925c-514369cccf41 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:26.500199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad02d695-d383-45c8-925c-514369cccf41 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:26.507746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02d695-d383-45c8-925c-514369cccf41 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:26.508208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02d695-d383-45c8-925c-514369cccf41 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:26.508994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02d695-d383-45c8-925c-514369cccf41 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:26.509439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad02d695-d383-45c8-925c-514369cccf41 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:26.643898 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad02d695-d383-45c8-925c-514369cccf41 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1463 microversion: 2.1 time: 0.148665 Apr 30 21:40:26.644477 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2786/5672] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:26 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:26.904932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e9efb1ac-6a45-4e1c-9529-76f680495d1e tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc1340b4c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:26.952451 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e9efb1ac-6a45-4e1c-9529-76f680495d1e tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 200 len: 338 microversion: 2.1 time: 0.052260 Apr 30 21:40:26.953027 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2887/5673] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:26 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 338 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:26.965087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2a90dea5-4945-4718-8a16-d9c28c91e426 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Action: 'create', calling method: .version_select at 0x7fdc20836ee0>, body: {"snapshot": {"volume_id": "313784e9-788a-46d4-8756-1a84b8db72b2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1852561685"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:27.397153 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2a90dea5-4945-4718-8a16-d9c28c91e426 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.435317 Apr 30 21:40:27.397764 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2787/5674] 10.222.0.23 () {60 vars in 1161 bytes} [Sat Apr 30 21:40:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:40:27.408522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a845eaa8-3596-4bda-892a-63c404d91263 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc20194b80>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:27.444943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a845eaa8-3596-4bda-892a-63c404d91263 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 200 len: 287 microversion: 2.1 time: 0.040484 Apr 30 21:40:27.445521 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2888/5675] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:27 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:27.455298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-699f1cad-ecd9-46f7-8f54-2666b0237a07 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc207d7e50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:27.488168 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-699f1cad-ecd9-46f7-8f54-2666b0237a07 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036709 Apr 30 21:40:27.499404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0404db76-2cbc-4cc6-85d1-37dd83f1808f tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc263569d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:27.503592 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2788/5676] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Apr 30 21:40:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:27.533478 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0404db76-2cbc-4cc6-85d1-37dd83f1808f tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 200 len: 287 microversion: 2.1 time: 0.038135 Apr 30 21:40:27.534698 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2889/5677] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:27 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:27.663264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8d2a9b0-1c93-4bbe-8b85-49060efbd634 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:27.663950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8d2a9b0-1c93-4bbe-8b85-49060efbd634 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:27.670872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8d2a9b0-1c93-4bbe-8b85-49060efbd634 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:27.671722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8d2a9b0-1c93-4bbe-8b85-49060efbd634 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:27.673115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8d2a9b0-1c93-4bbe-8b85-49060efbd634 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:27.673961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8d2a9b0-1c93-4bbe-8b85-49060efbd634 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:27.805959 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8d2a9b0-1c93-4bbe-8b85-49060efbd634 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1463 microversion: 2.1 time: 0.148853 Apr 30 21:40:27.806545 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2789/5678] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:27 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:28.547170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f00f25e3-d019-4902-833d-967b3af96653 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc262260d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:28.579617 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f00f25e3-d019-4902-833d-967b3af96653 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 200 len: 287 microversion: 2.1 time: 0.035782 Apr 30 21:40:28.579617 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2890/5679] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:28 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:28.823040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-54697ac1-214b-4b28-8d1e-85fd482b1c0a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:28.823696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-54697ac1-214b-4b28-8d1e-85fd482b1c0a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:28.830384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54697ac1-214b-4b28-8d1e-85fd482b1c0a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:28.830924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54697ac1-214b-4b28-8d1e-85fd482b1c0a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:28.831713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54697ac1-214b-4b28-8d1e-85fd482b1c0a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:28.832197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-54697ac1-214b-4b28-8d1e-85fd482b1c0a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:29.078120 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-54697ac1-214b-4b28-8d1e-85fd482b1c0a tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1463 microversion: 2.1 time: 0.258847 Apr 30 21:40:29.078735 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2790/5680] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:28 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:29.189664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-0480e5a5-1c71-4e2d-a34a-29d284cb4c81 req-21cdc811-968a-46e3-86a6-5ec67713e117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe6375b-31f0-4a9f-9cf6-357e9667a986", "name": "network-vif-plugged", "status": "completed", "tag": "578e460d-1625-4088-bd45-f1ae521cc7de"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:29.199534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0480e5a5-1c71-4e2d-a34a-29d284cb4c81 req-21cdc811-968a-46e3-86a6-5ec67713e117 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:29.199995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-0480e5a5-1c71-4e2d-a34a-29d284cb4c81 req-21cdc811-968a-46e3-86a6-5ec67713e117 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:29.211795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-0480e5a5-1c71-4e2d-a34a-29d284cb4c81 req-21cdc811-968a-46e3-86a6-5ec67713e117 service nova] Creating event network-vif-plugged:578e460d-1625-4088-bd45-f1ae521cc7de for instance 8fe6375b-31f0-4a9f-9cf6-357e9667a986 on nch2-master-1 Apr 30 21:40:29.216696 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-0480e5a5-1c71-4e2d-a34a-29d284cb4c81 req-21cdc811-968a-46e3-86a6-5ec67713e117 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 Apr 30 21:40:29.217295 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2891/5681] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:29.590676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2859b463-016e-41ac-bc39-5ae9debd1dd5 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc208360d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:29.620207 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2859b463-016e-41ac-bc39-5ae9debd1dd5 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 200 len: 288 microversion: 2.1 time: 0.033468 Apr 30 21:40:29.620836 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2791/5682] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:29 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:29.632945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6489d396-56ff-4294-82aa-97938ddb9c8a tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc204d4ee0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:29.749937 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6489d396-56ff-4294-82aa-97938ddb9c8a tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 202 len: 0 microversion: 2.1 time: 0.122597 Apr 30 21:40:29.750520 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2892/5683] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:40:29 2022] DELETE /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:40:29.762450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b251db4f-3127-4995-8685-cce8e244c5de tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc20ffff70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:29.795763 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b251db4f-3127-4995-8685-cce8e244c5de tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 200 len: 287 microversion: 2.1 time: 0.037081 Apr 30 21:40:29.796531 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2792/5684] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:29 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:30.098367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c329b372-2d0c-4285-a3ee-d9763dd8217f tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:30.100090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c329b372-2d0c-4285-a3ee-d9763dd8217f tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:30.109642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c329b372-2d0c-4285-a3ee-d9763dd8217f tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:30.110309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c329b372-2d0c-4285-a3ee-d9763dd8217f tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:30.111604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c329b372-2d0c-4285-a3ee-d9763dd8217f tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:30.113279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c329b372-2d0c-4285-a3ee-d9763dd8217f tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:30.289419 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c329b372-2d0c-4285-a3ee-d9763dd8217f tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1463 microversion: 2.1 time: 0.196879 Apr 30 21:40:30.290057 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2893/5685] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:30 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1463 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:30.809407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e293d4b3-67e6-4b63-a71a-ce5b99924b16 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc206f0e50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:30.840179 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e293d4b3-67e6-4b63-a71a-ce5b99924b16 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 200 len: 287 microversion: 2.1 time: 0.036530 Apr 30 21:40:30.840758 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2793/5686] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:30 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:31.307204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f96a55ff-1e2d-4907-a5a5-ba501709ac6b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:31.307826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f96a55ff-1e2d-4907-a5a5-ba501709ac6b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:31.314453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f96a55ff-1e2d-4907-a5a5-ba501709ac6b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.314908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f96a55ff-1e2d-4907-a5a5-ba501709ac6b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.315694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f96a55ff-1e2d-4907-a5a5-ba501709ac6b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.316141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f96a55ff-1e2d-4907-a5a5-ba501709ac6b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.451508 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f96a55ff-1e2d-4907-a5a5-ba501709ac6b tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1648 microversion: 2.1 time: 0.149071 Apr 30 21:40:31.452119 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2894/5687] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:31 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1648 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:31.467712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-333ca094-4abb-4cc7-8062-5e554d8696aa tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:31.468345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-333ca094-4abb-4cc7-8062-5e554d8696aa tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:31.474478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333ca094-4abb-4cc7-8062-5e554d8696aa tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.475491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333ca094-4abb-4cc7-8062-5e554d8696aa tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.476288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333ca094-4abb-4cc7-8062-5e554d8696aa tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.476737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333ca094-4abb-4cc7-8062-5e554d8696aa tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.692080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-333ca094-4abb-4cc7-8062-5e554d8696aa tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1648 microversion: 2.1 time: 0.228142 Apr 30 21:40:31.692672 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2794/5688] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:31 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1648 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:31.707742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eb14c393-b579-49cb-b316-c26c02d81d7c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:31.708414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eb14c393-b579-49cb-b316-c26c02d81d7c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:31.714845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb14c393-b579-49cb-b316-c26c02d81d7c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.715299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb14c393-b579-49cb-b316-c26c02d81d7c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.716104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb14c393-b579-49cb-b316-c26c02d81d7c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.716538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb14c393-b579-49cb-b316-c26c02d81d7c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.852922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1543d784-bf4b-48a2-9797-734dc451ab0b tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc211440d0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:31.922289 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eb14c393-b579-49cb-b316-c26c02d81d7c tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1648 microversion: 2.1 time: 0.217827 Apr 30 21:40:31.934551 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2895/5689] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:31 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1648 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:31.940480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:31.940920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:31.947415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.947878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.948691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:31.949136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:31.976706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:40:31.993872 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1543d784-bf4b-48a2-9797-734dc451ab0b tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 200 len: 287 microversion: 2.1 time: 0.145386 Apr 30 21:40:31.994453 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2795/5690] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:31 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:40:32.303851 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31b7fe01-b289-4815-ac83-d1fea6d24ec4 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 204 len: 0 microversion: 2.1 time: 0.366444 Apr 30 21:40:32.304457 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2896/5691] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:40:31 2022] DELETE /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:40:32.312594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ed289b25-d41a-4d2a-aaf2-0cc07db6920d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:32.313222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ed289b25-d41a-4d2a-aaf2-0cc07db6920d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:32.320038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed289b25-d41a-4d2a-aaf2-0cc07db6920d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:32.320502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed289b25-d41a-4d2a-aaf2-0cc07db6920d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:32.321282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed289b25-d41a-4d2a-aaf2-0cc07db6920d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:32.321810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed289b25-d41a-4d2a-aaf2-0cc07db6920d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:32.537064 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ed289b25-d41a-4d2a-aaf2-0cc07db6920d tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1654 microversion: 2.1 time: 0.228168 Apr 30 21:40:32.538672 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2796/5692] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:32 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1654 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:40:33.006478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-630c220b-6d46-4e16-b219-ef4164d7698d tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc262261f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:33.033272 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-630c220b-6d46-4e16-b219-ef4164d7698d tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] HTTP exception thrown: Snapshot 648512f7-cd57-4892-a374-42885b0b9c06 could not be found. Apr 30 21:40:33.033990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-630c220b-6d46-4e16-b219-ef4164d7698d tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Returning 404 to user: Snapshot 648512f7-cd57-4892-a374-42885b0b9c06 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:33.034801 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-630c220b-6d46-4e16-b219-ef4164d7698d tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06" status: 404 len: 111 microversion: 2.1 time: 0.033249 Apr 30 21:40:33.035358 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2897/5693] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:40:33 2022] GET /compute/v2.1/os-snapshots/648512f7-cd57-4892-a374-42885b0b9c06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:33.043668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5ad4d926-d3fa-4587-b189-770c4cfffad8 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc209c2940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:33.268952 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5ad4d926-d3fa-4587-b189-770c4cfffad8 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 202 len: 0 microversion: 2.1 time: 0.229069 Apr 30 21:40:33.269616 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2797/5694] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:40:33 2022] DELETE /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:40:33.280168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3930bdae-f579-4ca7-bcc1-e9ca931c6bbc tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc206409d0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:33.327590 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3930bdae-f579-4ca7-bcc1-e9ca931c6bbc tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 200 len: 337 microversion: 2.1 time: 0.052770 Apr 30 21:40:33.328250 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2898/5695] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:33 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 337 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:33.555599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-43d1b18a-9789-49ce-9be4-73d0c655ecc9 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:33.556227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-43d1b18a-9789-49ce-9be4-73d0c655ecc9 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:33.563117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d1b18a-9789-49ce-9be4-73d0c655ecc9 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:33.563576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d1b18a-9789-49ce-9be4-73d0c655ecc9 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:33.564378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d1b18a-9789-49ce-9be4-73d0c655ecc9 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:33.564808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43d1b18a-9789-49ce-9be4-73d0c655ecc9 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:33.898935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-43d1b18a-9789-49ce-9be4-73d0c655ecc9 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1654 microversion: 2.1 time: 0.347312 Apr 30 21:40:33.901276 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2798/5696] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:33 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1654 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:34.342320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ab9b479-2c3c-44a9-926d-5b7de8f4055e tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc2046f430>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:34.393506 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ab9b479-2c3c-44a9-926d-5b7de8f4055e tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 200 len: 337 microversion: 2.1 time: 0.056360 Apr 30 21:40:34.394523 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2899/5697] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:34 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 337 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:34.498610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c1f2b52d-bdae-47ec-a78e-48aa8c3c1bcf req-7104aca3-8f01-4b5b-b840-c70db9424cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe6375b-31f0-4a9f-9cf6-357e9667a986", "name": "network-vif-deleted", "tag": "578e460d-1625-4088-bd45-f1ae521cc7de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:34.520916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c1f2b52d-bdae-47ec-a78e-48aa8c3c1bcf req-7104aca3-8f01-4b5b-b840-c70db9424cbd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:34.521523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c1f2b52d-bdae-47ec-a78e-48aa8c3c1bcf req-7104aca3-8f01-4b5b-b840-c70db9424cbd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:34.535468 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c1f2b52d-bdae-47ec-a78e-48aa8c3c1bcf req-7104aca3-8f01-4b5b-b840-c70db9424cbd service nova] Creating event network-vif-deleted:578e460d-1625-4088-bd45-f1ae521cc7de for instance 8fe6375b-31f0-4a9f-9cf6-357e9667a986 on nch2-master-1 Apr 30 21:40:34.542171 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c1f2b52d-bdae-47ec-a78e-48aa8c3c1bcf req-7104aca3-8f01-4b5b-b840-c70db9424cbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047334 Apr 30 21:40:34.543149 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2799/5698] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:34.916691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:34.917432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:34.923965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:34.924425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:34.925211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:34.925661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:34.959594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:34.960044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:34.960495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lazy-loading 'fault' on Instance uuid 8fe6375b-31f0-4a9f-9cf6-357e9667a986 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:40:35.009271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-69070c9e-00ca-436d-9fe0-b6635ecbca25 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 200 len: 1453 microversion: 2.1 time: 0.096325 Apr 30 21:40:35.009868 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2900/5699] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:34 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:35.407335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d7284eb-39b5-4b8d-a6d6-05389136365b tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc13a7b5e0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:35.463077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d7284eb-39b5-4b8d-a6d6-05389136365b tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 200 len: 337 microversion: 2.1 time: 0.059962 Apr 30 21:40:35.463682 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2800/5700] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:35 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 337 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:36.029342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:36.030015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 8fe6375b-31f0-4a9f-9cf6-357e9667a986] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:36.038361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:36.039584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:36.040613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:36.041079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:36.055463 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] HTTP exception thrown: Instance 8fe6375b-31f0-4a9f-9cf6-357e9667a986 could not be found. Apr 30 21:40:36.056076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Returning 404 to user: Instance 8fe6375b-31f0-4a9f-9cf6-357e9667a986 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:36.060821 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b964a740-f456-4582-bf41-83a83880f5e8 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986" status: 404 len: 111 microversion: 2.1 time: 0.031758 Apr 30 21:40:36.060821 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2901/5701] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:36 2022] GET /compute/v2.1/servers/8fe6375b-31f0-4a9f-9cf6-357e9667a986 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:36.067050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:36.067703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:36.075085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:36.075542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:36.076316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:36.076934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:36.106888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:40:36.364872 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2df2e218-9146-4f45-bfa0-f85899a85ec3 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 204 len: 0 microversion: 2.1 time: 0.302263 Apr 30 21:40:36.365485 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2801/5702] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:40:36 2022] DELETE /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:40:36.373717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e8bde85c-a39b-40d1-85e8-07648d1cbd90 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:36.374375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e8bde85c-a39b-40d1-85e8-07648d1cbd90 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:36.381270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8bde85c-a39b-40d1-85e8-07648d1cbd90 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:36.381733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8bde85c-a39b-40d1-85e8-07648d1cbd90 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:36.382753 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8bde85c-a39b-40d1-85e8-07648d1cbd90 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:36.383203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8bde85c-a39b-40d1-85e8-07648d1cbd90 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:36.477924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c61ef41-b515-4c2f-9e19-28f78d787966 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc2094cc10>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:36.524427 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e8bde85c-a39b-40d1-85e8-07648d1cbd90 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1655 microversion: 2.1 time: 0.154371 Apr 30 21:40:36.525004 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2902/5703] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:36 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:36.551364 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c61ef41-b515-4c2f-9e19-28f78d787966 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 200 len: 337 microversion: 2.1 time: 0.077194 Apr 30 21:40:36.551364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2802/5704] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:36 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 337 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:37.541831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c759d479-0e31-4124-bdf0-0188dd2e3529 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:37.542386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c759d479-0e31-4124-bdf0-0188dd2e3529 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:37.549648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c759d479-0e31-4124-bdf0-0188dd2e3529 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:37.550362 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c759d479-0e31-4124-bdf0-0188dd2e3529 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:37.551229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c759d479-0e31-4124-bdf0-0188dd2e3529 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:37.551747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c759d479-0e31-4124-bdf0-0188dd2e3529 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:37.563882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b59abf4c-95a5-41f7-b648-e046a4cd2c76 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc21144820>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:37.598472 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b59abf4c-95a5-41f7-b648-e046a4cd2c76 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] HTTP exception thrown: Volume 313784e9-788a-46d4-8756-1a84b8db72b2 could not be found. Apr 30 21:40:37.599152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b59abf4c-95a5-41f7-b648-e046a4cd2c76 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Returning 404 to user: Volume 313784e9-788a-46d4-8756-1a84b8db72b2 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:37.600774 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b59abf4c-95a5-41f7-b648-e046a4cd2c76 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 404 len: 109 microversion: 2.1 time: 0.041559 Apr 30 21:40:37.601341 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2803/5705] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:37 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:40:37.612014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-86bd8a95-48e0-4908-8c53-30200e788413 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc20798940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:37.643404 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-86bd8a95-48e0-4908-8c53-30200e788413 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] HTTP exception thrown: Volume 313784e9-788a-46d4-8756-1a84b8db72b2 could not be found. Apr 30 21:40:37.644019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-86bd8a95-48e0-4908-8c53-30200e788413 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Returning 404 to user: Volume 313784e9-788a-46d4-8756-1a84b8db72b2 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:37.644869 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-86bd8a95-48e0-4908-8c53-30200e788413 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 404 len: 109 microversion: 2.1 time: 0.037455 Apr 30 21:40:37.645421 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2804/5706] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:40:37 2022] DELETE /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:37.654223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0824440-289a-4331-ac13-c459575377e3 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Calling method '.version_select at 0x7fdc13a7b700>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:37.703219 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c759d479-0e31-4124-bdf0-0188dd2e3529 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1655 microversion: 2.1 time: 0.165450 Apr 30 21:40:37.703978 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d0824440-289a-4331-ac13-c459575377e3 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] HTTP exception thrown: Volume 313784e9-788a-46d4-8756-1a84b8db72b2 could not be found. Apr 30 21:40:37.704096 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2903/5707] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:37 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:37.705632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0824440-289a-4331-ac13-c459575377e3 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] Returning 404 to user: Volume 313784e9-788a-46d4-8756-1a84b8db72b2 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:37.711914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0824440-289a-4331-ac13-c459575377e3 tempest-VolumesSnapshotsTestJSON-1027907309 tempest-VolumesSnapshotsTestJSON-1027907309-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2" status: 404 len: 109 microversion: 2.1 time: 0.061933 Apr 30 21:40:37.712636 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2805/5708] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:40:37 2022] GET /compute/v2.1/os-volumes/313784e9-788a-46d4-8756-1a84b8db72b2 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:40:38.551591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d99be2d7-b886-49a3-8972-c4b9e78412e0 req-1af192ef-3480-48af-9079-3f18d17fa7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6bc37e-bf6b-430b-8b66-31cad7d44aa8", "name": "network-vif-deleted", "tag": "34aaf1e3-0ee3-4f7a-9896-612382bee0eb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:40:38.570257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d99be2d7-b886-49a3-8972-c4b9e78412e0 req-1af192ef-3480-48af-9079-3f18d17fa7fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:38.570681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d99be2d7-b886-49a3-8972-c4b9e78412e0 req-1af192ef-3480-48af-9079-3f18d17fa7fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:38.583701 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d99be2d7-b886-49a3-8972-c4b9e78412e0 req-1af192ef-3480-48af-9079-3f18d17fa7fe service nova] Creating event network-vif-deleted:34aaf1e3-0ee3-4f7a-9896-612382bee0eb for instance 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 on nch1-master-1 Apr 30 21:40:38.589682 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d99be2d7-b886-49a3-8972-c4b9e78412e0 req-1af192ef-3480-48af-9079-3f18d17fa7fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041644 Apr 30 21:40:38.590556 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2904/5709] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:40:38.722767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46482bac-ecbc-4293-b0c8-44f133c9d680 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:38.725477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46482bac-ecbc-4293-b0c8-44f133c9d680 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:38.733881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46482bac-ecbc-4293-b0c8-44f133c9d680 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:38.734796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46482bac-ecbc-4293-b0c8-44f133c9d680 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:38.736349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46482bac-ecbc-4293-b0c8-44f133c9d680 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:38.737114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46482bac-ecbc-4293-b0c8-44f133c9d680 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:38.828260 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46482bac-ecbc-4293-b0c8-44f133c9d680 tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 200 len: 1448 microversion: 2.1 time: 0.110810 Apr 30 21:40:38.838096 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2806/5710] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:38 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 1448 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:40:39.848448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:40:39.849554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] [instance: 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:40:39.859198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:39.859801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:39.860588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:40:39.861032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:40:39.879262 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] HTTP exception thrown: Instance 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 could not be found. Apr 30 21:40:39.880162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] Returning 404 to user: Instance 3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:40:39.881536 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84729627-f997-4ada-8967-4a9cc36ccecc tempest-TestServerMultinode-256767118 tempest-TestServerMultinode-256767118-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8" status: 404 len: 111 microversion: 2.1 time: 0.039049 Apr 30 21:40:39.882387 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2905/5711] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:40:39 2022] GET /compute/v2.1/servers/3c6bc37e-bf6b-430b-8b66-31cad7d44aa8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:41:29.018358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] Calling method '.version_select at 0x7fdc20bebf70>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:41:29.019907 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:41:29.019907 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 21:41:29.021380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:41:29.022713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:41:29.038661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:41:29.039124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:41:29.050677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:41:29.051138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:41:29.057691 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2ed3a5b0-0607-4073-9d1f-9b623749e7de tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1561043854-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.176316 Apr 30 21:41:29.058693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2807/5712] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:41:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:43:07.489538 ncdv-master-1 devstack@n-api.service[130671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 21:43:07.656960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:07.657502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:43:07.663505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:07.663961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:07.664740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:07.665183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:07.694712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:43:07.986158 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-544a783b-742f-464d-8be8-415416f440fb tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 204 len: 0 microversion: 2.1 time: 0.498879 Apr 30 21:43:07.990043 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2906/5713] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:43:07 2022] DELETE /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:43:07.993526 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 21:43:07.994577 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 21:43:07.998640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:07.999451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:43:08.009024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:08.009559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:08.010597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:08.011117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:08.181125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:43:08.201069 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ae7dcf5-baf7-4f85-95d2-21ebb8a6afd6 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1733 microversion: 2.1 time: 0.202059 Apr 30 21:43:08.205594 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2808/5714] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:43:07 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:43:09.213420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:09.214179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:43:09.222211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:09.224765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:09.224765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:09.224765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:09.249396 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55376. Apr 30 21:43:09.366507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:43:09.374553 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-232134b9-1bd3-43fb-ac9a-72b75a7b8fc0 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1733 microversion: 2.1 time: 0.166182 Apr 30 21:43:09.375121 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2907/5715] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:43:09 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:43:10.393516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:10.394915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:43:10.403641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:10.405205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:10.405205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:10.405661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:10.429224 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55422. Apr 30 21:43:10.430721 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55420. Apr 30 21:43:10.484736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2e100e385e40fb9139cc6316c92159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede1fc028b654b819f147b9e5dde458e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:43:10.500749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f9d242cb-0906-409c-9d42-f76408dd089c req-f3ada698-7096-4327-bbff-ab5941eb6f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6e31e3-d94b-4292-9669-c2ed8f9c6180", "name": "network-vif-deleted", "tag": "d24f8b2f-d431-4caa-98b1-e20fd7c178a2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:43:10.501950 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b51ac2ae-8ff8-444c-9f4e-2c409abf2626 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 200 len: 1665 microversion: 2.1 time: 0.112562 Apr 30 21:43:10.502543 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2809/5716] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:43:10 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 1665 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:43:10.521500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f9d242cb-0906-409c-9d42-f76408dd089c req-f3ada698-7096-4327-bbff-ab5941eb6f00 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:10.521991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f9d242cb-0906-409c-9d42-f76408dd089c req-f3ada698-7096-4327-bbff-ab5941eb6f00 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:10.544363 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f9d242cb-0906-409c-9d42-f76408dd089c req-f3ada698-7096-4327-bbff-ab5941eb6f00 service nova] Creating event network-vif-deleted:d24f8b2f-d431-4caa-98b1-e20fd7c178a2 for instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 on nch1-master-1 Apr 30 21:43:10.550179 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f9d242cb-0906-409c-9d42-f76408dd089c req-f3ada698-7096-4327-bbff-ab5941eb6f00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053477 Apr 30 21:43:10.551803 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2908/5717] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:43:11.527820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:11.529195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:43:11.538177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:11.538853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:11.540368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:11.541186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:11.560432 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] HTTP exception thrown: Instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 could not be found. Apr 30 21:43:11.561276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Returning 404 to user: Instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:43:11.562428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f4bc952-e14a-40e3-af95-838ac9efce22 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 404 len: 111 microversion: 2.1 time: 0.041768 Apr 30 21:43:11.567582 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2810/5718] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:43:11 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:43:12.578082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:12.578712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:43:12.585857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:12.586861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:12.587641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:12.588085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:12.602267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] HTTP exception thrown: Instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 could not be found. Apr 30 21:43:12.602785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Returning 404 to user: Instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:43:12.603628 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d97d355b-8cef-4d1b-a267-896bacb604e8 tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 404 len: 111 microversion: 2.1 time: 0.029941 Apr 30 21:43:12.604171 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2909/5719] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:43:12 2022] DELETE /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:43:12.612289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:12.612917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] [instance: 5a6e31e3-d94b-4292-9669-c2ed8f9c6180] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:43:12.619690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:12.620153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:12.620938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:43:12.621387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:43:12.635457 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] HTTP exception thrown: Instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 could not be found. Apr 30 21:43:12.636064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Returning 404 to user: Instance 5a6e31e3-d94b-4292-9669-c2ed8f9c6180 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:43:12.636899 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-360e5b0d-f727-496d-be66-b9fb2f44bb2d tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180" status: 404 len: 111 microversion: 2.1 time: 0.028509 Apr 30 21:43:12.637647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2811/5720] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:43:12 2022] GET /compute/v2.1/servers/5a6e31e3-d94b-4292-9669-c2ed8f9c6180 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:43:12.865639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-95236c57-b597-4861-b3df-03ea398f8ade tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] Calling method '.version_select at 0x7fdc1347e8b0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:43:12.947900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-95236c57-b597-4861-b3df-03ea398f8ade tempest-TestServerBasicOps-220070941 tempest-TestServerBasicOps-220070941-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-615660911" status: 202 len: 0 microversion: 2.1 time: 0.086221 Apr 30 21:43:12.948574 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2910/5721] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-615660911 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:45:17.910275 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:45:17.910837 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 21:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:45:18.008456 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:45:18.008622 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 21:45:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:45:21.089414 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:45:21.090055 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 21:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:45:37.114650 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:45:37.115287 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 21:45:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:45:54.756295 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:45:54.756803 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 21:45:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:46:01.326377 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:46:01.326974 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 21:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:46:27.582413 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 21:46:27.584227 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 21:46:27.587975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dca28031-ecbf-42a8-8012-ea562a718fd9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Action: 'create', calling method: .version_select at 0x7fdc207084c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1608596903"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:27.602854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-dca28031-ecbf-42a8-8012-ea562a718fd9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Getting quotas for project abef47ea98c94b53836ceb8e201788f7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:46:27.608328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-dca28031-ecbf-42a8-8012-ea562a718fd9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Getting quotas for user 34a160f829dd4dc6af9f2254653dc0b8 and project abef47ea98c94b53836ceb8e201788f7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:46:27.810969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-dca28031-ecbf-42a8-8012-ea562a718fd9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Getting quotas for project abef47ea98c94b53836ceb8e201788f7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:46:27.816216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-dca28031-ecbf-42a8-8012-ea562a718fd9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Getting quotas for user 34a160f829dd4dc6af9f2254653dc0b8 and project abef47ea98c94b53836ceb8e201788f7. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:46:27.831392 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dca28031-ecbf-42a8-8012-ea562a718fd9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.250866 Apr 30 21:46:27.834824 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2812/5722] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:46:27 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:30.416005 ncdv-master-1 devstack@n-api.service[130671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [306cf566-6014-4b35-a2ad-51934902a33f] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 21:46:30.416874 ncdv-master-1 devstack@n-api.service[130671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 21:46:30.420934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1380014582", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "223065cf-14f3-4066-9159-1b9f16888528", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1608596903", "security_groups": [{"name": "tempest-secgroup-smoke-1185433765"}], "networks": [{"uuid": "6bd727f6-7263-495c-aa6d-b15a3908072b"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:30.666568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] validate_networks() for [('6bd727f6-7263-495c-aa6d-b15a3908072b', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:46:31.248784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:46:31.249213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:46:31.249690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:46:31.250245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:46:31.250663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:46:31.260518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:31.260976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:31.261819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:31.262267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:31.281873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Getting quotas for project abef47ea98c94b53836ceb8e201788f7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:46:31.287039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Getting quotas for user 34a160f829dd4dc6af9f2254653dc0b8 and project abef47ea98c94b53836ceb8e201788f7. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:46:31.348769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:46:31.351186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='223065cf-14f3-4066-9159-1b9f16888528',volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:46:31.428097 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58476. Apr 30 21:46:31.428930 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] [306cf566-6014-4b35-a2ad-51934902a33f] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58474. Apr 30 21:46:31.827494 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59166801-7a1a-40eb-946d-17ba88adada7 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.414069 Apr 30 21:46:31.828154 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2911/5723] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:46:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:46:31.840697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ccb06c5a-85ff-481a-ad6c-7c5cc3841d34 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:31.841327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ccb06c5a-85ff-481a-ad6c-7c5cc3841d34 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:31.853563 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58482. Apr 30 21:46:31.859359 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58484. Apr 30 21:46:31.966971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ccb06c5a-85ff-481a-ad6c-7c5cc3841d34 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:31.974103 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ccb06c5a-85ff-481a-ad6c-7c5cc3841d34 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1099 microversion: 2.1 time: 0.139734 Apr 30 21:46:31.980771 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2813/5724] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:31 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1099 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:32.991906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5b26b94-7870-48fa-aae4-ddab700daa97 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:32.992649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5b26b94-7870-48fa-aae4-ddab700daa97 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:33.051663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5b26b94-7870-48fa-aae4-ddab700daa97 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:33.059709 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5b26b94-7870-48fa-aae4-ddab700daa97 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1099 microversion: 2.1 time: 0.072521 Apr 30 21:46:33.060312 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2912/5725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:32 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1099 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:34.076592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:34.077251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:34.087651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:34.088118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:34.088905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:34.089354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:34.150790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:34.158598 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82afde21-13e3-45a2-bf4f-504e9ee2fad0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1197 microversion: 2.1 time: 0.086081 Apr 30 21:46:34.159336 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2814/5726] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:34 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:35.187012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:35.187012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:35.196028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:35.197242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:35.198163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:35.198794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:35.277433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:35.288578 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-801a837c-4aa0-4f52-98b0-808ecd95f59b tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1215 microversion: 2.1 time: 0.112498 Apr 30 21:46:35.295809 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2913/5727] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:35 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:36.306337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:36.306959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:36.313898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:36.314356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:36.315136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:36.315575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:36.478466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:36.488825 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a33a53b2-d3b2-49dc-822a-db33e00aaab1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1283 microversion: 2.1 time: 0.186746 Apr 30 21:46:36.489775 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2815/5728] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:36 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1283 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:36.743239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-1c1d649e-6e9e-41ab-a789-78f62a73747f req-90d9f08e-ab1a-4fc6-96c6-af3adff6b1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658846c-4db9-4a36-9de1-86476a6aa9a4", "tag": "83f36608-44f4-4502-9c2b-4aa0d74f0be3"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:36.752065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1c1d649e-6e9e-41ab-a789-78f62a73747f req-90d9f08e-ab1a-4fc6-96c6-af3adff6b1f1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:36.752482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-1c1d649e-6e9e-41ab-a789-78f62a73747f req-90d9f08e-ab1a-4fc6-96c6-af3adff6b1f1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:36.765209 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-1c1d649e-6e9e-41ab-a789-78f62a73747f req-90d9f08e-ab1a-4fc6-96c6-af3adff6b1f1 service nova] Creating event network-changed:83f36608-44f4-4502-9c2b-4aa0d74f0be3 for instance b658846c-4db9-4a36-9de1-86476a6aa9a4 on nch1-master-1 Apr 30 21:46:36.771574 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-1c1d649e-6e9e-41ab-a789-78f62a73747f req-90d9f08e-ab1a-4fc6-96c6-af3adff6b1f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113011 Apr 30 21:46:36.772694 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2914/5729] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:46:37.505716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:37.506357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:37.513208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:37.517736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:37.517736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:37.517736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:37.645150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:37.653489 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e6a8c43-117b-4980-b546-af52a7b3f9b1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.151780 Apr 30 21:46:37.654098 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2816/5730] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:37 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:38.677856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:38.678581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:38.685311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:38.685773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:38.686561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:38.687003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:38.824627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:38.832143 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-85382c65-038a-415a-9127-72e8ec509444 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.159438 Apr 30 21:46:38.832720 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2915/5731] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:38 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:39.848831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:39.849462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:39.856495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:39.856961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:39.857749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:39.858233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:40.008206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:40.015939 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7cef8cef-be92-4ce4-976c-7dec44b980a1 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.171065 Apr 30 21:46:40.016551 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2817/5732] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:39 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:41.036116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:41.036683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:41.043698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:41.044152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:41.044933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:41.045378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:41.178024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:41.187368 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ebb3dcb-d8b5-46b3-96fd-e56930c331f9 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.155220 Apr 30 21:46:41.187948 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2916/5733] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:41 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:42.204316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:42.204938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:42.211823 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:42.212275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:42.213049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:42.213496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:42.350893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:42.359080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93452bdb-53f9-4a35-8918-d08615812141 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.158760 Apr 30 21:46:42.359647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2818/5734] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:42 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:43.377182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:43.377831 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:43.385218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:43.385678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:43.386490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:43.386942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:43.522081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:43.529836 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7fa0306-21fa-4130-b8c5-cabd1611dfe3 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.156605 Apr 30 21:46:43.530515 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2917/5735] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:43 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:44.546989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:44.547555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:44.554369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:44.554825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:44.555661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:44.556107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:44.685706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:44.693541 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-04f2ef8f-751b-4e88-a6ad-eaf6d94ed28d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.150574 Apr 30 21:46:44.694193 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2819/5736] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:44 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:44.975214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-05ec847d-1ec0-42dd-88ce-f8878b52b502 req-53ca3c75-25a6-4f31-8c55-322059d30600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b658846c-4db9-4a36-9de1-86476a6aa9a4", "name": "network-vif-plugged", "status": "completed", "tag": "83f36608-44f4-4502-9c2b-4aa0d74f0be3"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:44.983279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-05ec847d-1ec0-42dd-88ce-f8878b52b502 req-53ca3c75-25a6-4f31-8c55-322059d30600 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:44.983728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-05ec847d-1ec0-42dd-88ce-f8878b52b502 req-53ca3c75-25a6-4f31-8c55-322059d30600 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:44.996812 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-05ec847d-1ec0-42dd-88ce-f8878b52b502 req-53ca3c75-25a6-4f31-8c55-322059d30600 service nova] Creating event network-vif-plugged:83f36608-44f4-4502-9c2b-4aa0d74f0be3 for instance b658846c-4db9-4a36-9de1-86476a6aa9a4 on nch1-master-1 Apr 30 21:46:45.002107 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-05ec847d-1ec0-42dd-88ce-f8878b52b502 req-53ca3c75-25a6-4f31-8c55-322059d30600 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099748 Apr 30 21:46:45.002759 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2918/5737] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:46:45.710959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:45.712522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:45.719326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:45.719781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:45.720558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:45.721004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:45.857294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:45.864801 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8577960-9f5b-481d-8ac9-bd153f32db9c tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.157729 Apr 30 21:46:45.865379 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2820/5738] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:45 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:46.881920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:46.882625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:46.890056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:46.890517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:46.891300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:46.891738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:47.032716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:47.040873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f2ddf8e4-ace8-4715-8ebf-e28f7f6e6ccb tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1271 microversion: 2.1 time: 0.163419 Apr 30 21:46:47.041448 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2919/5739] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:46 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:48.058455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:48.059082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:48.065982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:48.066451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:48.067235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:48.067682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:48.196150 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:48.204237 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c300587b-b7f0-4392-88a1-420e82f1783a tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1460 microversion: 2.1 time: 0.149684 Apr 30 21:46:48.204812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2821/5740] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:48 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:48.221025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:48.221641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:48.228684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:48.229139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:48.229943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:48.230385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:48.365543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:48.373127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ed2bee8-8843-47b2-8142-be191954f34d tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1460 microversion: 2.1 time: 0.156037 Apr 30 21:46:48.373693 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2920/5741] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:48 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1460 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:46:49.144407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-924383682", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "3afa63ee-7e45-4c03-a8c8-517cba3ed00e"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:49.201475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] validate_networks() for [('3afa63ee-7e45-4c03-a8c8-517cba3ed00e', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:46:49.615057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:46:49.615498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:46:49.615987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:46:49.616441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:46:49.616864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:46:49.626770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:49.627225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:49.628064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:49.628512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:49.646434 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Getting quotas for project d1febcefe29f461ea37667520a278022. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:46:49.652404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Getting quotas for user 0ed9fb1a529f4247acd72a6de21ceb4c and project d1febcefe29f461ea37667520a278022. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:46:49.666937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:46:49.669236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:46:49.808798 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f6c1f57-f673-4d19-9ba2-a29bcd103c6b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668320 Apr 30 21:46:49.809555 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2822/5742] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:46:49.821901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1e803d45-883d-480c-b33f-3d3e0a1afece tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:49.822634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1e803d45-883d-480c-b33f-3d3e0a1afece tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:49.907626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1e803d45-883d-480c-b33f-3d3e0a1afece tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:49.914539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1e803d45-883d-480c-b33f-3d3e0a1afece tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1218 microversion: 2.1 time: 0.097389 Apr 30 21:46:49.915263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2921/5743] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:49 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:50.897390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-08d9161f-e9c4-4453-b5ef-8730fede3412 req-36af6423-9d20-41fd-9552-8d670e66e694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658846c-4db9-4a36-9de1-86476a6aa9a4", "tag": "83f36608-44f4-4502-9c2b-4aa0d74f0be3"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:50.908015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-08d9161f-e9c4-4453-b5ef-8730fede3412 req-36af6423-9d20-41fd-9552-8d670e66e694 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:50.908469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-08d9161f-e9c4-4453-b5ef-8730fede3412 req-36af6423-9d20-41fd-9552-8d670e66e694 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:50.919729 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-08d9161f-e9c4-4453-b5ef-8730fede3412 req-36af6423-9d20-41fd-9552-8d670e66e694 service nova] Creating event network-changed:83f36608-44f4-4502-9c2b-4aa0d74f0be3 for instance b658846c-4db9-4a36-9de1-86476a6aa9a4 on nch1-master-1 Apr 30 21:46:50.932439 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-08d9161f-e9c4-4453-b5ef-8730fede3412 req-36af6423-9d20-41fd-9552-8d670e66e694 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038568 Apr 30 21:46:50.933286 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2823/5744] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:46:50.934695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80aae962-2a61-4fb8-a810-1a2562510eb6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:50.936109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80aae962-2a61-4fb8-a810-1a2562510eb6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:51.007875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80aae962-2a61-4fb8-a810-1a2562510eb6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:51.020164 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80aae962-2a61-4fb8-a810-1a2562510eb6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1218 microversion: 2.1 time: 0.091879 Apr 30 21:46:51.021576 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2922/5745] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:50 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:46:52.040580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:52.042637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:52.053003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:52.053406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:52.054384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:52.054849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:52.156190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:52.164202 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-01c97ee4-1ea4-4f8a-8732-9174b3f79a9f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1270 microversion: 2.1 time: 0.131086 Apr 30 21:46:52.171192 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2824/5746] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:52 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:46:52.559510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-160418d4-6bba-4bd7-bf7f-bb88266b0639 req-b4d34fba-6aa8-4b33-8319-bb75b6f34814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658846c-4db9-4a36-9de1-86476a6aa9a4", "tag": "83f36608-44f4-4502-9c2b-4aa0d74f0be3"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:52.569134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-160418d4-6bba-4bd7-bf7f-bb88266b0639 req-b4d34fba-6aa8-4b33-8319-bb75b6f34814 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:52.569600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-160418d4-6bba-4bd7-bf7f-bb88266b0639 req-b4d34fba-6aa8-4b33-8319-bb75b6f34814 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:52.587067 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-160418d4-6bba-4bd7-bf7f-bb88266b0639 req-b4d34fba-6aa8-4b33-8319-bb75b6f34814 service nova] Creating event network-changed:83f36608-44f4-4502-9c2b-4aa0d74f0be3 for instance b658846c-4db9-4a36-9de1-86476a6aa9a4 on nch1-master-1 Apr 30 21:46:52.592153 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-160418d4-6bba-4bd7-bf7f-bb88266b0639 req-b4d34fba-6aa8-4b33-8319-bb75b6f34814 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106481 Apr 30 21:46:52.592940 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2923/5747] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:46:53.181704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:53.182116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:53.188846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:53.189510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:53.190494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:53.191098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:53.349538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:53.357840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0fa7af58-29cc-456e-b005-f082774183ed tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1318 microversion: 2.1 time: 0.179999 Apr 30 21:46:53.358427 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2825/5748] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:53 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:54.381065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:54.382529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:54.397778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:54.398592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:54.399574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:54.400015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:54.618630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-200e0595-2121-459e-9ae1-ddf26e4a36f5 req-507fbbe7-74c7-4761-87a6-e0f40c6e408d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658846c-4db9-4a36-9de1-86476a6aa9a4", "tag": "83f36608-44f4-4502-9c2b-4aa0d74f0be3"}, {"name": "network-changed", "server_uuid": "8e903493-0587-46ef-9b8e-e3f6dbe73b64", "tag": "06ed68eb-7e63-4393-817d-09eba452925a"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:54.628457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-200e0595-2121-459e-9ae1-ddf26e4a36f5 req-507fbbe7-74c7-4761-87a6-e0f40c6e408d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:54.628968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-200e0595-2121-459e-9ae1-ddf26e4a36f5 req-507fbbe7-74c7-4761-87a6-e0f40c6e408d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:54.641564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-200e0595-2121-459e-9ae1-ddf26e4a36f5 req-507fbbe7-74c7-4761-87a6-e0f40c6e408d service nova] Creating event network-changed:83f36608-44f4-4502-9c2b-4aa0d74f0be3 for instance b658846c-4db9-4a36-9de1-86476a6aa9a4 on nch1-master-1 Apr 30 21:46:54.642309 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-200e0595-2121-459e-9ae1-ddf26e4a36f5 req-507fbbe7-74c7-4761-87a6-e0f40c6e408d service nova] Creating event network-changed:06ed68eb-7e63-4393-817d-09eba452925a for instance 8e903493-0587-46ef-9b8e-e3f6dbe73b64 on nch2-master-1 Apr 30 21:46:54.650469 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-200e0595-2121-459e-9ae1-ddf26e4a36f5 req-507fbbe7-74c7-4761-87a6-e0f40c6e408d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035525 Apr 30 21:46:54.651516 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2826/5749] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:46:54.677937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:54.685578 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-96475707-ac40-4d5d-b9aa-ab49c7841f23 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1318 microversion: 2.1 time: 0.312718 Apr 30 21:46:54.686385 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2924/5750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:54 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:55.704240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:55.704947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:55.711541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:55.711987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:55.712766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:55.713209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:56.246040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:56.254025 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d902e5fd-c978-4535-ba30-c1b9b489beee tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1318 microversion: 2.1 time: 0.555321 Apr 30 21:46:56.254613 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2827/5751] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:55 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:57.270868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:57.271688 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:57.279055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:57.279512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:57.281911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:57.281911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:57.411376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:57.418882 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa31bceb-d494-4bf9-a262-f0ac70d32bcf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1318 microversion: 2.1 time: 0.151965 Apr 30 21:46:57.419455 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2925/5752] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:57 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:58.435181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:58.435732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:58.443282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:58.443744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:58.444533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:58.444977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:58.587906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:58.595737 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4352e3a6-ccc0-4dcd-9bfc-8777f20f5e8e tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1318 microversion: 2.1 time: 0.164604 Apr 30 21:46:58.597214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2828/5753] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:58 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:46:59.071442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e117f685-5162-4b13-984d-63d662b65009 req-084d9540-b739-4ef9-8824-c6295c32c8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e903493-0587-46ef-9b8e-e3f6dbe73b64", "name": "network-vif-plugged", "status": "completed", "tag": "06ed68eb-7e63-4393-817d-09eba452925a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:46:59.080361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e117f685-5162-4b13-984d-63d662b65009 req-084d9540-b739-4ef9-8824-c6295c32c8e8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:59.080851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e117f685-5162-4b13-984d-63d662b65009 req-084d9540-b739-4ef9-8824-c6295c32c8e8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:59.091725 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e117f685-5162-4b13-984d-63d662b65009 req-084d9540-b739-4ef9-8824-c6295c32c8e8 service nova] Creating event network-vif-plugged:06ed68eb-7e63-4393-817d-09eba452925a for instance 8e903493-0587-46ef-9b8e-e3f6dbe73b64 on nch2-master-1 Apr 30 21:46:59.097211 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e117f685-5162-4b13-984d-63d662b65009 req-084d9540-b739-4ef9-8824-c6295c32c8e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029628 Apr 30 21:46:59.101991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2926/5754] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:46:59.613789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:46:59.614420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:46:59.621136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:59.621592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:59.622398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:46:59.622841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:46:59.759667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:46:59.768200 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-53f6aa07-1be0-4b29-b528-a874ba3335bc tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1318 microversion: 2.1 time: 0.158361 Apr 30 21:46:59.768874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2829/5755] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:46:59 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:00.786859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:00.787647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:00.793989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:00.794452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:00.795257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:00.795704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:00.935525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:00.943355 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d55ca470-61d6-4bb7-ae9c-bf6456801e4b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1507 microversion: 2.1 time: 0.162126 Apr 30 21:47:00.944207 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2927/5756] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:00 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:07.970333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6df2702f-aa61-4bdf-8568-dc1ef93b580a tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cef2a6ba-722a-421e-a3d7-963730a1eb11", "device": "/dev/sdb"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:47:07.972076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6df2702f-aa61-4bdf-8568-dc1ef93b580a tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:07.978798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6df2702f-aa61-4bdf-8568-dc1ef93b580a tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:07.979340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6df2702f-aa61-4bdf-8568-dc1ef93b580a tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:07.980204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6df2702f-aa61-4bdf-8568-dc1ef93b580a tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:07.980724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6df2702f-aa61-4bdf-8568-dc1ef93b580a tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:08.765492 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6df2702f-aa61-4bdf-8568-dc1ef93b580a tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "POST /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799149 Apr 30 21:47:08.766256 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2830/5757] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:47:07 2022] POST /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:47:47.092276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e86d2d42-2391-47e3-ad61-304e532184a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'create', calling method: .version_select at 0x7fdc204b6790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1021439937"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:47:47.108276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e86d2d42-2391-47e3-ad61-304e532184a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:47:47.114359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e86d2d42-2391-47e3-ad61-304e532184a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:47:47.509583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e86d2d42-2391-47e3-ad61-304e532184a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:47:47.514639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-e86d2d42-2391-47e3-ad61-304e532184a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:47:47.529266 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e86d2d42-2391-47e3-ad61-304e532184a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.441027 Apr 30 21:47:47.530600 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2928/5758] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:47:47 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:49.850922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1719682741", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "2bd705d2-50f2-4767-b7d1-c21957344019"}], "key_name": "tempest-TestNetworkBasicOps-1021439937", "security_groups": [{"name": "tempest-secgroup-smoke-811633989"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:47:49.962128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] validate_networks() for [('2bd705d2-50f2-4767-b7d1-c21957344019', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:47:50.326484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:47:50.326916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:47:50.327399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:47:50.327813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:47:50.328324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:47:50.338473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:50.339106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:50.340090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:50.340541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:50.358396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:47:50.363789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:47:50.379103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:47:50.379103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:47:50.516564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e36620cf-4152-4ce7-937c-6ad778587121 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.671079 Apr 30 21:47:50.517238 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2831/5759] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:47:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:47:50.531649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-94ceb8a3-fa76-42c3-b401-92a83698ee76 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:50.532766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-94ceb8a3-fa76-42c3-b401-92a83698ee76 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:50.587739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-94ceb8a3-fa76-42c3-b401-92a83698ee76 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:50.594377 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-94ceb8a3-fa76-42c3-b401-92a83698ee76 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1249 microversion: 2.1 time: 0.070450 Apr 30 21:47:50.597878 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2929/5760] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:50 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:51.611977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:51.612515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:51.620072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:51.620523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:51.621369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:51.621858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:51.695563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:51.699161 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e05ed9c5-69fe-4d33-a199-863575100eb8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1253 microversion: 2.1 time: 0.092124 Apr 30 21:47:51.699736 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2832/5761] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:51 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1253 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:52.716854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:52.717616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:52.726632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:52.727286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:52.728143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:52.728653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:52.795447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:52.803233 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3a152c9b-4681-4ff1-889d-ffae2724b45e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1309 microversion: 2.1 time: 0.090645 Apr 30 21:47:52.803806 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2930/5762] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:52 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:53.821450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:53.822115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:53.829909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:53.830384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:53.831352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:53.831808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:53.964846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:53.972524 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e9083bf-bcda-47eb-85f5-186b12e1886f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.155919 Apr 30 21:47:53.973125 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2833/5763] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:53 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:54.303940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-469eefd7-7b6f-4c16-84ad-97a9da810dd5 req-b247b52f-b443-4cf3-acda-f2ebd9260160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd5eae6-8fcd-480e-8105-0140f46d3f15", "tag": "0671ef54-efde-4401-afa6-2532e83c2ecb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:47:54.313067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-469eefd7-7b6f-4c16-84ad-97a9da810dd5 req-b247b52f-b443-4cf3-acda-f2ebd9260160 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:54.313530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-469eefd7-7b6f-4c16-84ad-97a9da810dd5 req-b247b52f-b443-4cf3-acda-f2ebd9260160 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:54.326794 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-469eefd7-7b6f-4c16-84ad-97a9da810dd5 req-b247b52f-b443-4cf3-acda-f2ebd9260160 service nova] Creating event network-changed:0671ef54-efde-4401-afa6-2532e83c2ecb for instance fbd5eae6-8fcd-480e-8105-0140f46d3f15 on nch1-master-1 Apr 30 21:47:54.332363 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-469eefd7-7b6f-4c16-84ad-97a9da810dd5 req-b247b52f-b443-4cf3-acda-f2ebd9260160 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032917 Apr 30 21:47:54.333279 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2931/5764] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:47:54.991090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:54.991651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:54.998627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:54.999095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:54.999907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:55.000335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:55.142752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:55.150525 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5d36e05-811b-4faf-ae6f-4c18a191aa56 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.163966 Apr 30 21:47:55.151664 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2834/5765] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:54 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:56.169452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:56.170110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:56.176819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:56.179532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:56.179532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:56.179532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:56.313101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:56.321888 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d5e9a315-cc94-4d07-b854-f7a171e7b1b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.157232 Apr 30 21:47:56.322468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2932/5766] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:56 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:57.339687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:57.340347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:57.347487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:57.347956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:57.348748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:57.349272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:57.481347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:57.488837 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1985d481-0e28-4096-8450-0bf5e197c384 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.153141 Apr 30 21:47:57.489412 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2835/5767] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:57 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:58.506204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:58.506820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:58.513855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:58.514294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:58.515071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:58.515509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:58.654535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:58.661944 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc698311-a54a-44bb-989c-42f0cfa92496 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.160017 Apr 30 21:47:58.662516 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2933/5768] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:58 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:47:59.679458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:47:59.680071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:47:59.686932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:59.687398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:59.688188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:47:59.688639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:47:59.833013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:47:59.841091 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ac81c5c-f905-4f8b-a2ce-9ba08a807fc0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.165641 Apr 30 21:47:59.841663 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2836/5769] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:47:59 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:00.858676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:00.859295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:00.866217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:00.866677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:00.867455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:00.867899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:01.000317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:01.008253 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-614e9916-6a1b-4312-aacd-0255beb2ffaf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.153052 Apr 30 21:48:01.008825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2934/5770] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:00 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:01.270079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2da2fb19-6658-4ed5-aa98-09720e36e96f req-81fbc618-d609-469c-82b2-8ab52db8aa02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd5eae6-8fcd-480e-8105-0140f46d3f15", "name": "network-vif-plugged", "status": "completed", "tag": "0671ef54-efde-4401-afa6-2532e83c2ecb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:01.280547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2da2fb19-6658-4ed5-aa98-09720e36e96f req-81fbc618-d609-469c-82b2-8ab52db8aa02 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:01.281036 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2da2fb19-6658-4ed5-aa98-09720e36e96f req-81fbc618-d609-469c-82b2-8ab52db8aa02 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:01.292402 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2da2fb19-6658-4ed5-aa98-09720e36e96f req-81fbc618-d609-469c-82b2-8ab52db8aa02 service nova] Creating event network-vif-plugged:0671ef54-efde-4401-afa6-2532e83c2ecb for instance fbd5eae6-8fcd-480e-8105-0140f46d3f15 on nch1-master-1 Apr 30 21:48:01.297694 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2da2fb19-6658-4ed5-aa98-09720e36e96f req-81fbc618-d609-469c-82b2-8ab52db8aa02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031565 Apr 30 21:48:01.298340 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2837/5771] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:48:02.025973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:02.026598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:02.032960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:02.035841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:02.035841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:02.035841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:02.164896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:02.172297 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f04bb9e-acb7-42af-aa6e-817fe7d3351c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1374 microversion: 2.1 time: 0.151083 Apr 30 21:48:02.172870 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2935/5772] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:02 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:03.189749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:03.191867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:03.196843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:03.197298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:03.198257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:03.198703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:03.334983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:03.343408 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d272365-2355-4e5b-84bd-fad65d48ce09 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1546 microversion: 2.1 time: 0.158092 Apr 30 21:48:03.343989 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2838/5773] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:03 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:03.359855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:03.360468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:03.367162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:03.367617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:03.368390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:03.368828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:03.498260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:03.505712 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5e8cf097-c6bd-4987-8465-2358cc76c113 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1546 microversion: 2.1 time: 0.149686 Apr 30 21:48:03.506316 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2936/5774] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:03 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:05.555835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-21e8fab9-4ac5-4147-9328-68c8843f776e req-78b3fd9c-d256-4a5f-a7a0-ab5e28381503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd5eae6-8fcd-480e-8105-0140f46d3f15", "tag": "0671ef54-efde-4401-afa6-2532e83c2ecb"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:05.565781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-21e8fab9-4ac5-4147-9328-68c8843f776e req-78b3fd9c-d256-4a5f-a7a0-ab5e28381503 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:05.566307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-21e8fab9-4ac5-4147-9328-68c8843f776e req-78b3fd9c-d256-4a5f-a7a0-ab5e28381503 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:05.579198 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-21e8fab9-4ac5-4147-9328-68c8843f776e req-78b3fd9c-d256-4a5f-a7a0-ab5e28381503 service nova] Creating event network-changed:0671ef54-efde-4401-afa6-2532e83c2ecb for instance fbd5eae6-8fcd-480e-8105-0140f46d3f15 on nch1-master-1 Apr 30 21:48:05.584834 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-21e8fab9-4ac5-4147-9328-68c8843f776e req-78b3fd9c-d256-4a5f-a7a0-ab5e28381503 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Apr 30 21:48:05.586387 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2839/5775] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:48:29.877904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c4fa275-688e-41a5-9e9a-644459fa565a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:29.878863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c4fa275-688e-41a5-9e9a-644459fa565a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:29.885633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c4fa275-688e-41a5-9e9a-644459fa565a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:29.886181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c4fa275-688e-41a5-9e9a-644459fa565a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:29.886952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c4fa275-688e-41a5-9e9a-644459fa565a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:29.887393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c4fa275-688e-41a5-9e9a-644459fa565a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:29.935282 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c4fa275-688e-41a5-9e9a-644459fa565a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15/action" status: 200 len: 24565 microversion: 2.1 time: 0.061723 Apr 30 21:48:29.935929 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2937/5776] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:48:29 2022] POST /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15/action => generated 24565 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:48:45.794030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-89987012-5e33-4c78-b980-8c4b5f262c8d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'create', calling method: .version_select at 0x7fdc207089d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-873131139"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:45.807782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-89987012-5e33-4c78-b980-8c4b5f262c8d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:48:45.813228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-89987012-5e33-4c78-b980-8c4b5f262c8d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:48:46.212579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-89987012-5e33-4c78-b980-8c4b5f262c8d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:48:46.219628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-89987012-5e33-4c78-b980-8c4b5f262c8d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:48:46.236355 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-89987012-5e33-4c78-b980-8c4b5f262c8d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.446930 Apr 30 21:48:46.236972 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2840/5777] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:48:45 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:48.673784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1664700817", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "58c50a14-b8e4-422b-b888-1ef880ea4f55"}], "key_name": "tempest-TestNetworkBasicOps-873131139", "security_groups": [{"name": "tempest-secgroup-smoke-1861430591"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:48.777224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] validate_networks() for [('58c50a14-b8e4-422b-b888-1ef880ea4f55', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:48:49.153990 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:48:49.154422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:48:49.154905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:48:49.155316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:48:49.155731 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:48:49.165201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:49.165893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:49.166502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:49.166944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:49.186949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:48:49.192358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:48:49.204725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:48:49.207069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:48:49.312052 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-181a93dd-994a-45ad-aa7f-5d4498fd3c32 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.642727 Apr 30 21:48:49.312701 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2938/5778] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:48:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:48:49.323989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fcfae3df-81aa-4479-affb-deb7367345ef tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:49.324729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fcfae3df-81aa-4479-affb-deb7367345ef tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:49.388012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fcfae3df-81aa-4479-affb-deb7367345ef tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:49.393551 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fcfae3df-81aa-4479-affb-deb7367345ef tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1248 microversion: 2.1 time: 0.074553 Apr 30 21:48:49.394173 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2841/5779] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:49 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:50.412303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:50.412944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:50.422246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:50.422726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:50.423495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:50.423934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:50.485165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:50.492589 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8f257c1f-e9cc-40e9-b6fd-f58d0ed1b889 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1252 microversion: 2.1 time: 0.084971 Apr 30 21:48:50.493163 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2939/5780] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:50 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:51.508588 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:51.509105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:51.516262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:51.516728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:51.517542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:51.518020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:51.599075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:51.607711 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5852741f-6968-4358-be1a-cca67b3d9729 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1306 microversion: 2.1 time: 0.103129 Apr 30 21:48:51.608351 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2842/5781] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:51 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:52.630651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:52.631674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:52.638414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:52.638881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:52.639680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:52.640134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:52.861110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:52.869035 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-93db5cb8-d715-4a19-8e2e-e3869ec3a92f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.242369 Apr 30 21:48:52.869616 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2940/5782] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:52 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:53.073110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2d78fc03-6c87-43a1-afed-7d1dab2e5944 req-1235a416-ba58-4374-8920-c14e1d52fa79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b41050d-1a2f-4d73-ad3c-552e9c70e9b3", "tag": "ee7f6250-3cbb-4da0-91b0-207c0b7c0530"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:53.082991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d78fc03-6c87-43a1-afed-7d1dab2e5944 req-1235a416-ba58-4374-8920-c14e1d52fa79 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:53.083444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2d78fc03-6c87-43a1-afed-7d1dab2e5944 req-1235a416-ba58-4374-8920-c14e1d52fa79 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:53.103342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2d78fc03-6c87-43a1-afed-7d1dab2e5944 req-1235a416-ba58-4374-8920-c14e1d52fa79 service nova] Creating event network-changed:ee7f6250-3cbb-4da0-91b0-207c0b7c0530 for instance 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 on nch2-master-1 Apr 30 21:48:53.109036 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2d78fc03-6c87-43a1-afed-7d1dab2e5944 req-1235a416-ba58-4374-8920-c14e1d52fa79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050509 Apr 30 21:48:53.109920 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2843/5783] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:48:53.887373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:53.888583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:53.895838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:53.896372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:53.897163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:53.897614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:54.049845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:54.058106 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89ada629-b1fc-452c-a3df-5d5e97554a41 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.175173 Apr 30 21:48:54.058909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2941/5784] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:53 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:54.175037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:54.175900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-cf041e71-d4aa-485d-9d84-99f1f449edb5 req-c826aeaf-956a-4ba4-a9ac-dc4a3ec3c4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658846c-4db9-4a36-9de1-86476a6aa9a4", "tag": "83f36608-44f4-4502-9c2b-4aa0d74f0be3"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:54.176708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:54.188284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cf041e71-d4aa-485d-9d84-99f1f449edb5 req-c826aeaf-956a-4ba4-a9ac-dc4a3ec3c4b3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:54.189227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-cf041e71-d4aa-485d-9d84-99f1f449edb5 req-c826aeaf-956a-4ba4-a9ac-dc4a3ec3c4b3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:54.189599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:54.190367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:54.191406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:54.193176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:54.203677 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-cf041e71-d4aa-485d-9d84-99f1f449edb5 req-c826aeaf-956a-4ba4-a9ac-dc4a3ec3c4b3 service nova] Creating event network-changed:83f36608-44f4-4502-9c2b-4aa0d74f0be3 for instance b658846c-4db9-4a36-9de1-86476a6aa9a4 on nch1-master-1 Apr 30 21:48:54.211229 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-cf041e71-d4aa-485d-9d84-99f1f449edb5 req-c826aeaf-956a-4ba4-a9ac-dc4a3ec3c4b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039302 Apr 30 21:48:54.212436 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2942/5785] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:48:54.227270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:48:54.539994 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 204 len: 0 microversion: 2.1 time: 0.369341 Apr 30 21:48:54.543978 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2844/5786] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:48:54 2022] DELETE /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:48:54.550367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:54.551487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:54.558483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:54.559089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:54.560107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:54.560614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:54.706330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:54.715369 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-60521aa8-50ed-488b-a573-7aeccd9b8fdd tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1585 microversion: 2.1 time: 0.169731 Apr 30 21:48:54.715954 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2943/5787] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:54 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1585 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:55.076579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:55.077333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:55.084182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:55.088110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:55.088110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:55.088110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:55.228534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:55.236159 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-04422713-4474-48da-8e20-cbcb5af65897 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.163891 Apr 30 21:48:55.236737 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2845/5788] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:55 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:55.734343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:55.734958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:55.741882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:55.749187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:55.749187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:55.749187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:55.878408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:55.886588 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22a8116e-6c4f-4048-9a59-48d08d884fde tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1585 microversion: 2.1 time: 0.156224 Apr 30 21:48:55.887162 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2944/5789] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:55 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1585 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:56.258075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:56.258696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:56.265460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:56.265957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:56.267126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:56.267228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:56.397672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:56.405317 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5533f120-c583-4ed6-81d6-3acb9e5d6058 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.151251 Apr 30 21:48:56.405927 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2846/5790] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:56 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:56.904225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:56.904762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:56.912357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:56.912818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:56.913612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:56.914099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:57.059008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:57.066970 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-09f7a66f-cd27-447a-bfe4-f909630b7e95 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1466 microversion: 2.1 time: 0.167037 Apr 30 21:48:57.067568 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2945/5791] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:56 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:57.109356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7ee15551-d28e-4eb3-aa7e-5e406cb62cc5 req-2346e9be-7531-453e-94b5-7aa8e6a51599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b658846c-4db9-4a36-9de1-86476a6aa9a4", "name": "network-vif-deleted", "tag": "83f36608-44f4-4502-9c2b-4aa0d74f0be3"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:57.117411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7ee15551-d28e-4eb3-aa7e-5e406cb62cc5 req-2346e9be-7531-453e-94b5-7aa8e6a51599 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:57.117903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7ee15551-d28e-4eb3-aa7e-5e406cb62cc5 req-2346e9be-7531-453e-94b5-7aa8e6a51599 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:57.130243 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7ee15551-d28e-4eb3-aa7e-5e406cb62cc5 req-2346e9be-7531-453e-94b5-7aa8e6a51599 service nova] Creating event network-vif-deleted:83f36608-44f4-4502-9c2b-4aa0d74f0be3 for instance b658846c-4db9-4a36-9de1-86476a6aa9a4 on nch1-master-1 Apr 30 21:48:57.136160 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7ee15551-d28e-4eb3-aa7e-5e406cb62cc5 req-2346e9be-7531-453e-94b5-7aa8e6a51599 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030479 Apr 30 21:48:57.136966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2847/5792] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:48:57.423031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:57.423797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:57.430549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:57.430949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:57.431739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:57.432243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:57.577880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:57.585436 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de40d083-4828-46de-b68d-c473743e4df5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.166678 Apr 30 21:48:57.586040 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2946/5793] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:57 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:58.086455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:58.087206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:58.093940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:58.094413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:58.095323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:58.095780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:58.128287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:58.128779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:58.129248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lazy-loading 'fault' on Instance uuid b658846c-4db9-4a36-9de1-86476a6aa9a4 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:48:58.170532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a160f829dd4dc6af9f2254653dc0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abef47ea98c94b53836ceb8e201788f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:58.178280 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-29a364e7-73ba-40e1-9fb3-dd3cd4ad5a2f tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 200 len: 1235 microversion: 2.1 time: 0.097372 Apr 30 21:48:58.178876 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2848/5794] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:58 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:58.602328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:58.602844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:58.609548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:58.610296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:58.611075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:58.611534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:58.743228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:58.750890 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43510faa-619c-4543-9f6b-f03d7ee786e8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.152728 Apr 30 21:48:58.751466 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2947/5795] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:58 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:48:59.197038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:59.197620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] [instance: b658846c-4db9-4a36-9de1-86476a6aa9a4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:59.204520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:59.204982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:59.205779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:59.206241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:59.226318 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] HTTP exception thrown: Instance b658846c-4db9-4a36-9de1-86476a6aa9a4 could not be found. Apr 30 21:48:59.226934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Returning 404 to user: Instance b658846c-4db9-4a36-9de1-86476a6aa9a4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:48:59.227761 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bfd86617-ed9b-4c22-b321-a7db19b166f6 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4" status: 404 len: 111 microversion: 2.1 time: 0.034737 Apr 30 21:48:59.228414 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2849/5796] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:59 2022] GET /compute/v2.1/servers/b658846c-4db9-4a36-9de1-86476a6aa9a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:48:59.451078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7ec7991-7e60-47f3-848e-0c7451978d74 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] Calling method '.version_select at 0x7fdc2041c3a0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:59.533927 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7ec7991-7e60-47f3-848e-0c7451978d74 tempest-TestVolumeBackupRestore-1350104366 tempest-TestVolumeBackupRestore-1350104366-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1608596903" status: 202 len: 0 microversion: 2.1 time: 0.086772 Apr 30 21:48:59.534562 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2948/5797] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:48:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1608596903 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:48:59.609397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-87c03aec-c73b-4847-8593-a50f092d28c8 req-176ed8d6-285a-4a4e-80ad-922ad3385bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41050d-1a2f-4d73-ad3c-552e9c70e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "ee7f6250-3cbb-4da0-91b0-207c0b7c0530"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:48:59.617579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-87c03aec-c73b-4847-8593-a50f092d28c8 req-176ed8d6-285a-4a4e-80ad-922ad3385bdb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:59.618069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-87c03aec-c73b-4847-8593-a50f092d28c8 req-176ed8d6-285a-4a4e-80ad-922ad3385bdb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:59.629244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-87c03aec-c73b-4847-8593-a50f092d28c8 req-176ed8d6-285a-4a4e-80ad-922ad3385bdb service nova] Creating event network-vif-plugged:ee7f6250-3cbb-4da0-91b0-207c0b7c0530 for instance 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 on nch2-master-1 Apr 30 21:48:59.634315 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-87c03aec-c73b-4847-8593-a50f092d28c8 req-176ed8d6-285a-4a4e-80ad-922ad3385bdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028661 Apr 30 21:48:59.634899 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2850/5798] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:48:59.768460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:48:59.769121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:48:59.777328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:59.777809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:59.778623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:48:59.779066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:48:59.925117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:48:59.930303 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-852a9022-8397-40a8-97fe-f7b8ca1fecdf tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.165649 Apr 30 21:48:59.940557 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2949/5799] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:48:59 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:00.948087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:00.948795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:00.959081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:00.959859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:00.961161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:00.961692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:01.097161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:01.105377 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bcf27b78-9104-4742-8a14-86040000eac7 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1374 microversion: 2.1 time: 0.162471 Apr 30 21:49:01.105975 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2851/5800] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:00 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:02.122403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:02.123021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:02.129201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:02.129655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:02.130459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:02.131408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:02.265083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:02.273566 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99f5e45e-6b00-4422-883f-5bbeedb17f67 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1546 microversion: 2.1 time: 0.155179 Apr 30 21:49:02.279430 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2950/5801] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:02 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:02.293426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:02.294073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:02.300964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:02.301590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:02.302407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:02.302883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:02.434443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:02.441929 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bcfc5ddf-cbc6-4006-ab08-474b989d3e58 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1546 microversion: 2.1 time: 0.152469 Apr 30 21:49:02.442501 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2852/5802] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:02 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:07.174710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:07.175800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:07.183288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:07.187828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:07.187828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:07.187828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:07.281680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lazy-loading 'services' on Instance uuid 8e903493-0587-46ef-9b8e-e3f6dbe73b64 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:49:07.516394 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e289124f-3216-4bfb-a312-f8279ffca408 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64/os-volume_attachments/cef2a6ba-722a-421e-a3d7-963730a1eb11" status: 202 len: 0 microversion: 2.1 time: 0.345467 Apr 30 21:49:07.536733 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2951/5803] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:49:07 2022] DELETE /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64/os-volume_attachments/cef2a6ba-722a-421e-a3d7-963730a1eb11 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:49:08.643381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:08.644038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:08.652138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:08.652671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:08.653461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:08.653944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:08.681277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:49:08.995564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ab850f9-5049-45bb-985f-db86552f4871 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 204 len: 0 microversion: 2.1 time: 0.355759 Apr 30 21:49:08.996286 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2853/5804] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:49:08 2022] DELETE /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:49:09.006665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:09.007462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:09.013729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:09.014291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:09.015069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:09.015511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:09.151739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:09.161051 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f8b41f43-67dd-415b-89be-46b7b215b2ea tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1513 microversion: 2.1 time: 0.160114 Apr 30 21:49:09.161628 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2952/5805] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:08 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:10.179056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:10.179774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:10.186663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:10.187126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:10.187907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:10.188354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:10.322077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:10.329517 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18cefac3-323a-439a-8ec2-9f9f9737e9ec tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1513 microversion: 2.1 time: 0.154835 Apr 30 21:49:10.330440 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2854/5806] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:10 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:11.114977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3d350387-5be0-4968-b583-2f87a3935de4 req-f4fbc8f4-4431-4d94-8dc2-269e6e37f62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e903493-0587-46ef-9b8e-e3f6dbe73b64", "name": "network-vif-deleted", "tag": "06ed68eb-7e63-4393-817d-09eba452925a"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:11.124993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3d350387-5be0-4968-b583-2f87a3935de4 req-f4fbc8f4-4431-4d94-8dc2-269e6e37f62f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:11.125561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3d350387-5be0-4968-b583-2f87a3935de4 req-f4fbc8f4-4431-4d94-8dc2-269e6e37f62f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:11.138973 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3d350387-5be0-4968-b583-2f87a3935de4 req-f4fbc8f4-4431-4d94-8dc2-269e6e37f62f service nova] Creating event network-vif-deleted:06ed68eb-7e63-4393-817d-09eba452925a for instance 8e903493-0587-46ef-9b8e-e3f6dbe73b64 on nch2-master-1 Apr 30 21:49:11.145035 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3d350387-5be0-4968-b583-2f87a3935de4 req-f4fbc8f4-4431-4d94-8dc2-269e6e37f62f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033848 Apr 30 21:49:11.146528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2953/5807] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:49:11.347276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:11.347989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:11.354979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:11.355436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:11.356212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:11.356891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:11.422970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:11.431149 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8fc24d9d-c93e-4ba2-8165-ef0666189e03 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 200 len: 1303 microversion: 2.1 time: 0.087916 Apr 30 21:49:11.431796 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2855/5808] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:11 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:12.447945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:12.448657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: 8e903493-0587-46ef-9b8e-e3f6dbe73b64] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:12.455738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:12.456197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:12.456981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:12.457427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:12.470989 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] HTTP exception thrown: Instance 8e903493-0587-46ef-9b8e-e3f6dbe73b64 could not be found. Apr 30 21:49:12.471594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Returning 404 to user: Instance 8e903493-0587-46ef-9b8e-e3f6dbe73b64 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:49:12.472436 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fd12cf00-e2bd-44c3-bd32-001822de69cd tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64" status: 404 len: 111 microversion: 2.1 time: 0.028875 Apr 30 21:49:12.472982 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2954/5809] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:12 2022] GET /compute/v2.1/servers/8e903493-0587-46ef-9b8e-e3f6dbe73b64 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:49:23.886311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-531843706", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "3afa63ee-7e45-4c03-a8c8-517cba3ed00e"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:23.949637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] validate_networks() for [('3afa63ee-7e45-4c03-a8c8-517cba3ed00e', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:49:24.375784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:49:24.376226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:49:24.376714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:49:24.377136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:49:24.377568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:49:24.387339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:24.387798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:24.388660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:24.389113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:24.412974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Getting quotas for project d1febcefe29f461ea37667520a278022. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:49:24.418941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Getting quotas for user 0ed9fb1a529f4247acd72a6de21ceb4c and project d1febcefe29f461ea37667520a278022. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:49:24.431969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:49:24.435028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:49:24.550289 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-00dee6cb-34e8-444a-a531-631ed0b12c51 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667578 Apr 30 21:49:24.550951 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2856/5810] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:49:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 21:49:24.562093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0560e12a-c460-422d-a800-d2f01af25089 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:24.563300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0560e12a-c460-422d-a800-d2f01af25089 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:24.630121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0560e12a-c460-422d-a800-d2f01af25089 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:24.638883 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0560e12a-c460-422d-a800-d2f01af25089 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1218 microversion: 2.1 time: 0.080630 Apr 30 21:49:24.639657 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2955/5811] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:24 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:25.656571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:25.657078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:25.664752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:25.665209 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:25.666029 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:25.666590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:25.734808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:25.742959 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc41a627-9fbd-4a0c-bbaf-2076447c65d1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1222 microversion: 2.1 time: 0.090446 Apr 30 21:49:25.743539 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2857/5812] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:25 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:26.759909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:26.760547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:26.768441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:26.768900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:26.769804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:26.770252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:26.835030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:26.842768 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-93b124ca-a94f-44bc-b3d2-6f9a1012bd17 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1288 microversion: 2.1 time: 0.086939 Apr 30 21:49:26.845985 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2956/5813] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:26 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:27.861691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:27.862341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:27.869708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:27.870210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:27.871004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:27.871456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:28.001680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:28.010304 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e75ebb7-c5c5-4c9f-bbb7-824afd7f7a67 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.152561 Apr 30 21:49:28.010824 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2858/5814] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:27 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:29.028248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:29.028871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:29.035877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:29.036499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:29.037279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:29.037724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:29.170447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:29.178095 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75dc82ae-6070-455d-941c-a87ba8ce484c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.153884 Apr 30 21:49:29.179240 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2957/5815] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:29 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:29.427073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3b72b6e5-9495-410f-897d-87b21ed3e85d req-8f14ca32-ddc8-4f34-8adf-1cce49d07431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81dbbed-6eeb-4227-be53-e56c759b5bb9", "tag": "b042542b-4779-45e4-97f5-1694f1b001e5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:29.436806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3b72b6e5-9495-410f-897d-87b21ed3e85d req-8f14ca32-ddc8-4f34-8adf-1cce49d07431 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:29.437280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3b72b6e5-9495-410f-897d-87b21ed3e85d req-8f14ca32-ddc8-4f34-8adf-1cce49d07431 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:29.449306 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3b72b6e5-9495-410f-897d-87b21ed3e85d req-8f14ca32-ddc8-4f34-8adf-1cce49d07431 service nova] Creating event network-changed:b042542b-4779-45e4-97f5-1694f1b001e5 for instance b81dbbed-6eeb-4227-be53-e56c759b5bb9 on nch1-master-1 Apr 30 21:49:29.454610 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3b72b6e5-9495-410f-897d-87b21ed3e85d req-8f14ca32-ddc8-4f34-8adf-1cce49d07431 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031785 Apr 30 21:49:29.455294 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2859/5816] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:49:29.479835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:29.480710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:29.492868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:29.496055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:29.496946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:29.497396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:29.531629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:49:29.795252 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-90ec8eb0-7a5d-41f2-ab81-8af90dc42785 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 204 len: 0 microversion: 2.1 time: 0.319984 Apr 30 21:49:29.795868 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2958/5817] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:49:29 2022] DELETE /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:49:29.805566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:29.806313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:29.813240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:29.813705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:29.814540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:29.815230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:29.954938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:29.963220 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2884d2f-f419-4f14-b7b0-0eec32dcd63e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1552 microversion: 2.1 time: 0.162598 Apr 30 21:49:29.964115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2860/5818] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:29 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:30.196739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:30.197444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:30.204511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:30.204838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:30.205629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:30.206102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:30.342588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:30.350800 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dbf2760b-42bc-49c6-a719-93525c123d7b tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.158450 Apr 30 21:49:30.351382 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2959/5819] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:30 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:30.981278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:30.982246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:30.989541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:30.990054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:30.990880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:30.991331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:31.120630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:31.128173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6f97639d-6442-4739-ad5c-994bdcb32c93 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1552 microversion: 2.1 time: 0.150870 Apr 30 21:49:31.128744 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2861/5820] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:30 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:31.369155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:31.370099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:31.377221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:31.377710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:31.380611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:31.380611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:31.575089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:31.583159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-313fdfe9-0b3e-458f-8751-61145d2a2b1c tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.218664 Apr 30 21:49:31.586678 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2960/5821] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:31 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:31.770705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-60e46686-dcd9-4e25-b37e-506c7c4097fc req-5ca564f7-c754-410c-a870-01ae649b23fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41050d-1a2f-4d73-ad3c-552e9c70e9b3", "name": "network-vif-deleted", "tag": "ee7f6250-3cbb-4da0-91b0-207c0b7c0530"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:31.779516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60e46686-dcd9-4e25-b37e-506c7c4097fc req-5ca564f7-c754-410c-a870-01ae649b23fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:31.782119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60e46686-dcd9-4e25-b37e-506c7c4097fc req-5ca564f7-c754-410c-a870-01ae649b23fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:31.791235 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-60e46686-dcd9-4e25-b37e-506c7c4097fc req-5ca564f7-c754-410c-a870-01ae649b23fc service nova] Creating event network-vif-deleted:ee7f6250-3cbb-4da0-91b0-207c0b7c0530 for instance 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 on nch2-master-1 Apr 30 21:49:31.796124 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-60e46686-dcd9-4e25-b37e-506c7c4097fc req-5ca564f7-c754-410c-a870-01ae649b23fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029196 Apr 30 21:49:31.796712 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2862/5822] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:49:32.145283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:32.145928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:32.153149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:32.153612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:32.154434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:32.154882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:32.187727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:32.188189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:32.188654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lazy-loading 'fault' on Instance uuid 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:49:32.233776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:32.242647 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c25b4cce-263b-4c28-9efc-47717fb4f3b3 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 200 len: 1338 microversion: 2.1 time: 0.101232 Apr 30 21:49:32.243904 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2961/5823] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:32 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:32.602263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:32.602888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:32.609203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:32.609716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:32.610517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:32.610966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:32.744572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:32.752277 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f4e9483-1ca9-47f6-8d54-b4a66cf392f5 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.155422 Apr 30 21:49:32.752850 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2863/5824] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:32 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:33.260396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:33.261021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:33.268377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:33.268826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:33.269616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:33.270094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:33.284373 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] HTTP exception thrown: Instance 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 could not be found. Apr 30 21:49:33.284981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Returning 404 to user: Instance 6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:49:33.288160 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-469bbdee-2e76-4d24-8a09-d5e1d862012e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3" status: 404 len: 111 microversion: 2.1 time: 0.030006 Apr 30 21:49:33.288160 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2962/5825] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:33 2022] GET /compute/v2.1/servers/6b41050d-1a2f-4d73-ad3c-552e9c70e9b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:49:33.526511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de1fc97a-417f-4a0d-a78e-e2dc1f340ba0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '.version_select at 0x7fdc200b0940>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:33.590219 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de1fc97a-417f-4a0d-a78e-e2dc1f340ba0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-873131139" status: 202 len: 0 microversion: 2.1 time: 0.068691 Apr 30 21:49:33.590812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2864/5826] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-873131139 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:49:33.769737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:33.770431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:33.777627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:33.778117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:33.778895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:33.779332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:33.917262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:33.930947 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee7d7ad4-eb90-4454-9488-c0fb2e4cb8b4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.164842 Apr 30 21:49:33.931983 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2963/5827] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:33 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:34.948985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:34.949603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:34.956374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:34.956847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:34.957644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:34.958122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:35.134046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:35.141534 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e45f575-bb51-4fc0-9de4-2fda96337564 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.197845 Apr 30 21:49:35.142220 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2865/5828] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:34 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:35.616478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f1b1d28c-6a8d-4ac2-aa3e-a42d89be7d9e req-88bfcd5d-5d0b-4b09-8031-9b7212ef91d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81dbbed-6eeb-4227-be53-e56c759b5bb9", "name": "network-vif-plugged", "status": "completed", "tag": "b042542b-4779-45e4-97f5-1694f1b001e5"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:35.629621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f1b1d28c-6a8d-4ac2-aa3e-a42d89be7d9e req-88bfcd5d-5d0b-4b09-8031-9b7212ef91d2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:35.630449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f1b1d28c-6a8d-4ac2-aa3e-a42d89be7d9e req-88bfcd5d-5d0b-4b09-8031-9b7212ef91d2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:35.643690 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f1b1d28c-6a8d-4ac2-aa3e-a42d89be7d9e req-88bfcd5d-5d0b-4b09-8031-9b7212ef91d2 service nova] Creating event network-vif-plugged:b042542b-4779-45e4-97f5-1694f1b001e5 for instance b81dbbed-6eeb-4227-be53-e56c759b5bb9 on nch1-master-1 Apr 30 21:49:35.648604 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f1b1d28c-6a8d-4ac2-aa3e-a42d89be7d9e req-88bfcd5d-5d0b-4b09-8031-9b7212ef91d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036392 Apr 30 21:49:35.650454 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2964/5829] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:49:35.663587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:35.665573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:35.669116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f0d6880f-82e1-4bed-9f0e-404155019cdb req-da0aa49e-46fc-4500-93d2-e7b84da38e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd5eae6-8fcd-480e-8105-0140f46d3f15", "tag": "0671ef54-efde-4401-afa6-2532e83c2ecb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:35.674311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:35.674969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:35.675787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:35.676246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:35.679459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f0d6880f-82e1-4bed-9f0e-404155019cdb req-da0aa49e-46fc-4500-93d2-e7b84da38e2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:35.679960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f0d6880f-82e1-4bed-9f0e-404155019cdb req-da0aa49e-46fc-4500-93d2-e7b84da38e2f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:35.692766 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f0d6880f-82e1-4bed-9f0e-404155019cdb req-da0aa49e-46fc-4500-93d2-e7b84da38e2f service nova] Creating event network-changed:0671ef54-efde-4401-afa6-2532e83c2ecb for instance fbd5eae6-8fcd-480e-8105-0140f46d3f15 on nch1-master-1 Apr 30 21:49:35.700273 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f0d6880f-82e1-4bed-9f0e-404155019cdb req-da0aa49e-46fc-4500-93d2-e7b84da38e2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036296 Apr 30 21:49:35.701421 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2965/5830] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:49:35.737876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:49:36.070459 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc0e06f0-3bf6-4c1a-b735-d35e8877a316 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 204 len: 0 microversion: 2.1 time: 0.411600 Apr 30 21:49:36.075822 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2866/5831] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:49:35 2022] DELETE /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:49:36.080759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:36.081709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:36.088299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:36.088763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:36.089553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:36.090199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:36.159448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:36.160162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:36.166560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:36.167088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:36.167871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:36.168636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:36.312040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:36.320478 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b3fcf56-d54a-496d-970b-b7c0b614b66a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1671 microversion: 2.1 time: 0.243963 Apr 30 21:49:36.321191 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2966/5832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:36 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1671 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:49:36.339115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:36.346718 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2fb3546a-2747-401e-a7c1-a6a4bcca3af6 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.192294 Apr 30 21:49:36.347364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2867/5833] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:36 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:49:37.338069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:37.338694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:37.345588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:37.346086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:37.346869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:37.347316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:37.364031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:37.364748 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:37.372388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:37.372916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:37.373740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:37.374332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:37.545773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:37.552586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:37.553239 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd7c4e6c-03ab-49c0-9695-0ac5ed617dd5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1671 microversion: 2.1 time: 0.219081 Apr 30 21:49:37.553834 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2967/5834] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:37 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:37.560547 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fbca3c5c-9dc7-4df5-bf9c-49047cc32e61 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1318 microversion: 2.1 time: 0.200392 Apr 30 21:49:37.561198 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2868/5835] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:37 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:49:38.562624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-17ebd144-898a-4411-b9c5-94600851e057 req-66344fb7-0306-46e8-a361-b07e8214a3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd5eae6-8fcd-480e-8105-0140f46d3f15", "name": "network-vif-deleted", "tag": "0671ef54-efde-4401-afa6-2532e83c2ecb"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:38.571070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:38.571070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:38.572033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-17ebd144-898a-4411-b9c5-94600851e057 req-66344fb7-0306-46e8-a361-b07e8214a3c6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:38.572220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-17ebd144-898a-4411-b9c5-94600851e057 req-66344fb7-0306-46e8-a361-b07e8214a3c6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:38.578177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:38.578650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:38.579457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:38.579914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:38.584447 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-17ebd144-898a-4411-b9c5-94600851e057 req-66344fb7-0306-46e8-a361-b07e8214a3c6 service nova] Creating event network-vif-deleted:0671ef54-efde-4401-afa6-2532e83c2ecb for instance fbd5eae6-8fcd-480e-8105-0140f46d3f15 on nch1-master-1 Apr 30 21:49:38.589480 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-17ebd144-898a-4411-b9c5-94600851e057 req-66344fb7-0306-46e8-a361-b07e8214a3c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Apr 30 21:49:38.590131 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2968/5836] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:49:38.595129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:38.595836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:38.602769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:38.603225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:38.604026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:38.604469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:39.022418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:39.030356 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f2a060bd-1da9-41e0-8caf-70a687e6c31f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 200 len: 1485 microversion: 2.1 time: 0.464232 Apr 30 21:49:39.030943 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2869/5837] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:38 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 1485 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:39.112748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:39.120745 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37377268-6ec0-437e-9ed8-9cced6c0087f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1507 microversion: 2.1 time: 0.529492 Apr 30 21:49:39.121493 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2969/5838] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:38 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:39.137525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-21367198-e2b7-451a-b133-b5dc2eb58dc1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb", "device": "/dev/sdb"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:39.140402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-21367198-e2b7-451a-b133-b5dc2eb58dc1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:39.144811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21367198-e2b7-451a-b133-b5dc2eb58dc1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:39.145278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21367198-e2b7-451a-b133-b5dc2eb58dc1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:39.146169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21367198-e2b7-451a-b133-b5dc2eb58dc1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:39.146742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21367198-e2b7-451a-b133-b5dc2eb58dc1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:39.764074 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-21367198-e2b7-451a-b133-b5dc2eb58dc1 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "POST /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630311 Apr 30 21:49:39.764910 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2870/5839] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 21:49:39 2022] POST /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:49:40.047605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:40.048267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: fbd5eae6-8fcd-480e-8105-0140f46d3f15] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:40.055193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:40.055676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:40.056450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:40.056891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:40.070988 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] HTTP exception thrown: Instance fbd5eae6-8fcd-480e-8105-0140f46d3f15 could not be found. Apr 30 21:49:40.071585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Returning 404 to user: Instance fbd5eae6-8fcd-480e-8105-0140f46d3f15 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:49:40.072413 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f1d2a59-bb21-4fe6-bf2e-30efa5424d17 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15" status: 404 len: 111 microversion: 2.1 time: 0.028861 Apr 30 21:49:40.072952 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2970/5840] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:40 2022] GET /compute/v2.1/servers/fbd5eae6-8fcd-480e-8105-0140f46d3f15 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:49:40.445881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c93dafe2-39b8-4a20-8e28-a63ceb01d30a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '.version_select at 0x7fdc20ac4e50>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:40.532348 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c93dafe2-39b8-4a20-8e28-a63ceb01d30a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1021439937" status: 202 len: 0 microversion: 2.1 time: 0.091672 Apr 30 21:49:40.532947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2871/5841] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:49:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1021439937 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:49:50.646044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ff0ffbb5-08b6-419a-a6c5-0bcbdc13f06d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'create', calling method: .version_select at 0x7fdc13486430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1823822717"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:50.666456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ff0ffbb5-08b6-419a-a6c5-0bcbdc13f06d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:49:50.672807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ff0ffbb5-08b6-419a-a6c5-0bcbdc13f06d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:49:50.853141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ff0ffbb5-08b6-419a-a6c5-0bcbdc13f06d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:49:50.860208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ff0ffbb5-08b6-419a-a6c5-0bcbdc13f06d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:49:50.922181 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ff0ffbb5-08b6-419a-a6c5-0bcbdc13f06d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.280057 Apr 30 21:49:50.931059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2971/5842] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:49:50 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:53.360417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1085640343", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c92ca584-e52b-4c14-980a-c6e49fa47273"}], "key_name": "tempest-TestNetworkBasicOps-1823822717", "security_groups": [{"name": "tempest-secgroup-smoke-777921360"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:53.464718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] validate_networks() for [('c92ca584-e52b-4c14-980a-c6e49fa47273', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:49:54.176542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:49:54.177019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:49:54.177541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:49:54.177959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:49:54.178392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:49:54.187796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:54.188263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:54.189144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:54.189602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:54.207151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:49:54.212396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Getting quotas for user 2df099ec39004e72a4e49a6eb1694aee and project cf9af556d4c3479a89d448e8bc633a3e. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:49:54.224825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:49:54.227778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:49:54.328193 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-627363c8-2268-4a78-8c2e-0e875e37b586 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.972459 Apr 30 21:49:54.328859 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2872/5843] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:49:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:49:54.340101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0bb3621d-ad92-4140-b45b-7b089f3bf95b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:54.340854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0bb3621d-ad92-4140-b45b-7b089f3bf95b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:54.397405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0bb3621d-ad92-4140-b45b-7b089f3bf95b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:54.405849 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0bb3621d-ad92-4140-b45b-7b089f3bf95b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1249 microversion: 2.1 time: 0.070511 Apr 30 21:49:54.412371 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2972/5844] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:54 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:55.423986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:55.424642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:55.432536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:55.433003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:55.433816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:55.434274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:55.500154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:55.508328 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55a37c49-fef3-443b-9f6c-99408dc23d3c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1245 microversion: 2.1 time: 0.089473 Apr 30 21:49:55.508946 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2873/5845] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:55 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:56.526518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:56.527140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:56.535723 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:56.536168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:56.536948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:56.537607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:56.633600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:56.641080 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e305aef-8121-44bf-8788-c808218bfc4a tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1307 microversion: 2.1 time: 0.118897 Apr 30 21:49:56.641644 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2973/5846] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:56 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:49:57.658728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:57.659303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:57.666155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:57.667305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:57.667425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:57.667854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:57.701704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-526d1a24-5c91-443f-aba2-c98d9df22f49 req-0ea9c728-1bb2-473b-924f-ea2569c4b786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea3276e-9ca6-4153-a619-5c78af4ce39a", "tag": "fb230768-af80-45b3-b7a7-71b087f56c9b"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:49:57.714727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-526d1a24-5c91-443f-aba2-c98d9df22f49 req-0ea9c728-1bb2-473b-924f-ea2569c4b786 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:57.715454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-526d1a24-5c91-443f-aba2-c98d9df22f49 req-0ea9c728-1bb2-473b-924f-ea2569c4b786 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:57.731483 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-526d1a24-5c91-443f-aba2-c98d9df22f49 req-0ea9c728-1bb2-473b-924f-ea2569c4b786 service nova] Creating event network-changed:fb230768-af80-45b3-b7a7-71b087f56c9b for instance 0ea3276e-9ca6-4153-a619-5c78af4ce39a on nch2-master-1 Apr 30 21:49:57.736851 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-526d1a24-5c91-443f-aba2-c98d9df22f49 req-0ea9c728-1bb2-473b-924f-ea2569c4b786 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038629 Apr 30 21:49:57.737699 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2974/5847] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:49:57.915352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:57.922739 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56a2e494-3537-4baa-9175-e8015f48adf5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1374 microversion: 2.1 time: 0.268122 Apr 30 21:49:57.923442 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2874/5848] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:57 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:49:58.941235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:49:58.941969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:49:58.948827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:58.949284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:58.950095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:49:58.950542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:49:59.079708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:49:59.087708 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-281b2623-0430-4e34-a41d-52958f03a687 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1374 microversion: 2.1 time: 0.151570 Apr 30 21:49:59.088278 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2975/5849] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:49:58 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:00.104990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:00.105621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:00.112636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:00.113103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:00.113923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:00.114383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:00.251898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:00.253111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb824532-f8b9-42f4-8a79-0a6b70e3e74f tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1374 microversion: 2.1 time: 0.152705 Apr 30 21:50:00.253691 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2875/5850] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:00 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:01.270683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:01.271303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:01.279093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:01.279564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:01.280804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:01.280804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:01.409389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:01.416758 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cadeb296-7918-418f-9f0c-0617c7f6a9a8 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1374 microversion: 2.1 time: 0.150090 Apr 30 21:50:01.417331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2976/5851] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:01 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1374 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:02.434016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:02.434642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:02.441294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:02.441778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:02.442634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:02.443082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:02.574950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:02.582327 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-046bceba-183d-4260-b470-f14faa5b6a39 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1374 microversion: 2.1 time: 0.152338 Apr 30 21:50:02.582908 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2876/5852] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:02 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:03.599322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:03.599945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:03.606787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:03.607241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:03.608023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:03.608468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:03.736112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:03.743543 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ddef7acc-0139-403a-898f-b75be1a86241 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1374 microversion: 2.1 time: 0.148099 Apr 30 21:50:03.744133 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2977/5853] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:03 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1374 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:03.804256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d4a0fc62-d678-4967-be72-ff2f5a8ff809 req-1c6bed36-c192-470d-a30e-08d8f0bf444c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea3276e-9ca6-4153-a619-5c78af4ce39a", "name": "network-vif-plugged", "status": "completed", "tag": "fb230768-af80-45b3-b7a7-71b087f56c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:50:03.813192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d4a0fc62-d678-4967-be72-ff2f5a8ff809 req-1c6bed36-c192-470d-a30e-08d8f0bf444c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:03.813656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d4a0fc62-d678-4967-be72-ff2f5a8ff809 req-1c6bed36-c192-470d-a30e-08d8f0bf444c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:03.824643 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d4a0fc62-d678-4967-be72-ff2f5a8ff809 req-1c6bed36-c192-470d-a30e-08d8f0bf444c service nova] Creating event network-vif-plugged:fb230768-af80-45b3-b7a7-71b087f56c9b for instance 0ea3276e-9ca6-4153-a619-5c78af4ce39a on nch2-master-1 Apr 30 21:50:03.829531 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d4a0fc62-d678-4967-be72-ff2f5a8ff809 req-1c6bed36-c192-470d-a30e-08d8f0bf444c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029068 Apr 30 21:50:03.830159 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2877/5854] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:50:04.760725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:04.761345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:04.768148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:04.768611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:04.769396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:04.769867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:04.904660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:04.912168 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b74894d-b546-4aaa-b53b-562624b20f3e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1374 microversion: 2.1 time: 0.155349 Apr 30 21:50:04.912751 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2978/5855] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:04 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:05.931718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:05.932357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:05.938592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:05.939060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:05.939841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:05.940287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:06.072372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:06.079798 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab6dfd18-b82c-40b1-aadb-5bbe3ef4275d tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1545 microversion: 2.1 time: 0.153833 Apr 30 21:50:06.080391 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2878/5856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:05 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:06.096286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:06.096904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:06.104270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:06.104726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:06.105493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:06.105968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:06.238321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:06.245981 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c60aed4a-6811-4244-963f-06c13edf88b5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1545 microversion: 2.1 time: 0.153536 Apr 30 21:50:06.246567 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2979/5857] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:06 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:08.182276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5c7b93ee-5cde-43d8-ad96-bb3b921e104a req-da36cff4-50de-41a3-83ce-f4a5dc881f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea3276e-9ca6-4153-a619-5c78af4ce39a", "tag": "fb230768-af80-45b3-b7a7-71b087f56c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:50:08.191028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5c7b93ee-5cde-43d8-ad96-bb3b921e104a req-da36cff4-50de-41a3-83ce-f4a5dc881f0e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:08.191432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5c7b93ee-5cde-43d8-ad96-bb3b921e104a req-da36cff4-50de-41a3-83ce-f4a5dc881f0e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:08.203427 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5c7b93ee-5cde-43d8-ad96-bb3b921e104a req-da36cff4-50de-41a3-83ce-f4a5dc881f0e service nova] Creating event network-changed:fb230768-af80-45b3-b7a7-71b087f56c9b for instance 0ea3276e-9ca6-4153-a619-5c78af4ce39a on nch2-master-1 Apr 30 21:50:08.208474 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5c7b93ee-5cde-43d8-ad96-bb3b921e104a req-da36cff4-50de-41a3-83ce-f4a5dc881f0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030052 Apr 30 21:50:08.209138 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2879/5858] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:50:30.536967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26c31b0b-fa30-4f56-9323-88ad0924d2a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:50:30.537867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-26c31b0b-fa30-4f56-9323-88ad0924d2a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:30.545422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26c31b0b-fa30-4f56-9323-88ad0924d2a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:30.545915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26c31b0b-fa30-4f56-9323-88ad0924d2a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:30.546707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26c31b0b-fa30-4f56-9323-88ad0924d2a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:30.547150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26c31b0b-fa30-4f56-9323-88ad0924d2a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:30.594945 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26c31b0b-fa30-4f56-9323-88ad0924d2a5 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a/action" status: 200 len: 24570 microversion: 2.1 time: 0.061850 Apr 30 21:50:30.595602 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2980/5859] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:50:30 2022] POST /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a/action => generated 24570 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:50:41.661460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc3be933-5c0b-424f-b331-c4dc4d0ff127 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:50:41.662536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc3be933-5c0b-424f-b331-c4dc4d0ff127 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:41.669369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc3be933-5c0b-424f-b331-c4dc4d0ff127 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:41.669854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc3be933-5c0b-424f-b331-c4dc4d0ff127 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:41.670634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc3be933-5c0b-424f-b331-c4dc4d0ff127 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:41.671081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc3be933-5c0b-424f-b331-c4dc4d0ff127 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:41.729235 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc3be933-5c0b-424f-b331-c4dc4d0ff127 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "POST /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a/action" status: 200 len: 32641 microversion: 2.1 time: 0.072908 Apr 30 21:50:41.729888 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2880/5860] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:50:41 2022] POST /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a/action => generated 32641 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:50:42.816316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:42.817492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:42.823361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2a199d35-6d75-4f5a-90e2-7cc26c8aa96f req-fff0811b-9b38-428b-a315-04427f7298db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea3276e-9ca6-4153-a619-5c78af4ce39a", "tag": "fb230768-af80-45b3-b7a7-71b087f56c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:50:42.826163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:42.826819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:42.827788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:42.828397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:42.837083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2a199d35-6d75-4f5a-90e2-7cc26c8aa96f req-fff0811b-9b38-428b-a315-04427f7298db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:42.837548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2a199d35-6d75-4f5a-90e2-7cc26c8aa96f req-fff0811b-9b38-428b-a315-04427f7298db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:42.852119 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2a199d35-6d75-4f5a-90e2-7cc26c8aa96f req-fff0811b-9b38-428b-a315-04427f7298db service nova] Creating event network-changed:fb230768-af80-45b3-b7a7-71b087f56c9b for instance 0ea3276e-9ca6-4153-a619-5c78af4ce39a on nch2-master-1 Apr 30 21:50:42.858655 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2a199d35-6d75-4f5a-90e2-7cc26c8aa96f req-fff0811b-9b38-428b-a315-04427f7298db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040124 Apr 30 21:50:42.859194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:50:42.859346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2881/5861] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:50:43.239838 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-83b030dd-9898-40cd-85c9-639102cbd8a0 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 204 len: 0 microversion: 2.1 time: 0.427358 Apr 30 21:50:43.240540 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2981/5862] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:50:42 2022] DELETE /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:50:43.250620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:43.251567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:43.258137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:43.258602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:43.259589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:43.260225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:43.404084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:43.411552 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93855ad6-34ce-4cfb-9d2f-529940b64d0e tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1670 microversion: 2.1 time: 0.165707 Apr 30 21:50:43.412127 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2882/5863] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:43 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:50:44.430788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:44.431496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:44.439557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:44.439912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:44.440692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:44.441155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:44.594822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:44.602840 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e96f80b3-8b71-4e84-bd90-7da9c668dfa1 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1551 microversion: 2.1 time: 0.176941 Apr 30 21:50:44.603435 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2982/5864] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:44 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1551 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:45.381107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2bae35d4-4e60-4374-a8b1-0d43255593d1 req-9215884e-3847-431a-922e-75cac6911565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea3276e-9ca6-4153-a619-5c78af4ce39a", "name": "network-vif-deleted", "tag": "fb230768-af80-45b3-b7a7-71b087f56c9b"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:50:45.390639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2bae35d4-4e60-4374-a8b1-0d43255593d1 req-9215884e-3847-431a-922e-75cac6911565 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:45.395887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2bae35d4-4e60-4374-a8b1-0d43255593d1 req-9215884e-3847-431a-922e-75cac6911565 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:45.402805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2bae35d4-4e60-4374-a8b1-0d43255593d1 req-9215884e-3847-431a-922e-75cac6911565 service nova] Creating event network-vif-deleted:fb230768-af80-45b3-b7a7-71b087f56c9b for instance 0ea3276e-9ca6-4153-a619-5c78af4ce39a on nch2-master-1 Apr 30 21:50:45.407563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2bae35d4-4e60-4374-a8b1-0d43255593d1 req-9215884e-3847-431a-922e-75cac6911565 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030217 Apr 30 21:50:45.408140 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2883/5865] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:50:45.620691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:45.621885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:45.628898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:45.629352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:45.630160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:45.630599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:45.663454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:45.663909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:45.664366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lazy-loading 'fault' on Instance uuid 0ea3276e-9ca6-4153-a619-5c78af4ce39a {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:50:45.707316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2df099ec39004e72a4e49a6eb1694aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9af556d4c3479a89d448e8bc633a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:45.714984 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e6619745-edbf-44a1-b82e-384da3279fc4 tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 200 len: 1339 microversion: 2.1 time: 0.098769 Apr 30 21:50:45.715587 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2983/5866] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:45 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:46.734345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:46.735059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] [instance: 0ea3276e-9ca6-4153-a619-5c78af4ce39a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:46.741279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:46.741741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:46.743194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:46.743640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:46.757207 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] HTTP exception thrown: Instance 0ea3276e-9ca6-4153-a619-5c78af4ce39a could not be found. Apr 30 21:50:46.757849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Returning 404 to user: Instance 0ea3276e-9ca6-4153-a619-5c78af4ce39a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:50:46.758681 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74b2fd20-e99e-40c1-92c4-eb2afd0b655b tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a" status: 404 len: 111 microversion: 2.1 time: 0.029629 Apr 30 21:50:46.759250 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2884/5867] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:46 2022] GET /compute/v2.1/servers/0ea3276e-9ca6-4153-a619-5c78af4ce39a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:50:46.976036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6435a570-1c02-42d4-ad53-91f34e7bc07c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] Calling method '.version_select at 0x7fdc26288430>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:47.035294 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6435a570-1c02-42d4-ad53-91f34e7bc07c tempest-TestNetworkBasicOps-1002566 tempest-TestNetworkBasicOps-1002566-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1823822717" status: 202 len: 0 microversion: 2.1 time: 0.063108 Apr 30 21:50:47.035873 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2984/5868] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:50:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1823822717 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:50:56.902564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-446191368", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "c75203da-211e-439d-82cd-523ee1e5bf85"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:50:56.954142 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] validate_networks() for [('c75203da-211e-439d-82cd-523ee1e5bf85', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:50:57.288206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:50:57.288648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:50:57.289132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:50:57.289552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:50:57.290524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:50:57.299272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:57.299734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:57.300553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:57.300998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:57.317988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Getting quotas for project 9e063926f9194aa7b6cf535aae766b03. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:50:57.323234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Getting quotas for user b8aa6b4d5c154ab396ad1d657c27f9b1 and project 9e063926f9194aa7b6cf535aae766b03. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:50:57.335267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:50:57.337550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:50:57.431312 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7338c71-201a-4759-821e-8509079aa752 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657612 Apr 30 21:50:57.431962 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2885/5869] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:50:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:50:57.442015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f808641b-f039-4640-8359-39968bd23528 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:57.446331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f808641b-f039-4640-8359-39968bd23528 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:57.502648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f808641b-f039-4640-8359-39968bd23528 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:57.509382 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f808641b-f039-4640-8359-39968bd23528 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1214 microversion: 2.1 time: 0.071249 Apr 30 21:50:57.509998 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2985/5870] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:57 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:58.526407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:58.527030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:58.534691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:58.535159 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:58.535943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:58.536391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:58.597400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:58.604982 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b880ac2-7e15-450e-a431-ab96ae59aa5a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1218 microversion: 2.1 time: 0.082744 Apr 30 21:50:58.605479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2886/5871] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:58 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:50:59.623219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:50:59.623838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:50:59.631719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:59.632817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:59.634171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:50:59.634689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:50:59.702851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:50:59.710265 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fd3e3c39-703b-47f1-98d9-2dd61d0f0b82 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1272 microversion: 2.1 time: 0.092144 Apr 30 21:50:59.710851 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2986/5872] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:50:59 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:51:00.728207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:00.728855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:00.735672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:00.736128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:00.736905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:00.737350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:00.863748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a006bed8-4771-4a3f-9ba7-ce26fe785022 req-5325be7c-0b1a-4114-8c63-2d8a4df190c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0ceee7-b553-45c1-b1d4-52cf9894f847", "tag": "a80ee346-9422-4c0e-a377-cf3f96ac350f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:00.872747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a006bed8-4771-4a3f-9ba7-ce26fe785022 req-5325be7c-0b1a-4114-8c63-2d8a4df190c9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:00.873207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a006bed8-4771-4a3f-9ba7-ce26fe785022 req-5325be7c-0b1a-4114-8c63-2d8a4df190c9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:00.885245 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a006bed8-4771-4a3f-9ba7-ce26fe785022 req-5325be7c-0b1a-4114-8c63-2d8a4df190c9 service nova] Creating event network-changed:a80ee346-9422-4c0e-a377-cf3f96ac350f for instance 3b0ceee7-b553-45c1-b1d4-52cf9894f847 on nch2-master-1 Apr 30 21:51:00.890475 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a006bed8-4771-4a3f-9ba7-ce26fe785022 req-5325be7c-0b1a-4114-8c63-2d8a4df190c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030405 Apr 30 21:51:00.891079 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2987/5873] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:51:00.962899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:00.970375 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-40f1429c-8c2a-4007-a46c-549fe7d463f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.246794 Apr 30 21:51:00.970962 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2887/5874] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:00 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:01.988527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:01.989262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:01.996167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:01.996623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:01.997394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:01.997885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:02.129440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:02.136933 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9470339e-4a87-4db9-9d5b-fa07398cba4f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.153621 Apr 30 21:51:02.137503 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2988/5875] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:01 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:03.153984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:03.154633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:03.161152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:03.161555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:03.162361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:03.162809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:03.305386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:03.312889 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b20694a1-dd9a-49e8-bb71-555488e17b5d tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.163623 Apr 30 21:51:03.313461 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2888/5876] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:03 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:04.330567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:04.331190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:04.338617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:04.339075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:04.339861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:04.340303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:04.470462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:04.478552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7509a53d-f068-4208-a599-60bbe51a7dba tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.151913 Apr 30 21:51:04.479134 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2989/5877] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:04 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:51:05.495553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:05.496194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:05.503194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:05.503666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:05.504457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:05.504915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:05.633437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:05.641020 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9230421-0b97-409f-95b3-cc819a5abdfe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.149998 Apr 30 21:51:05.641596 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2889/5878] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:05 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:06.660532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:06.661157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:06.668144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:06.668737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:06.669526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:06.670002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:06.794475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:06.801953 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4289fafe-486a-4cc8-923a-a07fd71a3394 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.145362 Apr 30 21:51:06.802528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2990/5879] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:06 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:07.819343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:07.819977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:07.826874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:07.827343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:07.828137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:07.828597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:07.958645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:07.966259 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d5ea054-d2d6-4da0-91c4-2994f0a391af tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.150773 Apr 30 21:51:07.966848 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2890/5880] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:07 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:08.143151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5fa86929-41b1-4e7d-8085-119119a5fc60 req-d6f4cbf9-8560-46f8-81cb-544f4af73cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0ceee7-b553-45c1-b1d4-52cf9894f847", "name": "network-vif-plugged", "status": "completed", "tag": "a80ee346-9422-4c0e-a377-cf3f96ac350f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:08.152288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5fa86929-41b1-4e7d-8085-119119a5fc60 req-d6f4cbf9-8560-46f8-81cb-544f4af73cc8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:08.152744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5fa86929-41b1-4e7d-8085-119119a5fc60 req-d6f4cbf9-8560-46f8-81cb-544f4af73cc8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:08.163492 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5fa86929-41b1-4e7d-8085-119119a5fc60 req-d6f4cbf9-8560-46f8-81cb-544f4af73cc8 service nova] Creating event network-vif-plugged:a80ee346-9422-4c0e-a377-cf3f96ac350f for instance 3b0ceee7-b553-45c1-b1d4-52cf9894f847 on nch2-master-1 Apr 30 21:51:08.169147 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5fa86929-41b1-4e7d-8085-119119a5fc60 req-d6f4cbf9-8560-46f8-81cb-544f4af73cc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029608 Apr 30 21:51:08.169726 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2991/5881] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:51:08.992313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:08.993450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:09.000306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:09.000773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:09.001555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:09.002038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:09.131730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:09.143287 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2256869a-a7c0-44f8-97a0-88ab098545b6 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1314 microversion: 2.1 time: 0.152952 Apr 30 21:51:09.143882 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2891/5882] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:08 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:10.163992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:10.164699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:10.171009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.171469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.172247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.172693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.302573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:10.310567 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-25d733e7-29be-43a0-a8b4-256dcae773cf tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1501 microversion: 2.1 time: 0.151683 Apr 30 21:51:10.311120 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2992/5883] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:10 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:10.328112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:10.328799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:10.335715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.336178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.336964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.337414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.479921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:10.487362 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b23ebe59-68de-40ac-8267-38bccb719be0 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1501 microversion: 2.1 time: 0.163203 Apr 30 21:51:10.487942 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2892/5884] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:10 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:10.504129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:10.504672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:10.511274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.511737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.512512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.512957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.535581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lazy-loading 'flavor' on Instance uuid 3b0ceee7-b553-45c1-b1d4-52cf9894f847 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:51:10.769492 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-576ebd12-f9ab-4416-a223-ea38a5e277f4 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action" status: 202 len: 0 microversion: 2.1 time: 0.268767 Apr 30 21:51:10.770116 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2993/5885] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:51:10 2022] POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:51:10.779140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:10.779803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:10.785625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.786110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.787710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:10.787710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:10.916148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:10.924200 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16fa31bf-e605-4793-b961-baee7f4a8bff tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1509 microversion: 2.1 time: 0.148953 Apr 30 21:51:10.924765 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2893/5886] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:10 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:11.942591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:11.943298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:11.950374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:11.950823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:11.951590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:11.952027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:12.077598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:12.085043 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-48ad91eb-61ec-4db3-a173-458bb9c412e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1492 microversion: 2.1 time: 0.146729 Apr 30 21:51:12.085620 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2994/5887] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:11 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1492 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:12.101975 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0eb7287d-9ace-4758-9125-9ad07cd5d4f5 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:12.103084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0eb7287d-9ace-4758-9125-9ad07cd5d4f5 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:12.109786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0eb7287d-9ace-4758-9125-9ad07cd5d4f5 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:12.110255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0eb7287d-9ace-4758-9125-9ad07cd5d4f5 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:12.111041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0eb7287d-9ace-4758-9125-9ad07cd5d4f5 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:12.111489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0eb7287d-9ace-4758-9125-9ad07cd5d4f5 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:12.323783 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0eb7287d-9ace-4758-9125-9ad07cd5d4f5 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action" status: 202 len: 0 microversion: 2.1 time: 0.225500 Apr 30 21:51:12.324464 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2894/5888] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:51:12 2022] POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:51:12.333310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:12.334109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:12.340940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:12.341397 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:12.342203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:12.342635 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:12.481325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:12.493162 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f37770dc-1170-4c2a-9641-c97959c741bd tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1498 microversion: 2.1 time: 0.163256 Apr 30 21:51:12.493790 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2995/5889] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:12 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:13.511959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:13.512667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:13.519394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:13.519852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:13.520623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:13.521065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:13.651843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:13.659317 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-92378a9e-1cba-4acb-8a56-603ae3b14661 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1498 microversion: 2.1 time: 0.153091 Apr 30 21:51:13.659888 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2895/5890] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:13 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:14.676290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:14.676907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:14.683783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:14.684238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:14.685011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:14.685453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:14.810227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:14.817539 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ffbe7e21-0d60-478a-8039-188944e191f7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1501 microversion: 2.1 time: 0.145161 Apr 30 21:51:14.818145 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2996/5891] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:14 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1501 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:14.834733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:14.835286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:14.842294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:14.842752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:14.843539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:14.843981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:14.865708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lazy-loading 'flavor' on Instance uuid 3b0ceee7-b553-45c1-b1d4-52cf9894f847 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:51:15.101850 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca878484-9ab5-456c-bcbb-e3d4078c4cbe tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action" status: 202 len: 0 microversion: 2.1 time: 0.270839 Apr 30 21:51:15.103141 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2896/5892] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:51:14 2022] POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:51:15.111564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:15.112179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:15.118186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:15.118640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:15.119754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:15.120192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:15.250970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:15.258910 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-87336df4-a6dc-4318-9444-07146a1d4c1f tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1509 microversion: 2.1 time: 0.150775 Apr 30 21:51:15.259493 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2997/5893] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:15 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:16.278020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:16.278740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:16.285198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:16.285663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:16.286478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:16.286927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:16.415309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:16.422870 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb17ed17-7605-46ed-8199-fa4aa2580114 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1492 microversion: 2.1 time: 0.150887 Apr 30 21:51:16.423440 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2897/5894] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:16 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1492 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:16.444004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a41d763a-e293-4860-be2b-68f1d80314e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:16.444556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a41d763a-e293-4860-be2b-68f1d80314e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:16.451972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41d763a-e293-4860-be2b-68f1d80314e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:16.452430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41d763a-e293-4860-be2b-68f1d80314e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:16.453201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41d763a-e293-4860-be2b-68f1d80314e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:16.453640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a41d763a-e293-4860-be2b-68f1d80314e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:16.660652 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a41d763a-e293-4860-be2b-68f1d80314e7 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action" status: 202 len: 0 microversion: 2.1 time: 0.220312 Apr 30 21:51:16.661224 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2998/5895] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:51:16 2022] POST /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:51:16.670360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:16.673049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:16.677893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:16.678619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:16.679512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:16.679987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:16.818201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:16.825780 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0a72e858-4a73-4130-978b-25e29f1858ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1498 microversion: 2.1 time: 0.159621 Apr 30 21:51:16.826374 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2898/5896] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:16 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:51:17.844025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:17.844720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:17.851360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:17.851893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:17.853287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:17.853738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:17.986701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:17.994247 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-843f187c-5d6d-477b-a5df-fa7e8f8c5c8e tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1498 microversion: 2.1 time: 0.155302 Apr 30 21:51:17.994822 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 2999/5897] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:17 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:19.011593 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:19.012152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:19.018908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:19.019375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:19.020162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:19.020616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:19.148325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:19.156005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f524132e-79ee-4535-9291-2eb88e2582ca tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1501 microversion: 2.1 time: 0.148432 Apr 30 21:51:19.156578 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2899/5898] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:19 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:19.172385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:19.172891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:19.179665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:19.180776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:19.181552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:19.182018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:19.206344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:51:19.525647 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c261ed30-32f5-4210-9564-45883c6241eb tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 204 len: 0 microversion: 2.1 time: 0.356805 Apr 30 21:51:19.526277 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3000/5899] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:51:19 2022] DELETE /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:51:19.534589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:19.535156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:19.542327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:19.542795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:19.543606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:19.544053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:19.673385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:19.680778 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-274a494f-a088-470d-a7f6-92521ae8e82b tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1507 microversion: 2.1 time: 0.150272 Apr 30 21:51:19.681342 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2900/5900] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:19 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:20.698692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:20.699427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:20.706209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:20.713233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:20.713233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:20.713233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:20.845976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:20.854274 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cbdbfa59-b2d6-462e-8ad8-7fed9873876a tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1507 microversion: 2.1 time: 0.159884 Apr 30 21:51:20.854844 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3001/5901] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:20 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:21.850798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-651a6a78-a01c-4ee8-a78f-25a3c2ecfbac req-5754808a-ce37-4dba-ac7d-3f2f5160be43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0ceee7-b553-45c1-b1d4-52cf9894f847", "name": "network-vif-deleted", "tag": "a80ee346-9422-4c0e-a377-cf3f96ac350f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:21.859633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-651a6a78-a01c-4ee8-a78f-25a3c2ecfbac req-5754808a-ce37-4dba-ac7d-3f2f5160be43 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:21.860119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-651a6a78-a01c-4ee8-a78f-25a3c2ecfbac req-5754808a-ce37-4dba-ac7d-3f2f5160be43 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:21.871027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:21.871737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:21.872362 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-651a6a78-a01c-4ee8-a78f-25a3c2ecfbac req-5754808a-ce37-4dba-ac7d-3f2f5160be43 service nova] Creating event network-vif-deleted:a80ee346-9422-4c0e-a377-cf3f96ac350f for instance 3b0ceee7-b553-45c1-b1d4-52cf9894f847 on nch2-master-1 Apr 30 21:51:21.877438 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-651a6a78-a01c-4ee8-a78f-25a3c2ecfbac req-5754808a-ce37-4dba-ac7d-3f2f5160be43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030352 Apr 30 21:51:21.878732 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2901/5902] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:51:21.879099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:21.879644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:21.880545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:21.880959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:21.948925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8aa6b4d5c154ab396ad1d657c27f9b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e063926f9194aa7b6cf535aae766b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:21.956546 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-34a82061-38c9-4c2d-b8b5-34d88d36a2d2 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 200 len: 1465 microversion: 2.1 time: 0.090075 Apr 30 21:51:21.957159 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3002/5903] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:21 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 1465 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:51:22.974530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:22.975230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] [instance: 3b0ceee7-b553-45c1-b1d4-52cf9894f847] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:22.981453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:22.981951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:22.982725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:22.983170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:22.996878 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] HTTP exception thrown: Instance 3b0ceee7-b553-45c1-b1d4-52cf9894f847 could not be found. Apr 30 21:51:22.998686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] Returning 404 to user: Instance 3b0ceee7-b553-45c1-b1d4-52cf9894f847 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:51:22.998686 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4e11a5ad-c007-44df-8474-1f5251762e26 tempest-TestServerAdvancedOps-747311002 tempest-TestServerAdvancedOps-747311002-project] 10.222.0.23 "GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847" status: 404 len: 111 microversion: 2.1 time: 0.028892 Apr 30 21:51:22.998955 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2902/5904] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:22 2022] GET /compute/v2.1/servers/3b0ceee7-b553-45c1-b1d4-52cf9894f847 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:51:23.891872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:23.892416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:23.899467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:23.899924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:23.900876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:23.901332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:23.980487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lazy-loading 'services' on Instance uuid b81dbbed-6eeb-4227-be53-e56c759b5bb9 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:51:24.137778 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9/os-volume_attachments/9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb" status: 202 len: 0 microversion: 2.1 time: 0.249782 Apr 30 21:51:24.138443 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3003/5905] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 21:51:23 2022] DELETE /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9/os-volume_attachments/9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:51:25.261035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:25.261610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:25.268242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:25.268710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:25.269500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:25.269988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:25.296800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:51:25.559705 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e3a9274-5dc7-4893-8b4a-56e4b875873f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 204 len: 0 microversion: 2.1 time: 0.303027 Apr 30 21:51:25.560346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2903/5906] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:51:25 2022] DELETE /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:51:25.570080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:25.570796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:25.577860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:25.578324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:25.579104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:25.579602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:25.728223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:25.736293 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3737018-edc3-4df2-bc61-dee22b200753 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1513 microversion: 2.1 time: 0.171350 Apr 30 21:51:25.736893 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3004/5907] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:25 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:26.757355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:26.758167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:26.766028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:26.766487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:26.767265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:26.767707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:26.922059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:26.930324 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11ac8571-e39f-452d-aeab-fe7651acefb4 tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1513 microversion: 2.1 time: 0.177432 Apr 30 21:51:26.931265 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2904/5908] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:26 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:27.792869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9fb0e413-148e-45a2-bbea-fc53c09712e7 req-42a6de1f-4cb1-414c-a1bf-9933bf66cba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81dbbed-6eeb-4227-be53-e56c759b5bb9", "name": "network-vif-deleted", "tag": "b042542b-4779-45e4-97f5-1694f1b001e5"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:27.803264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9fb0e413-148e-45a2-bbea-fc53c09712e7 req-42a6de1f-4cb1-414c-a1bf-9933bf66cba7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:27.803264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9fb0e413-148e-45a2-bbea-fc53c09712e7 req-42a6de1f-4cb1-414c-a1bf-9933bf66cba7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:27.814063 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9fb0e413-148e-45a2-bbea-fc53c09712e7 req-42a6de1f-4cb1-414c-a1bf-9933bf66cba7 service nova] Creating event network-vif-deleted:b042542b-4779-45e4-97f5-1694f1b001e5 for instance b81dbbed-6eeb-4227-be53-e56c759b5bb9 on nch1-master-1 Apr 30 21:51:27.819514 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9fb0e413-148e-45a2-bbea-fc53c09712e7 req-42a6de1f-4cb1-414c-a1bf-9933bf66cba7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030942 Apr 30 21:51:27.820654 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3005/5909] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:51:27.950440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:27.950977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:27.965345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:27.965805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:27.972196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:27.972673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:28.072019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed9fb1a529f4247acd72a6de21ceb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1febcefe29f461ea37667520a278022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:28.082237 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67ba5f6d-1f78-4f34-b5ec-d70496584eaf tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 200 len: 1303 microversion: 2.1 time: 0.137632 Apr 30 21:51:28.092996 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2905/5910] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:27 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:29.101641 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:29.102379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] [instance: b81dbbed-6eeb-4227-be53-e56c759b5bb9] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:29.109136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:29.109598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:29.110406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:29.110972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:29.124548 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] HTTP exception thrown: Instance b81dbbed-6eeb-4227-be53-e56c759b5bb9 could not be found. Apr 30 21:51:29.125191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] Returning 404 to user: Instance b81dbbed-6eeb-4227-be53-e56c759b5bb9 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:51:29.126057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9967a2f-5a5c-446c-baf5-2234ac98347f tempest-VolumesSnapshotTestJSON-954528396 tempest-VolumesSnapshotTestJSON-954528396-project] 10.222.0.23 "GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9" status: 404 len: 111 microversion: 2.1 time: 0.029762 Apr 30 21:51:29.126614 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3006/5911] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:29 2022] GET /compute/v2.1/servers/b81dbbed-6eeb-4227-be53-e56c759b5bb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:51:48.510958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-40669123", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1015f375-c3d8-41c8-9a88-5a3e99cf27c6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f1968efb-9997-4382-98a0-ab6f19a6ad8d"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:48.761480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] validate_networks() for [('f1968efb-9997-4382-98a0-ab6f19a6ad8d', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:51:49.229377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:51:49.229957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:51:49.230439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:51:49.230884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:51:49.231476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:51:49.242324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:49.242832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:49.246891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:49.246891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:49.267543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:51:49.273186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for user 4d838be38c1941eba44ffcfc6c17f002 and project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:51:49.287574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:51:49.289666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1015f375-c3d8-41c8-9a88-5a3e99cf27c6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:51:49.428830 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-58112c39-5cca-4db4-a3d7-0211cddd344f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921634 Apr 30 21:51:49.429792 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2906/5912] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:51:49.440271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01bfab31-acc4-4243-a217-92676282e817 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:49.440963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01bfab31-acc4-4243-a217-92676282e817 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:49.852067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01bfab31-acc4-4243-a217-92676282e817 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:49.860113 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01bfab31-acc4-4243-a217-92676282e817 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1055 microversion: 2.1 time: 0.423847 Apr 30 21:51:49.860681 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3007/5913] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:49 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1055 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:51:50.879343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:50.879978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:50.886531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:50.887634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:50.888433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:50.888882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:50.952174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:50.959539 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-42921a48-0681-4aac-bc66-27d10e263d51 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1051 microversion: 2.1 time: 0.085169 Apr 30 21:51:50.960115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2907/5914] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:50 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1051 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:51.982418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:51.983797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:51.994930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:51.997123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:51.998799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:52.000116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:52.065829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:52.073303 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b3c5677-0855-424c-b336-87f5883a88ef tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1125 microversion: 2.1 time: 0.100275 Apr 30 21:51:52.073900 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3008/5915] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:51 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1125 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:53.092405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:53.093035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:53.100120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:53.100634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:53.101403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:53.101947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:53.248103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:53.259388 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-57306870-708e-48e7-8b05-25fa628c2298 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1167 microversion: 2.1 time: 0.171415 Apr 30 21:51:53.265464 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2908/5916] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:53 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1167 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:53.314410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5c7b71f0-25a6-42bc-90cc-9cd26a8b9632 req-8a06bd5f-ed9c-48f0-b5d2-a4f66f3f37f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f386bedd-b85f-414a-96df-07298ad66b86", "tag": "6b2a1c0d-d53e-42a3-8522-3d491ce3be6f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:51:53.323172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5c7b71f0-25a6-42bc-90cc-9cd26a8b9632 req-8a06bd5f-ed9c-48f0-b5d2-a4f66f3f37f0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:53.323893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5c7b71f0-25a6-42bc-90cc-9cd26a8b9632 req-8a06bd5f-ed9c-48f0-b5d2-a4f66f3f37f0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:53.337179 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5c7b71f0-25a6-42bc-90cc-9cd26a8b9632 req-8a06bd5f-ed9c-48f0-b5d2-a4f66f3f37f0 service nova] Creating event network-changed:6b2a1c0d-d53e-42a3-8522-3d491ce3be6f for instance f386bedd-b85f-414a-96df-07298ad66b86 on nch1-master-1 Apr 30 21:51:53.348004 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5c7b71f0-25a6-42bc-90cc-9cd26a8b9632 req-8a06bd5f-ed9c-48f0-b5d2-a4f66f3f37f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129131 Apr 30 21:51:53.348652 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3009/5917] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:51:54.276992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:54.277580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:54.285156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:54.285619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:54.286521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:54.286972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:54.417231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:54.425049 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a29cba3a-443e-4a54-9a5a-84d5324c892a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1167 microversion: 2.1 time: 0.152226 Apr 30 21:51:54.425618 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2909/5918] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:54 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1167 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:55.444527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:55.445298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:55.452444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:55.452908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:55.453696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:55.454169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:55.590609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:55.598636 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9421190c-2015-44f3-8f0e-f67d020cdcda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1167 microversion: 2.1 time: 0.159484 Apr 30 21:51:55.599732 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3010/5919] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:55 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1167 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:51:56.615785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:56.616414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:56.625133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:56.625599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:56.626414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:56.626853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:56.763257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:56.770998 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b058bc7-9355-43ba-98b4-9808e7db8da2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1167 microversion: 2.1 time: 0.159166 Apr 30 21:51:56.771585 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2910/5920] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:56 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1167 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:57.788843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:57.789456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:57.796302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:57.796682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:57.797451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:57.797942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:57.927999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:57.935845 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84f81c1e-764c-4652-b718-3d7dbe06e2ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.150599 Apr 30 21:51:57.936777 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3011/5921] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:57 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:51:58.955914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:51:58.956565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:51:58.963448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:58.963900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:58.964673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:51:58.965115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:51:59.107451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:51:59.114893 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-42bcebd6-32e1-4442-bc11-5f38b6377ff0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.163522 Apr 30 21:51:59.115465 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2911/5922] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:51:58 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:00.132212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:00.132878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:00.140288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:00.140750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:00.141538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:00.142013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:00.268945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:00.276877 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df043d48-ae83-40b9-9902-ff6326584df9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.148539 Apr 30 21:52:00.277457 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3012/5923] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:00 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:01.102407 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 21:52:01.102648 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 21:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 21:52:01.294669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:01.295987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:01.303298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:01.303758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:01.304535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:01.305053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:01.436145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:01.443843 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a9fd93c-3f58-400b-957a-f1001e465434 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.153091 Apr 30 21:52:01.444425 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2912/5924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:01 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:02.460656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:02.461286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:02.468290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:02.468761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:02.469539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:02.470016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:02.606229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:02.613873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d041bc5-35b1-4888-8143-43cdb3c7bdfb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.157090 Apr 30 21:52:02.614446 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3013/5925] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:02 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:03.631712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:03.632251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:03.638371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:03.638860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:03.639635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:03.640080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:03.773977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:03.782112 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11ad1d7b-3734-4b5e-8577-0e49d751849c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.154834 Apr 30 21:52:03.786223 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2913/5926] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:03 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:52:04.400602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-46ee674a-3886-4d1c-8f68-ecc919fa2265 req-766b27c1-bf99-489a-b996-f5de3d29b5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f386bedd-b85f-414a-96df-07298ad66b86", "name": "network-vif-plugged", "status": "completed", "tag": "6b2a1c0d-d53e-42a3-8522-3d491ce3be6f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:04.408585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-46ee674a-3886-4d1c-8f68-ecc919fa2265 req-766b27c1-bf99-489a-b996-f5de3d29b5db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:04.409041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-46ee674a-3886-4d1c-8f68-ecc919fa2265 req-766b27c1-bf99-489a-b996-f5de3d29b5db service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:04.420587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-46ee674a-3886-4d1c-8f68-ecc919fa2265 req-766b27c1-bf99-489a-b996-f5de3d29b5db service nova] Creating event network-vif-plugged:6b2a1c0d-d53e-42a3-8522-3d491ce3be6f for instance f386bedd-b85f-414a-96df-07298ad66b86 on nch1-master-1 Apr 30 21:52:04.425542 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-46ee674a-3886-4d1c-8f68-ecc919fa2265 req-766b27c1-bf99-489a-b996-f5de3d29b5db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092120 Apr 30 21:52:04.426194 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3014/5927] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:52:04.799542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:04.800169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:04.807028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:04.807490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:04.808327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:04.808777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:04.936937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:04.944424 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d07ae8e1-e7cc-4e5d-838a-c7b6ecfd683e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.149365 Apr 30 21:52:04.944994 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2914/5928] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:04 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:05.964842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:05.965924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:05.972823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:05.973286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:05.974102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:05.974549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:06.113150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:06.121704 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-556fac82-2c83-40bd-a46b-5e2dc2299cad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1201 microversion: 2.1 time: 0.163614 Apr 30 21:52:06.133917 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3015/5929] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:05 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1201 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:07.139180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:07.139810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:07.146822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.147358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.148141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.148843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.283140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:07.290793 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc99c0ab-0f2a-479b-9a02-f2ce2ff6e74c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1388 microversion: 2.1 time: 0.155611 Apr 30 21:52:07.291363 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2915/5930] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:07 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:52:07.307658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:07.308334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:07.315072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.315528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.316306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.316897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.445394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:07.453633 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b8270336-1189-4a8b-b080-34cd955e7db8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1388 microversion: 2.1 time: 0.149858 Apr 30 21:52:07.454232 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3016/5931] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:07 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:07.469944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:07.470630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:07.476619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.477066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.477860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.478302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.617311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:07.625004 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23160429-f9f4-4004-95d5-c29bc73fa5fc tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1388 microversion: 2.1 time: 0.159644 Apr 30 21:52:07.625574 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2916/5932] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:07 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:07.692016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:07.692529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:07.698620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.699128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.699919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:07.700368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:07.725643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:52:07.987471 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-78999374-1ef3-47b7-bc4b-42090636a06a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 204 len: 0 microversion: 2.1 time: 0.299019 Apr 30 21:52:07.988062 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3017/5933] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:52:07 2022] DELETE /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:52:07.996416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:07.997037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:08.004436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:08.004945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:08.005731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:08.006368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:08.134849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:08.142979 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d28f7788-091a-463a-9dbd-a7640a621b78 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1394 microversion: 2.1 time: 0.150543 Apr 30 21:52:08.143570 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2917/5934] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:07 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1394 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:09.165309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:09.166075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:09.173278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:09.173815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:09.174611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:09.175058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:09.323627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:09.331978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d45c8904-009f-47dc-9ca8-f3b058b119e1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1394 microversion: 2.1 time: 0.175051 Apr 30 21:52:09.332553 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3018/5935] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:09 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1394 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:10.281601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e1e7ba1a-015d-4656-86fe-8687ca77cc94 req-94c1dae8-dd0e-443f-ac9a-3017a5c7c484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f386bedd-b85f-414a-96df-07298ad66b86", "name": "network-vif-deleted", "tag": "6b2a1c0d-d53e-42a3-8522-3d491ce3be6f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:10.285827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e1e7ba1a-015d-4656-86fe-8687ca77cc94 req-94c1dae8-dd0e-443f-ac9a-3017a5c7c484 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:10.286101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e1e7ba1a-015d-4656-86fe-8687ca77cc94 req-94c1dae8-dd0e-443f-ac9a-3017a5c7c484 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:10.299387 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e1e7ba1a-015d-4656-86fe-8687ca77cc94 req-94c1dae8-dd0e-443f-ac9a-3017a5c7c484 service nova] Creating event network-vif-deleted:6b2a1c0d-d53e-42a3-8522-3d491ce3be6f for instance f386bedd-b85f-414a-96df-07298ad66b86 on nch1-master-1 Apr 30 21:52:10.304663 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e1e7ba1a-015d-4656-86fe-8687ca77cc94 req-94c1dae8-dd0e-443f-ac9a-3017a5c7c484 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033122 Apr 30 21:52:10.308482 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2918/5936] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:52:10.349475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:10.350739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:10.357421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:10.357908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:10.358729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:10.359179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:10.431539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:10.438318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8080cc2e-7006-4347-bc9c-1563fa327196 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1352 microversion: 2.1 time: 0.093593 Apr 30 21:52:10.438898 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3019/5937] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:10 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:11.457744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:11.458477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:11.464686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:11.465156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:11.465977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:11.466432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:11.501285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:11.501820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:11.502283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lazy-loading 'fault' on Instance uuid f386bedd-b85f-414a-96df-07298ad66b86 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:52:11.545129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:11.552610 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e865d8a3-bf2d-46dc-b2a6-40d19f95a752 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 200 len: 1191 microversion: 2.1 time: 0.100583 Apr 30 21:52:11.553332 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2919/5938] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:11 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 1191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:12.570591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:12.571171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:12.578027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:12.585240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:12.585240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:12.585240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:12.595906 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance f386bedd-b85f-414a-96df-07298ad66b86 could not be found. Apr 30 21:52:12.596501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance f386bedd-b85f-414a-96df-07298ad66b86 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:52:12.597356 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a8759677-53b1-4e02-ae04-47134589eda0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 404 len: 111 microversion: 2.1 time: 0.030802 Apr 30 21:52:12.597904 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3020/5939] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:12 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:52:18.924898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:18.925484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:18.932319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:18.932775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:18.933587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:18.934060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:18.948214 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance f386bedd-b85f-414a-96df-07298ad66b86 could not be found. Apr 30 21:52:18.950836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance f386bedd-b85f-414a-96df-07298ad66b86 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:52:18.950836 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cb48f05f-c75c-4437-bdb2-d33dc384b13f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 404 len: 111 microversion: 2.1 time: 0.029555 Apr 30 21:52:18.950836 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2920/5940] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:52:18 2022] DELETE /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:52:18.958787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:18.959407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: f386bedd-b85f-414a-96df-07298ad66b86] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:18.966181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:18.966639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:18.967412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:18.968070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:18.981697 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance f386bedd-b85f-414a-96df-07298ad66b86 could not be found. Apr 30 21:52:18.985937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance f386bedd-b85f-414a-96df-07298ad66b86 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:52:18.985937 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f86fad5f-892e-41df-90da-117e9f1f7be3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86" status: 404 len: 111 microversion: 2.1 time: 0.028388 Apr 30 21:52:18.985937 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3021/5941] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:18 2022] GET /compute/v2.1/servers/f386bedd-b85f-414a-96df-07298ad66b86 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:52:30.876075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f106a00-52bf-49e1-abe4-802b1a15bde1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: .version_select at 0x7fdc208154c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1110964198"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:30.890919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f106a00-52bf-49e1-abe4-802b1a15bde1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:52:30.896583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f106a00-52bf-49e1-abe4-802b1a15bde1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:52:31.266762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f106a00-52bf-49e1-abe4-802b1a15bde1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:52:31.272902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-1f106a00-52bf-49e1-abe4-802b1a15bde1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:52:31.288630 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f106a00-52bf-49e1-abe4-802b1a15bde1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.577829 Apr 30 21:52:31.289225 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2921/5942] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:52:30 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:36.884281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-344554797", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f4402b35-971a-48cf-bc2d-3f5f5f47faa0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f1968efb-9997-4382-98a0-ab6f19a6ad8d"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:36.960692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] validate_networks() for [('f1968efb-9997-4382-98a0-ab6f19a6ad8d', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:52:38.140152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:52:38.140707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:52:38.141400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:52:38.141986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:52:38.142542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:52:38.152114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:38.152660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:38.153595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:38.154145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:38.171130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:52:38.177400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for user 4d838be38c1941eba44ffcfc6c17f002 and project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:52:38.238234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:52:38.240367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4402b35-971a-48cf-bc2d-3f5f5f47faa0',volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:52:38.592156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712630 Apr 30 21:52:38.594148 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3022/5943] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:52:38.618023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7fb50c20-5f9c-46e1-a375-ca0dcd60d2cd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:38.618847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7fb50c20-5f9c-46e1-a375-ca0dcd60d2cd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:38.690933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7fb50c20-5f9c-46e1-a375-ca0dcd60d2cd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:38.697986 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7fb50c20-5f9c-46e1-a375-ca0dcd60d2cd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1070 microversion: 2.1 time: 0.097385 Apr 30 21:52:38.699138 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2922/5944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:38 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1070 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:39.716178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:39.717435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:39.725156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:39.725895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:39.726928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:39.727582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:39.802642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1948435684", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "9cf87e88-0dfe-4815-b49c-8c1eeb03339d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1110964198", "security_groups": [{"name": "tempest-secgroup-smoke-1948744616"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:39.812092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:39.822034 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f19413b-6a75-4cbd-a98e-fa067a5cd467 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1120 microversion: 2.1 time: 0.109986 Apr 30 21:52:39.825956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3023/5945] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:39 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1120 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:39.927118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] validate_networks() for [('9cf87e88-0dfe-4815-b49c-8c1eeb03339d', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:52:40.366729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:52:40.367169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:52:40.367758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:52:40.368248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:52:40.368728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:52:40.378673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:40.379818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:40.380768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:40.381285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:40.399238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:52:40.404841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:52:40.421806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:52:40.424452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:52:40.557483 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eac4eead-f3ad-429c-8c49-7739b951d00a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759621 Apr 30 21:52:40.563167 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2923/5946] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:52:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:52:40.569341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-83c5ef7e-64d3-4c6a-9f4d-a2e585b36778 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:40.570495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-83c5ef7e-64d3-4c6a-9f4d-a2e585b36778 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:40.638593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-83c5ef7e-64d3-4c6a-9f4d-a2e585b36778 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:40.649144 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-83c5ef7e-64d3-4c6a-9f4d-a2e585b36778 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1267 microversion: 2.1 time: 0.084446 Apr 30 21:52:40.650245 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3024/5947] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:40 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:40.839615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:40.840285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:40.849437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:40.850005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:40.850873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:40.851429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:40.922242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:40.934522 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8e8d30a1-5ed8-4ca5-829e-e682c214d0a7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1176 microversion: 2.1 time: 0.098640 Apr 30 21:52:40.935546 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2924/5948] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:40 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1176 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:41.670286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-18ef7980-1ce3-48b3-9a2f-af8d19c4a211 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:41.672128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-18ef7980-1ce3-48b3-9a2f-af8d19c4a211 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:41.767703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-18ef7980-1ce3-48b3-9a2f-af8d19c4a211 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:41.779558 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-18ef7980-1ce3-48b3-9a2f-af8d19c4a211 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1267 microversion: 2.1 time: 0.114693 Apr 30 21:52:41.790264 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3025/5949] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:41 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1267 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:41.953373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:41.954796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:41.964079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:41.964955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:41.966566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:41.967436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:42.157899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:42.167299 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a7a72981-e6a5-4cc1-89f0-6ce11fc1bd10 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1228 microversion: 2.1 time: 0.219022 Apr 30 21:52:42.168226 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2925/5950] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:41 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1228 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:42.741704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-958273e3-8b2e-47ff-a32c-e0479724c329 req-a5229857-f6dc-4cde-9f16-a1bfd7d67571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0098f5bb-dee5-4817-8631-829f3f128ca3", "tag": "f223d792-369d-42d2-b92f-ca233aa6c3b4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:42.751323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-958273e3-8b2e-47ff-a32c-e0479724c329 req-a5229857-f6dc-4cde-9f16-a1bfd7d67571 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:42.752066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-958273e3-8b2e-47ff-a32c-e0479724c329 req-a5229857-f6dc-4cde-9f16-a1bfd7d67571 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:42.770576 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-958273e3-8b2e-47ff-a32c-e0479724c329 req-a5229857-f6dc-4cde-9f16-a1bfd7d67571 service nova] Creating event network-changed:f223d792-369d-42d2-b92f-ca233aa6c3b4 for instance 0098f5bb-dee5-4817-8631-829f3f128ca3 on nch1-master-1 Apr 30 21:52:42.776127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-958273e3-8b2e-47ff-a32c-e0479724c329 req-a5229857-f6dc-4cde-9f16-a1bfd7d67571 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052701 Apr 30 21:52:42.777283 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3026/5951] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:52:42.797055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:42.797749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:42.805572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:42.806356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:42.807295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:42.807888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:42.929611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:42.937909 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1093ebe6-9160-4df3-ac4e-acc1baf0ce97 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1319 microversion: 2.1 time: 0.145057 Apr 30 21:52:42.938503 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2926/5952] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:42 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:43.189529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:43.190304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:43.198854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:43.199317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:43.200124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:43.200713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:43.442678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:43.451633 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37adbd94-5008-42a1-b1cb-428a8542c1f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.266456 Apr 30 21:52:43.452172 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3027/5953] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:43 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:43.955500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:43.956056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:43.963425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:43.963888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:43.964682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:43.965128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:44.131578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:44.139040 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-69dceef3-a677-4a4f-adb2-6e40eab48f59 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.187537 Apr 30 21:52:44.139619 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2927/5954] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:43 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:44.468652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:44.469395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:44.476610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:44.477069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:44.478585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:44.479201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:44.726067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:44.733935 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19e9fc44-d914-4763-aa99-2847c9d061ad tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.269225 Apr 30 21:52:44.743138 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3028/5955] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:44 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:45.156630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:45.157255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:45.164535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:45.165018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:45.165810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:45.166252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:45.370264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-15f006b2-947d-4cbe-962f-3c66fb32cf21 req-21685d37-ff92-4359-b8cc-f4b076ef25a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:45.373951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:45.385167 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-682e5c57-c8f9-47d5-b2dd-ab4fb6e3b922 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.232280 Apr 30 21:52:45.390387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-15f006b2-947d-4cbe-962f-3c66fb32cf21 req-21685d37-ff92-4359-b8cc-f4b076ef25a0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:45.391167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-15f006b2-947d-4cbe-962f-3c66fb32cf21 req-21685d37-ff92-4359-b8cc-f4b076ef25a0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:45.395137 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2928/5956] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:45 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:45.405072 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-15f006b2-947d-4cbe-962f-3c66fb32cf21 req-21685d37-ff92-4359-b8cc-f4b076ef25a0 service nova] Creating event network-changed:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch2-master-1 Apr 30 21:52:45.412075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-15f006b2-947d-4cbe-962f-3c66fb32cf21 req-21685d37-ff92-4359-b8cc-f4b076ef25a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134128 Apr 30 21:52:45.412880 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3029/5957] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:52:45.752205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:45.753025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:45.759170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:45.759635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:45.760529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:45.760976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:45.890106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:45.898570 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16fe6f69-4abc-426b-ba4d-90e385850b0b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.150750 Apr 30 21:52:45.899145 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2929/5958] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:45 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:46.402920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:46.403657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:46.410715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:46.411171 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:46.411948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:46.412389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:46.544276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:46.552342 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45599284-a722-4b02-97a7-a2034964336c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.153978 Apr 30 21:52:46.552913 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3030/5959] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:46 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:46.915913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:46.916734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:46.923791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:46.924257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:46.925051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:46.925498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:47.157741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:47.165784 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7a8a9392-aa5c-45cf-aaf3-4438016786de tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.253765 Apr 30 21:52:47.166366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2930/5960] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:46 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:47.569830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:47.570380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:47.577112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:47.577590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:47.578575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:47.579077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:47.719567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:47.727546 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bbb4da5f-d303-4910-b078-9e2e52ba2b6b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.162306 Apr 30 21:52:47.728125 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3031/5961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:47 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:48.182827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:48.183368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:48.190062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:48.190517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:48.191288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:48.191723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:48.318368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:48.325915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c90e1f13-7ac2-4c18-91e1-90ce8efabd40 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.146976 Apr 30 21:52:48.326495 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2931/5962] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:48 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:52:48.743800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:48.744583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:48.751670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:48.752133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:48.752918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:48.753370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:48.895893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:48.904064 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6d51174-f3ff-402a-ac20-18153f5e4872 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.164361 Apr 30 21:52:48.904751 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3032/5963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:48 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:49.342847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:49.343500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:49.350317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:49.350770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:49.351539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:49.351987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:49.476078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:49.483635 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab3cf559-bfcc-4698-9612-f4d45d0119bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.144676 Apr 30 21:52:49.484207 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2932/5964] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:49 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:52:49.921870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:49.922433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:49.929161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:49.929612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:49.930414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:49.930929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:50.069279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:50.076618 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-66f1d42d-0c3b-4dbe-921f-1a1fb8d9861f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.158711 Apr 30 21:52:50.077188 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3033/5965] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:49 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:50.500869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:50.502104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:50.508948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:50.509409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:50.510403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:50.510707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:50.647399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:50.655175 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a9e6c89-2c1c-4db1-8681-579fc7d0e10f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.158230 Apr 30 21:52:50.655758 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2933/5966] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:50 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:50.658302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ade2c51b-5fc5-42c3-9140-35d2771e711c req-a829dc1a-9442-4543-81cc-486825a3b8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0098f5bb-dee5-4817-8631-829f3f128ca3", "name": "network-vif-plugged", "status": "completed", "tag": "f223d792-369d-42d2-b92f-ca233aa6c3b4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:50.668327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ade2c51b-5fc5-42c3-9140-35d2771e711c req-a829dc1a-9442-4543-81cc-486825a3b8ee service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:50.668910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ade2c51b-5fc5-42c3-9140-35d2771e711c req-a829dc1a-9442-4543-81cc-486825a3b8ee service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:50.680933 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ade2c51b-5fc5-42c3-9140-35d2771e711c req-a829dc1a-9442-4543-81cc-486825a3b8ee service nova] Creating event network-vif-plugged:f223d792-369d-42d2-b92f-ca233aa6c3b4 for instance 0098f5bb-dee5-4817-8631-829f3f128ca3 on nch1-master-1 Apr 30 21:52:50.686255 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ade2c51b-5fc5-42c3-9140-35d2771e711c req-a829dc1a-9442-4543-81cc-486825a3b8ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032632 Apr 30 21:52:50.686867 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3034/5967] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:52:51.094739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:51.095357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:51.102152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:51.102626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:51.103420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:51.103873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:51.231673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:51.239288 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab8175a6-9e4c-48b2-9756-269e207788ce tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.149937 Apr 30 21:52:51.243122 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2934/5968] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:51 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:51.673150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:51.673814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:51.681309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:51.681780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:51.682592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:51.683036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:51.813376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:51.821552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e2d15ce9-908b-4b4b-b5d3-c074aa1605a5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1216 microversion: 2.1 time: 0.152805 Apr 30 21:52:51.822156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3035/5969] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:51 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:52.256419 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:52.256949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:52.263775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:52.270098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:52.270098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:52.270098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:52.397055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:52.404741 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6acfae19-db57-478f-93cd-bff8feaf96d8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.152387 Apr 30 21:52:52.405314 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2935/5970] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:52 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:52.716645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f897de4d-f7b0-4b70-a6d3-1745f70e6ec7 req-5128eb80-7944-4758-946d-30b17005ce65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "name": "network-vif-plugged", "status": "completed", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:52.725633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f897de4d-f7b0-4b70-a6d3-1745f70e6ec7 req-5128eb80-7944-4758-946d-30b17005ce65 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:52.726176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f897de4d-f7b0-4b70-a6d3-1745f70e6ec7 req-5128eb80-7944-4758-946d-30b17005ce65 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:52.737084 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f897de4d-f7b0-4b70-a6d3-1745f70e6ec7 req-5128eb80-7944-4758-946d-30b17005ce65 service nova] Creating event network-vif-plugged:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch2-master-1 Apr 30 21:52:52.742060 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f897de4d-f7b0-4b70-a6d3-1745f70e6ec7 req-5128eb80-7944-4758-946d-30b17005ce65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029129 Apr 30 21:52:52.742640 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3036/5971] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:52:52.839407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:52.840147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:52.846251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:52.846720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:52.847514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:52.847968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:52.982308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:52.989628 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49301873-a930-4940-8d94-98eb856cc36a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1403 microversion: 2.1 time: 0.154221 Apr 30 21:52:52.990228 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2936/5972] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:52 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:52:53.006856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:53.007562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:53.013725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:53.014219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:53.015231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:53.015431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:53.168188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:53.177300 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4958fc96-88df-4191-b6de-509a209876f1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1403 microversion: 2.1 time: 0.175269 Apr 30 21:52:53.177906 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3037/5973] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:53 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:53.203845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-820097325"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:53.204947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:53.211154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:53.211622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:53.212442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:53.212892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:53.306855 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Attempting to quiesce instance before volume snapshot. Apr 30 21:52:53.391868 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Apr 30 21:52:53.424557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:53.425293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:53.433726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:53.434779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:53.435146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:53.435598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:53.573586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:53.581281 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9961601-fdc8-4be5-833a-de54acf57721 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1393 microversion: 2.1 time: 0.160598 Apr 30 21:52:53.582103 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3038/5974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:53 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:53.601653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Creating snapshot from volume f4402b35-971a-48cf-bc2d-3f5f5f47faa0. {{(pid=130670) snapshot_instance /opt/stack/nova/nova/compute/api.py:3452}} Apr 30 21:52:54.598209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:54.598865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:54.606136 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:54.606595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:54.607388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:54.607860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:54.739684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:54.747332 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80ed4662-16d8-4f51-a880-f6241dfb6223 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1565 microversion: 2.1 time: 0.153019 Apr 30 21:52:54.747909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3039/5975] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:54 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:52:54.764426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:54.764976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:54.770955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:54.776096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:54.776096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:54.776096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:54.906683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:54.914815 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-92ae35d9-7a5f-4399-843f-22d42cbeb28e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1565 microversion: 2.1 time: 0.154251 Apr 30 21:52:54.915476 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3040/5976] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:54 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:52:55.183702 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "POST /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3/action" status: 202 len: 0 microversion: 2.1 time: 1.983949 Apr 30 21:52:55.184340 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2937/5977] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:52:53 2022] POST /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3/action => generated 0 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 21:52:56.850777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-60157a02-5e5b-4427-991b-8f4a1daa42cc req-6988fc64-9b11-47a9-9209-b32a5505b1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:56.856107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:56.856730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:56.864623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:56.865080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:56.865900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:56.866344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:56.866617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60157a02-5e5b-4427-991b-8f4a1daa42cc req-6988fc64-9b11-47a9-9209-b32a5505b1cf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:56.867156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-60157a02-5e5b-4427-991b-8f4a1daa42cc req-6988fc64-9b11-47a9-9209-b32a5505b1cf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:56.878738 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-60157a02-5e5b-4427-991b-8f4a1daa42cc req-6988fc64-9b11-47a9-9209-b32a5505b1cf service nova] Creating event network-changed:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch2-master-1 Apr 30 21:52:56.884102 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-60157a02-5e5b-4427-991b-8f4a1daa42cc req-6988fc64-9b11-47a9-9209-b32a5505b1cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038779 Apr 30 21:52:56.885249 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2938/5978] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:52:57.080647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:57.088699 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac65113a-f556-4ce5-8166-0977c6afc444 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1565 microversion: 2.1 time: 0.246769 Apr 30 21:52:57.089269 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3041/5979] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:56 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1565 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:57.392866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-704660889", "imageRef": "04dc576d-3b92-4e9c-984c-dcc3d6f0bd97", "flavorRef": "452", "networks": [{"uuid": "f1968efb-9997-4382-98a0-ab6f19a6ad8d"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:52:57.449510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] validate_networks() for [('f1968efb-9997-4382-98a0-ab6f19a6ad8d', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:52:57.867084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:52:57.867673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:52:57.868016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:52:57.868448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:52:57.868883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:52:57.878030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:57.878623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:57.880115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:57.880581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:57.898708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:52:57.903904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for user 4d838be38c1941eba44ffcfc6c17f002 and project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:52:57.916968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:52:57.919649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='90f9ec0f-5dc4-4ae9-b383-af9018403276',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:52:58.046877 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-390c242b-b531-4442-ab59-a456205de4f0 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658246 Apr 30 21:52:58.050328 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2939/5980] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:52:58.058081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bc4c907c-c583-464b-9141-aa36e71efc5c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:58.058728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bc4c907c-c583-464b-9141-aa36e71efc5c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:58.111657 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bc4c907c-c583-464b-9141-aa36e71efc5c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:58.119268 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bc4c907c-c583-464b-9141-aa36e71efc5c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1229 microversion: 2.1 time: 0.065145 Apr 30 21:52:58.119800 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3042/5981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:58 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1229 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:52:59.137584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:52:59.138247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:52:59.145017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:59.145486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:59.146311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:52:59.146767 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:52:59.208404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:52:59.215778 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9cd258ef-b825-4dd6-9664-798b408dace3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1233 microversion: 2.1 time: 0.083262 Apr 30 21:52:59.216346 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2940/5982] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:52:59 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:00.233246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:00.234425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:00.241911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:00.242707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:00.244038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:00.244997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:00.316264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:00.323752 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-40c44468-84da-4ba5-8a3a-f12a2e7dc2c9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1299 microversion: 2.1 time: 0.095217 Apr 30 21:53:00.324332 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3043/5983] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:00 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:01.340693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:01.342015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:01.348874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:01.349456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:01.350286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:01.350741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:01.482448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:01.490786 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1361e91b-8d0c-4840-afbc-f57ed494f81f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1341 microversion: 2.1 time: 0.154102 Apr 30 21:53:01.491363 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2941/5984] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:01 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:02.059663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c03a8adf-5d43-4a80-85d0-31f62a9199fe req-77e2f990-558f-4c03-902b-ab26a1e93403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e993974-134c-40e4-a949-75f0b12a3321", "tag": "3fccd6f7-dd9b-4168-9eeb-f8a6671583a2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:02.069196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c03a8adf-5d43-4a80-85d0-31f62a9199fe req-77e2f990-558f-4c03-902b-ab26a1e93403 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:02.070206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c03a8adf-5d43-4a80-85d0-31f62a9199fe req-77e2f990-558f-4c03-902b-ab26a1e93403 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:02.084315 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c03a8adf-5d43-4a80-85d0-31f62a9199fe req-77e2f990-558f-4c03-902b-ab26a1e93403 service nova] Creating event network-changed:3fccd6f7-dd9b-4168-9eeb-f8a6671583a2 for instance 6e993974-134c-40e4-a949-75f0b12a3321 on nch1-master-1 Apr 30 21:53:02.089776 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c03a8adf-5d43-4a80-85d0-31f62a9199fe req-77e2f990-558f-4c03-902b-ab26a1e93403 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034843 Apr 30 21:53:02.091461 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3044/5985] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:53:02.511352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:02.511984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:02.519428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:02.520667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:02.521554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:02.522253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:02.662424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:02.670486 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-52eac305-7a54-4164-87d1-e86f01997ff8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1341 microversion: 2.1 time: 0.163052 Apr 30 21:53:02.671012 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2942/5986] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:02 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:03.688487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:03.689143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:03.696284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:03.696744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:03.697520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:03.698003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:03.833733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:03.841358 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-17246643-90f8-4821-88bd-c46f6cbf6d81 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1341 microversion: 2.1 time: 0.157163 Apr 30 21:53:03.841955 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3045/5987] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:03 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:53:04.859504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:04.860046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:04.867904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:04.868373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:04.869162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:04.869616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:04.996226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:05.003745 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-44964f7a-299e-4d65-8f57-7d6a6564eff2 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1341 microversion: 2.1 time: 0.148331 Apr 30 21:53:05.004313 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2943/5988] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:04 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1341 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:06.020746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:06.021300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:06.028528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:06.028981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:06.029783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:06.030216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:06.165055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:06.172448 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d25f0118-9436-45ec-9048-633ae5dfe694 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.155818 Apr 30 21:53:06.173016 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3046/5989] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:06 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:07.190337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:07.190969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:07.198428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:07.198911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:07.199702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:07.200163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:07.331083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:07.338780 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b5d7fb7-a2c6-4a42-a73b-3c0672309186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.152412 Apr 30 21:53:07.339364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2944/5990] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:07 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:08.355842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:08.356477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:08.363296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:08.363748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:08.364669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:08.365113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:08.502245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:08.510264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c906d6a-28a1-46d9-b91f-1c4b6a1be8bb tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.158329 Apr 30 21:53:08.510846 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3047/5991] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:08 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:09.527846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:09.528472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:09.535334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:09.535749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:09.537224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:09.537679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:09.670502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:09.678060 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f59ea18-4b82-4b2b-8b85-7a29e2dac64c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.154090 Apr 30 21:53:09.678632 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2945/5992] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:09 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:10.694426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:10.695048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:10.701994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:10.702450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:10.703229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:10.703669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:10.838763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:10.846200 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3647f041-41b7-4c53-9aa9-3cdeb1c8d9e7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.155626 Apr 30 21:53:10.846761 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3048/5993] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:10 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:11.863626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:11.864315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:11.871807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:11.872275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:11.873068 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:11.873523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:12.004725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:12.012874 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-686fd9fb-2329-4d60-b62a-248c3b79fdec tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.153176 Apr 30 21:53:12.013461 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2946/5994] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:11 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:12.689944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a5289d8d-ff38-4255-a962-2ba27c2cb729 req-efc4a784-5121-41d3-88f3-3aec235fe099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e993974-134c-40e4-a949-75f0b12a3321", "name": "network-vif-plugged", "status": "completed", "tag": "3fccd6f7-dd9b-4168-9eeb-f8a6671583a2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:12.698978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a5289d8d-ff38-4255-a962-2ba27c2cb729 req-efc4a784-5121-41d3-88f3-3aec235fe099 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:12.699433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a5289d8d-ff38-4255-a962-2ba27c2cb729 req-efc4a784-5121-41d3-88f3-3aec235fe099 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:12.710867 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a5289d8d-ff38-4255-a962-2ba27c2cb729 req-efc4a784-5121-41d3-88f3-3aec235fe099 service nova] Creating event network-vif-plugged:3fccd6f7-dd9b-4168-9eeb-f8a6671583a2 for instance 6e993974-134c-40e4-a949-75f0b12a3321 on nch1-master-1 Apr 30 21:53:12.716290 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a5289d8d-ff38-4255-a962-2ba27c2cb729 req-efc4a784-5121-41d3-88f3-3aec235fe099 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030800 Apr 30 21:53:12.720298 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3049/5995] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:53:13.030808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:13.031475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:13.038323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:13.040898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:13.040898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:13.040898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:13.184514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:13.192921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a51e4a99-7426-4cdd-ad39-9e2382f6d62d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.166020 Apr 30 21:53:13.193741 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2947/5996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:13 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:14.212151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:14.212838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:14.226729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:14.227859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:14.228913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:14.229215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:14.370486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:14.378107 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be594a0e-d7a8-4bdf-bf6e-3353a8ed9eb9 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1375 microversion: 2.1 time: 0.170973 Apr 30 21:53:14.378714 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3050/5997] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:14 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:15.397156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:15.398183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:15.405552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:15.406058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:15.406912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:15.407433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:15.541156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:15.548800 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0e4f8aa-09c9-4983-bbd3-e5f83f7a4020 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1562 microversion: 2.1 time: 0.156368 Apr 30 21:53:15.550358 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2948/5998] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:15 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:15.565287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:15.565947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:15.572784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:15.573245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:15.574054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:15.574502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:15.707186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:15.715149 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa8b919e-c903-4be7-9aa1-ff4f63ba75cf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1562 microversion: 2.1 time: 0.153812 Apr 30 21:53:15.715915 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3051/5999] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:15 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:15.783469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:15.783995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:15.791111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:15.791111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:15.791904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:15.792372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:15.817581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:53:16.193076 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 204 len: 0 microversion: 2.1 time: 0.413204 Apr 30 21:53:16.193680 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2949/6000] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:53:15 2022] DELETE /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:53:16.202449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:16.203208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:16.209269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:16.209726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:16.210517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:16.210956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:16.351292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:16.359415 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0633fe81-6368-4901-961a-8e93147a101c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1568 microversion: 2.1 time: 0.160834 Apr 30 21:53:16.363734 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3052/6001] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:16 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:17.377881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:17.378607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:17.385856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:17.386328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:17.387118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:17.387576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:17.517808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:17.526231 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a06513fc-06c3-4f8b-8b48-5e7d51b1cd9f tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1568 microversion: 2.1 time: 0.152620 Apr 30 21:53:17.526922 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2950/6002] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:17 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:53:18.481593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b38de0b6-2a56-40a4-8625-3bca24ed7fa1 req-f64aaa02-36f0-4194-b279-acd95a30001e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e993974-134c-40e4-a949-75f0b12a3321", "name": "network-vif-deleted", "tag": "3fccd6f7-dd9b-4168-9eeb-f8a6671583a2"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:18.493130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b38de0b6-2a56-40a4-8625-3bca24ed7fa1 req-f64aaa02-36f0-4194-b279-acd95a30001e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:18.493934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b38de0b6-2a56-40a4-8625-3bca24ed7fa1 req-f64aaa02-36f0-4194-b279-acd95a30001e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:18.505662 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b38de0b6-2a56-40a4-8625-3bca24ed7fa1 req-f64aaa02-36f0-4194-b279-acd95a30001e service nova] Creating event network-vif-deleted:3fccd6f7-dd9b-4168-9eeb-f8a6671583a2 for instance 6e993974-134c-40e4-a949-75f0b12a3321 on nch1-master-1 Apr 30 21:53:18.512070 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b38de0b6-2a56-40a4-8625-3bca24ed7fa1 req-f64aaa02-36f0-4194-b279-acd95a30001e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036889 Apr 30 21:53:18.512991 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3053/6003] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:53:18.547148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:18.550800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:18.555520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:18.556113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:18.556947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:18.557420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:18.626631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:18.634605 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11068933-c72e-455f-9803-e9358911bb9d tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1526 microversion: 2.1 time: 0.093704 Apr 30 21:53:18.635198 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2951/6004] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:18 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1526 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:19.652570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:19.653299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:19.660324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:19.660770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:19.661537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:19.662024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:19.693375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:19.693854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:19.697420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lazy-loading 'fault' on Instance uuid 6e993974-134c-40e4-a949-75f0b12a3321 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:53:19.739493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:19.747633 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-46658673-679b-46c3-9990-09990b47af79 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 200 len: 1365 microversion: 2.1 time: 0.099562 Apr 30 21:53:19.748206 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3054/6005] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:19 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:20.341542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-015af19a-5d16-45b7-97f8-1dd33eca394b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:20.342614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-015af19a-5d16-45b7-97f8-1dd33eca394b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:20.349465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-015af19a-5d16-45b7-97f8-1dd33eca394b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:20.349981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-015af19a-5d16-45b7-97f8-1dd33eca394b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:20.355836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-015af19a-5d16-45b7-97f8-1dd33eca394b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:20.355836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-015af19a-5d16-45b7-97f8-1dd33eca394b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:20.398184 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-015af19a-5d16-45b7-97f8-1dd33eca394b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action" status: 200 len: 24572 microversion: 2.1 time: 0.060836 Apr 30 21:53:20.399070 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2952/6006] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:53:20 2022] POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action => generated 24572 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:53:20.776437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:20.777048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:20.783901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:20.787859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:20.787859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:20.787859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:20.798844 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance 6e993974-134c-40e4-a949-75f0b12a3321 could not be found. Apr 30 21:53:20.804867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance 6e993974-134c-40e4-a949-75f0b12a3321 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:53:20.804867 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-13c2f022-f636-47f2-a662-9254f45becf5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 404 len: 111 microversion: 2.1 time: 0.028105 Apr 30 21:53:20.804867 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3055/6007] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:20 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:53:31.371152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3f2d7b5d-b2d3-4d06-a4b3-fd460e1f5226 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:31.371903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3f2d7b5d-b2d3-4d06-a4b3-fd460e1f5226 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:31.380613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f2d7b5d-b2d3-4d06-a4b3-fd460e1f5226 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:31.381082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f2d7b5d-b2d3-4d06-a4b3-fd460e1f5226 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:31.381917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f2d7b5d-b2d3-4d06-a4b3-fd460e1f5226 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:31.382371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3f2d7b5d-b2d3-4d06-a4b3-fd460e1f5226 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:31.694766 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3f2d7b5d-b2d3-4d06-a4b3-fd460e1f5226 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1834 microversion: 2.1 time: 0.327687 Apr 30 21:53:31.700643 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2953/6008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:31 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1834 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:31.714713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:31.715533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:31.722847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:31.723337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:31.724122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:31.724568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:31.860732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:31.868250 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-422eebf4-32a4-4745-8144-9ca5aef04634 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1683 microversion: 2.1 time: 0.157977 Apr 30 21:53:31.868811 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3056/6009] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:31 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:31.968792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-99b9cb9f-02e8-49a5-a736-1032ddd07035 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:31.969777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-99b9cb9f-02e8-49a5-a736-1032ddd07035 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:31.976879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b9cb9f-02e8-49a5-a736-1032ddd07035 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:31.977345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b9cb9f-02e8-49a5-a736-1032ddd07035 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:31.978161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b9cb9f-02e8-49a5-a736-1032ddd07035 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:31.978680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b9cb9f-02e8-49a5-a736-1032ddd07035 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:32.030458 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-99b9cb9f-02e8-49a5-a736-1032ddd07035 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action" status: 200 len: 32647 microversion: 2.1 time: 0.065581 Apr 30 21:53:32.031136 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2954/6010] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:53:31 2022] POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action => generated 32647 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:53:32.206187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:32.208720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:32.212927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:32.213386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:32.214199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:32.214642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:32.252881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1f895f6258fe4d38bfa01a33d9d51f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a221b784f54288ba132d18b7785965', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:32.253521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] flavor_id is None. Assuming migration. {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 30 21:53:32.254012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 21:53:32.626015 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b92a9a8-8d33-4501-8152-8e70b625ff5a tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action" status: 202 len: 0 microversion: 2.1 time: 0.423406 Apr 30 21:53:32.626543 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3057/6011] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:53:32 2022] POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:53:32.635297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:32.636655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:32.643553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:32.644237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:32.645048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:32.645518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:32.781285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:32.788984 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56deb330-12bf-4cd0-b224-591a80af89f0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1692 microversion: 2.1 time: 0.157927 Apr 30 21:53:32.789562 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2955/6012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:32 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:53:33.807107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:33.807727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:33.815507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:33.815970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:33.816751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:33.817198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:33.954561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:33.963930 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-062bfed1-55ed-43c9-b4b3-ca0f48431dc8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1692 microversion: 2.1 time: 0.160824 Apr 30 21:53:33.964510 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3058/6013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:33 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:34.981360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:34.982105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:34.989042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:34.989512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:34.990390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:34.990847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:35.119954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:35.128276 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bdbc5dde-4c38-4c2a-84be-3da320502a4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1692 microversion: 2.1 time: 0.151055 Apr 30 21:53:35.128889 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2956/6014] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:34 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:36.146361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:36.146974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:36.154269 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:36.154722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:36.155494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:36.156082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:36.294712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:36.303802 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9cb08689-6d46-4158-ae2e-8076a9a5de20 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.159995 Apr 30 21:53:36.303802 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3059/6015] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:36 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:37.320473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:37.321116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:37.328001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:37.328974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:37.329786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:37.330232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:37.463851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:37.471887 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bfe173ae-be9c-4522-8a2f-8f6d8bad2968 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.155526 Apr 30 21:53:37.472472 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2957/6016] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:37 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:38.489030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:38.489682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:38.496697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:38.497137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:38.497939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:38.498379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:38.631190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:38.639082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-38d9ff68-444a-4871-8a67-f54d093e938d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.154508 Apr 30 21:53:38.641156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3060/6017] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:38 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:39.657099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:39.657739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:39.664475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:39.666568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:39.666568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:39.666568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:39.800650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:39.808060 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b5a11666-5228-4fc0-a2c5-e59e8046ca13 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.155670 Apr 30 21:53:39.808637 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2958/6018] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:39 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:40.825400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:40.825400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:40.834170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:40.834624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:40.835480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:40.835964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:40.997459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:41.005718 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ea12e833-8289-436e-9a20-3cc644f5dfb1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.185117 Apr 30 21:53:41.006265 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3061/6019] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:40 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:42.024184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:42.024856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:42.032123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:42.032592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:42.033438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:42.033933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:42.164928 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:42.172653 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18a42193-21e2-46a9-b4db-13f7b9bd2b27 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.152688 Apr 30 21:53:42.173233 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2959/6020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:42 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:43.190513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:43.191168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:43.197988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:43.198441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:43.199213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:43.199653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:43.334045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:43.341650 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9bcc09c3-a10d-47e4-af47-e44c0ca59638 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.155616 Apr 30 21:53:43.342249 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3062/6021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:43 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:44.357865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:44.358495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:44.365315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:44.365818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:44.366645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:44.367104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:44.502682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:44.510278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3d140705-8286-491f-a39c-aed3bf165e9f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.156449 Apr 30 21:53:44.510852 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2960/6022] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:44 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:45.527591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:45.528206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:45.535190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:45.535599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:45.536379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:45.536832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:45.665511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:45.673748 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c26b8cf-ec8a-45f9-ba8b-9dba683c3642 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.150098 Apr 30 21:53:45.674334 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3063/6023] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:45 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:46.690507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:46.691171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:46.697904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:46.698376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:46.699276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:46.699733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:46.836955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:46.844326 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67040f65-e612-45ad-9362-8719c9253843 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.157933 Apr 30 21:53:46.845531 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2961/6024] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:46 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:47.861697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:47.862354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:47.869167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:47.869616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:47.870412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:47.870854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:48.049619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:48.057180 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-44a6b5df-ed53-482f-b7a7-9e9c8bd33116 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1697 microversion: 2.1 time: 0.199912 Apr 30 21:53:48.057847 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3064/6025] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:47 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1697 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:53:48.988241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-116045ed-1869-41dd-b33f-e557c8ed5751 req-97379375-db18-4318-a205-e1e2df7b94ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "name": "network-vif-unplugged", "status": "completed", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:48.996842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-116045ed-1869-41dd-b33f-e557c8ed5751 req-97379375-db18-4318-a205-e1e2df7b94ca service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:49.001428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-116045ed-1869-41dd-b33f-e557c8ed5751 req-97379375-db18-4318-a205-e1e2df7b94ca service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:49.009537 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-116045ed-1869-41dd-b33f-e557c8ed5751 req-97379375-db18-4318-a205-e1e2df7b94ca service nova] Creating event network-vif-unplugged:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch1-master-1 Apr 30 21:53:49.014991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-116045ed-1869-41dd-b33f-e557c8ed5751 req-97379375-db18-4318-a205-e1e2df7b94ca service nova] Instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:53:49.026507 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-116045ed-1869-41dd-b33f-e557c8ed5751 req-97379375-db18-4318-a205-e1e2df7b94ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042406 Apr 30 21:53:49.027118 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2962/6026] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:53:49.074225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:49.074848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:49.081918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:49.082383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:49.083177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:49.083621 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:49.233739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:49.244149 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ac1e487-bfbc-4ea5-af59-1ac0456531d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1696 microversion: 2.1 time: 0.173714 Apr 30 21:53:49.244756 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3065/6027] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:49 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:50.273319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:50.274810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:50.282045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:50.287873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:50.287873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:50.287873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:50.420615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:50.428445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81ee2a31-f59e-4a09-a947-04791886aae9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1696 microversion: 2.1 time: 0.160696 Apr 30 21:53:50.429034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2963/6028] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:50 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:51.041088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-739e738a-b07a-4117-8b5a-9166b2c7e6e4 req-c2fbad68-2718-4b60-a6ec-39f11566804f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:51.050596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-739e738a-b07a-4117-8b5a-9166b2c7e6e4 req-c2fbad68-2718-4b60-a6ec-39f11566804f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:51.052590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-739e738a-b07a-4117-8b5a-9166b2c7e6e4 req-c2fbad68-2718-4b60-a6ec-39f11566804f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:51.062820 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-739e738a-b07a-4117-8b5a-9166b2c7e6e4 req-c2fbad68-2718-4b60-a6ec-39f11566804f service nova] Creating event network-changed:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch1-master-1 Apr 30 21:53:51.068245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-739e738a-b07a-4117-8b5a-9166b2c7e6e4 req-c2fbad68-2718-4b60-a6ec-39f11566804f service nova] Instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:53:51.079173 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-739e738a-b07a-4117-8b5a-9166b2c7e6e4 req-c2fbad68-2718-4b60-a6ec-39f11566804f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041880 Apr 30 21:53:51.081267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3066/6029] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:53:51.445866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:51.452215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:51.453619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:51.454653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:51.455461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:51.455920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:51.669654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:51.677293 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5d6150d8-2806-4815-bc84-4d5e7871a7b4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1694 microversion: 2.1 time: 0.235708 Apr 30 21:53:51.677920 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2964/6030] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:51 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1694 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:52.696778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:52.700029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:52.705795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:52.706315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:52.707177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:52.707770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:52.844589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:52.852982 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9e0fac6-3433-46b5-b93a-bc305aa61977 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1691 microversion: 2.1 time: 0.161264 Apr 30 21:53:52.853551 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3067/6031] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:52 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:52.875229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fce04900-0c00-443b-84f6-e5a2d3c6b12f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:52.876385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fce04900-0c00-443b-84f6-e5a2d3c6b12f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:52.883879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fce04900-0c00-443b-84f6-e5a2d3c6b12f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:52.884356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fce04900-0c00-443b-84f6-e5a2d3c6b12f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:52.885162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fce04900-0c00-443b-84f6-e5a2d3c6b12f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:52.885623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fce04900-0c00-443b-84f6-e5a2d3c6b12f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:53.146753 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fce04900-0c00-443b-84f6-e5a2d3c6b12f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action" status: 204 len: 0 microversion: 2.1 time: 0.275330 Apr 30 21:53:53.148399 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2965/6032] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:53:52 2022] POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:53:53.156177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:53.156792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:53.164035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:53.164764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:53.165742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:53.166225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:53.379649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:53.387753 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71d6c13a-ae9d-43dc-b715-a767dd8f3a6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1691 microversion: 2.1 time: 0.235357 Apr 30 21:53:53.388334 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3068/6033] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:53 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:54.407136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:54.407881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:54.413977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:54.414558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:54.415360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:54.415807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:54.554154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:54.562080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1c3403e7-0bc2-4412-a139-70c6d147934b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1691 microversion: 2.1 time: 0.159895 Apr 30 21:53:54.562661 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2966/6034] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:54 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:54.966237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f0d7c57d-a13a-4b1c-be0e-c45f92b42077 req-07d8fa99-8539-4994-bd7f-34827363e9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "name": "network-vif-plugged", "status": "completed", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:53:54.976298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f0d7c57d-a13a-4b1c-be0e-c45f92b42077 req-07d8fa99-8539-4994-bd7f-34827363e9df service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:54.976747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f0d7c57d-a13a-4b1c-be0e-c45f92b42077 req-07d8fa99-8539-4994-bd7f-34827363e9df service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:54.991330 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f0d7c57d-a13a-4b1c-be0e-c45f92b42077 req-07d8fa99-8539-4994-bd7f-34827363e9df service nova] Creating event network-vif-plugged:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch1-master-1 Apr 30 21:53:54.996430 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f0d7c57d-a13a-4b1c-be0e-c45f92b42077 req-07d8fa99-8539-4994-bd7f-34827363e9df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033905 Apr 30 21:53:54.997018 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3069/6035] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:53:55.580515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:55.581249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:55.588154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:55.588627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:55.589448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:55.589953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:55.727290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:55.734941 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c205e5d6-23da-495d-8629-9da39fdfbeb5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1683 microversion: 2.1 time: 0.159001 Apr 30 21:53:55.735525 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2967/6036] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:55 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:53:59.135439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:59.136048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:59.141956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:59.142980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:59.143756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:59.144203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:59.168736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:53:59.393133 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b46772b-5ec6-4422-afda-55c52f19531b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 204 len: 0 microversion: 2.1 time: 0.262432 Apr 30 21:53:59.393663 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3070/6037] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:53:59 2022] DELETE /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:53:59.402000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:53:59.402637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:53:59.409361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:59.409868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:59.410669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:53:59.411132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:53:59.541607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:53:59.549717 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-49dff842-fcf4-4c40-a49e-66c8bb42e021 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1409 microversion: 2.1 time: 0.151597 Apr 30 21:53:59.550316 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2968/6038] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:53:59 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1409 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:00.569491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:00.570702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:00.579619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:00.580073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:00.580846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:00.581282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:00.719863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:00.719863 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b245f888-ed56-4bac-aef3-7d15aa593ad5 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1409 microversion: 2.1 time: 0.153560 Apr 30 21:54:00.719863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3071/6039] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:00 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:01.738010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-76f055b3-553e-4e21-94fa-dd1902f88ce4 req-086bbed7-572d-4fe3-b1d6-f252c377c9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0098f5bb-dee5-4817-8631-829f3f128ca3", "name": "network-vif-deleted", "tag": "f223d792-369d-42d2-b92f-ca233aa6c3b4"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:01.738713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:01.739859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:01.747001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:01.753935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:01.754078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-76f055b3-553e-4e21-94fa-dd1902f88ce4 req-086bbed7-572d-4fe3-b1d6-f252c377c9c1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:01.754189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:01.754273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-76f055b3-553e-4e21-94fa-dd1902f88ce4 req-086bbed7-572d-4fe3-b1d6-f252c377c9c1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:01.754360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:01.765002 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-76f055b3-553e-4e21-94fa-dd1902f88ce4 req-086bbed7-572d-4fe3-b1d6-f252c377c9c1 service nova] Creating event network-vif-deleted:f223d792-369d-42d2-b92f-ca233aa6c3b4 for instance 0098f5bb-dee5-4817-8631-829f3f128ca3 on nch1-master-1 Apr 30 21:54:01.771062 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-76f055b3-553e-4e21-94fa-dd1902f88ce4 req-086bbed7-572d-4fe3-b1d6-f252c377c9c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037335 Apr 30 21:54:01.771926 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3072/6040] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:01.819619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:01.827871 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-62e87c85-ab2c-482d-8e2f-49f8dec3b459 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1367 microversion: 2.1 time: 0.097686 Apr 30 21:54:01.828493 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2969/6041] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:01 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:02.849684 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:02.850421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:02.857713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:02.858213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:02.859001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:02.859447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:02.891241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:02.891801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:02.893230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lazy-loading 'fault' on Instance uuid 0098f5bb-dee5-4817-8631-829f3f128ca3 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:54:02.933777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:02.941745 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19ece0d4-a8aa-452a-8269-1b72176e1548 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 200 len: 1206 microversion: 2.1 time: 0.097053 Apr 30 21:54:02.942342 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3073/6042] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:02 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 1206 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:03.959520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:03.960155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:03.966629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:03.967103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:03.967895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:03.968354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:03.981810 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance 0098f5bb-dee5-4817-8631-829f3f128ca3 could not be found. Apr 30 21:54:03.982423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance 0098f5bb-dee5-4817-8631-829f3f128ca3 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:54:03.983255 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-34dd62c8-2445-4c87-add0-636fb20d8e48 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 404 len: 111 microversion: 2.1 time: 0.028486 Apr 30 21:54:03.983781 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2970/6043] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:03 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:54:09.259296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:09.259800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:09.266700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:09.272329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:09.272329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:09.272329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:09.283527 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance 6e993974-134c-40e4-a949-75f0b12a3321 could not be found. Apr 30 21:54:09.284130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance 6e993974-134c-40e4-a949-75f0b12a3321 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:54:09.284971 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99669959-47f7-46d1-bb90-df59cb07c05b tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 404 len: 111 microversion: 2.1 time: 0.029640 Apr 30 21:54:09.285516 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3074/6044] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:54:09 2022] DELETE /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:54:09.293735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:09.294390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 6e993974-134c-40e4-a949-75f0b12a3321] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:09.301539 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:09.302077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:09.302877 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:09.303336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:09.317217 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance 6e993974-134c-40e4-a949-75f0b12a3321 could not be found. Apr 30 21:54:09.317852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance 6e993974-134c-40e4-a949-75f0b12a3321 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:54:09.318734 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cab65099-a214-40ce-a259-888bacee5dae tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321" status: 404 len: 111 microversion: 2.1 time: 0.028871 Apr 30 21:54:09.319276 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2971/6045] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:09 2022] GET /compute/v2.1/servers/6e993974-134c-40e4-a949-75f0b12a3321 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:54:10.104551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:10.105087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:10.111590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:10.112051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:10.112995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:10.114489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:10.131710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance 0098f5bb-dee5-4817-8631-829f3f128ca3 could not be found. Apr 30 21:54:10.132309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance 0098f5bb-dee5-4817-8631-829f3f128ca3 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:54:10.133191 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41c4b77a-322e-4d7f-8799-abaee9f06dd8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 404 len: 111 microversion: 2.1 time: 0.032734 Apr 30 21:54:10.133735 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3075/6046] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:54:10 2022] DELETE /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:54:10.142054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:10.142713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: 0098f5bb-dee5-4817-8631-829f3f128ca3] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:10.148891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:10.149362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:10.150185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:10.150644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:10.163990 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance 0098f5bb-dee5-4817-8631-829f3f128ca3 could not be found. Apr 30 21:54:10.164589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance 0098f5bb-dee5-4817-8631-829f3f128ca3 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:54:10.165425 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fa5c6c24-34c3-4953-ac31-ad523273874c tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3" status: 404 len: 111 microversion: 2.1 time: 0.027369 Apr 30 21:54:10.165981 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2972/6047] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:10 2022] GET /compute/v2.1/servers/0098f5bb-dee5-4817-8631-829f3f128ca3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:54:10.234352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b7588246-cba0-4120-b275-af007d2e866e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Action: 'create', calling method: .version_select at 0x7fdc135feee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1741964513"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:10.249251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b7588246-cba0-4120-b275-af007d2e866e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:54:10.255263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b7588246-cba0-4120-b275-af007d2e866e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for user 4d838be38c1941eba44ffcfc6c17f002 and project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:54:10.499343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b7588246-cba0-4120-b275-af007d2e866e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:54:10.504578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-b7588246-cba0-4120-b275-af007d2e866e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for user 4d838be38c1941eba44ffcfc6c17f002 and project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:54:10.520057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b7588246-cba0-4120-b275-af007d2e866e tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.289485 Apr 30 21:54:10.520696 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3076/6048] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:54:10 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:17.591967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1454152813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1741964513", "security_groups": [{"name": "tempest-secgroup-smoke-1508082721"}], "block_device_mapping_v2": [{"uuid": "73e426da-a6ca-4d21-b50f-30bf936473a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f1968efb-9997-4382-98a0-ab6f19a6ad8d"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:17.700280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] validate_networks() for [('f1968efb-9997-4382-98a0-ab6f19a6ad8d', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:54:18.058117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:54:18.058565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:54:18.059058 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:54:18.059487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:54:18.059919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:54:18.068781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:18.069248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:18.070096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:18.070552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:18.086788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:54:18.092030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Getting quotas for user 4d838be38c1941eba44ffcfc6c17f002 and project 839ab2af4d6b40c3b957be9c7dc78b26. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:54:18.150828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:54:18.153020 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73e426da-a6ca-4d21-b50f-30bf936473a1',volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:54:18.502700 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.914664 Apr 30 21:54:18.503345 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2973/6049] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:54:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:54:18.515041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e35ff5b9-29b1-49b0-853b-82cef4b06ffd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:18.519453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e35ff5b9-29b1-49b0-853b-82cef4b06ffd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:18.569903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e35ff5b9-29b1-49b0-853b-82cef4b06ffd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:18.576861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e35ff5b9-29b1-49b0-853b-82cef4b06ffd tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1095 microversion: 2.1 time: 0.066592 Apr 30 21:54:18.577667 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3077/6050] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:18 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:54:19.595242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:19.595932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:19.602284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:19.602755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:19.603541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:19.603997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:19.666493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:19.674138 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35bb5dab-703b-490a-97e5-89881a8d0daa tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1137 microversion: 2.1 time: 0.083878 Apr 30 21:54:19.674732 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2974/6051] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:19 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:19.930902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ae41486-408b-4ad7-b098-a1d118a0e854 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:19.931746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ae41486-408b-4ad7-b098-a1d118a0e854 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:19.939107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ae41486-408b-4ad7-b098-a1d118a0e854 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:19.939561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ae41486-408b-4ad7-b098-a1d118a0e854 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:19.940327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ae41486-408b-4ad7-b098-a1d118a0e854 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:19.940785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ae41486-408b-4ad7-b098-a1d118a0e854 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:19.992417 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ae41486-408b-4ad7-b098-a1d118a0e854 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action" status: 200 len: 24572 microversion: 2.1 time: 0.065325 Apr 30 21:54:19.993063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3078/6052] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:54:19 2022] POST /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03/action => generated 24572 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:54:20.692494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:20.693274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:20.700298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:20.700774 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:20.701987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:20.702641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:20.779951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:20.788201 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e93a352-94a3-4cfc-874a-018145c5b6f8 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1211 microversion: 2.1 time: 0.100486 Apr 30 21:54:20.788735 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2975/6053] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:20 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:21.805884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:21.806686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:21.814327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:21.814855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:21.815732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:21.816816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:21.955254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:21.963497 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b9096b6f-e0f4-420a-a564-468080a72bc6 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1279 microversion: 2.1 time: 0.162195 Apr 30 21:54:21.964066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3079/6054] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:21 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:22.121650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-52cd748b-2e67-401c-b056-c0699ec5b838 req-202b84f8-337a-4c47-b672-ba59a9064089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af31b0c5-c096-4cf6-9bf1-6f00587c0c26", "tag": "1fc802f0-1162-4d58-8092-e6c04cc94cdf"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:22.137576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-52cd748b-2e67-401c-b056-c0699ec5b838 req-202b84f8-337a-4c47-b672-ba59a9064089 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:22.138090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-52cd748b-2e67-401c-b056-c0699ec5b838 req-202b84f8-337a-4c47-b672-ba59a9064089 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:22.151273 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-52cd748b-2e67-401c-b056-c0699ec5b838 req-202b84f8-337a-4c47-b672-ba59a9064089 service nova] Creating event network-changed:1fc802f0-1162-4d58-8092-e6c04cc94cdf for instance af31b0c5-c096-4cf6-9bf1-6f00587c0c26 on nch1-master-1 Apr 30 21:54:22.156356 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-52cd748b-2e67-401c-b056-c0699ec5b838 req-202b84f8-337a-4c47-b672-ba59a9064089 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041432 Apr 30 21:54:22.161941 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2976/6055] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:22.980420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:22.981034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:22.988585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:22.988980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:22.989747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:22.990209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:23.117976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:23.125527 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e0c3abbb-921b-44bd-a7a9-369b4b1ae8b3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1267 microversion: 2.1 time: 0.148995 Apr 30 21:54:23.126180 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3080/6056] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:22 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:24.145062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:24.145805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:24.152442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:24.152914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:24.153710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:24.154186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:24.288636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:24.296209 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5c0d9118-bf40-4094-8056-bdf903732dd1 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1267 microversion: 2.1 time: 0.156884 Apr 30 21:54:24.297613 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2977/6057] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:24 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:25.312901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:25.313522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:25.320297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:25.320749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:25.321516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:25.321980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:25.451479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:25.458846 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-365cd666-66af-4c81-a8f0-505b4928d633 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1267 microversion: 2.1 time: 0.149863 Apr 30 21:54:25.459425 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3081/6058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:25 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:26.329768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f71ae9d-0dd8-4841-ae2b-8d9453c2afd2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:26.330440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f71ae9d-0dd8-4841-ae2b-8d9453c2afd2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:26.337982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f71ae9d-0dd8-4841-ae2b-8d9453c2afd2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:26.338456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f71ae9d-0dd8-4841-ae2b-8d9453c2afd2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:26.339265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f71ae9d-0dd8-4841-ae2b-8d9453c2afd2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:26.339726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f71ae9d-0dd8-4841-ae2b-8d9453c2afd2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:26.468935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f71ae9d-0dd8-4841-ae2b-8d9453c2afd2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1834 microversion: 2.1 time: 0.143008 Apr 30 21:54:26.469532 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2978/6059] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:26 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1834 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:26.475499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:26.476207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:26.483261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:26.483719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:26.484504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:26.484946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:26.694773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:26.702407 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5129ba74-b5ae-4ae3-995b-f78df163eef3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1267 microversion: 2.1 time: 0.230675 Apr 30 21:54:26.703027 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3082/6060] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:26 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:27.718876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:27.719542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:27.726348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:27.726821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:27.727655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:27.728111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:27.826836 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:27.827337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:27.834935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:27.835689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:27.836478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:27.836919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:27.863692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:54:27.891647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:27.900036 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ace2869a-23ea-4a56-aeb0-3b46870b0cbe tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1267 microversion: 2.1 time: 0.184990 Apr 30 21:54:27.900616 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2979/6061] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:27 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:27.905080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d0652400-ba4c-4ec5-ae85-b76f807eb7d5 req-b33146ff-f3f9-49ac-9652-782ee42f887e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:27.913189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d0652400-ba4c-4ec5-ae85-b76f807eb7d5 req-b33146ff-f3f9-49ac-9652-782ee42f887e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:27.913656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d0652400-ba4c-4ec5-ae85-b76f807eb7d5 req-b33146ff-f3f9-49ac-9652-782ee42f887e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:27.924435 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d0652400-ba4c-4ec5-ae85-b76f807eb7d5 req-b33146ff-f3f9-49ac-9652-782ee42f887e service nova] Creating event network-changed:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch1-master-1 Apr 30 21:54:27.930137 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d0652400-ba4c-4ec5-ae85-b76f807eb7d5 req-b33146ff-f3f9-49ac-9652-782ee42f887e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028352 Apr 30 21:54:27.930735 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2980/6062] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:28.084696 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc7bf74d-7532-49d0-85a9-c581adbf2200 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 204 len: 0 microversion: 2.1 time: 0.261990 Apr 30 21:54:28.085498 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3083/6063] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:54:27 2022] DELETE /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:54:28.094799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:28.095524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:28.101839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:28.102319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:28.103125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:28.103587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:28.240472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:28.248171 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-383ab12a-f6d7-436d-89a0-9851b48483da tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1689 microversion: 2.1 time: 0.157812 Apr 30 21:54:28.248683 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2981/6064] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:28 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:28.917870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:28.918576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:28.925461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:28.925963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:28.926736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:28.927222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:29.065781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:29.073873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2e1cd131-7164-402e-b534-41eb4ea98812 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1267 microversion: 2.1 time: 0.160438 Apr 30 21:54:29.074463 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3084/6065] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:28 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:29.096815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-83996bb1-5e73-43a8-83be-f259c8b23b70 req-7dcc24b4-3605-4832-9e66-1b1507ed2bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31b0c5-c096-4cf6-9bf1-6f00587c0c26", "name": "network-vif-plugged", "status": "completed", "tag": "1fc802f0-1162-4d58-8092-e6c04cc94cdf"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:29.106030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-83996bb1-5e73-43a8-83be-f259c8b23b70 req-7dcc24b4-3605-4832-9e66-1b1507ed2bf6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:29.106526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-83996bb1-5e73-43a8-83be-f259c8b23b70 req-7dcc24b4-3605-4832-9e66-1b1507ed2bf6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:29.117270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-83996bb1-5e73-43a8-83be-f259c8b23b70 req-7dcc24b4-3605-4832-9e66-1b1507ed2bf6 service nova] Creating event network-vif-plugged:1fc802f0-1162-4d58-8092-e6c04cc94cdf for instance af31b0c5-c096-4cf6-9bf1-6f00587c0c26 on nch1-master-1 Apr 30 21:54:29.122109 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-83996bb1-5e73-43a8-83be-f259c8b23b70 req-7dcc24b4-3605-4832-9e66-1b1507ed2bf6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029094 Apr 30 21:54:29.122693 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2982/6066] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:29.266761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:29.267500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:29.276149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:29.276941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:29.277882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:29.278337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:29.447721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:29.455438 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a8124e3-48df-46f4-80d9-af10b8b9858f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1689 microversion: 2.1 time: 0.193480 Apr 30 21:54:29.456043 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3085/6067] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:29 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:30.092447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:30.093115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:30.099807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:30.100455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:30.101080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:30.101544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:30.285911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a9a003d3-f829-4ca6-987d-bdf63312e7bf req-91c294e1-0d44-465a-a4b6-71b4731301ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03", "name": "network-vif-deleted", "tag": "a21d80d5-f736-4446-bbff-4418a0218d9c"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:30.294899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a9a003d3-f829-4ca6-987d-bdf63312e7bf req-91c294e1-0d44-465a-a4b6-71b4731301ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:30.295379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a9a003d3-f829-4ca6-987d-bdf63312e7bf req-91c294e1-0d44-465a-a4b6-71b4731301ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:30.306811 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a9a003d3-f829-4ca6-987d-bdf63312e7bf req-91c294e1-0d44-465a-a4b6-71b4731301ed service nova] Creating event network-vif-deleted:a21d80d5-f736-4446-bbff-4418a0218d9c for instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 on nch1-master-1 Apr 30 21:54:30.310176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:30.311784 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a9a003d3-f829-4ca6-987d-bdf63312e7bf req-91c294e1-0d44-465a-a4b6-71b4731301ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030195 Apr 30 21:54:30.312629 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3086/6068] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:30.318211 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c21bbcf2-bd89-46d6-93df-28b7bf6f8da3 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1267 microversion: 2.1 time: 0.230199 Apr 30 21:54:30.318785 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2983/6069] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:30 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:30.473773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:30.474440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:30.480851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:30.482522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:30.482522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:30.482801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:30.551516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:30.559352 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71aab144-6ac9-4097-a1c3-e7757f62e0d5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 200 len: 1352 microversion: 2.1 time: 0.090414 Apr 30 21:54:30.561314 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3087/6070] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:30 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:31.335263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:31.335899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:31.342732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:31.343201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:31.343986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:31.344440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:31.474284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:31.482199 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-186210cb-8ea7-4c19-97b5-0574721e6ec4 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1453 microversion: 2.1 time: 0.150879 Apr 30 21:54:31.485128 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2984/6071] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:31 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:31.499118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:31.499821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:31.507031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:31.507499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:31.508289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:31.508733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:31.576628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:31.577183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:31.583233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:31.583705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:31.584507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:31.584970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:31.599171 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] HTTP exception thrown: Instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 could not be found. Apr 30 21:54:31.599797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Returning 404 to user: Instance 5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:54:31.600651 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-faed15fb-4d66-4ebc-adda-5d7cf2408e5b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03" status: 404 len: 111 microversion: 2.1 time: 0.028119 Apr 30 21:54:31.601209 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2985/6072] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:31 2022] GET /compute/v2.1/servers/5c6e0d60-9352-479f-bdd2-0f1d0e7f3f03 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 21:54:31.647793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:31.655295 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f957238-6213-49aa-b7e1-525583854084 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1453 microversion: 2.1 time: 0.160417 Apr 30 21:54:31.655869 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3088/6073] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:31 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:34.468409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-95ae25c6-308a-481d-b447-f6dd63f5b5c6 req-26adefa9-df50-448d-b23c-d0eee9ff9a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af31b0c5-c096-4cf6-9bf1-6f00587c0c26", "tag": "1fc802f0-1162-4d58-8092-e6c04cc94cdf"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:34.476977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-95ae25c6-308a-481d-b447-f6dd63f5b5c6 req-26adefa9-df50-448d-b23c-d0eee9ff9a1c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:34.477381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-95ae25c6-308a-481d-b447-f6dd63f5b5c6 req-26adefa9-df50-448d-b23c-d0eee9ff9a1c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:34.489305 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-95ae25c6-308a-481d-b447-f6dd63f5b5c6 req-26adefa9-df50-448d-b23c-d0eee9ff9a1c service nova] Creating event network-changed:1fc802f0-1162-4d58-8092-e6c04cc94cdf for instance af31b0c5-c096-4cf6-9bf1-6f00587c0c26 on nch1-master-1 Apr 30 21:54:34.494511 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-95ae25c6-308a-481d-b447-f6dd63f5b5c6 req-26adefa9-df50-448d-b23c-d0eee9ff9a1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035142 Apr 30 21:54:34.498244 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2986/6074] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:35.746351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-34c7cc3e-bd53-4923-a37d-4ac7030e5a3b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '.version_select at 0x7fdc1365c700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:35.828049 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-34c7cc3e-bd53-4923-a37d-4ac7030e5a3b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110964198" status: 202 len: 0 microversion: 2.1 time: 0.085885 Apr 30 21:54:35.828696 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3089/6075] 10.222.0.23 () {58 vars in 1283 bytes} [Sat Apr 30 21:54:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110964198 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:54:35.856819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3ecb3e41-e1f3-4fa8-b47d-4448b166d76a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: .version_select at 0x7fdc13f17790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2041464218"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:35.870534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3ecb3e41-e1f3-4fa8-b47d-4448b166d76a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:54:35.876049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3ecb3e41-e1f3-4fa8-b47d-4448b166d76a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:54:36.214523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3ecb3e41-e1f3-4fa8-b47d-4448b166d76a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:54:36.219532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3ecb3e41-e1f3-4fa8-b47d-4448b166d76a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:54:36.233919 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3ecb3e41-e1f3-4fa8-b47d-4448b166d76a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.382350 Apr 30 21:54:36.234520 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2987/6076] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:54:35 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:54:44.320079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1642650590", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "5362d232-7b4d-4f90-b607-20bd0c08452c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2041464218", "security_groups": [{"name": "tempest-secgroup-smoke-1093917045"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:44.459639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] validate_networks() for [('5362d232-7b4d-4f90-b607-20bd0c08452c', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:54:44.901578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:54:44.902034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:54:44.902702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:54:44.903283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:54:44.903896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:54:44.914308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:44.915215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:44.916415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:44.917421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:44.942985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:54:44.948748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:54:44.963327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:54:44.966121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:54:45.138504 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-374289a8-9c5e-428c-bde1-65dec5997c3e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.823490 Apr 30 21:54:45.144718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3090/6077] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:54:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:54:45.150708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e8aa9246-6038-43d6-8805-3f5d5924a095 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:45.151991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e8aa9246-6038-43d6-8805-3f5d5924a095 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:45.231361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e8aa9246-6038-43d6-8805-3f5d5924a095 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:45.240759 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e8aa9246-6038-43d6-8805-3f5d5924a095 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1267 microversion: 2.1 time: 0.093919 Apr 30 21:54:45.243085 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2988/6078] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:45 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:46.260499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:46.261818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:46.270480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:46.271404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:46.272644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:46.273338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:46.339740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:46.347749 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ce6ec6a-37c2-4e5a-9bae-1f78824ca39b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1271 microversion: 2.1 time: 0.092081 Apr 30 21:54:46.356570 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3091/6079] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:46 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:47.365305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:47.366184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:47.374906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:47.377431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:47.377431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:47.377431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:47.454534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:47.463935 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-010ffbcb-9665-4c7f-beae-4dc61935afd9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1325 microversion: 2.1 time: 0.103359 Apr 30 21:54:47.464655 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2989/6080] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:47 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:48.482348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:48.482974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:48.491144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:48.491598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:48.492382 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:48.492824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:48.699454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:48.707565 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f94d5ab-1383-467f-8ab2-03d39f29e7a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1393 microversion: 2.1 time: 0.229136 Apr 30 21:54:48.708146 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3092/6081] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:48 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1393 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:54:48.880897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-928374fd-f6f4-4f92-902a-38285505ec26 req-645ad19c-70f2-44b2-88ca-5c8ce3ab400a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:48.889890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-928374fd-f6f4-4f92-902a-38285505ec26 req-645ad19c-70f2-44b2-88ca-5c8ce3ab400a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:48.891267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-928374fd-f6f4-4f92-902a-38285505ec26 req-645ad19c-70f2-44b2-88ca-5c8ce3ab400a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:48.916319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-928374fd-f6f4-4f92-902a-38285505ec26 req-645ad19c-70f2-44b2-88ca-5c8ce3ab400a service nova] Creating event network-changed:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:54:48.922310 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-928374fd-f6f4-4f92-902a-38285505ec26 req-645ad19c-70f2-44b2-88ca-5c8ce3ab400a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048096 Apr 30 21:54:48.923301 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2990/6082] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:49.724978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:49.725672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:49.732705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:49.733175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:49.734002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:49.734455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:49.871220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:49.878900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3dcbfb3a-eb7c-49d8-acf7-3bf6c45d4f7e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1393 microversion: 2.1 time: 0.158576 Apr 30 21:54:49.879470 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3093/6083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:49 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:50.896089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:50.897080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:50.904130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:50.904606 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:50.905404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:50.905894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:51.040603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:51.048028 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74bfabb6-edd1-44c7-840b-d0a087280647 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1393 microversion: 2.1 time: 0.156230 Apr 30 21:54:51.048612 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2991/6084] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:50 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:52.064575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:52.065190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:52.072089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:52.072546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:52.073352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:52.073888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:52.201497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:52.209483 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5991ff10-ba84-4624-a190-e057ca944c51 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1393 microversion: 2.1 time: 0.148887 Apr 30 21:54:52.210095 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3094/6085] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:52 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1393 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:53.228423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:53.229184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:53.236151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:53.236536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:53.237363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:53.237851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:53.370923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:53.379063 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4a0dbe8-ef6f-4e5c-9195-2d44fd1d4fd4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1393 microversion: 2.1 time: 0.156134 Apr 30 21:54:53.379475 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2992/6086] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:53 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:54.395494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:54.396294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:54.403786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:54.404268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:54.405063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:54.405507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:54.542418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:54.549979 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16fb0dc0-4deb-4038-9afe-f57ad3ac1d14 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1393 microversion: 2.1 time: 0.158423 Apr 30 21:54:54.555097 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3095/6087] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:54 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:55.136497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7efa628e-5eb5-4a1d-af51-00f5a05818c5 req-accdb134-6442-4061-8fe7-1749c5d8355e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "name": "network-vif-plugged", "status": "completed", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:55.146173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7efa628e-5eb5-4a1d-af51-00f5a05818c5 req-accdb134-6442-4061-8fe7-1749c5d8355e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:55.146873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7efa628e-5eb5-4a1d-af51-00f5a05818c5 req-accdb134-6442-4061-8fe7-1749c5d8355e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:55.158216 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7efa628e-5eb5-4a1d-af51-00f5a05818c5 req-accdb134-6442-4061-8fe7-1749c5d8355e service nova] Creating event network-vif-plugged:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:54:55.164075 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7efa628e-5eb5-4a1d-af51-00f5a05818c5 req-accdb134-6442-4061-8fe7-1749c5d8355e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Apr 30 21:54:55.164654 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2993/6088] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:55.567502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:55.568113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:55.575003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:55.575456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:55.576220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:55.576658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:55.711586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:55.720389 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26ee4208-eb3e-457b-820c-a388fa030c21 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1393 microversion: 2.1 time: 0.156788 Apr 30 21:54:55.721016 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3096/6089] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:55 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:56.739325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:56.740035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:56.747532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:56.748010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:56.748819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:56.749295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:56.892127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:56.901303 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c8500d13-1165-4cf5-87b9-e0fe86e4b280 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1565 microversion: 2.1 time: 0.167022 Apr 30 21:54:56.902122 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2994/6090] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:56 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:56.925553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:56.926240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:56.933964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:56.934421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:56.935223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:56.935667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:57.068795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:57.076726 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b492676-b686-47e1-900b-9ec0b9a09be1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1565 microversion: 2.1 time: 0.155124 Apr 30 21:54:57.077308 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3097/6091] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:56 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:54:59.277380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:54:59.278824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:54:59.286017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-848c6c78-3824-4c76-8283-f6c157a58178 req-cbf13ffb-e8db-4bae-89b5-ffb2a2469878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:54:59.286757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:59.287384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:59.288265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:59.288827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:59.295817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-848c6c78-3824-4c76-8283-f6c157a58178 req-cbf13ffb-e8db-4bae-89b5-ffb2a2469878 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:54:59.296283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-848c6c78-3824-4c76-8283-f6c157a58178 req-cbf13ffb-e8db-4bae-89b5-ffb2a2469878 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:54:59.308965 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-848c6c78-3824-4c76-8283-f6c157a58178 req-cbf13ffb-e8db-4bae-89b5-ffb2a2469878 service nova] Creating event network-changed:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:54:59.314351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-848c6c78-3824-4c76-8283-f6c157a58178 req-cbf13ffb-e8db-4bae-89b5-ffb2a2469878 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034504 Apr 30 21:54:59.315300 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3098/6092] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:54:59.524285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:54:59.532129 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a2e55df8-669d-42d6-bab1-c549380a79be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1565 microversion: 2.1 time: 0.259786 Apr 30 21:54:59.532775 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2995/6093] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:54:59 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1565 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:22.831493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9efe5939-4025-4c12-81cb-6481dcb50cf6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:22.832502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9efe5939-4025-4c12-81cb-6481dcb50cf6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:22.838767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9efe5939-4025-4c12-81cb-6481dcb50cf6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:22.841329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9efe5939-4025-4c12-81cb-6481dcb50cf6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:22.841329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9efe5939-4025-4c12-81cb-6481dcb50cf6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:22.841329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9efe5939-4025-4c12-81cb-6481dcb50cf6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:22.889062 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9efe5939-4025-4c12-81cb-6481dcb50cf6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action" status: 200 len: 24567 microversion: 2.1 time: 0.062804 Apr 30 21:55:22.889704 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3099/6094] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:55:22 2022] POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action => generated 24567 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:55:33.926907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c8e1c5ff-c69c-4703-adac-fdabc88abc55 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:33.927561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c8e1c5ff-c69c-4703-adac-fdabc88abc55 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:33.934003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e1c5ff-c69c-4703-adac-fdabc88abc55 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:33.935992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e1c5ff-c69c-4703-adac-fdabc88abc55 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:33.935992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e1c5ff-c69c-4703-adac-fdabc88abc55 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:33.935992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c8e1c5ff-c69c-4703-adac-fdabc88abc55 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.066874 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c8e1c5ff-c69c-4703-adac-fdabc88abc55 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1834 microversion: 2.1 time: 0.143883 Apr 30 21:55:34.067443 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2996/6095] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:33 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1834 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:34.083995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:34.084703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:34.091805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.092261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.093037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.093481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.223950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:34.232007 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1396a267-1435-4b78-a6aa-87575d9e02f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1683 microversion: 2.1 time: 0.152202 Apr 30 21:55:34.232615 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3100/6096] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:34 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:34.337227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-eb565ef5-fd53-422d-bb83-aded0491848f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:34.338205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-eb565ef5-fd53-422d-bb83-aded0491848f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:34.344905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb565ef5-fd53-422d-bb83-aded0491848f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.345362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb565ef5-fd53-422d-bb83-aded0491848f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.346192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb565ef5-fd53-422d-bb83-aded0491848f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.346654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-eb565ef5-fd53-422d-bb83-aded0491848f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.398704 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-eb565ef5-fd53-422d-bb83-aded0491848f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action" status: 200 len: 32640 microversion: 2.1 time: 0.065290 Apr 30 21:55:34.399331 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2997/6097] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:55:34 2022] POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action => generated 32640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:55:34.549861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:34.550359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:34.556984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.557442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.558238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.558677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.586477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1f895f6258fe4d38bfa01a33d9d51f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a221b784f54288ba132d18b7785965', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:34.587057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] flavor_id is None. Assuming migration. {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 30 21:55:34.587497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 21:55:34.869661 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-adfc8c39-96a6-499f-ae2b-a50cbbc311d2 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action" status: 202 len: 0 microversion: 2.1 time: 0.323798 Apr 30 21:55:34.870239 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3101/6098] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:55:34 2022] POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:55:34.879293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:34.880006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:34.887229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.890212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:34.890212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:34.890212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:35.025732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:35.033829 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0ab7d785-5c1b-44f3-8c32-750f563b7ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1692 microversion: 2.1 time: 0.158880 Apr 30 21:55:35.034393 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2998/6099] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:34 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:36.052613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:36.053292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:36.059763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:36.060262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:36.061551 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:36.062082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:36.199027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:36.207042 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f4a73c7-a944-4eda-9660-7b2cbd0f6925 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1692 microversion: 2.1 time: 0.159235 Apr 30 21:55:36.207657 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3102/6100] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:36 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:37.224357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:37.225014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:37.232601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:37.233081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:37.233917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:37.234380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:37.451425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:37.459009 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-83434937-d195-4271-a196-d53a2643cf66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1692 microversion: 2.1 time: 0.238584 Apr 30 21:55:37.459585 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 2999/6101] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:37 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1692 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:38.476306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:38.476955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:38.483987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:38.484443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:38.485226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:38.485675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:38.616901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:38.625034 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0aa413e0-ea7c-4104-bd5c-5f2266e38d68 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.152568 Apr 30 21:55:38.625624 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3103/6102] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:38 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:39.643692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:39.644331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:39.651528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:39.652004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:39.652802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:39.653261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:39.787401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:39.794696 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-564af7b7-3325-4c4e-8185-b26dd1e898eb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.156377 Apr 30 21:55:39.795252 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3000/6103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:39 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:40.811542 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:40.812785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:40.819463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:40.834520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:40.834520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:40.834520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:40.950510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:40.958042 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a0391f76-ab8e-4a0f-a984-e238d2eb9a48 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.150355 Apr 30 21:55:40.958614 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3104/6104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:40 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:41.974680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:41.975263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:41.982037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:41.982504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:41.983289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:41.983742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:42.121380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:42.129581 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-25d33fb2-7ace-4065-8e09-98e80323617d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.158876 Apr 30 21:55:42.130178 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3001/6105] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:41 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:43.147281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:43.147898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:43.154703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:43.155162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:43.156591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:43.157039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:43.286478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:43.293919 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9ccf0988-d9be-42ca-a8a3-53e097fb32c1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.150734 Apr 30 21:55:43.297514 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3105/6106] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:43 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:44.310931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:44.311583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:44.318340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:44.318816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:44.319610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:44.324231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:44.459006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:44.466403 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b1005fb8-cabd-46c5-b52d-88905792f889 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.159377 Apr 30 21:55:44.466978 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3002/6107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:44 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:45.483715 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:45.484335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:45.491343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:45.491692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:45.492790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:45.492919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:45.635207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:45.643867 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dcc67d7f-98f5-40ce-b05c-7d5118f3b36a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.163922 Apr 30 21:55:45.644487 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3106/6108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:45 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:46.661103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:46.661721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:46.668704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:46.669178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:46.670017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:46.670486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:46.803110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:46.810604 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-247fe370-0e83-40e3-b146-78a18d841ea8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.154084 Apr 30 21:55:46.811172 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3003/6109] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:46 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:55:47.827562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:47.828183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:47.834981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:47.840075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:47.840075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:47.840075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:47.983307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:47.991468 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2579885d-78ec-4083-8d7e-548623ba82e5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.167889 Apr 30 21:55:47.995018 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3107/6110] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:47 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:49.009085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:49.009719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:49.016213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:49.016677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:49.017463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:49.017986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:49.150346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:49.157783 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-234861ca-d7d4-4eb6-ba9d-9f8f44785e4b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1697 microversion: 2.1 time: 0.152747 Apr 30 21:55:49.158356 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3004/6111] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:49 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:50.174385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:50.174957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:50.181837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:50.182298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:50.183073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:50.183564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:50.401884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:50.409601 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef2b0ae4-4b4c-4115-ba4c-15e7b8c60ea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1696 microversion: 2.1 time: 0.239209 Apr 30 21:55:50.410260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3108/6112] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:50 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1696 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:50.721916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-76bcf43d-028c-46dc-b9e6-0ce5da002309 req-8cc5857d-38a5-4917-ba53-cb7b0c0002c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "name": "network-vif-unplugged", "status": "completed", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:50.731014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-76bcf43d-028c-46dc-b9e6-0ce5da002309 req-8cc5857d-38a5-4917-ba53-cb7b0c0002c1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:50.731486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-76bcf43d-028c-46dc-b9e6-0ce5da002309 req-8cc5857d-38a5-4917-ba53-cb7b0c0002c1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:50.743644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-76bcf43d-028c-46dc-b9e6-0ce5da002309 req-8cc5857d-38a5-4917-ba53-cb7b0c0002c1 service nova] Creating event network-vif-unplugged:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch1-master-1 Apr 30 21:55:50.748874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-76bcf43d-028c-46dc-b9e6-0ce5da002309 req-8cc5857d-38a5-4917-ba53-cb7b0c0002c1 service nova] Instance 41424b21-6846-4a18-8240-5d25e2acfb8b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:55:50.760264 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-76bcf43d-028c-46dc-b9e6-0ce5da002309 req-8cc5857d-38a5-4917-ba53-cb7b0c0002c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042202 Apr 30 21:55:50.760914 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3005/6113] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:55:51.430995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:51.432266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:51.440448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:51.440920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:51.441726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:51.442223 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:52.000430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:52.008433 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-714af518-221c-419f-9431-9ebf5dc103d2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1696 microversion: 2.1 time: 0.581691 Apr 30 21:55:52.009035 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3109/6114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:51 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1696 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:52.777223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3b66bc51-0c59-4c12-b0a2-46369a337a92 req-3470a09a-6310-4ba9-9ce5-442145d11589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:52.786171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3b66bc51-0c59-4c12-b0a2-46369a337a92 req-3470a09a-6310-4ba9-9ce5-442145d11589 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:52.786640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3b66bc51-0c59-4c12-b0a2-46369a337a92 req-3470a09a-6310-4ba9-9ce5-442145d11589 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:52.798120 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3b66bc51-0c59-4c12-b0a2-46369a337a92 req-3470a09a-6310-4ba9-9ce5-442145d11589 service nova] Creating event network-changed:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch1-master-1 Apr 30 21:55:52.803413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-3b66bc51-0c59-4c12-b0a2-46369a337a92 req-3470a09a-6310-4ba9-9ce5-442145d11589 service nova] Instance 41424b21-6846-4a18-8240-5d25e2acfb8b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:55:52.814091 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3b66bc51-0c59-4c12-b0a2-46369a337a92 req-3470a09a-6310-4ba9-9ce5-442145d11589 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041840 Apr 30 21:55:52.814682 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3006/6115] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:55:53.026658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:53.027379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:53.035421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:53.035859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:53.036639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:53.037165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:53.217283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:53.226312 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe152256-456f-4499-b9af-02f06f007fc9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1694 microversion: 2.1 time: 0.203762 Apr 30 21:55:53.226828 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3110/6116] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:53 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:54.247373 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:54.248095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:54.255212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:54.255690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:54.256517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:54.256978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:54.399008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:54.411555 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d69419ee-9c0b-4548-b691-26ef4387e85a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1694 microversion: 2.1 time: 0.169287 Apr 30 21:55:54.412504 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3007/6117] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:54 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:55.428970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:55.429506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:55.436728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:55.437185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:55.437986 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:55.438427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:55.578552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:55.587222 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc932010-a600-4ed2-8157-fdbdd28dce3c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1691 microversion: 2.1 time: 0.162248 Apr 30 21:55:55.587811 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3111/6118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:55 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:55.603953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2bfee223-d528-48b9-8247-f4e50f579af7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:55.604515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2bfee223-d528-48b9-8247-f4e50f579af7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:55.611554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bfee223-d528-48b9-8247-f4e50f579af7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:55.612098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bfee223-d528-48b9-8247-f4e50f579af7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:55.612899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bfee223-d528-48b9-8247-f4e50f579af7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:55.613365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2bfee223-d528-48b9-8247-f4e50f579af7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:55.874272 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2bfee223-d528-48b9-8247-f4e50f579af7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action" status: 202 len: 0 microversion: 2.1 time: 0.274148 Apr 30 21:55:55.874909 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3008/6119] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:55:55 2022] POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:55:55.883583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:55.884195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:55.891020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:55.891724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:55.892519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:55.892993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:56.101322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:56.110474 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-970fd107-30c9-4734-8a1b-8127b7938d2c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1690 microversion: 2.1 time: 0.230610 Apr 30 21:55:56.111449 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3112/6120] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:55 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:57.132864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:57.133578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:57.140067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:57.140540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:57.141345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:57.141854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:57.290397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:57.297878 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf2bef0d-cbb8-449a-b6f3-31d497347ea6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1690 microversion: 2.1 time: 0.170676 Apr 30 21:55:57.298440 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3009/6121] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:57 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:55:57.532761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-3d38258e-8680-4176-a0fb-c10964248482 req-88396dd8-5a65-4045-af27-6b70ce0c25e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "name": "network-vif-plugged", "status": "completed", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:57.542650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3d38258e-8680-4176-a0fb-c10964248482 req-88396dd8-5a65-4045-af27-6b70ce0c25e3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:57.543101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-3d38258e-8680-4176-a0fb-c10964248482 req-88396dd8-5a65-4045-af27-6b70ce0c25e3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:57.555360 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-3d38258e-8680-4176-a0fb-c10964248482 req-88396dd8-5a65-4045-af27-6b70ce0c25e3 service nova] Creating event network-vif-plugged:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch1-master-1 Apr 30 21:55:57.560526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-3d38258e-8680-4176-a0fb-c10964248482 req-88396dd8-5a65-4045-af27-6b70ce0c25e3 service nova] Instance 41424b21-6846-4a18-8240-5d25e2acfb8b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:55:57.572872 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-3d38258e-8680-4176-a0fb-c10964248482 req-88396dd8-5a65-4045-af27-6b70ce0c25e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043869 Apr 30 21:55:57.573479 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3113/6122] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:55:58.315851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:58.316482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:58.323272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:58.323743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:58.324520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:58.324973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:58.461033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:58.469681 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-857bf832-92d3-4d3a-8f27-38638eef3154 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1690 microversion: 2.1 time: 0.158190 Apr 30 21:55:58.470284 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3010/6123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:58 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:55:59.487113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:55:59.487906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-2f1c7329-0f18-4995-9655-4b6b0a30ba7e req-5ffbfc6d-5320-4c54-9afe-1f2a4527f9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "name": "network-vif-unplugged", "status": "completed", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:55:59.488308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:55:59.495408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:59.496043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:59.496436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2f1c7329-0f18-4995-9655-4b6b0a30ba7e req-5ffbfc6d-5320-4c54-9afe-1f2a4527f9c4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:59.496851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:55:59.496958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2f1c7329-0f18-4995-9655-4b6b0a30ba7e req-5ffbfc6d-5320-4c54-9afe-1f2a4527f9c4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:59.497318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:55:59.511041 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-2f1c7329-0f18-4995-9655-4b6b0a30ba7e req-5ffbfc6d-5320-4c54-9afe-1f2a4527f9c4 service nova] Creating event network-vif-unplugged:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:55:59.516347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-2f1c7329-0f18-4995-9655-4b6b0a30ba7e req-5ffbfc6d-5320-4c54-9afe-1f2a4527f9c4 service nova] Instance 41424b21-6846-4a18-8240-5d25e2acfb8b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:55:59.527829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-2f1c7329-0f18-4995-9655-4b6b0a30ba7e req-5ffbfc6d-5320-4c54-9afe-1f2a4527f9c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045004 Apr 30 21:55:59.528766 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3114/6124] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:55:59.726572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:55:59.734821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5e4dd434-52e7-4242-9015-45bfa1f5cd2d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1690 microversion: 2.1 time: 0.251614 Apr 30 21:55:59.735728 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3011/6125] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:55:59 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1690 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:56:00.753355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:00.754211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:00.760478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:00.765493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:00.765493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:00.765493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:00.899092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:00.906787 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2c595e7b-4d4f-4cc2-a34c-b220ea44f908 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1690 microversion: 2.1 time: 0.158640 Apr 30 21:56:00.907368 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3115/6126] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:00 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:01.543700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-564f9861-cc56-4d9e-a628-133e7a598adb req-489449eb-54e6-4fef-8404-5e2f2dffb7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:01.559054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-564f9861-cc56-4d9e-a628-133e7a598adb req-489449eb-54e6-4fef-8404-5e2f2dffb7e6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:01.559520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-564f9861-cc56-4d9e-a628-133e7a598adb req-489449eb-54e6-4fef-8404-5e2f2dffb7e6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:01.571606 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-564f9861-cc56-4d9e-a628-133e7a598adb req-489449eb-54e6-4fef-8404-5e2f2dffb7e6 service nova] Creating event network-changed:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:56:01.576824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-564f9861-cc56-4d9e-a628-133e7a598adb req-489449eb-54e6-4fef-8404-5e2f2dffb7e6 service nova] Instance 41424b21-6846-4a18-8240-5d25e2acfb8b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 21:56:01.588798 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-564f9861-cc56-4d9e-a628-133e7a598adb req-489449eb-54e6-4fef-8404-5e2f2dffb7e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049440 Apr 30 21:56:01.589434 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3012/6127] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:56:01.924669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:01.925413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:01.931889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:01.932284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:01.933090 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:01.933524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:02.210036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:02.219367 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-73237217-6c3a-419a-94d4-2e2545a369d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1690 microversion: 2.1 time: 0.298754 Apr 30 21:56:02.220156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3116/6128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:01 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1690 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:03.236897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:03.237632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:03.244787 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:03.245269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:03.246099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:03.246564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:03.391005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:03.400015 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6212836f-8487-44fc-9ccb-7ec842fdcd99 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1683 microversion: 2.1 time: 0.167528 Apr 30 21:56:03.400681 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3013/6129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:03 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:05.486059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-38cfe1e3-743c-4199-9d9e-ab9d3ec165e8 req-fa4c0f5a-6ddc-4f2e-b56c-cd71fa51507e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "name": "network-vif-plugged", "status": "completed", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:05.496119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-38cfe1e3-743c-4199-9d9e-ab9d3ec165e8 req-fa4c0f5a-6ddc-4f2e-b56c-cd71fa51507e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:05.496567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-38cfe1e3-743c-4199-9d9e-ab9d3ec165e8 req-fa4c0f5a-6ddc-4f2e-b56c-cd71fa51507e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:05.507373 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-38cfe1e3-743c-4199-9d9e-ab9d3ec165e8 req-fa4c0f5a-6ddc-4f2e-b56c-cd71fa51507e service nova] Creating event network-vif-plugged:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:56:05.512288 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-38cfe1e3-743c-4199-9d9e-ab9d3ec165e8 req-fa4c0f5a-6ddc-4f2e-b56c-cd71fa51507e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 Apr 30 21:56:05.512904 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3117/6130] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:56:27.607130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-38337634-afd0-4a1f-bc76-c2b28da1f9f6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:27.608124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-38337634-afd0-4a1f-bc76-c2b28da1f9f6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:27.615497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38337634-afd0-4a1f-bc76-c2b28da1f9f6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:27.615968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38337634-afd0-4a1f-bc76-c2b28da1f9f6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:27.616781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38337634-afd0-4a1f-bc76-c2b28da1f9f6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:27.618123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-38337634-afd0-4a1f-bc76-c2b28da1f9f6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:27.687367 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-38337634-afd0-4a1f-bc76-c2b28da1f9f6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action" status: 200 len: 63188 microversion: 2.1 time: 0.084361 Apr 30 21:56:27.688320 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3014/6131] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:56:27 2022] POST /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b/action => generated 63188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:56:34.028867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d2c1ee4-f02e-47d7-8289-f8d89f95db20 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:34.029574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8d2c1ee4-f02e-47d7-8289-f8d89f95db20 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:34.035734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d2c1ee4-f02e-47d7-8289-f8d89f95db20 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:34.036191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d2c1ee4-f02e-47d7-8289-f8d89f95db20 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:34.036971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d2c1ee4-f02e-47d7-8289-f8d89f95db20 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:34.037414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d2c1ee4-f02e-47d7-8289-f8d89f95db20 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:34.189793 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d2c1ee4-f02e-47d7-8289-f8d89f95db20 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1834 microversion: 2.1 time: 0.166608 Apr 30 21:56:34.193519 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3118/6132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:34 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1834 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:35.125702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:35.126929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:35.127057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c39294dc-f229-49d9-aa58-f4106c73393a req-584555c1-7c6d-40a2-9320-3916ae78c6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:35.135207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:35.135594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c39294dc-f229-49d9-aa58-f4106c73393a req-584555c1-7c6d-40a2-9320-3916ae78c6fb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:35.135778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:35.136052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c39294dc-f229-49d9-aa58-f4106c73393a req-584555c1-7c6d-40a2-9320-3916ae78c6fb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:35.136565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:35.137291 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:35.147685 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c39294dc-f229-49d9-aa58-f4106c73393a req-584555c1-7c6d-40a2-9320-3916ae78c6fb service nova] Creating event network-changed:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:56:35.152883 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c39294dc-f229-49d9-aa58-f4106c73393a req-584555c1-7c6d-40a2-9320-3916ae78c6fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029413 Apr 30 21:56:35.153720 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3119/6133] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 21:56:35.169223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:56:35.481832 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d8508ac2-2e73-42d6-a654-4489de7deb9b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 204 len: 0 microversion: 2.1 time: 0.360219 Apr 30 21:56:35.483592 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3015/6134] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:56:35 2022] DELETE /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 21:56:35.491863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:35.492640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:35.499121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:35.499664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:35.500518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:35.501060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:35.660026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:35.667676 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c9a845db-744e-49ad-899b-45c716f1b57a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1689 microversion: 2.1 time: 0.180017 Apr 30 21:56:35.668263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3120/6135] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:35 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:36.687832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:36.688561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:36.695900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:36.696366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:36.697480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:36.698031 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:36.859088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:36.866524 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-16aea2f4-68bc-4c0c-afa6-fdba9e72db61 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1571 microversion: 2.1 time: 0.183855 Apr 30 21:56:36.867094 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3016/6136] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:36 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1571 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:37.343394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-08a8f774-86fc-45a4-9d35-e0ba21667e9e req-4510c0ce-fe68-43b6-8542-b835e65525a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41424b21-6846-4a18-8240-5d25e2acfb8b", "name": "network-vif-deleted", "tag": "a8f6d470-91c2-4ec5-a3c1-e90192dd4945"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:37.352209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-08a8f774-86fc-45a4-9d35-e0ba21667e9e req-4510c0ce-fe68-43b6-8542-b835e65525a0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:37.352647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-08a8f774-86fc-45a4-9d35-e0ba21667e9e req-4510c0ce-fe68-43b6-8542-b835e65525a0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:37.372159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-08a8f774-86fc-45a4-9d35-e0ba21667e9e req-4510c0ce-fe68-43b6-8542-b835e65525a0 service nova] Creating event network-vif-deleted:a8f6d470-91c2-4ec5-a3c1-e90192dd4945 for instance 41424b21-6846-4a18-8240-5d25e2acfb8b on nch2-master-1 Apr 30 21:56:37.372159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-08a8f774-86fc-45a4-9d35-e0ba21667e9e req-4510c0ce-fe68-43b6-8542-b835e65525a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028556 Apr 30 21:56:37.372159 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3121/6137] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:56:37.884228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:37.884765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:37.891664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:37.892141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:37.892943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:37.893401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:37.927511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:37.927985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:37.928459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lazy-loading 'fault' on Instance uuid 41424b21-6846-4a18-8240-5d25e2acfb8b {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:56:37.972955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:37.980904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82c2338c-949a-4113-9bd1-5abf94011f8c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 200 len: 1357 microversion: 2.1 time: 0.100737 Apr 30 21:56:37.981488 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3017/6138] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:37 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:39.001527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:39.002257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 41424b21-6846-4a18-8240-5d25e2acfb8b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:39.009066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:39.014821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:39.014821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:39.014821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:39.026336 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] HTTP exception thrown: Instance 41424b21-6846-4a18-8240-5d25e2acfb8b could not be found. Apr 30 21:56:39.026928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Returning 404 to user: Instance 41424b21-6846-4a18-8240-5d25e2acfb8b could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:56:39.027757 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8288e1e-e436-47c0-8e74-677ee8e13f38 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b" status: 404 len: 111 microversion: 2.1 time: 0.031394 Apr 30 21:56:39.028296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3122/6139] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:38 2022] GET /compute/v2.1/servers/41424b21-6846-4a18-8240-5d25e2acfb8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:56:42.825114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e53827a-a9d3-4705-b38e-a1ef94280c77 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '.version_select at 0x7fdc139f5670>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:42.895809 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e53827a-a9d3-4705-b38e-a1ef94280c77 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2041464218" status: 202 len: 0 microversion: 2.1 time: 0.075166 Apr 30 21:56:42.896419 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3018/6140] 10.222.0.23 () {58 vars in 1283 bytes} [Sat Apr 30 21:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2041464218 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:56:42.937124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a31c52ae-bb54-4f38-bc35-ec24f6e83a35 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: .version_select at 0x7fdc1360c820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-219563355"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:42.955810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a31c52ae-bb54-4f38-bc35-ec24f6e83a35 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:56:42.962122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a31c52ae-bb54-4f38-bc35-ec24f6e83a35 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:56:43.168470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a31c52ae-bb54-4f38-bc35-ec24f6e83a35 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:56:43.173647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a31c52ae-bb54-4f38-bc35-ec24f6e83a35 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:56:43.188492 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a31c52ae-bb54-4f38-bc35-ec24f6e83a35 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.255370 Apr 30 21:56:43.193994 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3123/6141] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:56:42 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:51.677102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-106358079", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "b16290a3-2768-44e4-956f-b231962064b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-219563355", "security_groups": [{"name": "tempest-secgroup-smoke-783543149"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:51.924348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] validate_networks() for [('b16290a3-2768-44e4-956f-b231962064b4', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:56:52.399268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:56:52.399720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:56:52.400251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:56:52.400683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:56:52.402201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:56:52.412529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:52.413010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:52.413892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:52.414362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:52.434382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:56:52.440743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:56:52.460412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:56:52.463234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:56:52.589584 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d6bafbff-5d2b-44ff-8591-1d33b93a197e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.917291 Apr 30 21:56:52.590629 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3019/6142] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:56:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:56:52.605626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6633572c-9c1a-4887-843c-8d3c85a415bd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:52.606354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6633572c-9c1a-4887-843c-8d3c85a415bd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:52.762998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6633572c-9c1a-4887-843c-8d3c85a415bd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:52.771271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6633572c-9c1a-4887-843c-8d3c85a415bd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1265 microversion: 2.1 time: 0.174463 Apr 30 21:56:52.774696 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3124/6143] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:52 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:53.788366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9770eb41-0dec-447d-9bec-ab0c02a013f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:53.788906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9770eb41-0dec-447d-9bec-ab0c02a013f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:53.861642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9770eb41-0dec-447d-9bec-ab0c02a013f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:53.871033 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9770eb41-0dec-447d-9bec-ab0c02a013f5 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1265 microversion: 2.1 time: 0.086639 Apr 30 21:56:53.871754 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3020/6144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:53 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:54.888100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7587100a-2314-4d11-afb3-2947a212f69d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:54.888787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7587100a-2314-4d11-afb3-2947a212f69d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:54.944611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7587100a-2314-4d11-afb3-2947a212f69d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:54.951843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7587100a-2314-4d11-afb3-2947a212f69d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1265 microversion: 2.1 time: 0.067617 Apr 30 21:56:54.952425 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3125/6145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:54 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1265 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:55.968586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:55.969287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:55.976253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:55.976724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:55.977518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:55.978015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:56.040814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:56.048966 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5c95bfce-b223-4f97-9445-eef91644ac46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1269 microversion: 2.1 time: 0.084320 Apr 30 21:56:56.049548 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3021/6146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:55 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:57.066793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:57.067453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:57.076030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:57.076486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:57.077262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:57.077734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:57.149561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:57.157125 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77820ed6-6415-47ae-bde8-5b5b3d86354d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1323 microversion: 2.1 time: 0.094242 Apr 30 21:56:57.157699 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3126/6147] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:57 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1323 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:58.174327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:58.175084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:58.182715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:58.183197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:58.184046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:58.184512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:58.532208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:58.539971 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-58524e0a-b47b-47fc-803f-5778e2504edd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.369557 Apr 30 21:56:58.541372 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3022/6148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:58 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:56:58.917872 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-97b79ae2-444b-4849-a24e-91d0b5e142ce req-def713e0-4034-41dd-ac86-4f14e1c4a9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:56:58.927547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-97b79ae2-444b-4849-a24e-91d0b5e142ce req-def713e0-4034-41dd-ac86-4f14e1c4a9cc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:58.928935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-97b79ae2-444b-4849-a24e-91d0b5e142ce req-def713e0-4034-41dd-ac86-4f14e1c4a9cc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:58.949130 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-97b79ae2-444b-4849-a24e-91d0b5e142ce req-def713e0-4034-41dd-ac86-4f14e1c4a9cc service nova] Creating event network-changed:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch2-master-1 Apr 30 21:56:58.954452 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-97b79ae2-444b-4849-a24e-91d0b5e142ce req-def713e0-4034-41dd-ac86-4f14e1c4a9cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040363 Apr 30 21:56:58.955279 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3127/6149] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:56:59.558278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:56:59.558915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:56:59.566161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:59.566634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:59.567429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:56:59.567883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:56:59.708145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:56:59.715617 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fba2c3e0-0713-4f3a-8c91-94bed2fb7e69 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.161879 Apr 30 21:56:59.716196 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3023/6150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:56:59 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:00.733984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:00.734701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:00.741137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:00.741599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:00.742423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:00.742968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:00.879355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:00.887614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d7f413a-a766-4c93-ad01-dffc2f0dc5f1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.158902 Apr 30 21:57:00.888187 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3128/6151] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:00 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:01.905147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:01.905796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:01.912002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:01.912471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:01.913251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:01.913704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:02.041124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:02.048525 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d0f5fe5a-5453-4c01-a076-da3da9b69d19 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.147910 Apr 30 21:57:02.049097 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3024/6152] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:01 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:03.065431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:03.066082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:03.072148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:03.072605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:03.073383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:03.073854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:03.208679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:03.216689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4657f128-b890-49e6-b143-e8face3e17d4 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.155417 Apr 30 21:57:03.217252 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3129/6153] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:03 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:04.232624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:04.233249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:04.240121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:04.240617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:04.241391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:04.241871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:04.373971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:04.381415 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8a8e4902-9098-43e0-859c-40370dd525be tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.152731 Apr 30 21:57:04.382027 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3025/6154] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:04 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:05.398903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:05.399442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:05.406245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:05.410180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:05.410180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:05.410180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:05.540756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:05.549198 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eea85fbc-45a2-4e1b-a6f0-e640ac629579 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.154404 Apr 30 21:57:05.549814 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3130/6155] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:05 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:05.983025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5a313ebe-edac-4a71-9fd0-c663a5d3640f req-39909d02-66cd-4d67-a1d6-2c8f5fa40947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "name": "network-vif-plugged", "status": "completed", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:05.991185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5a313ebe-edac-4a71-9fd0-c663a5d3640f req-39909d02-66cd-4d67-a1d6-2c8f5fa40947 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:05.992278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5a313ebe-edac-4a71-9fd0-c663a5d3640f req-39909d02-66cd-4d67-a1d6-2c8f5fa40947 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:06.002543 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5a313ebe-edac-4a71-9fd0-c663a5d3640f req-39909d02-66cd-4d67-a1d6-2c8f5fa40947 service nova] Creating event network-vif-plugged:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch2-master-1 Apr 30 21:57:06.007726 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5a313ebe-edac-4a71-9fd0-c663a5d3640f req-39909d02-66cd-4d67-a1d6-2c8f5fa40947 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098406 Apr 30 21:57:06.008312 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3026/6156] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:06.566893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:06.567434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:06.574097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:06.574552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:06.575318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:06.575757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:06.707916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:06.715244 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1415bec9-a2e5-48a0-88a4-a2ca48dfbbd6 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1390 microversion: 2.1 time: 0.152379 Apr 30 21:57:06.715863 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3131/6157] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:06 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:07.731734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:07.732446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:07.739682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:07.740158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:07.741034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:07.741497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:07.875533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:07.883002 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-95e1420b-9909-42f4-9617-db4ff45fb49c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1561 microversion: 2.1 time: 0.155633 Apr 30 21:57:07.885120 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3027/6158] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:07 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:07.899442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:07.900064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:07.907404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:07.907864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:07.908638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:07.909078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:08.036393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:08.043830 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b5e78ce2-9248-4960-a552-cfdb3f651747 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1561 microversion: 2.1 time: 0.148203 Apr 30 21:57:08.044406 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3132/6159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:07 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:09.996538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f74e4330-8873-454c-8745-6aa7ae624441 req-1025332b-039f-4a7c-89ae-ffd81d16758c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:10.004107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:10.005282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:10.006741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f74e4330-8873-454c-8745-6aa7ae624441 req-1025332b-039f-4a7c-89ae-ffd81d16758c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:10.010919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f74e4330-8873-454c-8745-6aa7ae624441 req-1025332b-039f-4a7c-89ae-ffd81d16758c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:10.013340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:10.013855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:10.014698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:10.015383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:10.019685 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f74e4330-8873-454c-8745-6aa7ae624441 req-1025332b-039f-4a7c-89ae-ffd81d16758c service nova] Creating event network-changed:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch2-master-1 Apr 30 21:57:10.024909 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f74e4330-8873-454c-8745-6aa7ae624441 req-1025332b-039f-4a7c-89ae-ffd81d16758c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032347 Apr 30 21:57:10.025495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3133/6160] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:10.231976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:10.240746 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3b617f7f-9ccb-469d-9404-737bec58bc5e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1561 microversion: 2.1 time: 0.251877 Apr 30 21:57:10.241329 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3028/6161] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:09 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1561 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:33.560260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-69ab2dd8-ce6e-4e11-9e3b-201f3bdf1b28 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:33.561256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-69ab2dd8-ce6e-4e11-9e3b-201f3bdf1b28 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:33.567613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69ab2dd8-ce6e-4e11-9e3b-201f3bdf1b28 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:33.568193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69ab2dd8-ce6e-4e11-9e3b-201f3bdf1b28 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:33.568815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69ab2dd8-ce6e-4e11-9e3b-201f3bdf1b28 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:33.569253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-69ab2dd8-ce6e-4e11-9e3b-201f3bdf1b28 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:33.621802 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-69ab2dd8-ce6e-4e11-9e3b-201f3bdf1b28 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action" status: 200 len: 24569 microversion: 2.1 time: 0.112998 Apr 30 21:57:33.622414 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3134/6162] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:57:33 2022] POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action => generated 24569 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:57:39.971168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:39.972470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:39.977953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:39.978426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:39.979217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:39.979676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:40.108166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:40.116022 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a0db252e-c758-424c-82c1-e88131729306 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1679 microversion: 2.1 time: 0.149627 Apr 30 21:57:40.116667 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3029/6163] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:39 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:40.215178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-86d97f7a-12c3-416a-9b4d-4c45a381c848 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:40.216206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-86d97f7a-12c3-416a-9b4d-4c45a381c848 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:40.231032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86d97f7a-12c3-416a-9b4d-4c45a381c848 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:40.231032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86d97f7a-12c3-416a-9b4d-4c45a381c848 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:40.231032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86d97f7a-12c3-416a-9b4d-4c45a381c848 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:40.231032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86d97f7a-12c3-416a-9b4d-4c45a381c848 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:40.283380 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-86d97f7a-12c3-416a-9b4d-4c45a381c848 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action" status: 200 len: 32642 microversion: 2.1 time: 0.072269 Apr 30 21:57:40.284207 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3135/6164] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:57:40 2022] POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action => generated 32642 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:57:40.507872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6510aab4-d7ce-4433-a606-c7f9d1434e07 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:40.512317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6510aab4-d7ce-4433-a606-c7f9d1434e07 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:40.514529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6510aab4-d7ce-4433-a606-c7f9d1434e07 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:40.514997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6510aab4-d7ce-4433-a606-c7f9d1434e07 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:40.515786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6510aab4-d7ce-4433-a606-c7f9d1434e07 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:40.516243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6510aab4-d7ce-4433-a606-c7f9d1434e07 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:40.643508 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6510aab4-d7ce-4433-a606-c7f9d1434e07 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1830 microversion: 2.1 time: 0.188897 Apr 30 21:57:40.644350 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3030/6165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:40 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1830 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:40.660661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:40.661924 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:40.669190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:40.669654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:40.670460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:40.670908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:40.696932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lazy-loading 'flavor' on Instance uuid 51f43bb4-4c09-4eba-aad5-fca0789cae7b {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:57:40.709149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Going to try to live migrate instance to another host {{(pid=130671) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 30 21:57:43.156059 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bf25cd92-8c99-4792-a592-c60fd1bb6696 tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action" status: 202 len: 0 microversion: 2.1 time: 2.499502 Apr 30 21:57:43.156757 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3136/6166] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:57:40 2022] POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action => generated 0 bytes in 2501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 21:57:43.165423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:43.166093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:43.173057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:43.173528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:43.174351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:43.174808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:43.312089 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:43.319648 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fa8a766f-98df-44bd-9c62-67a9eddf4c24 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.158072 Apr 30 21:57:43.320212 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3031/6167] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:43 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:44.336538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:44.337152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:44.344487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:44.344938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:44.345732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:44.346193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:44.508129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:44.515685 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0a823000-35b7-46f1-b1c1-96d43286f8b8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.183143 Apr 30 21:57:44.519184 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3137/6168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:44 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:45.001683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-349d79d8-b650-427d-8701-1355c89712e6 req-9de52b0b-2241-42aa-ac7e-4c3f0d9c9638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "name": "network-vif-unplugged", "status": "completed", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:45.010874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-349d79d8-b650-427d-8701-1355c89712e6 req-9de52b0b-2241-42aa-ac7e-4c3f0d9c9638 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:45.011334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-349d79d8-b650-427d-8701-1355c89712e6 req-9de52b0b-2241-42aa-ac7e-4c3f0d9c9638 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:45.023078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-349d79d8-b650-427d-8701-1355c89712e6 req-9de52b0b-2241-42aa-ac7e-4c3f0d9c9638 service nova] Creating event network-vif-unplugged:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch2-master-1 Apr 30 21:57:45.028903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-349d79d8-b650-427d-8701-1355c89712e6 req-9de52b0b-2241-42aa-ac7e-4c3f0d9c9638 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092256 Apr 30 21:57:45.029577 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3032/6169] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:45.534339 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:45.536868 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:45.543804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:45.548581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:45.548581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:45.548581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:45.693638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:45.701351 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b198bf9f-7bc5-4c16-9879-86b7bbb12396 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.171404 Apr 30 21:57:45.701954 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3138/6170] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:45 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:45.876453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-907e9952-3f7b-433d-a27a-6971a8edf638 req-ea6cafa3-1344-400a-a420-5b67cb2d1a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "name": "network-vif-plugged", "status": "completed", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:45.886070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-907e9952-3f7b-433d-a27a-6971a8edf638 req-ea6cafa3-1344-400a-a420-5b67cb2d1a92 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:45.887978 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-907e9952-3f7b-433d-a27a-6971a8edf638 req-ea6cafa3-1344-400a-a420-5b67cb2d1a92 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:45.898808 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-907e9952-3f7b-433d-a27a-6971a8edf638 req-ea6cafa3-1344-400a-a420-5b67cb2d1a92 service nova] Creating event network-vif-plugged:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch2-master-1 Apr 30 21:57:45.904369 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-907e9952-3f7b-433d-a27a-6971a8edf638 req-ea6cafa3-1344-400a-a420-5b67cb2d1a92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031949 Apr 30 21:57:45.905151 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3033/6171] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:46.718314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:46.718930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:46.726373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:46.726826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:46.727595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:46.728032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:46.860081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:46.867624 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7633063b-5aea-41a6-a70a-a159c5735138 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.153242 Apr 30 21:57:46.868207 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3139/6172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:46 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:47.063911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2edc9c1a-37f1-42b6-b79e-97bd92726a73 req-7a7ce233-422c-4b76-b8c9-c8b0b497870d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:47.073399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2edc9c1a-37f1-42b6-b79e-97bd92726a73 req-7a7ce233-422c-4b76-b8c9-c8b0b497870d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:47.073899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2edc9c1a-37f1-42b6-b79e-97bd92726a73 req-7a7ce233-422c-4b76-b8c9-c8b0b497870d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:47.087386 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2edc9c1a-37f1-42b6-b79e-97bd92726a73 req-7a7ce233-422c-4b76-b8c9-c8b0b497870d service nova] Creating event network-changed:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch2-master-1 Apr 30 21:57:47.092257 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2edc9c1a-37f1-42b6-b79e-97bd92726a73 req-7a7ce233-422c-4b76-b8c9-c8b0b497870d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032453 Apr 30 21:57:47.093575 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3034/6173] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:47.884597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:47.885164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:47.892041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:47.893074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:47.893327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:47.894062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:48.029771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:48.037957 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75fdd235-2843-4c3d-a4aa-6492b173711d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.157375 Apr 30 21:57:48.041705 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3140/6174] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:47 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:49.057140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:49.057895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:49.064130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:49.064607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:49.065398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:49.065884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:49.197012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:49.204572 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dc4f509e-805d-46e9-a3e1-318520c10a85 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.152674 Apr 30 21:57:49.205141 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3035/6175] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:49 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:50.221271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:50.221927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:50.229064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:50.229518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:50.230338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:50.230767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:50.423137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:50.431196 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f995901e-3b24-4e6b-b3c9-30b0c103cc6a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.214024 Apr 30 21:57:50.431770 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3141/6176] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:50 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:50.994297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8ad8b548-5585-4f64-b356-f683fc7dcff5 req-96588ece-82b2-4544-9178-0ac5b0ba150a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "name": "network-vif-unplugged", "status": "completed", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:51.003151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8ad8b548-5585-4f64-b356-f683fc7dcff5 req-96588ece-82b2-4544-9178-0ac5b0ba150a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:51.004128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8ad8b548-5585-4f64-b356-f683fc7dcff5 req-96588ece-82b2-4544-9178-0ac5b0ba150a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:51.015081 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8ad8b548-5585-4f64-b356-f683fc7dcff5 req-96588ece-82b2-4544-9178-0ac5b0ba150a service nova] Creating event network-vif-unplugged:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch2-master-1 Apr 30 21:57:51.021078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8ad8b548-5585-4f64-b356-f683fc7dcff5 req-96588ece-82b2-4544-9178-0ac5b0ba150a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030629 Apr 30 21:57:51.021652 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3036/6177] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:51.448342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:51.448966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:51.456870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:51.457413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:51.458255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:51.458710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:51.634709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:51.642065 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db5c3a4c-9442-443b-a353-f017ce7468a3 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.197864 Apr 30 21:57:51.642635 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3142/6178] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:51 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:52.669923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:52.669923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:52.669923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:52.669923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:52.670869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:52.670971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:52.807529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f059c6e1-7587-4a58-9f76-25c4c66e7749 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:52.808525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f059c6e1-7587-4a58-9f76-25c4c66e7749 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:52.813858 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:52.814758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f059c6e1-7587-4a58-9f76-25c4c66e7749 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:52.815217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f059c6e1-7587-4a58-9f76-25c4c66e7749 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:52.816005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f059c6e1-7587-4a58-9f76-25c4c66e7749 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:52.816446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f059c6e1-7587-4a58-9f76-25c4c66e7749 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:52.821486 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec688fec-0cf3-4a79-ac50-b40c93d7f377 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1689 microversion: 2.1 time: 0.165633 Apr 30 21:57:52.822101 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3037/6179] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:52 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:52.879307 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f059c6e1-7587-4a58-9f76-25c4c66e7749 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "POST /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26/action" status: 200 len: 24560 microversion: 2.1 time: 0.134512 Apr 30 21:57:52.880047 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3143/6180] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:57:52 2022] POST /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26/action => generated 24560 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:57:53.839132 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:53.839755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:53.846656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:53.848952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:53.848952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:53.849181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.362235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:54.362235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:54.365695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.365973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:54.366373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.367219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.367726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.374227 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-79477ea3-8f57-409a-a3a7-1fdbe2910e88 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1679 microversion: 2.1 time: 0.538988 Apr 30 21:57:54.379367 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3038/6181] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:53 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1679 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:54.387969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-143afab5-878a-4b22-905e-30ac7b6acc97 req-66deeb31-8609-49eb-9dc4-6a58f1c734f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af31b0c5-c096-4cf6-9bf1-6f00587c0c26", "tag": "1fc802f0-1162-4d58-8092-e6c04cc94cdf"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:54.398869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-143afab5-878a-4b22-905e-30ac7b6acc97 req-66deeb31-8609-49eb-9dc4-6a58f1c734f3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.399427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-143afab5-878a-4b22-905e-30ac7b6acc97 req-66deeb31-8609-49eb-9dc4-6a58f1c734f3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.412434 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-143afab5-878a-4b22-905e-30ac7b6acc97 req-66deeb31-8609-49eb-9dc4-6a58f1c734f3 service nova] Creating event network-changed:1fc802f0-1162-4d58-8092-e6c04cc94cdf for instance af31b0c5-c096-4cf6-9bf1-6f00587c0c26 on nch1-master-1 Apr 30 21:57:54.415308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:57:54.417791 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-143afab5-878a-4b22-905e-30ac7b6acc97 req-66deeb31-8609-49eb-9dc4-6a58f1c734f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038519 Apr 30 21:57:54.418747 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3039/6182] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:54.424657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c7fd8e99-e69f-4159-ac93-88014bf09abd tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:54.425387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c7fd8e99-e69f-4159-ac93-88014bf09abd tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:54.432343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7fd8e99-e69f-4159-ac93-88014bf09abd tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.432902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7fd8e99-e69f-4159-ac93-88014bf09abd tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.433970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7fd8e99-e69f-4159-ac93-88014bf09abd tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.434436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c7fd8e99-e69f-4159-ac93-88014bf09abd tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.662759 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c7fd8e99-e69f-4159-ac93-88014bf09abd tempest-TestNetworkAdvancedServerOps-404478808 tempest-TestNetworkAdvancedServerOps-404478808-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1830 microversion: 2.1 time: 0.242490 Apr 30 21:57:54.663380 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3040/6183] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:54 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1830 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:54.682074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:54.682728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:54.689298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.689795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.690620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.691379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.710933 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c24663b0-1a31-4639-9e77-ebc49adbb194 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 204 len: 0 microversion: 2.1 time: 0.358528 Apr 30 21:57:54.711855 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3144/6184] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:57:54 2022] DELETE /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:57:54.722648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:54.723776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:54.734506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.735156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.735848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:54.736302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:54.916284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:54.920211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:54.924291 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ccd6755a-fac2-4160-9938-423b76c20b3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1679 microversion: 2.1 time: 0.246906 Apr 30 21:57:54.936595 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3041/6185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:54 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:57:54.937131 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-93da7319-bc70-42f1-b855-c5bc80350906 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1577 microversion: 2.1 time: 0.211395 Apr 30 21:57:54.937131 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3145/6186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:54 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:55.946876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:55.947509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:55.954233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:55.954702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:55.955483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:55.955940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:56.113019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:56.121017 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a79e0917-2dde-4ecb-b407-f24d27ce7fda tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1577 microversion: 2.1 time: 0.177988 Apr 30 21:57:56.121588 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3042/6187] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:55 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:57.006106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-8afda44c-cf5d-49db-b95e-70db66fed1d1 req-aae99ede-7e19-464d-b707-387220aa2733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31b0c5-c096-4cf6-9bf1-6f00587c0c26", "name": "network-vif-deleted", "tag": "1fc802f0-1162-4d58-8092-e6c04cc94cdf"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:57.015218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8afda44c-cf5d-49db-b95e-70db66fed1d1 req-aae99ede-7e19-464d-b707-387220aa2733 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:57.020378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-8afda44c-cf5d-49db-b95e-70db66fed1d1 req-aae99ede-7e19-464d-b707-387220aa2733 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:57.027753 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-8afda44c-cf5d-49db-b95e-70db66fed1d1 req-aae99ede-7e19-464d-b707-387220aa2733 service nova] Creating event network-vif-deleted:1fc802f0-1162-4d58-8092-e6c04cc94cdf for instance af31b0c5-c096-4cf6-9bf1-6f00587c0c26 on nch1-master-1 Apr 30 21:57:57.032689 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-8afda44c-cf5d-49db-b95e-70db66fed1d1 req-aae99ede-7e19-464d-b707-387220aa2733 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031146 Apr 30 21:57:57.032842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d57029d4-475d-41aa-85ca-3ff92aca4ac9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:57.033592 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3146/6188] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:57.033790 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d57029d4-475d-41aa-85ca-3ff92aca4ac9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:57.041427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d57029d4-475d-41aa-85ca-3ff92aca4ac9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:57.049679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d57029d4-475d-41aa-85ca-3ff92aca4ac9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:57.049679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d57029d4-475d-41aa-85ca-3ff92aca4ac9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:57.049679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d57029d4-475d-41aa-85ca-3ff92aca4ac9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:57.117479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d57029d4-475d-41aa-85ca-3ff92aca4ac9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action" status: 200 len: 38445 microversion: 2.1 time: 0.088972 Apr 30 21:57:57.118170 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3043/6189] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:57:57 2022] POST /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b/action => generated 38445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 21:57:57.139576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:57.140297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:57.152108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:57.152108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:57.152108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:57.152108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:57.217461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d838be38c1941eba44ffcfc6c17f002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839ab2af4d6b40c3b957be9c7dc78b26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:57.225113 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1cb43c9a-7998-4664-ab72-4e69e0dd3b06 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 200 len: 1226 microversion: 2.1 time: 0.089976 Apr 30 21:57:57.225699 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3147/6190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:57 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:58.224992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:58.225722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:58.233615 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:58.234192 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:58.234995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:58.237077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:58.270220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:57:58.305258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ffb7e10f-ec59-483d-8dec-6cc731bb07dd req-c934cc26-384c-4577-92dc-d1327e667093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:58.315805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ffb7e10f-ec59-483d-8dec-6cc731bb07dd req-c934cc26-384c-4577-92dc-d1327e667093 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:58.316402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ffb7e10f-ec59-483d-8dec-6cc731bb07dd req-c934cc26-384c-4577-92dc-d1327e667093 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:58.328335 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ffb7e10f-ec59-483d-8dec-6cc731bb07dd req-c934cc26-384c-4577-92dc-d1327e667093 service nova] Creating event network-changed:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch1-master-1 Apr 30 21:57:58.333126 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ffb7e10f-ec59-483d-8dec-6cc731bb07dd req-c934cc26-384c-4577-92dc-d1327e667093 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111163 Apr 30 21:57:58.333722 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3148/6191] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:58.338866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:58.346057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] [instance: af31b0c5-c096-4cf6-9bf1-6f00587c0c26] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:58.346057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:58.346057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:58.346955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:58.347381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:58.361462 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] HTTP exception thrown: Instance af31b0c5-c096-4cf6-9bf1-6f00587c0c26 could not be found. Apr 30 21:57:58.362091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Returning 404 to user: Instance af31b0c5-c096-4cf6-9bf1-6f00587c0c26 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:57:58.369985 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8beed1ba-2a88-4354-8b1e-144f2d740186 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26" status: 404 len: 111 microversion: 2.1 time: 0.028110 Apr 30 21:57:58.369985 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3149/6192] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:58 2022] GET /compute/v2.1/servers/af31b0c5-c096-4cf6-9bf1-6f00587c0c26 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:57:58.605717 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5221cfc7-cbcd-483f-b41a-27cc0cf364f7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 204 len: 0 microversion: 2.1 time: 0.385177 Apr 30 21:57:58.606624 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3044/6193] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:57:58 2022] DELETE /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:57:58.616634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:58.617152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:58.626737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:58.627395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:58.628412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:58.629029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:58.793193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:58.801230 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db0518f7-e719-438f-bfb8-796b9f63fb4c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1685 microversion: 2.1 time: 0.189427 Apr 30 21:57:58.803003 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3150/6194] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:58 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:57:59.657390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2c313890-8470-4669-902b-da0ba72096aa req-a7d4af62-238f-4f47-8c99-b3d5ba7ec4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f43bb4-4c09-4eba-aad5-fca0789cae7b", "name": "network-vif-deleted", "tag": "037519cd-c561-4f5b-8464-74318a55fafd"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:57:59.668205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2c313890-8470-4669-902b-da0ba72096aa req-a7d4af62-238f-4f47-8c99-b3d5ba7ec4f4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:59.669082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2c313890-8470-4669-902b-da0ba72096aa req-a7d4af62-238f-4f47-8c99-b3d5ba7ec4f4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:59.679818 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2c313890-8470-4669-902b-da0ba72096aa req-a7d4af62-238f-4f47-8c99-b3d5ba7ec4f4 service nova] Creating event network-vif-deleted:037519cd-c561-4f5b-8464-74318a55fafd for instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b on nch1-master-1 Apr 30 21:57:59.684708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2c313890-8470-4669-902b-da0ba72096aa req-a7d4af62-238f-4f47-8c99-b3d5ba7ec4f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037659 Apr 30 21:57:59.685496 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3045/6195] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:57:59.820218 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:57:59.820821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:57:59.827888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:59.828349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:59.829130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:57:59.829609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:57:59.997084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:57:59.997084 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e694b508-9086-41a7-ae75-915a4316df10 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 200 len: 1350 microversion: 2.1 time: 0.090484 Apr 30 21:57:59.997084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3151/6196] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:57:59 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:58:00.929702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:00.930483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 51f43bb4-4c09-4eba-aad5-fca0789cae7b] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:00.937739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:00.938267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:00.939065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:00.939524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:00.953033 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] HTTP exception thrown: Instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b could not be found. Apr 30 21:58:00.953579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Returning 404 to user: Instance 51f43bb4-4c09-4eba-aad5-fca0789cae7b could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:58:00.954456 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4b66cf6-a42c-4fb0-87f7-d571aa768964 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b" status: 404 len: 111 microversion: 2.1 time: 0.029703 Apr 30 21:58:00.954986 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3046/6197] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:00 2022] GET /compute/v2.1/servers/51f43bb4-4c09-4eba-aad5-fca0789cae7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:58:04.869491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a7044232-6aa4-40ec-bbfb-f5aa41369d2e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '.version_select at 0x7fdc1355b700>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:04.949166 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a7044232-6aa4-40ec-bbfb-f5aa41369d2e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-219563355" status: 202 len: 0 microversion: 2.1 time: 0.083464 Apr 30 21:58:04.949775 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3152/6198] 10.222.0.23 () {58 vars in 1280 bytes} [Sat Apr 30 21:58:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-219563355 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:58:04.979265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9c44c5f-8188-4732-9bbc-e81522f366cd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: .version_select at 0x7fdc2088b310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2045309898"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:58:04.994062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c9c44c5f-8188-4732-9bbc-e81522f366cd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:58:04.999232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c9c44c5f-8188-4732-9bbc-e81522f366cd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:58:05.446853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c9c44c5f-8188-4732-9bbc-e81522f366cd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:58:05.452641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-c9c44c5f-8188-4732-9bbc-e81522f366cd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:58:05.467264 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9c44c5f-8188-4732-9bbc-e81522f366cd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.492278 Apr 30 21:58:05.467855 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3047/6199] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 21:58:04 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:58:06.239895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad561a04-6e1b-409d-921c-f2cafc936db7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] Calling method '.version_select at 0x7fdc133d44c0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:06.337520 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad561a04-6e1b-409d-921c-f2cafc936db7 tempest-TestVolumeBootPattern-539025653 tempest-TestVolumeBootPattern-539025653-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1741964513" status: 202 len: 0 microversion: 2.1 time: 0.105865 Apr 30 21:58:06.338177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3153/6200] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:58:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1741964513 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 21:58:14.838158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1927125722", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "6027e0e7-3535-415c-b35f-9a3568908318"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2045309898", "security_groups": [{"name": "tempest-secgroup-smoke-1991118122"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:58:15.100155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] validate_networks() for [('6027e0e7-3535-415c-b35f-9a3568908318', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 21:58:15.822305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:58:15.824554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:58:15.827499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:58:15.828067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:58:15.829032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:58:15.839475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:15.840507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:15.841544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:15.842046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:15.862093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 21:58:15.869906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Getting quotas for user 9294e527a38c483482c6a49091c226c9 and project 12f7d764a613404a9be3d0a9d325c8f6. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 21:58:15.884837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 21:58:15.889911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 21:58:16.016951 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5afd611-2e94-4357-bda3-93f8d8c2bd66 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.182650 Apr 30 21:58:16.019738 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3048/6201] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:58:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 21:58:16.029503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7f31a5e-3a9b-48ff-b15a-0e7248d4368c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:16.030147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7f31a5e-3a9b-48ff-b15a-0e7248d4368c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:16.100713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7f31a5e-3a9b-48ff-b15a-0e7248d4368c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:16.108048 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7f31a5e-3a9b-48ff-b15a-0e7248d4368c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1267 microversion: 2.1 time: 0.082333 Apr 30 21:58:16.108641 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3154/6202] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:16 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:17.126762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:17.127414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:17.133924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:17.134371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:17.135256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:17.135725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:17.219441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:17.228286 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae03cff8-4601-411a-a1e6-78c491a46ae8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1271 microversion: 2.1 time: 0.106392 Apr 30 21:58:17.228884 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3049/6203] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:17 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:18.245880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:18.247198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:18.256476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:18.257222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:18.258419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:18.259106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:18.358463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:18.367572 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70cad9ab-b0b2-4bd0-ad49-c04d979711f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1319 microversion: 2.1 time: 0.126768 Apr 30 21:58:18.369569 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3155/6204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:18 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:19.387521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:19.388174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:19.396166 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:19.396650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:19.397462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:19.397964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:19.642997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:19.651039 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c93dec0-88fa-43cd-b40e-7076315a0bfd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1393 microversion: 2.1 time: 0.267533 Apr 30 21:58:19.651666 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3050/6205] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:19 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1393 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:20.179784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e41387cb-6228-4628-884b-13f4b18f035e req-b4294e13-1784-49e0-8c05-22801802b56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d722f7-99b1-4e8a-b509-e3dd313d1657", "tag": "86cac3f4-0498-432f-98dc-d0429323f790"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:58:20.189104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e41387cb-6228-4628-884b-13f4b18f035e req-b4294e13-1784-49e0-8c05-22801802b56c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:20.189562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e41387cb-6228-4628-884b-13f4b18f035e req-b4294e13-1784-49e0-8c05-22801802b56c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:20.201875 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e41387cb-6228-4628-884b-13f4b18f035e req-b4294e13-1784-49e0-8c05-22801802b56c service nova] Creating event network-changed:86cac3f4-0498-432f-98dc-d0429323f790 for instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 on nch2-master-1 Apr 30 21:58:20.206729 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e41387cb-6228-4628-884b-13f4b18f035e req-b4294e13-1784-49e0-8c05-22801802b56c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033210 Apr 30 21:58:20.207339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3156/6206] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:58:20.668810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:20.669442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:20.676522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:20.677045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:20.677836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:20.678294 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:20.917543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:20.924942 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24ce582e-ad52-4401-ae9c-e2325ef9edb7 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1393 microversion: 2.1 time: 0.260110 Apr 30 21:58:20.925543 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3051/6207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:20 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:21.943432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:21.944132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:21.950379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:21.950830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:21.951629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:21.952067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:22.080467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:22.089879 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-947b2caf-c885-4227-ae5a-f44698dc7f46 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1393 microversion: 2.1 time: 0.151839 Apr 30 21:58:22.090685 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3157/6208] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:21 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:23.108045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:23.108590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:23.115947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:23.116421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:23.117212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:23.117674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:23.245660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:23.253232 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a11538b-eaba-439c-bc2b-3fcc4247c671 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1393 microversion: 2.1 time: 0.149221 Apr 30 21:58:23.253834 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3052/6209] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:23 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1393 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:24.270651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:24.271297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:24.278383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:24.278922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:24.279804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:24.280506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:24.414681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:24.423107 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d9aabf45-31cc-4e05-a807-7b8cb39ef2df tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1393 microversion: 2.1 time: 0.156275 Apr 30 21:58:24.423107 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3158/6210] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:24 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:25.439896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:25.440483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:25.447756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:25.448230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:25.449053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:25.449511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:25.580080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:25.587475 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d1d2d9bb-3b90-499d-9c03-6b496167d001 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1393 microversion: 2.1 time: 0.151554 Apr 30 21:58:25.588050 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3053/6211] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:25 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:26.176879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b3cad74c-dec6-4022-802d-a79dcdb17214 req-d5d3a6aa-43c9-4923-9cc4-d7ae237f5d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d722f7-99b1-4e8a-b509-e3dd313d1657", "name": "network-vif-plugged", "status": "completed", "tag": "86cac3f4-0498-432f-98dc-d0429323f790"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:58:26.185824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b3cad74c-dec6-4022-802d-a79dcdb17214 req-d5d3a6aa-43c9-4923-9cc4-d7ae237f5d22 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:26.186235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b3cad74c-dec6-4022-802d-a79dcdb17214 req-d5d3a6aa-43c9-4923-9cc4-d7ae237f5d22 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:26.196925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b3cad74c-dec6-4022-802d-a79dcdb17214 req-d5d3a6aa-43c9-4923-9cc4-d7ae237f5d22 service nova] Creating event network-vif-plugged:86cac3f4-0498-432f-98dc-d0429323f790 for instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 on nch2-master-1 Apr 30 21:58:26.201881 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b3cad74c-dec6-4022-802d-a79dcdb17214 req-d5d3a6aa-43c9-4923-9cc4-d7ae237f5d22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029479 Apr 30 21:58:26.207428 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3159/6212] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:58:26.604541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:26.605175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:26.612049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:26.612526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:26.613340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:26.613869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:26.746704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:26.754584 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c84fba1b-616d-4c66-803b-07b51c754a3f tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1393 microversion: 2.1 time: 0.153529 Apr 30 21:58:26.755166 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3054/6213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:26 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:27.773428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:27.774161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:27.780426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:27.780883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:27.781820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:27.782274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:27.917880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:27.925359 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7687fb15-fe06-485d-9f23-16632c1ed15b tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1566 microversion: 2.1 time: 0.157872 Apr 30 21:58:27.926719 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3160/6214] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:27 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:27.942359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:27.943111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:27.949972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:27.950455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:27.951316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:27.951782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:28.077519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:28.085017 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ccce3723-d7e4-4505-8f24-b5f54e897554 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1566 microversion: 2.1 time: 0.147176 Apr 30 21:58:28.085595 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3055/6215] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:27 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:30.269170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:58:30.269813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:30.277665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-037bace9-f7d1-4341-b2f9-0e2cae88c38e req-426b7429-6509-4776-b569-342d7f198e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d722f7-99b1-4e8a-b509-e3dd313d1657", "tag": "86cac3f4-0498-432f-98dc-d0429323f790"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:58:30.287070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-037bace9-f7d1-4341-b2f9-0e2cae88c38e req-426b7429-6509-4776-b569-342d7f198e35 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:30.287546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-037bace9-f7d1-4341-b2f9-0e2cae88c38e req-426b7429-6509-4776-b569-342d7f198e35 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:30.294866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:30.295329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:30.296173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:30.296622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:30.309542 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-037bace9-f7d1-4341-b2f9-0e2cae88c38e req-426b7429-6509-4776-b569-342d7f198e35 service nova] Creating event network-changed:86cac3f4-0498-432f-98dc-d0429323f790 for instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 on nch2-master-1 Apr 30 21:58:30.314900 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-037bace9-f7d1-4341-b2f9-0e2cae88c38e req-426b7429-6509-4776-b569-342d7f198e35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040776 Apr 30 21:58:30.315714 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3056/6216] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:58:30.559165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:58:30.566842 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30ccc9f3-f9f2-4178-af1d-3ed2ebf617dc tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1566 microversion: 2.1 time: 0.301765 Apr 30 21:58:30.569143 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3161/6217] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:58:30 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1566 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:58:53.867307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e64ce32-0eb4-406b-96b6-4c5f804a3f78 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:58:53.868336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e64ce32-0eb4-406b-96b6-4c5f804a3f78 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:58:53.874528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e64ce32-0eb4-406b-96b6-4c5f804a3f78 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:53.874998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e64ce32-0eb4-406b-96b6-4c5f804a3f78 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:53.875780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e64ce32-0eb4-406b-96b6-4c5f804a3f78 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:58:53.876426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e64ce32-0eb4-406b-96b6-4c5f804a3f78 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:58:53.925096 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e64ce32-0eb4-406b-96b6-4c5f804a3f78 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657/action" status: 200 len: 24573 microversion: 2.1 time: 0.062232 Apr 30 21:58:53.925713 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3057/6218] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:58:53 2022] POST /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657/action => generated 24573 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:59:00.391443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:59:00.393137 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:00.399961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:00.400414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:00.401188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:00.401626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:00.477370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 21:59:00.478433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 21:59:00.478433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 21:59:00.478761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 21:59:00.479180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 21:59:00.746506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:00.752744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:00.753243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:00.754060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:00.754503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:00.782406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ce42e49e-902b-484b-a505-98a3ee5c430d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657/action" status: 202 len: 1138 microversion: 2.1 time: 0.395020 Apr 30 21:59:00.783059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3162/6219] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:59:00 2022] POST /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657/action => generated 1138 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 30 21:59:00.798246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:00.798976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:00.809948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:00.815544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:00.815544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:00.815544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:00.971397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:00.979521 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-19b96d7f-a1ac-47ea-9cf0-7b2241c34f0a tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.185516 Apr 30 21:59:00.980094 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3058/6220] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:00 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:01.996740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:01.997334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:02.003388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:02.003853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:02.004627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:02.005071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:02.131278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:02.139123 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc364c7c-761c-4a34-ae87-485a9014a7d1 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.146623 Apr 30 21:59:02.139694 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3163/6221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:01 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:03.157044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:03.157676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:03.165409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:03.165921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:03.166715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:03.167175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:03.307096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:03.314085 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45c3841c-e765-48cc-ab1c-d19baea5b4fb tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.161112 Apr 30 21:59:03.314722 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3059/6222] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:03 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:04.331506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:04.332117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:04.340082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:04.341311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:04.341311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:04.341911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:04.479124 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:04.486552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4992fd96-a82c-4ab8-9d42-3cbc716f11dd tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.159077 Apr 30 21:59:04.487119 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3164/6223] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:04 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:05.504080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:05.504718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:05.512212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:05.512686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:05.513477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:05.514100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:05.645384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:05.652853 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4914f71f-deef-4fee-a1f5-2bafc5859100 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.152729 Apr 30 21:59:05.653428 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3060/6224] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:05 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:06.669164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:06.669698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:06.676547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:06.677021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:06.677800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:06.678294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:06.809357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:06.821033 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3802f84b-c59b-467b-881e-cc248c019f8e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.156006 Apr 30 21:59:06.821619 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3165/6225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:06 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:07.838019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:07.838660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:07.845448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:07.845958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:07.846783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:07.847245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:07.979086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:07.987908 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-262e5775-26d3-4c69-b647-9f66032c231e tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.153845 Apr 30 21:59:07.990323 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3061/6226] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:07 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:09.006169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:09.006788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:09.014311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:09.014771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:09.015556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:09.016001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:09.143793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:09.151216 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e3728659-554c-4cc7-8ba6-9ca88b13e580 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.149023 Apr 30 21:59:09.151787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3166/6227] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:09 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:10.168429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:10.168960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:10.176009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:10.176514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:10.177346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:10.177836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:10.314363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:10.321995 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f6247f5-04cf-4ec8-a45d-c1d135106e1c tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.158064 Apr 30 21:59:10.322566 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3062/6228] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:10 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:11.338947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:11.339568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:11.347293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:11.347744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:11.348515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:11.348956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:11.479230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:11.486912 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4970e9e9-878c-4cec-9a53-2c4d34bac9f9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.151892 Apr 30 21:59:11.487512 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3167/6229] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:11 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:12.505055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:12.505721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:12.513365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:12.513872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:12.514682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:12.515147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:12.649214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:12.656638 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-63aa7ace-899a-4863-84d1-271756c93ca2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1693 microversion: 2.1 time: 0.155959 Apr 30 21:59:12.657210 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3063/6230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:12 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:13.673156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:13.673797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:13.680675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:13.681132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:13.681958 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:13.682406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:13.808894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:13.816268 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8addba1e-48e3-4dbf-bb7f-2945a8cbf6c8 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1699 microversion: 2.1 time: 0.146980 Apr 30 21:59:13.816832 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3168/6231] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:13 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1699 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:14.833750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:14.834407 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:14.841868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:14.842347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:14.843141 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:14.843604 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:14.975130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:14.982737 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6297c9b-8bb8-4683-8e13-5fea9f2d0152 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1699 microversion: 2.1 time: 0.152981 Apr 30 21:59:14.983303 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3064/6232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:14 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:16.000200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:16.000822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:16.007669 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:16.008126 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:16.008902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:16.009353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:16.139704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:16.147453 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d19542e-84ad-4c77-a48a-109d487dc4a2 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1684 microversion: 2.1 time: 0.151174 Apr 30 21:59:16.148036 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3169/6233] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:15 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:59:18.293244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-74b3e2f4-d903-4ca8-9206-8c2fc8a0d708 req-27e86fde-0a59-4f30-b0e3-bd3e77d2bea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d722f7-99b1-4e8a-b509-e3dd313d1657", "name": "network-vif-plugged", "status": "completed", "tag": "86cac3f4-0498-432f-98dc-d0429323f790"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:59:18.302203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-74b3e2f4-d903-4ca8-9206-8c2fc8a0d708 req-27e86fde-0a59-4f30-b0e3-bd3e77d2bea5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:18.302675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-74b3e2f4-d903-4ca8-9206-8c2fc8a0d708 req-27e86fde-0a59-4f30-b0e3-bd3e77d2bea5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:18.313654 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-74b3e2f4-d903-4ca8-9206-8c2fc8a0d708 req-27e86fde-0a59-4f30-b0e3-bd3e77d2bea5 service nova] Creating event network-vif-plugged:86cac3f4-0498-432f-98dc-d0429323f790 for instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 on nch2-master-1 Apr 30 21:59:18.319036 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-74b3e2f4-d903-4ca8-9206-8c2fc8a0d708 req-27e86fde-0a59-4f30-b0e3-bd3e77d2bea5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029512 Apr 30 21:59:18.319619 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3065/6234] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:59:40.341108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-090e0881-abe2-48d6-8553-d0ce30ebdddf tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:59:40.342149 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-090e0881-abe2-48d6-8553-d0ce30ebdddf tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:40.348395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-090e0881-abe2-48d6-8553-d0ce30ebdddf tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:40.348848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-090e0881-abe2-48d6-8553-d0ce30ebdddf tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:40.349663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-090e0881-abe2-48d6-8553-d0ce30ebdddf tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:40.350180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-090e0881-abe2-48d6-8553-d0ce30ebdddf tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:40.403464 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-090e0881-abe2-48d6-8553-d0ce30ebdddf tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "POST /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657/action" status: 200 len: 24567 microversion: 2.1 time: 0.066731 Apr 30 21:59:40.404344 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3170/6235] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 21:59:40 2022] POST /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657/action => generated 24567 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 21:59:52.148111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:52.149049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:52.151379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d0220b55-a527-429e-b88e-63108b9d359b req-6f12305f-5143-4ffa-848f-547e0ad7ee54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d722f7-99b1-4e8a-b509-e3dd313d1657", "tag": "86cac3f4-0498-432f-98dc-d0429323f790"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:59:52.157052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:52.157522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:52.158342 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:52.158868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:52.166196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0220b55-a527-429e-b88e-63108b9d359b req-6f12305f-5143-4ffa-848f-547e0ad7ee54 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:52.166665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d0220b55-a527-429e-b88e-63108b9d359b req-6f12305f-5143-4ffa-848f-547e0ad7ee54 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:52.181058 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d0220b55-a527-429e-b88e-63108b9d359b req-6f12305f-5143-4ffa-848f-547e0ad7ee54 service nova] Creating event network-changed:86cac3f4-0498-432f-98dc-d0429323f790 for instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 on nch2-master-1 Apr 30 21:59:52.186268 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d0220b55-a527-429e-b88e-63108b9d359b req-6f12305f-5143-4ffa-848f-547e0ad7ee54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039936 Apr 30 21:59:52.186425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 21:59:52.187591 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3171/6236] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:59:52.452279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7d5995fa-4c8a-4f73-8c86-10f089078c4d tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 204 len: 0 microversion: 2.1 time: 0.308316 Apr 30 21:59:52.462225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:52.462989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:52.467196 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3066/6237] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:59:52 2022] DELETE /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 21:59:52.470911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:52.471309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:52.472106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:52.472561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:52.896261 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:52.904703 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4d2ed5bc-6332-4517-a5ae-bc3a88006be0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1690 microversion: 2.1 time: 0.446854 Apr 30 21:59:52.905288 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3172/6238] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:52 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1690 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:53.923218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:53.923962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:53.930743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:53.931240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:53.932104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:53.932555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:54.137471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:54.145284 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-962e0f4d-79d1-48e5-a768-6a2e2963cea9 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1572 microversion: 2.1 time: 0.226380 Apr 30 21:59:54.145902 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3067/6239] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:53 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1572 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 21:59:54.348330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-51e3a28f-bce1-46b3-8d2e-3da41d8cd920 req-d94d7dae-ca8c-47f7-9370-ededfec8e6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d722f7-99b1-4e8a-b509-e3dd313d1657", "name": "network-vif-deleted", "tag": "86cac3f4-0498-432f-98dc-d0429323f790"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 21:59:54.357744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-51e3a28f-bce1-46b3-8d2e-3da41d8cd920 req-d94d7dae-ca8c-47f7-9370-ededfec8e6c5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:54.358227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-51e3a28f-bce1-46b3-8d2e-3da41d8cd920 req-d94d7dae-ca8c-47f7-9370-ededfec8e6c5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:54.368577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-51e3a28f-bce1-46b3-8d2e-3da41d8cd920 req-d94d7dae-ca8c-47f7-9370-ededfec8e6c5 service nova] Creating event network-vif-deleted:86cac3f4-0498-432f-98dc-d0429323f790 for instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 on nch2-master-1 Apr 30 21:59:54.373607 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-51e3a28f-bce1-46b3-8d2e-3da41d8cd920 req-d94d7dae-ca8c-47f7-9370-ededfec8e6c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029125 Apr 30 21:59:54.374215 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3173/6240] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 21:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 21:59:55.162554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:55.163193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:55.170165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:55.170642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:55.172176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:55.172176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:55.204961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:55.205440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:55.205942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lazy-loading 'fault' on Instance uuid 24d722f7-99b1-4e8a-b509-e3dd313d1657 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 21:59:55.250349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e527a38c483482c6a49091c226c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f7d764a613404a9be3d0a9d325c8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 21:59:55.257740 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-847642c3-9769-41ca-9d46-a4a0d1642212 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 200 len: 1357 microversion: 2.1 time: 0.099084 Apr 30 21:59:55.261960 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3068/6241] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:55 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 21:59:56.277006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 21:59:56.277915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] [instance: 24d722f7-99b1-4e8a-b509-e3dd313d1657] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 21:59:56.284323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:56.284781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:56.285559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 21:59:56.286035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 21:59:56.299061 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] HTTP exception thrown: Instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 could not be found. Apr 30 21:59:56.299656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Returning 404 to user: Instance 24d722f7-99b1-4e8a-b509-e3dd313d1657 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 21:59:56.300502 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5db2d4f1-fd6e-4e8f-a3cb-fd13cda85594 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657" status: 404 len: 111 microversion: 2.1 time: 0.028847 Apr 30 21:59:56.301012 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3174/6242] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:59:56 2022] GET /compute/v2.1/servers/24d722f7-99b1-4e8a-b509-e3dd313d1657 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 21:59:59.991018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-963a3214-c48e-4d60-995e-25f2c5b904d0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] Calling method '.version_select at 0x7fdc139e3550>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:00.061270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-963a3214-c48e-4d60-995e-25f2c5b904d0 tempest-TestNetworkAdvancedServerOps-528899204 tempest-TestNetworkAdvancedServerOps-528899204-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045309898" status: 202 len: 0 microversion: 2.1 time: 0.074336 Apr 30 22:00:00.061933 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3069/6243] 10.222.0.23 () {58 vars in 1283 bytes} [Sat Apr 30 21:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045309898 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:00:26.342034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-200406572", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:26.393163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] validate_networks() for None {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:00:26.995497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:00:26.995931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:00:26.996450 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:00:26.996867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:00:26.997281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:00:27.006104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:27.006566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:27.007387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:27.007830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:27.024903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Getting quotas for project 2bae0a08aedf4727bc608812485cfd5e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:00:27.030098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Getting quotas for user f1c0ee25ae4a4265b191f1291e8997f9 and project 2bae0a08aedf4727bc608812485cfd5e. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:00:27.042103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:00:27.044321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:00:27.186299 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c912b580-ef12-4c85-98a4-b12104b2f88b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964816 Apr 30 22:00:27.186945 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3175/6244] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:00:27.197391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca212c62-c5ad-468a-8d20-335fd95ddf05 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:27.197990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ca212c62-c5ad-468a-8d20-335fd95ddf05 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:27.252672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ca212c62-c5ad-468a-8d20-335fd95ddf05 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:27.258907 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca212c62-c5ad-468a-8d20-335fd95ddf05 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1221 microversion: 2.1 time: 0.065641 Apr 30 22:00:27.259529 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3070/6245] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:27 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:28.277303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:28.278112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:28.284975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:28.285439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:28.286289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:28.286740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:28.349233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:28.357227 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e49b3753-193d-48d5-9369-96b450c34bcf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1225 microversion: 2.1 time: 0.085545 Apr 30 22:00:28.357805 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3176/6246] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:28 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:00:29.375010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:29.375703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:29.385509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:29.386181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:29.387006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:29.388186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:29.463451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:29.471199 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0bc019d5-1da9-4974-9ccd-9da60eda55e4 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1281 microversion: 2.1 time: 0.101258 Apr 30 22:00:29.471769 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3071/6247] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:29 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:30.489111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:30.489800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:30.496970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:30.497674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:30.498704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:30.499316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:30.751950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:30.759406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fbb51780-1c14-4ec1-9778-828469f11cc7 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1321 microversion: 2.1 time: 0.274315 Apr 30 22:00:30.759966 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3177/6248] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:30 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:31.315976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-5ef99bb8-0b86-4690-a1f9-aa7b966b0104 req-7b2faaa5-24f4-43f7-91bf-669d4e8a2927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9eb46a-0d0d-4764-a192-c2e2c898bce4", "tag": "047dcbdf-7b17-4734-81aa-b0ccacc831f5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:31.327273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5ef99bb8-0b86-4690-a1f9-aa7b966b0104 req-7b2faaa5-24f4-43f7-91bf-669d4e8a2927 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:31.328211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-5ef99bb8-0b86-4690-a1f9-aa7b966b0104 req-7b2faaa5-24f4-43f7-91bf-669d4e8a2927 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:31.345657 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-5ef99bb8-0b86-4690-a1f9-aa7b966b0104 req-7b2faaa5-24f4-43f7-91bf-669d4e8a2927 service nova] Creating event network-changed:047dcbdf-7b17-4734-81aa-b0ccacc831f5 for instance 6a9eb46a-0d0d-4764-a192-c2e2c898bce4 on nch1-master-1 Apr 30 22:00:31.352319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-5ef99bb8-0b86-4690-a1f9-aa7b966b0104 req-7b2faaa5-24f4-43f7-91bf-669d4e8a2927 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052287 Apr 30 22:00:31.353374 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3072/6249] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:31.777457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:31.778073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:31.784233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:31.784700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:31.785492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:31.786047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:31.985371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:31.992817 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2df846bc-4af8-48bf-bd90-50d03503be0e tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1321 microversion: 2.1 time: 0.219947 Apr 30 22:00:31.993381 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3178/6250] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:31 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:33.011871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:33.012634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:33.019493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:33.031402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:33.031402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:33.031402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:33.176298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:33.184086 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ebcc412-59ac-431e-b3d3-8fa4ad9a3b21 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1321 microversion: 2.1 time: 0.177995 Apr 30 22:00:33.184665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3073/6251] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:33 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:34.201558 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:34.202162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:34.208994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:34.209456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:34.210270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:34.210722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:34.338005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:34.345518 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a24ec5b-1b2f-4f0b-9c70-e0d7b3b5d28f tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1321 microversion: 2.1 time: 0.147837 Apr 30 22:00:34.350875 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3179/6252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:34 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:35.364258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:35.364898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:35.372298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:35.372775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:35.373578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:35.374071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:35.505651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:35.513135 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1d16bdda-bfad-4100-9e0d-5e599ea3d26b tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1321 microversion: 2.1 time: 0.152820 Apr 30 22:00:35.513709 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3074/6253] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:35 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:36.530718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:36.531303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:36.538390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:36.538850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:36.539640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:36.540599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:36.678734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:36.686259 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b0886af9-27e9-4f52-a035-4f08817e6ed9 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1321 microversion: 2.1 time: 0.159589 Apr 30 22:00:36.686831 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3180/6254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:36 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:36.956528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4ae188c9-79c6-4df1-9c60-e26ffbbd59e4 req-be3d554e-15c7-49e0-98be-d757c2b00d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9eb46a-0d0d-4764-a192-c2e2c898bce4", "name": "network-vif-plugged", "status": "completed", "tag": "047dcbdf-7b17-4734-81aa-b0ccacc831f5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:36.965990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4ae188c9-79c6-4df1-9c60-e26ffbbd59e4 req-be3d554e-15c7-49e0-98be-d757c2b00d01 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:36.966453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4ae188c9-79c6-4df1-9c60-e26ffbbd59e4 req-be3d554e-15c7-49e0-98be-d757c2b00d01 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:36.978383 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4ae188c9-79c6-4df1-9c60-e26ffbbd59e4 req-be3d554e-15c7-49e0-98be-d757c2b00d01 service nova] Creating event network-vif-plugged:047dcbdf-7b17-4734-81aa-b0ccacc831f5 for instance 6a9eb46a-0d0d-4764-a192-c2e2c898bce4 on nch1-master-1 Apr 30 22:00:36.983755 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4ae188c9-79c6-4df1-9c60-e26ffbbd59e4 req-be3d554e-15c7-49e0-98be-d757c2b00d01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030941 Apr 30 22:00:36.984404 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3075/6255] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:37.703190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:37.703874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:37.710656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:37.711122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:37.711897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:37.712340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:37.839216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:37.846617 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-119a4992-037d-49df-8d0b-702fe9d96adf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1321 microversion: 2.1 time: 0.147332 Apr 30 22:00:37.847183 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3181/6256] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:37 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:38.865655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:38.866417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:38.872916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:38.873385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:38.874201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:38.874656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.008471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:39.016360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7d8f6a97-49fa-4e27-8022-54a3e70adfea tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1471 microversion: 2.1 time: 0.155958 Apr 30 22:00:39.016949 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3076/6257] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:38 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:39.083954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-944689d7-fd33-48e4-9888-1305f9f9472f tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Calling method '.version_select at 0x7fdc135d81f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:39.147624 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-944689d7-fd33-48e4-9888-1305f9f9472f tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/0e65c38e3ff842df99c336b404c2479a" status: 200 len: 371 microversion: 2.1 time: 0.116214 Apr 30 22:00:39.148184 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3182/6258] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 22:00:39 2022] GET /compute/v2.1/os-quota-sets/0e65c38e3ff842df99c336b404c2479a => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:39.159158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d83bfdf-e666-4108-8a38-cb91f62eca19 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-575927788", "id": 155836150, "os-flavor-access:is_public": "True"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:39.160755 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 22:00:39.160755 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 22:00:39.245518 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d83bfdf-e666-4108-8a38-cb91f62eca19 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.090106 Apr 30 22:00:39.246158 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3077/6259] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:00:39 2022] POST /compute/v2.1/flavors => generated 434 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:39.257065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "155836150"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:39.258210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:39.264827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.265287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.266345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.266789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.448311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '686799762ca943a0bca4b4bb0ae53722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e65c38e3ff842df99c336b404c2479a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:39.454758 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-575927788 {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:00:39.461012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.461462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.462843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.463278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.485039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Getting quotas for project 2bae0a08aedf4727bc608812485cfd5e. Resources: {'ram', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:00:39.490081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Getting quotas for user f1c0ee25ae4a4265b191f1291e8997f9 and project 2bae0a08aedf4727bc608812485cfd5e. Resources: {'ram', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:00:39.503728 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.compute.api [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] ram quota exceeded for 0e65c38e3ff842df99c336b404c2479a, tried to resize instance. Apr 30 22:00:39.504531 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Apr 30 22:00:39.505128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:00:39.505995 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1b10d29e-78c3-4388-b28e-2c94429409a2 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4/action" status: 403 len: 118 microversion: 2.1 time: 0.252930 Apr 30 22:00:39.506567 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3183/6260] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:00:39 2022] POST /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4/action => generated 118 bytes in 254 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:00:39.515521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0bf7bfed-cd23-4ae9-9e85-03501a46daaf tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:39.516522 ncdv-master-1 devstack@n-api.service[130670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 22:00:39.516522 ncdv-master-1 devstack@n-api.service[130670]: warnings.warn(msg) Apr 30 22:00:39.588390 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0bf7bfed-cd23-4ae9-9e85-03501a46daaf tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/155836150" status: 202 len: 0 microversion: 2.1 time: 0.076605 Apr 30 22:00:39.588966 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3078/6261] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 22:00:39 2022] DELETE /compute/v2.1/flavors/155836150 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 22:00:39.597035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c62ca5c-ebb1-47a8-a706-8c56f9f275ae tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:39.615460 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c62ca5c-ebb1-47a8-a706-8c56f9f275ae tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022240 Apr 30 22:00:39.616004 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3184/6262] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 22:00:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:39.633139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2eb8c26-5fb8-4a44-adb2-cc9f02ca75d7 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Calling method '.version_select at 0x7fdc13964790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:39.711519 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2eb8c26-5fb8-4a44-adb2-cc9f02ca75d7 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/0e65c38e3ff842df99c336b404c2479a" status: 200 len: 371 microversion: 2.1 time: 0.082157 Apr 30 22:00:39.712285 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3079/6263] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 22:00:39 2022] GET /compute/v2.1/os-quota-sets/0e65c38e3ff842df99c336b404c2479a => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:39.722623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26be95f8-4b8d-4318-9f91-f2c022604aaf tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1040548928", "id": 1345443231, "os-flavor-access:is_public": "True"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:39.724192 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 22:00:39.724192 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 22:00:39.795551 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26be95f8-4b8d-4318-9f91-f2c022604aaf tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.076696 Apr 30 22:00:39.796139 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3185/6264] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:00:39 2022] POST /compute/v2.1/flavors => generated 437 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:39.807104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1345443231"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:39.808137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:39.814063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.814534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.815325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.815782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.901344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '686799762ca943a0bca4b4bb0ae53722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e65c38e3ff842df99c336b404c2479a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:39.907402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1040548928 {{(pid=130670) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:00:39.913610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.914175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.915509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:39.915969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:39.935854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Getting quotas for project 2bae0a08aedf4727bc608812485cfd5e. Resources: {'ram', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:00:39.940711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Getting quotas for user f1c0ee25ae4a4265b191f1291e8997f9 and project 2bae0a08aedf4727bc608812485cfd5e. Resources: {'ram', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:00:39.952278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] cores quota exceeded for 0e65c38e3ff842df99c336b404c2479a, tried to resize instance. Apr 30 22:00:39.952827 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Apr 30 22:00:39.953433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:00:39.954316 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-920529f9-f02a-48dc-9650-8bb8e1b14ee1 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4/action" status: 403 len: 113 microversion: 2.1 time: 0.151718 Apr 30 22:00:39.954885 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3080/6265] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:00:39 2022] POST /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4/action => generated 113 bytes in 153 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:00:39.963139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f2ce934-2b51-4bff-ba4b-83eac902e049 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:39.963935 ncdv-master-1 devstack@n-api.service[130671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 22:00:39.963935 ncdv-master-1 devstack@n-api.service[130671]: warnings.warn(msg) Apr 30 22:00:40.036014 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f2ce934-2b51-4bff-ba4b-83eac902e049 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1345443231" status: 202 len: 0 microversion: 2.1 time: 0.076585 Apr 30 22:00:40.036610 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3186/6266] 10.222.0.23 () {58 vars in 1160 bytes} [Sat Apr 30 22:00:39 2022] DELETE /compute/v2.1/flavors/1345443231 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:00:40.046237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc177219-0237-486e-9042-67f5d05fca88 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:40.075345 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc177219-0237-486e-9042-67f5d05fca88 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033764 Apr 30 22:00:40.075943 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3081/6267] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 22:00:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:40.092475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:40.092971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:40.100231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:40.100693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:40.101471 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:40.101964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:40.126900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:00:40.377129 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2bfb7edc-8d7b-4255-a4e8-84e7059575cf tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 204 len: 0 microversion: 2.1 time: 0.288304 Apr 30 22:00:40.377725 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3187/6268] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:00:40 2022] DELETE /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:00:40.385785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:40.386424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:40.392865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:40.396803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:40.396803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:40.396803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:40.521660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:40.529747 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71c09225-4862-42f3-922b-bfa1939608e8 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1477 microversion: 2.1 time: 0.147780 Apr 30 22:00:40.530277 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3082/6269] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:40 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1477 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:41.547890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:41.548531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:41.556507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:41.556967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:41.557745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:41.558217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:41.688459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:41.696127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e047eac6-5a0e-4438-aa98-fcf2b2c37fec tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1477 microversion: 2.1 time: 0.152661 Apr 30 22:00:41.696704 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3188/6270] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:41 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:42.303266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-43232daf-995f-4481-a819-ac83b2fce8cf req-ac486fe1-b020-44d2-804c-034070ddf94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9eb46a-0d0d-4764-a192-c2e2c898bce4", "name": "network-vif-deleted", "tag": "047dcbdf-7b17-4734-81aa-b0ccacc831f5"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:42.313200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-43232daf-995f-4481-a819-ac83b2fce8cf req-ac486fe1-b020-44d2-804c-034070ddf94f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:42.320753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-43232daf-995f-4481-a819-ac83b2fce8cf req-ac486fe1-b020-44d2-804c-034070ddf94f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:42.326388 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-43232daf-995f-4481-a819-ac83b2fce8cf req-ac486fe1-b020-44d2-804c-034070ddf94f service nova] Creating event network-vif-deleted:047dcbdf-7b17-4734-81aa-b0ccacc831f5 for instance 6a9eb46a-0d0d-4764-a192-c2e2c898bce4 on nch1-master-1 Apr 30 22:00:42.331456 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-43232daf-995f-4481-a819-ac83b2fce8cf req-ac486fe1-b020-44d2-804c-034070ddf94f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Apr 30 22:00:42.332476 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3083/6271] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:42.713567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:42.714225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:42.721106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:42.721574 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:42.722390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:42.722845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:42.753240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:42.753700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:42.754192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lazy-loading 'fault' on Instance uuid 6a9eb46a-0d0d-4764-a192-c2e2c898bce4 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:00:42.794799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c0ee25ae4a4265b191f1291e8997f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bae0a08aedf4727bc608812485cfd5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:42.802336 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7865b9e0-978d-4e59-9694-b6a19e142bcb tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 200 len: 1311 microversion: 2.1 time: 0.093740 Apr 30 22:00:42.802907 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3189/6272] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:42 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:43.821285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:43.822027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] [instance: 6a9eb46a-0d0d-4764-a192-c2e2c898bce4] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:43.828206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:43.828674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:43.829454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:43.829948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:43.842923 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] HTTP exception thrown: Instance 6a9eb46a-0d0d-4764-a192-c2e2c898bce4 could not be found. Apr 30 22:00:43.843517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] Returning 404 to user: Instance 6a9eb46a-0d0d-4764-a192-c2e2c898bce4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:00:43.844340 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-64df8baa-cdd6-46be-8d18-15300da1eef0 tempest-ServersAdminNegativeTestJSON-709210156 tempest-ServersAdminNegativeTestJSON-709210156-project] 10.222.0.23 "GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4" status: 404 len: 111 microversion: 2.1 time: 0.028257 Apr 30 22:00:43.844884 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3084/6273] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:43 2022] GET /compute/v2.1/servers/6a9eb46a-0d0d-4764-a192-c2e2c898bce4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:00:48.596113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-307261930", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "9f6c5cb2-6f4a-4732-9fc5-fc8cae4549bc"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:48.647779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] validate_networks() for [('9f6c5cb2-6f4a-4732-9fc5-fc8cae4549bc', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:00:49.000520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:00:49.000951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:00:49.001432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:00:49.001890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:00:49.002310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:00:49.011895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:49.012350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:49.013154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:49.013597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:49.031036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Getting quotas for project b34dde3a4dd64ad1ab4c082b5d7ba735. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:00:49.036280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Getting quotas for user 5b6f19685e3f4fe79b47dffd24a4c765 and project b34dde3a4dd64ad1ab4c082b5d7ba735. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:00:49.048447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:00:49.050780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:00:49.195873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ae5f4f84-c9f0-4b75-ae3d-12ec427004fa tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720081 Apr 30 22:00:49.196565 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3190/6274] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:00:49.211628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ac536d5-46d9-4143-8a33-47b3b9db97ea tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:49.212287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ac536d5-46d9-4143-8a33-47b3b9db97ea tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:49.272913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4ac536d5-46d9-4143-8a33-47b3b9db97ea tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:49.281559 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ac536d5-46d9-4143-8a33-47b3b9db97ea tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1214 microversion: 2.1 time: 0.074670 Apr 30 22:00:49.281950 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3085/6275] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:49 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:50.299109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:50.299740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:50.307782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:50.308256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:50.309048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:50.309494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:50.368629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:50.376575 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9513faa4-cf8c-4b03-9970-590bf1fdeb12 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1218 microversion: 2.1 time: 0.081464 Apr 30 22:00:50.377148 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3191/6276] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:50 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:51.394809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:51.395449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:51.404997 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:51.405468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:51.406296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:51.406756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:51.484802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:51.492212 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ab8898b-72bd-4250-96ad-576d2b25a68c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1274 microversion: 2.1 time: 0.101725 Apr 30 22:00:51.492801 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3086/6277] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:51 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:52.510156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:52.510805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:52.518048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:52.518509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:52.519300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:52.519746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:52.722346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:52.729886 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d097f3c-7b1e-451a-8c39-27976ae8f47f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1314 microversion: 2.1 time: 0.223701 Apr 30 22:00:52.730464 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3192/6278] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:52 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:53.083203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-14e9af60-98d5-4983-9bb2-d23169f27146 req-1d3b463d-bd11-485d-b0c9-eda3bfed69d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720364ab-3a5e-45c3-b631-5967ff687acf", "tag": "ae7ea3da-5ed0-4da2-8ddb-f05d40224369"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:53.092683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-14e9af60-98d5-4983-9bb2-d23169f27146 req-1d3b463d-bd11-485d-b0c9-eda3bfed69d0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:53.094829 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-14e9af60-98d5-4983-9bb2-d23169f27146 req-1d3b463d-bd11-485d-b0c9-eda3bfed69d0 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:53.106500 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-14e9af60-98d5-4983-9bb2-d23169f27146 req-1d3b463d-bd11-485d-b0c9-eda3bfed69d0 service nova] Creating event network-changed:ae7ea3da-5ed0-4da2-8ddb-f05d40224369 for instance 720364ab-3a5e-45c3-b631-5967ff687acf on nch1-master-1 Apr 30 22:00:53.111691 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-14e9af60-98d5-4983-9bb2-d23169f27146 req-1d3b463d-bd11-485d-b0c9-eda3bfed69d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032230 Apr 30 22:00:53.112746 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3087/6279] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:53.747345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:53.747913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:53.754867 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:53.755329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:53.756121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:53.756568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:53.884032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:53.891825 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a8aa4cd4-f1f5-4c09-a5d7-ad46df230012 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1314 microversion: 2.1 time: 0.149168 Apr 30 22:00:53.892946 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3193/6280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:53 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:54.778346 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:00:54.778978 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:00:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:00:54.910218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:54.910853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:54.918645 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:54.919111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:54.919900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:54.920354 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:55.049853 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:55.057137 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8a8e09b-eee2-45f0-b17d-77e2a98e04a9 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1314 microversion: 2.1 time: 0.151752 Apr 30 22:00:55.058332 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3088/6281] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:54 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:56.075474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:56.076093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:56.082941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:56.083402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:56.084181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:56.084628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:56.212317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:56.219818 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7b30f1b0-5e82-4051-9641-caa003e0057f tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1314 microversion: 2.1 time: 0.148981 Apr 30 22:00:56.220377 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3194/6282] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:56 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:57.244726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:57.245427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:57.251640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:57.252113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:57.252915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:57.253381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:57.383389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:57.392108 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c4f33a14-df2e-4aae-bf1f-be10f59cf08d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1314 microversion: 2.1 time: 0.154338 Apr 30 22:00:57.392695 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3089/6283] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:57 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:58.408580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:58.409252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:58.416146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:58.416610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:58.418104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:58.418596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:58.546673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:58.554214 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eccd41a8-f5fe-4dd6-adc1-c5e365e72c76 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1314 microversion: 2.1 time: 0.149693 Apr 30 22:00:58.554787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3195/6284] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:58 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:00:59.007345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d61ccc84-2db0-4b18-824c-4f7941c1beee req-20223aa1-c71d-47d2-abf7-b838d32ae746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720364ab-3a5e-45c3-b631-5967ff687acf", "name": "network-vif-plugged", "status": "completed", "tag": "ae7ea3da-5ed0-4da2-8ddb-f05d40224369"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:00:59.016904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d61ccc84-2db0-4b18-824c-4f7941c1beee req-20223aa1-c71d-47d2-abf7-b838d32ae746 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:59.017366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d61ccc84-2db0-4b18-824c-4f7941c1beee req-20223aa1-c71d-47d2-abf7-b838d32ae746 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:59.028006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d61ccc84-2db0-4b18-824c-4f7941c1beee req-20223aa1-c71d-47d2-abf7-b838d32ae746 service nova] Creating event network-vif-plugged:ae7ea3da-5ed0-4da2-8ddb-f05d40224369 for instance 720364ab-3a5e-45c3-b631-5967ff687acf on nch1-master-1 Apr 30 22:00:59.033062 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d61ccc84-2db0-4b18-824c-4f7941c1beee req-20223aa1-c71d-47d2-abf7-b838d32ae746 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029419 Apr 30 22:00:59.033709 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3090/6285] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:00:59.570668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:00:59.571311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:00:59.578247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:59.578700 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:59.579468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:00:59.579908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:00:59.707633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:00:59.715553 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2732aa20-2aad-46da-b757-5c53bc74f1ab tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1314 microversion: 2.1 time: 0.148747 Apr 30 22:00:59.716126 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3196/6286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:00:59 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:00.734201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:00.734930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:00.741298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:00.741793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:00.742597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:00.743061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:00.871923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:00.879307 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71426d52-741d-4038-8743-546330640395 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1502 microversion: 2.1 time: 0.150302 Apr 30 22:01:00.879878 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3091/6287] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:00 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:00.896118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:00.897157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:00.904026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:00.904485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:00.905272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:00.905724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:00.935534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:00.941640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Old instance type m1.heat2, new instance type m1.heat {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:01:00.947967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:01:00.949330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:01:00.949330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:01:00.949330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:01:00.949330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:01:01.191992 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4fabade-7dd0-476c-8d07-83e578c24f65 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "POST /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf/action" status: 202 len: 0 microversion: 2.1 time: 0.299706 Apr 30 22:01:01.192543 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3197/6288] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:01:00 2022] POST /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 22:01:01.200865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:01.201572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:01.207592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:01.208061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:01.208901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:01.209347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:01.677385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:01.685422 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-409d1253-c935-4042-a613-d6861bc837c8 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1511 microversion: 2.1 time: 0.488673 Apr 30 22:01:01.686021 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3092/6289] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:01 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:02.703788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:02.704435 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:02.710709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:02.711236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:02.712024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:02.712475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:02.843726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:02.851378 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c867bcd8-d144-43ec-a582-b9c8c7cf1265 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1511 microversion: 2.1 time: 0.152706 Apr 30 22:01:02.852845 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3198/6290] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:02 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:03.870000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:03.870673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:03.877418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:03.877929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:03.878716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:03.879194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:04.081766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:04.089144 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-772ee223-15fc-4f05-adfa-fb214247f5d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1511 microversion: 2.1 time: 0.223223 Apr 30 22:01:04.089713 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3093/6291] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:03 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:05.106013 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:05.106691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:05.113575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:05.114063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:05.114847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:05.115293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:05.245710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:05.253854 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee4e922b-a55f-47bf-8657-d379304f20d6 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.151765 Apr 30 22:01:05.254423 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3199/6292] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:05 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:06.272038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:06.272670 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:06.280438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:06.280976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:06.281791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:06.282317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:06.409299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:06.416758 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c204da01-802d-4e85-8547-1f577cfe6f91 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.148596 Apr 30 22:01:06.417321 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3094/6293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:06 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:07.435133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:07.435793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:07.442717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:07.443184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:07.443971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:07.444420 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:07.575928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:07.583594 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-48882749-f772-4573-9ca4-4218eac6c541 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.152905 Apr 30 22:01:07.584167 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3200/6294] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:07 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:08.600708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:08.601275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:08.608557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:08.609025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:08.613636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:08.613636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:08.737678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:08.745127 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f0bce27-d008-4877-90e5-b8fe7f345a32 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.148411 Apr 30 22:01:08.745769 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3095/6295] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:08 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:09.762191 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:09.763367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:09.770469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:09.770927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:09.771707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:09.772151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:09.902531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:09.910644 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-29b4cdf7-5313-46c3-952b-fbf038b2b27c tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.152477 Apr 30 22:01:09.911233 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3201/6296] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:09 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:10.927481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:10.928175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:10.935522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:10.935995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:10.939038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:10.939038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:11.066905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:11.074258 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-66950a14-b38b-4fd6-9482-95290f86a0fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.150693 Apr 30 22:01:11.074830 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3096/6297] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:10 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:12.091272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:12.091897 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:12.098769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:12.099232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:12.100014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:12.100464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:12.229744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:12.237703 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-302093b0-04a5-4d0c-97da-12412a62a941 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.150476 Apr 30 22:01:12.238297 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3202/6298] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:12 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:13.254646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:13.255274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:13.261999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:13.262469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:13.263891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:13.264346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:13.396864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:13.404317 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6bdf1b09-89f8-41ee-914f-58570612307d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.153654 Apr 30 22:01:13.404896 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3097/6299] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:13 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:14.420983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:14.422279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:14.429227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:14.429683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:14.430490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:14.430965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:14.560205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:14.567780 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-88b72092-b672-49b6-a3a0-c9a41894eacc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.150792 Apr 30 22:01:14.571954 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3203/6300] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:14 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:15.585442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:15.586047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:15.592845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:15.593324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:15.594153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:15.594621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:15.739453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:15.747457 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-414a7811-0210-484a-9ce7-99595885c95e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.165556 Apr 30 22:01:15.748034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3098/6301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:15 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:16.764869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:16.765773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:16.772575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:16.773035 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:16.773829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:16.774277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:16.900692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:16.908253 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0718d852-edc4-4a4e-833f-59d51e3e441b tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.147884 Apr 30 22:01:16.908820 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3204/6302] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:16 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:17.924474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:17.925107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:17.932240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:17.932711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:17.933493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:17.933976 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:18.066315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:18.073722 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c068cb1a-50e4-48f1-b1a9-5785eeb19e88 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.153219 Apr 30 22:01:18.074332 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3099/6303] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:17 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:19.090532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:19.091398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:19.098465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:19.099001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:19.099793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:19.100242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:19.235067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:19.243254 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-14340cfe-7b2d-4323-b7a3-40cf7855ae6d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.156803 Apr 30 22:01:19.244015 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3205/6304] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:19 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:20.259557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:20.260220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:20.268052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:20.268581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:20.269387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:20.269879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:20.398174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:20.405573 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3147d89a-2da2-4b93-9f3b-e74dd122292d tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.149953 Apr 30 22:01:20.406180 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3100/6305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:20 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:21.423710 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:21.424310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:21.431289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:21.431751 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:21.432523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:21.432966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:21.566453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:21.574046 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ffe6793-defd-40af-8ec7-a2fdd36954e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.154330 Apr 30 22:01:21.574622 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3206/6306] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:21 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:22.591136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:22.591672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:22.598481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:22.598951 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:22.599739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:22.600193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:22.745967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:22.753915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24d0c03c-394f-4c40-a07e-0afbe77fd526 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.166754 Apr 30 22:01:22.754484 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3101/6307] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:22 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:23.770396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:23.771014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:23.778371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:23.778823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:23.779589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:23.780055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:23.910065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:23.917655 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-837f9597-fd26-4877-9380-bf19b6666d00 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.151126 Apr 30 22:01:23.918278 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3207/6308] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:23 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:24.935856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:24.936496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:24.943346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:24.943821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:24.944619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:24.945091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:25.074428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:25.081733 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-85aca7b8-575f-4290-a879-46bb5c5e89eb tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.150492 Apr 30 22:01:25.082334 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3102/6309] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:24 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:26.098779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:26.099399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:26.106358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:26.106819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:26.107598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:26.108051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:26.235293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:26.242849 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42ee6f02-9213-47dd-b365-cce98bbb4ff1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.148011 Apr 30 22:01:26.243425 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3208/6310] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:26 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:27.260396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:27.260770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:27.268121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:27.268648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:27.269484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:27.269970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:27.406129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:27.413546 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98bbfadc-7453-40a5-aaa9-bd99f5f5a0d1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.157641 Apr 30 22:01:27.414146 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3103/6311] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:27 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:28.430944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:28.431563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:28.439001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:28.439454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:28.440228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:28.440666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:28.574303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:28.582090 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a45c8e87-fb3d-4fcc-8fcb-2b3e2b6c55e1 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.155936 Apr 30 22:01:28.582680 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3209/6312] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:28 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:29.599860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:29.600417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:29.607238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:29.607706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:29.608495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:29.608954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:29.737571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:29.745017 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab62d441-2d91-49aa-8701-7bade96a7321 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.149257 Apr 30 22:01:29.745600 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3104/6313] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:29 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:30.761666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:30.762322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:30.769806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:30.770270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:30.771060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:30.771510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:30.900994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:30.914780 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6bf40e60-082d-4a03-b083-99d21f3b75c5 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1516 microversion: 2.1 time: 0.157041 Apr 30 22:01:30.915406 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3210/6314] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:30 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:31.932381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:31.932967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:31.939445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:31.939925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:31.940725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:31.941190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:32.077038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:32.084625 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e7b709a7-2ab9-4c47-a42b-602cdb4be330 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1515 microversion: 2.1 time: 0.156474 Apr 30 22:01:32.085203 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3105/6315] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:31 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:32.592278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c9f211be-265f-4110-a991-093555ddda8a req-b5b3c0f1-673f-4ce1-a115-776e7116fffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720364ab-3a5e-45c3-b631-5967ff687acf", "name": "network-vif-unplugged", "status": "completed", "tag": "ae7ea3da-5ed0-4da2-8ddb-f05d40224369"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:32.600693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c9f211be-265f-4110-a991-093555ddda8a req-b5b3c0f1-673f-4ce1-a115-776e7116fffb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:32.601170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c9f211be-265f-4110-a991-093555ddda8a req-b5b3c0f1-673f-4ce1-a115-776e7116fffb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:32.612929 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c9f211be-265f-4110-a991-093555ddda8a req-b5b3c0f1-673f-4ce1-a115-776e7116fffb service nova] Creating event network-vif-unplugged:ae7ea3da-5ed0-4da2-8ddb-f05d40224369 for instance 720364ab-3a5e-45c3-b631-5967ff687acf on nch2-master-1 Apr 30 22:01:32.618369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-c9f211be-265f-4110-a991-093555ddda8a req-b5b3c0f1-673f-4ce1-a115-776e7116fffb service nova] Instance 720364ab-3a5e-45c3-b631-5967ff687acf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:01:32.629291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c9f211be-265f-4110-a991-093555ddda8a req-b5b3c0f1-673f-4ce1-a115-776e7116fffb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041660 Apr 30 22:01:32.629926 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3211/6316] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:01:33.102456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:33.103130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:33.110478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:33.110958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:33.111763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:33.112226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:33.338368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:33.345869 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-353be7be-37cf-4252-9fdd-8bc8fe717705 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1515 microversion: 2.1 time: 0.247273 Apr 30 22:01:33.346450 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3106/6317] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:33 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:34.364373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:34.365077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:34.371367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:34.372336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:34.373093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:34.373530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:34.507270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:34.515666 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a0691497-e3dd-49a0-b9dd-2efea066e4ac tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1513 microversion: 2.1 time: 0.156496 Apr 30 22:01:34.516246 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3212/6318] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:34 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:34.644643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a3cd43a1-cee9-4b64-8c1a-98351eb79ef0 req-35b75c14-083c-4ebf-9504-18a051bb5c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720364ab-3a5e-45c3-b631-5967ff687acf", "tag": "ae7ea3da-5ed0-4da2-8ddb-f05d40224369"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:34.653515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a3cd43a1-cee9-4b64-8c1a-98351eb79ef0 req-35b75c14-083c-4ebf-9504-18a051bb5c75 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:34.654013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a3cd43a1-cee9-4b64-8c1a-98351eb79ef0 req-35b75c14-083c-4ebf-9504-18a051bb5c75 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:34.665572 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a3cd43a1-cee9-4b64-8c1a-98351eb79ef0 req-35b75c14-083c-4ebf-9504-18a051bb5c75 service nova] Creating event network-changed:ae7ea3da-5ed0-4da2-8ddb-f05d40224369 for instance 720364ab-3a5e-45c3-b631-5967ff687acf on nch2-master-1 Apr 30 22:01:34.671590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-a3cd43a1-cee9-4b64-8c1a-98351eb79ef0 req-35b75c14-083c-4ebf-9504-18a051bb5c75 service nova] Instance 720364ab-3a5e-45c3-b631-5967ff687acf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:01:34.682487 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a3cd43a1-cee9-4b64-8c1a-98351eb79ef0 req-35b75c14-083c-4ebf-9504-18a051bb5c75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041670 Apr 30 22:01:34.683085 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3107/6319] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:01:35.536484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:35.537162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:35.543909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:35.544371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:35.545166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:35.545612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:35.681452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:35.689404 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d63ab692-ddba-4582-aa9a-c9a2972b718e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1510 microversion: 2.1 time: 0.156893 Apr 30 22:01:35.690087 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3213/6320] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:35 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:35.707280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:35.707900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:35.714006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:35.718264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:35.718264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:35.718264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:35.741835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:01:35.849227 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Found an unconfirmed migration during delete, id: 16, status: finished Apr 30 22:01:38.035119 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc7498c6-e4b6-4458-8450-b09f88eb75fc tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 204 len: 0 microversion: 2.1 time: 2.332475 Apr 30 22:01:38.036036 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3108/6321] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:01:35 2022] DELETE /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 0 bytes in 2334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:01:38.044707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:38.045453 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:38.053248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:38.054014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:38.058446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:38.058446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:38.182235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:38.189570 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b5922e01-5be7-4414-ad1c-56a70b3fe6bd tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1502 microversion: 2.1 time: 0.149476 Apr 30 22:01:38.190177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3214/6322] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:38 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:01:38.973163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-43f81dd0-3503-4104-bce4-95cbad42c733 req-49d7d245-3b13-4399-86f2-d7056db3beba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720364ab-3a5e-45c3-b631-5967ff687acf", "name": "network-vif-plugged", "status": "completed", "tag": "ae7ea3da-5ed0-4da2-8ddb-f05d40224369"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:38.982406 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-43f81dd0-3503-4104-bce4-95cbad42c733 req-49d7d245-3b13-4399-86f2-d7056db3beba service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:38.982874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-43f81dd0-3503-4104-bce4-95cbad42c733 req-49d7d245-3b13-4399-86f2-d7056db3beba service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:38.996525 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-43f81dd0-3503-4104-bce4-95cbad42c733 req-49d7d245-3b13-4399-86f2-d7056db3beba service nova] Creating event network-vif-plugged:ae7ea3da-5ed0-4da2-8ddb-f05d40224369 for instance 720364ab-3a5e-45c3-b631-5967ff687acf on nch2-master-1 Apr 30 22:01:38.998411 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-43f81dd0-3503-4104-bce4-95cbad42c733 req-49d7d245-3b13-4399-86f2-d7056db3beba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029268 Apr 30 22:01:38.998984 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3109/6323] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:01:39.206295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:39.206920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:39.214106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:39.214567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:39.215348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:39.215817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:39.353193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:39.361373 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f8c431b-3d23-4f5d-95d0-9a2cfaa6b52e tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1502 microversion: 2.1 time: 0.158975 Apr 30 22:01:39.362448 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3215/6324] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:39 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:39.844418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2fd55e4d-aa23-48ed-9580-5711fe336ed5 req-1b47867f-ee9e-4e2b-8005-ff8f6a0abc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720364ab-3a5e-45c3-b631-5967ff687acf", "name": "network-vif-deleted", "tag": "ae7ea3da-5ed0-4da2-8ddb-f05d40224369"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:39.852465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2fd55e4d-aa23-48ed-9580-5711fe336ed5 req-1b47867f-ee9e-4e2b-8005-ff8f6a0abc05 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:39.852924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2fd55e4d-aa23-48ed-9580-5711fe336ed5 req-1b47867f-ee9e-4e2b-8005-ff8f6a0abc05 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:39.863735 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2fd55e4d-aa23-48ed-9580-5711fe336ed5 req-1b47867f-ee9e-4e2b-8005-ff8f6a0abc05 service nova] Creating event network-vif-deleted:ae7ea3da-5ed0-4da2-8ddb-f05d40224369 for instance 720364ab-3a5e-45c3-b631-5967ff687acf on nch2-master-1 Apr 30 22:01:39.868646 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2fd55e4d-aa23-48ed-9580-5711fe336ed5 req-1b47867f-ee9e-4e2b-8005-ff8f6a0abc05 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029216 Apr 30 22:01:39.869262 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3110/6325] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:01:40.379056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:40.379730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:40.386591 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:40.387047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:40.388449 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:40.388895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:40.422294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:40.422752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:40.423460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lazy-loading 'fault' on Instance uuid 720364ab-3a5e-45c3-b631-5967ff687acf {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:01:40.464605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6f19685e3f4fe79b47dffd24a4c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:40.471465 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4c7d1c16-c849-4a49-8f2c-e394716d1f98 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 200 len: 1304 microversion: 2.1 time: 0.096467 Apr 30 22:01:40.472042 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3216/6326] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:40 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:41.489894 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:41.490641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:41.497478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:41.497983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:41.498779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:41.499238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:41.512221 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] HTTP exception thrown: Instance 720364ab-3a5e-45c3-b631-5967ff687acf could not be found. Apr 30 22:01:41.512828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Returning 404 to user: Instance 720364ab-3a5e-45c3-b631-5967ff687acf could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:01:41.513652 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-90ed4e69-5921-48b1-b60f-1c89ff23ec71 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 404 len: 111 microversion: 2.1 time: 0.028982 Apr 30 22:01:41.514207 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3111/6327] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:41 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:01:41.529985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:41.530507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:41.537197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:41.537656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:41.538473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:41.538921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:41.552818 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] HTTP exception thrown: Instance 720364ab-3a5e-45c3-b631-5967ff687acf could not be found. Apr 30 22:01:41.553417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Returning 404 to user: Instance 720364ab-3a5e-45c3-b631-5967ff687acf could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:01:41.554290 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d95e968-b55b-44a2-a4b9-bcbad8540737 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 404 len: 111 microversion: 2.1 time: 0.028335 Apr 30 22:01:41.554852 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3217/6328] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:01:41 2022] DELETE /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:01:41.563276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:41.563899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] [instance: 720364ab-3a5e-45c3-b631-5967ff687acf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:41.569689 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:41.570186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:41.570961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:41.571408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:41.584529 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] HTTP exception thrown: Instance 720364ab-3a5e-45c3-b631-5967ff687acf could not be found. Apr 30 22:01:41.585116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] Returning 404 to user: Instance 720364ab-3a5e-45c3-b631-5967ff687acf could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:01:41.585975 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e5617e9-2eef-4002-9e87-54d9a36e23a0 tempest-DeleteServersTestJSON-1906621159 tempest-DeleteServersTestJSON-1906621159-project] 10.222.0.23 "GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf" status: 404 len: 111 microversion: 2.1 time: 0.027089 Apr 30 22:01:41.586659 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3112/6329] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:41 2022] GET /compute/v2.1/servers/720364ab-3a5e-45c3-b631-5967ff687acf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:01:45.689507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-385177513", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "e8ec1f46-c26c-49d0-9e30-f56317b867b1"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:45.743434 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] validate_networks() for [('e8ec1f46-c26c-49d0-9e30-f56317b867b1', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:01:46.080325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:01:46.080781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:01:46.081259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:01:46.081673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:01:46.082135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:01:46.091523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:46.091972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:46.092780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:46.093222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:46.109545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Getting quotas for project 65065d04e6dc45cb9798be1c9703ad2f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:01:46.114786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Getting quotas for user 0de908a2758a4489b9a3ef80078f2b1b and project 65065d04e6dc45cb9798be1c9703ad2f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:01:46.126762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:01:46.129015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:01:46.260526 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-001386f4-b9df-4287-94ed-95eeae9cccc8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686932 Apr 30 22:01:46.261309 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3218/6330] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:01:46.280490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-490b3db1-3747-4994-8fc8-fd55b5a7869f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:46.281127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-490b3db1-3747-4994-8fc8-fd55b5a7869f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:46.340559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-490b3db1-3747-4994-8fc8-fd55b5a7869f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:46.351554 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-490b3db1-3747-4994-8fc8-fd55b5a7869f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1217 microversion: 2.1 time: 0.076249 Apr 30 22:01:46.354743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3113/6331] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:46 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:47.372854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:47.373649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:47.380967 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:47.381431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:47.382252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:47.382704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:47.447607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:47.451638 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-835314fd-feef-4904-b9c2-882790737cca tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1221 microversion: 2.1 time: 0.083865 Apr 30 22:01:47.452221 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3219/6332] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:47 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:48.468418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:48.469067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:48.475887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:48.476361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:48.477169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:48.477640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:48.550422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:48.558340 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-08c31e13-9f29-4696-a61b-7d05f42cb7e9 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1277 microversion: 2.1 time: 0.093628 Apr 30 22:01:48.559692 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3114/6333] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:48 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:49.577260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:49.578349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:49.585328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:49.586029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:49.586834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:49.587289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:49.805287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:49.812724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e72ee45-0934-4ffe-b83d-f7ab9e16a8d4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1317 microversion: 2.1 time: 0.240184 Apr 30 22:01:49.813298 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3220/6334] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:49 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:01:50.015459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8662ab32-7618-444e-82e1-df95658b9bce req-70a8415f-9637-43cf-857d-a93f1b694e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087d4e4b-4f7a-444e-bda3-d3782178b4b0", "tag": "145138a3-f995-4c55-b712-77ad4f3d1234"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:50.024164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8662ab32-7618-444e-82e1-df95658b9bce req-70a8415f-9637-43cf-857d-a93f1b694e62 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:50.030572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8662ab32-7618-444e-82e1-df95658b9bce req-70a8415f-9637-43cf-857d-a93f1b694e62 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:50.036246 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8662ab32-7618-444e-82e1-df95658b9bce req-70a8415f-9637-43cf-857d-a93f1b694e62 service nova] Creating event network-changed:145138a3-f995-4c55-b712-77ad4f3d1234 for instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 on nch2-master-1 Apr 30 22:01:50.041130 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8662ab32-7618-444e-82e1-df95658b9bce req-70a8415f-9637-43cf-857d-a93f1b694e62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030493 Apr 30 22:01:50.041731 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3115/6335] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:01:50.830375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:50.831004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:50.837809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:50.838270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:50.839063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:50.839493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:50.990516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:50.998042 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab1b40b0-bd16-4213-b2d6-efd2dc6f4887 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1317 microversion: 2.1 time: 0.171573 Apr 30 22:01:50.998634 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3221/6336] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:50 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:52.016758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:52.017482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:52.023734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:52.024203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:52.024990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:52.025451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:52.213399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:52.221359 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c4be971b-7f87-4c32-808a-2f0737bcd63a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1317 microversion: 2.1 time: 0.210005 Apr 30 22:01:52.221955 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3116/6337] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:52 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:53.238698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:53.239357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:53.247150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:53.247603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:53.248437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:53.248857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:53.442692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:53.450235 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f0531adc-dddb-461f-a334-207cb53fa0e4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1317 microversion: 2.1 time: 0.215841 Apr 30 22:01:53.452636 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3222/6338] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:53 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:54.466882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:54.467495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:54.474432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:54.474902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:54.475686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:54.476136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:54.607996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:54.615372 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9dd5f629-c5ba-499d-9f1e-56bb191878b8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1317 microversion: 2.1 time: 0.152616 Apr 30 22:01:54.615938 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3117/6339] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:54 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:55.023769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-95d97b83-2f16-4de3-9c8f-8ef75a970163 req-f87840ea-bab3-4caa-9c84-54d8fe3db43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087d4e4b-4f7a-444e-bda3-d3782178b4b0", "name": "network-vif-plugged", "status": "completed", "tag": "145138a3-f995-4c55-b712-77ad4f3d1234"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:55.033613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-95d97b83-2f16-4de3-9c8f-8ef75a970163 req-f87840ea-bab3-4caa-9c84-54d8fe3db43f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:55.034091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-95d97b83-2f16-4de3-9c8f-8ef75a970163 req-f87840ea-bab3-4caa-9c84-54d8fe3db43f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:55.048884 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-95d97b83-2f16-4de3-9c8f-8ef75a970163 req-f87840ea-bab3-4caa-9c84-54d8fe3db43f service nova] Creating event network-vif-plugged:145138a3-f995-4c55-b712-77ad4f3d1234 for instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 on nch2-master-1 Apr 30 22:01:55.054148 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-95d97b83-2f16-4de3-9c8f-8ef75a970163 req-f87840ea-bab3-4caa-9c84-54d8fe3db43f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034150 Apr 30 22:01:55.054755 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3223/6340] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:01:55.632136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:55.632813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:55.640515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:55.640987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:55.641796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:55.642261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:55.770674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:55.778062 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2fe0749c-ea90-439c-8063-443d715363a5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1317 microversion: 2.1 time: 0.149816 Apr 30 22:01:55.778639 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3118/6341] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:55 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:56.795317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:56.796034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:56.803207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:56.803668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:56.804448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:56.804893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:56.931297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:56.938863 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-efad758a-8079-4517-9919-177d9374fa1f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1507 microversion: 2.1 time: 0.147921 Apr 30 22:01:56.939430 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3224/6342] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:56 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:56.955312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:56.955943 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:56.962628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:56.963126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:56.963909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:56.964362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.091662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:57.098982 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-460b73ae-73d3-49b0-a946-6975b18bb3ad tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1507 microversion: 2.1 time: 0.147492 Apr 30 22:01:57.099551 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3119/6343] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:56 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:57.114765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-058bc825-e524-4866-8497-11e7e72fe597 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:57.115934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-058bc825-e524-4866-8497-11e7e72fe597 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:57.122432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-058bc825-e524-4866-8497-11e7e72fe597 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.122889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-058bc825-e524-4866-8497-11e7e72fe597 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.123656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-058bc825-e524-4866-8497-11e7e72fe597 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.124093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-058bc825-e524-4866-8497-11e7e72fe597 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.251122 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-058bc825-e524-4866-8497-11e7e72fe597 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "PUT /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1079 microversion: 2.1 time: 0.140190 Apr 30 22:01:57.251946 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3225/6344] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 22:01:57 2022] PUT /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1079 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:57.266213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:57.266911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:57.272993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.273471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.274296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.274756 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.406506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:57.413863 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c176cb40-b80f-4209-8bac-98443e54cc38 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1505 microversion: 2.1 time: 0.152372 Apr 30 22:01:57.414441 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3120/6345] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:57 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:57.430112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:57.430739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:57.437318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.437808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.438592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.439037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.574998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:57.582443 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-efb75683-f0fe-4c14-822c-16eee15dac78 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1505 microversion: 2.1 time: 0.156312 Apr 30 22:01:57.583016 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3226/6346] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:57 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:01:57.598924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:01:57.599935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:57.606412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.606832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.607624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.608088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.635726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:57.641643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=130670) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:01:57.647819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:01:57.648267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:01:57.648766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:01:57.649197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:01:57.649631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:01:57.853471 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a2c2bebc-64c3-4899-8ce7-9f77ea59decf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "POST /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.258321 Apr 30 22:01:57.854133 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3121/6347] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:01:57 2022] POST /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:01:57.863510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:57.864057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:57.870948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.871400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:57.872224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:57.872667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:58.008620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:58.016715 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-742f7f55-9724-40eb-aa6f-7ffc65ae2026 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1516 microversion: 2.1 time: 0.157662 Apr 30 22:01:58.017520 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3227/6348] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:57 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:01:59.034948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:01:59.035521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:01:59.042216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:59.042688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:59.044127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:01:59.044584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:01:59.172977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:01:59.180475 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-007e7c53-0e9d-4221-bea1-1550a0f0eba8 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1516 microversion: 2.1 time: 0.150427 Apr 30 22:01:59.181056 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3122/6349] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:01:59 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:00.198497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:00.199123 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:00.206107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:00.206569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:00.207363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:00.207813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:00.412592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:00.422815 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-35f8abe8-96fb-463d-b527-dd01e7b328bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1516 microversion: 2.1 time: 0.228207 Apr 30 22:02:00.423452 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3228/6350] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:00 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:01.440644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:01.441319 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:01.448207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:01.448685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:01.449477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:01.449967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:01.585688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:01.593572 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-21e25b46-0307-4bf1-a2f3-69808f96cafb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.156825 Apr 30 22:02:01.594176 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3123/6351] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:01 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:02.611433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:02.611956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:02.618327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:02.618784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:02.619555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:02.619996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:02.750280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:02.757700 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-64be65cd-11c6-4498-ba7a-16a549cf938c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.150398 Apr 30 22:02:02.758303 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3229/6352] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:02 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:03.775413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:03.776074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:03.783278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:03.783752 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:03.784548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:03.785006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:03.914085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:03.921637 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c859bb03-c5af-4f7a-aa69-92c973cb8b07 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.150144 Apr 30 22:02:03.922254 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3124/6353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:03 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:04.938000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:04.938662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:04.945539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:04.946026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:04.946805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:04.947252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:05.075648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:05.083034 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3fed87f7-4969-42c0-b65e-e219d0afe02e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.149079 Apr 30 22:02:05.083606 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3230/6354] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:04 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:06.100518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:06.101176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:06.108646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:06.109114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:06.109931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:06.110391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:06.236707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:06.244107 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-43b75a81-b1aa-4250-a18a-ac637e3432ac tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.147562 Apr 30 22:02:06.244680 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3125/6355] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:06 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:07.261979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:07.262587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:07.269830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:07.270289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:07.271074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:07.271520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:07.401927 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:07.409921 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-657a4ce4-6f63-45bc-b4d6-02bb0fbe76af tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.152415 Apr 30 22:02:07.410490 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3231/6356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:07 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:08.427038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:08.427662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:08.434477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:08.434941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:08.435730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:08.436180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:08.569455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:08.576910 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a106141d-f07b-49ec-9029-19f5577d2b76 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.153789 Apr 30 22:02:08.577472 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3126/6357] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:08 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:09.593916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:09.594466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:09.601225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:09.601679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:09.602491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:09.602933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:09.731518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:09.738897 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca35e9f7-ff04-44c1-b93f-a9507b3f346d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.149591 Apr 30 22:02:09.739468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3232/6358] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:09 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:10.756039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:10.756680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:10.764386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:10.764864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:10.765657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:10.766148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:10.892950 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:10.900445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bd731fed-04ad-48a8-87ba-700013927d2f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.148402 Apr 30 22:02:10.901018 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3127/6359] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:10 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:11.916504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:11.917152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:11.924565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:11.925021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:11.925821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:11.926265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:12.056288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:12.063760 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1c769e5-be68-4b4d-b828-e604aae8e12a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.151283 Apr 30 22:02:12.064337 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3233/6360] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:11 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:13.081086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:13.081745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:13.088532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:13.089003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:13.089815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:13.090271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:13.215077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:13.222491 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a8d13a4e-6bfd-4b07-b9b9-a1e444a455d2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.145335 Apr 30 22:02:13.223055 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3128/6361] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:13 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:14.239181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:14.239809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:14.246755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:14.247221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:14.248006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:14.248454 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:14.379948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:14.383370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe7432c3-f0d3-442e-b135-1ebcc1416f50 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.148217 Apr 30 22:02:14.383952 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3234/6362] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:14 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:15.403245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:15.403880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:15.410702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:15.411176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:15.411965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:15.412428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:15.543462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:15.550863 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0dc6b1dd-1b58-4639-98e4-7bd03c817700 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.152040 Apr 30 22:02:15.552261 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3129/6363] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:15 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:16.568479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:16.569032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:16.576089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:16.576550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:16.577338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:16.577844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:16.709957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:16.718121 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7fc57579-fbbc-4c51-baa5-b8a93ecefcea tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.153604 Apr 30 22:02:16.718717 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3235/6364] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:16 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:17.735111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:17.735753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:17.742677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:17.743152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:17.743949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:17.744412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:17.876278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:17.883803 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47b78058-3051-4d3f-9ab3-4baaa8ff3501 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.152654 Apr 30 22:02:17.884377 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3130/6365] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:17 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:18.901212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:18.901871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:18.908608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:18.916022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:18.916022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:18.916022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:19.039197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:19.046693 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-39e18027-89b0-4092-a001-79b7d7dd3b5c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.149449 Apr 30 22:02:19.047262 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3236/6366] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:18 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:20.063930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:20.064565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:20.071360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:20.071832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:20.072622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:20.073074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:20.198359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:20.205802 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b11c5db2-110b-4b0d-b056-5eaa87276990 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.145736 Apr 30 22:02:20.206392 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3131/6367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:20 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:21.222294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:21.222918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:21.230379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:21.230859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:21.231642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:21.232088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:21.361720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:21.369116 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-61bb0d9c-f504-4f76-865c-55429422ebe3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.150776 Apr 30 22:02:21.369680 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3237/6368] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:21 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:22.386621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:22.387258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:22.394398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:22.394872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:22.395661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:22.396119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:22.779850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:22.787226 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a03adbcc-b296-406e-9037-0dd63145951f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.405162 Apr 30 22:02:22.787789 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3132/6369] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:22 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:23.804120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:23.804743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:23.811603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:23.812056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:23.812833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:23.813275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:23.952359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:23.959797 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-766cdf85-524f-4f8a-abdd-0a38e0c912c2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.159657 Apr 30 22:02:23.960368 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3238/6370] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:23 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:24.977165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:24.977862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:24.984696 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:24.985198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:24.986028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:24.986488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:25.111574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:25.119008 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-42e733d6-5334-4f19-9533-003d4ef593e0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.145754 Apr 30 22:02:25.119580 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3133/6371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:24 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:26.136922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:26.137553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:26.144853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:26.145312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:26.146157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:26.146607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:26.278157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:26.285779 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-138ff0d1-a838-44bf-a11f-056cd2925897 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.153270 Apr 30 22:02:26.286527 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3239/6372] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:26 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:27.302999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:27.303692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:27.310932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:27.311398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:27.312181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:27.312634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:27.438265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:27.445693 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fa73c0e2-0292-4f0b-9acc-541855223f16 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1521 microversion: 2.1 time: 0.146635 Apr 30 22:02:27.446273 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3134/6373] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:27 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:28.462260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:28.472308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:28.472308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:28.472308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:28.472308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:28.472308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:28.558431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-d12e5a05-dce9-49cd-a84e-a8350b3ea85b req-0eda1acc-071b-477e-8cc7-b971679d025f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087d4e4b-4f7a-444e-bda3-d3782178b4b0", "name": "network-vif-unplugged", "status": "completed", "tag": "145138a3-f995-4c55-b712-77ad4f3d1234"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:28.566023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d12e5a05-dce9-49cd-a84e-a8350b3ea85b req-0eda1acc-071b-477e-8cc7-b971679d025f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:28.566493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-d12e5a05-dce9-49cd-a84e-a8350b3ea85b req-0eda1acc-071b-477e-8cc7-b971679d025f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:28.578771 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-d12e5a05-dce9-49cd-a84e-a8350b3ea85b req-0eda1acc-071b-477e-8cc7-b971679d025f service nova] Creating event network-vif-unplugged:145138a3-f995-4c55-b712-77ad4f3d1234 for instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 on nch1-master-1 Apr 30 22:02:28.586818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-d12e5a05-dce9-49cd-a84e-a8350b3ea85b req-0eda1acc-071b-477e-8cc7-b971679d025f service nova] Instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:02:28.595396 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-d12e5a05-dce9-49cd-a84e-a8350b3ea85b req-0eda1acc-071b-477e-8cc7-b971679d025f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042077 Apr 30 22:02:28.596002 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3135/6374] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:02:28.635500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:28.643747 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-105cba7f-c090-4d2a-bcb4-dc6baf8af41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1520 microversion: 2.1 time: 0.185444 Apr 30 22:02:28.644331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3240/6375] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:28 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:29.662895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:29.663564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:29.670332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:29.670799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:29.671617 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:29.672071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:29.801913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:29.809900 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0230e09d-cccf-4983-bc0f-10d8cd37e8ec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1518 microversion: 2.1 time: 0.152313 Apr 30 22:02:29.810466 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3136/6376] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:29 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:30.615183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-2df5e03a-42d1-4db2-9fa4-b6a54403cc85 req-23773289-5234-4a8f-953e-f6abd7607e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087d4e4b-4f7a-444e-bda3-d3782178b4b0", "tag": "145138a3-f995-4c55-b712-77ad4f3d1234"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:30.628034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2df5e03a-42d1-4db2-9fa4-b6a54403cc85 req-23773289-5234-4a8f-953e-f6abd7607e8a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:30.628515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2df5e03a-42d1-4db2-9fa4-b6a54403cc85 req-23773289-5234-4a8f-953e-f6abd7607e8a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:30.645840 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-2df5e03a-42d1-4db2-9fa4-b6a54403cc85 req-23773289-5234-4a8f-953e-f6abd7607e8a service nova] Creating event network-changed:145138a3-f995-4c55-b712-77ad4f3d1234 for instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 on nch1-master-1 Apr 30 22:02:30.657367 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-2df5e03a-42d1-4db2-9fa4-b6a54403cc85 req-23773289-5234-4a8f-953e-f6abd7607e8a service nova] Instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:02:30.668857 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-2df5e03a-42d1-4db2-9fa4-b6a54403cc85 req-23773289-5234-4a8f-953e-f6abd7607e8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057372 Apr 30 22:02:30.669462 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3241/6377] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:02:30.827684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:30.828325 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:30.835340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:30.835813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:30.836611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:30.837070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:31.419662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:31.427180 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6ba94792-9ded-401b-baeb-f2a1eb949ffa tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1518 microversion: 2.1 time: 0.604183 Apr 30 22:02:31.427826 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3137/6378] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:30 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1518 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:32.446025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:32.446755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:32.453118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:32.453578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:32.454392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:32.467938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:32.586705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:32.594656 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84d5f4d1-c646-4b03-8e99-b2908b4c2a28 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1515 microversion: 2.1 time: 0.153945 Apr 30 22:02:32.595242 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3242/6379] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:32 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:32.611450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-867d17c1-7148-476c-953c-88e4d73bbc43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:32.612041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-867d17c1-7148-476c-953c-88e4d73bbc43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:32.618324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-867d17c1-7148-476c-953c-88e4d73bbc43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:32.618803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-867d17c1-7148-476c-953c-88e4d73bbc43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:32.619603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-867d17c1-7148-476c-953c-88e4d73bbc43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:32.620070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-867d17c1-7148-476c-953c-88e4d73bbc43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:32.792395 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-867d17c1-7148-476c-953c-88e4d73bbc43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "POST /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0/action" status: 204 len: 0 microversion: 2.1 time: 0.184150 Apr 30 22:02:32.793034 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3138/6380] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:02:32 2022] POST /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0/action => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 22:02:32.801511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:32.802167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:32.808156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:32.808608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:32.809415 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:32.809878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:33.001237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:33.008981 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a5ba870a-1bcb-4063-a7f5-075797d5fe71 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1515 microversion: 2.1 time: 0.211697 Apr 30 22:02:33.009575 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3243/6381] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:32 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:34.027924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:34.028642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:34.035682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:34.036155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:34.036944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:34.037401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:34.169971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:34.177686 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8e27cf8e-2e93-4a0a-99d5-a2aa2749e24c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1515 microversion: 2.1 time: 0.154668 Apr 30 22:02:34.178331 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3139/6382] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:34 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:35.194429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:35.202152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:35.202594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.203043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.203931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.204383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.339993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:35.347585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cbfbcc1d-29b9-4dbd-82e3-6d3f73b3b73a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1507 microversion: 2.1 time: 0.157063 Apr 30 22:02:35.348171 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3244/6383] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:35 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:35.363859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:35.364501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:35.372065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.372544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.373424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.373874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.469829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-447f03b5-434c-4557-be39-4356ff0f1c66 req-21779191-a3ea-4135-98ec-5e53a558b142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087d4e4b-4f7a-444e-bda3-d3782178b4b0", "name": "network-vif-plugged", "status": "completed", "tag": "145138a3-f995-4c55-b712-77ad4f3d1234"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:35.478027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-447f03b5-434c-4557-be39-4356ff0f1c66 req-21779191-a3ea-4135-98ec-5e53a558b142 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.478576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-447f03b5-434c-4557-be39-4356ff0f1c66 req-21779191-a3ea-4135-98ec-5e53a558b142 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.490476 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-447f03b5-434c-4557-be39-4356ff0f1c66 req-21779191-a3ea-4135-98ec-5e53a558b142 service nova] Creating event network-vif-plugged:145138a3-f995-4c55-b712-77ad4f3d1234 for instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 on nch1-master-1 Apr 30 22:02:35.495653 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-447f03b5-434c-4557-be39-4356ff0f1c66 req-21779191-a3ea-4135-98ec-5e53a558b142 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091580 Apr 30 22:02:35.496260 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3245/6384] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:02:35.510149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:35.517942 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1c63d375-3136-4bcf-b122-37a4d5526061 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1507 microversion: 2.1 time: 0.157934 Apr 30 22:02:35.518842 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3140/6385] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:35 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:02:35.535932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:35.536518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:35.543519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.543971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.544747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.545188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.677278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:35.684747 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-55b12699-aa0a-498f-8de7-100540c7c368 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 200 len: 1507 microversion: 2.1 time: 0.153187 Apr 30 22:02:35.685319 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3246/6386] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:35 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:35.701066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:35.701600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:35.707649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.708128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.708926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:35.709391 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:35.734465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:02:36.114133 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a5077447-191f-46b8-9cf8-ae2684c34cb4 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "DELETE /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 204 len: 0 microversion: 2.1 time: 0.417091 Apr 30 22:02:36.114733 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3141/6387] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:02:35 2022] DELETE /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:02:36.171426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-922486743", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "e8ec1f46-c26c-49d0-9e30-f56317b867b1"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:36.222135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] validate_networks() for [('e8ec1f46-c26c-49d0-9e30-f56317b867b1', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:02:36.580660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:02:36.581086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:02:36.581561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:02:36.582017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:02:36.582535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:02:36.591444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:36.591874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:36.592681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:36.593125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:36.610639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Getting quotas for project 65065d04e6dc45cb9798be1c9703ad2f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:02:36.615949 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Getting quotas for user 0de908a2758a4489b9a3ef80078f2b1b and project 65065d04e6dc45cb9798be1c9703ad2f. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:02:36.628905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:02:36.631235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:02:36.737343 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15d039f8-6e8d-48cc-b505-8d7eee224bb0 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569893 Apr 30 22:02:36.738044 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3247/6388] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:02:36.749169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a02277a-92f1-4daf-a2c6-bb51016f9e81 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:36.752554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3a02277a-92f1-4daf-a2c6-bb51016f9e81 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:36.804571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3a02277a-92f1-4daf-a2c6-bb51016f9e81 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:36.811923 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a02277a-92f1-4daf-a2c6-bb51016f9e81 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1217 microversion: 2.1 time: 0.067636 Apr 30 22:02:36.812492 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3142/6389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:36 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:37.830392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:37.831127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:37.837926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:37.842320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:37.842320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:37.842320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:37.909987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:37.918061 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7d2f1c8-9255-4121-90eb-cd846fc4eac5 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1221 microversion: 2.1 time: 0.092839 Apr 30 22:02:37.918825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3248/6390] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:37 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:38.171971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0807b884-c3f0-4b70-ad54-64f1a6bdeb3f req-6a166ee4-03cf-4a91-816b-a3f7b8544839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087d4e4b-4f7a-444e-bda3-d3782178b4b0", "name": "network-vif-deleted", "tag": "145138a3-f995-4c55-b712-77ad4f3d1234"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:38.181154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0807b884-c3f0-4b70-ad54-64f1a6bdeb3f req-6a166ee4-03cf-4a91-816b-a3f7b8544839 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:38.181680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0807b884-c3f0-4b70-ad54-64f1a6bdeb3f req-6a166ee4-03cf-4a91-816b-a3f7b8544839 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:38.193174 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0807b884-c3f0-4b70-ad54-64f1a6bdeb3f req-6a166ee4-03cf-4a91-816b-a3f7b8544839 service nova] Creating event network-vif-deleted:145138a3-f995-4c55-b712-77ad4f3d1234 for instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 on nch1-master-1 Apr 30 22:02:38.198027 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0807b884-c3f0-4b70-ad54-64f1a6bdeb3f req-6a166ee4-03cf-4a91-816b-a3f7b8544839 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029715 Apr 30 22:02:38.198610 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3143/6391] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:02:38.934129 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:38.934793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:38.943686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:38.945022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:38.945022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:38.945398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:39.032056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:39.040169 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab192a03-2e00-432d-9f92-7d506f1bfbc7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1287 microversion: 2.1 time: 0.109979 Apr 30 22:02:39.040766 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3249/6392] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:38 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:40.057801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:40.058647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:40.065558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:40.066056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:40.066850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:40.067307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:40.214032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:40.221975 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-892e6a14-0cab-478d-bca5-c0d912d03789 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1317 microversion: 2.1 time: 0.168333 Apr 30 22:02:40.222549 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3144/6393] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:40 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:40.292605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-738eea0f-3795-46bb-b350-a5d810b46eed req-de9f21c3-b64d-449d-be8f-38b646259a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0873a873-a29c-4c1c-9f96-af605b386b1d", "tag": "97923c07-7d28-4a3f-bbfb-88d17719ac2f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:40.301470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-738eea0f-3795-46bb-b350-a5d810b46eed req-de9f21c3-b64d-449d-be8f-38b646259a45 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:40.304481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-738eea0f-3795-46bb-b350-a5d810b46eed req-de9f21c3-b64d-449d-be8f-38b646259a45 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:40.313393 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-738eea0f-3795-46bb-b350-a5d810b46eed req-de9f21c3-b64d-449d-be8f-38b646259a45 service nova] Creating event network-changed:97923c07-7d28-4a3f-bbfb-88d17719ac2f for instance 0873a873-a29c-4c1c-9f96-af605b386b1d on nch1-master-1 Apr 30 22:02:40.318295 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-738eea0f-3795-46bb-b350-a5d810b46eed req-de9f21c3-b64d-449d-be8f-38b646259a45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029533 Apr 30 22:02:40.319070 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3250/6394] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:02:41.238905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:41.239546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:41.246972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:41.247447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:41.248246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:41.248709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:41.375633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:41.383046 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-efdee4d5-3133-469d-a6bd-a22752696264 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1317 microversion: 2.1 time: 0.148066 Apr 30 22:02:41.383613 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3145/6395] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:41 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:42.402870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:42.403680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:42.409959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:42.410414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:42.411184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:42.411624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:42.544870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:42.552528 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53f3275e-1400-41e4-aeaf-98d38579057c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1317 microversion: 2.1 time: 0.155495 Apr 30 22:02:42.553107 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3251/6396] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:42 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:43.570067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:43.570710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:43.578234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:43.578712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:43.579514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:43.579972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:43.713974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:43.721403 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0ba45ab7-6294-43e3-ab37-142c543dd156 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1317 microversion: 2.1 time: 0.155356 Apr 30 22:02:43.722005 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3146/6397] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:43 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:44.738215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:44.738864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:44.746272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:44.746726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:44.747498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:44.747937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:44.877085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:44.884687 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-553f8ea3-118e-4219-b77a-68132256f07e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1317 microversion: 2.1 time: 0.150354 Apr 30 22:02:44.885265 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3252/6398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:44 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:45.416632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-1083e563-e443-412d-a8d4-fc6e6dd09675 req-09a532b6-6a5e-4334-a1e6-b6dacd7c6bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0873a873-a29c-4c1c-9f96-af605b386b1d", "name": "network-vif-plugged", "status": "completed", "tag": "97923c07-7d28-4a3f-bbfb-88d17719ac2f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:45.426269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1083e563-e443-412d-a8d4-fc6e6dd09675 req-09a532b6-6a5e-4334-a1e6-b6dacd7c6bc5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:45.426677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1083e563-e443-412d-a8d4-fc6e6dd09675 req-09a532b6-6a5e-4334-a1e6-b6dacd7c6bc5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:45.438115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-1083e563-e443-412d-a8d4-fc6e6dd09675 req-09a532b6-6a5e-4334-a1e6-b6dacd7c6bc5 service nova] Creating event network-vif-plugged:97923c07-7d28-4a3f-bbfb-88d17719ac2f for instance 0873a873-a29c-4c1c-9f96-af605b386b1d on nch1-master-1 Apr 30 22:02:45.443246 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-1083e563-e443-412d-a8d4-fc6e6dd09675 req-09a532b6-6a5e-4334-a1e6-b6dacd7c6bc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030512 Apr 30 22:02:45.443859 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3147/6399] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:02:45.901884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:45.902500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:45.909502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:45.910006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:45.910782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:45.911228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:46.044611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:46.052128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-692f7acf-02d2-4bf4-a713-7efc8de99656 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1317 microversion: 2.1 time: 0.154904 Apr 30 22:02:46.052709 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3253/6400] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:45 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:47.071231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:47.071954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:47.078516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.079060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.079860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.080321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.208642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:47.216151 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-63e7aff1-0532-498c-8b09-999c5b7efe1c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1507 microversion: 2.1 time: 0.150619 Apr 30 22:02:47.216724 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3148/6401] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:47 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:47.233483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:47.234154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:47.240976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.241432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.242240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.242685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.376951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:47.385960 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56a93fb1-7d8c-43b4-9feb-04f43faf6faf tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1507 microversion: 2.1 time: 0.157445 Apr 30 22:02:47.386540 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3254/6402] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:47 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:02:47.402921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:02:47.403942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:47.410131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.410608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.411409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.411876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.440466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:47.446349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Old instance type m1.heat2, new instance type m1.heat {{(pid=130670) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:02:47.452528 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:02:47.452959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:02:47.453445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:02:47.453897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:02:47.454323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:02:47.716949 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fd4941eb-b5bc-45f6-ae0e-13148a85918f tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "POST /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.318623 Apr 30 22:02:47.717629 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3149/6403] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:02:47 2022] POST /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:02:47.725964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:47.726670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:47.732987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.738354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.738354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:47.738354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:47.867192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:47.874984 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-25c1d76d-e467-4215-b980-4f269a41b65c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1514 microversion: 2.1 time: 0.152932 Apr 30 22:02:47.875591 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3255/6404] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:47 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:02:48.893509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:48.894729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:48.900237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:48.900711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:48.901509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:48.902505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:49.042408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:49.050757 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7d5f87d0-c058-4055-a1d6-80265cfb0fb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1514 microversion: 2.1 time: 0.162347 Apr 30 22:02:49.051368 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3150/6405] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:48 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:02:50.073273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:50.074534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:50.081716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:50.082552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:50.083374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:50.083830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:50.565134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:50.572805 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-df269f22-a73b-49c9-afa9-56e9f5040dd2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1514 microversion: 2.1 time: 0.504055 Apr 30 22:02:50.573709 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3256/6406] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:50 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1514 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:51.589641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:51.590381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:51.597331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:51.597840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:51.598635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:51.599099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:51.727871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:51.735270 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0dee22f8-1e19-4df4-b0b2-8580d23d423c tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.149630 Apr 30 22:02:51.735835 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3151/6407] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:51 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:52.752937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:52.753601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:52.760409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:52.760864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:52.761666 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:52.762132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:52.891709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:52.899259 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5409dea6-5c3f-4a73-8968-bf20a623a702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.150270 Apr 30 22:02:52.899835 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3257/6408] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:52 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:53.916728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:53.917365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:53.924800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:53.925267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:53.926082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:53.926543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:54.060202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:54.067774 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e64e9e53-c406-4ee1-947f-a6e0785e9540 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.155052 Apr 30 22:02:54.068349 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3152/6409] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:53 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:55.084730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:55.085366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:55.092813 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:55.093275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:55.094074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:55.094515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:55.221644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:55.228963 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fba3bdc8-4ea6-4d21-b7fe-ac2286071128 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.148179 Apr 30 22:02:55.229531 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3258/6410] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:55 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:56.245196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:56.246364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:56.253251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:56.253723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:56.254577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:56.255038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:56.388158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:56.395791 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8d190326-7b34-40a9-9832-ee7f520497d3 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.154597 Apr 30 22:02:56.396356 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3153/6411] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:56 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:57.412476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:57.413096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:57.420841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:57.422433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:57.422433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:57.422647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:57.550520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:57.557965 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80f771fd-957c-413f-8646-3e08a22ccc64 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.149367 Apr 30 22:02:57.558541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3259/6412] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:57 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:58.574420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:58.574959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:58.581929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:58.582387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:58.583183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:58.583642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:58.716085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:58.723558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2923b792-b05b-4340-93b7-38d17a4358b2 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.153168 Apr 30 22:02:58.724147 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3154/6413] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:58 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:02:59.740548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:02:59.741179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:02:59.748068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:59.748529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:59.749338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:02:59.749801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:02:59.876633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:02:59.884028 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-71e6a9c5-a6ab-456f-9e0a-5b43cafc8b74 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.147437 Apr 30 22:02:59.884596 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3260/6414] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:02:59 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:00.901941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:00.902550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:00.909701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:00.910196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:00.910979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:00.911432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:01.038831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:01.046344 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7cd02d84-6c33-4a19-baf1-495dafbc559d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.148427 Apr 30 22:03:01.046924 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3155/6415] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:00 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:02.063275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:02.063908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:02.070291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:02.070754 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:02.071540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:02.071992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:02.202220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:02.209655 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b2983094-903d-4242-812f-0fc73978d112 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.150417 Apr 30 22:03:02.210267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3261/6416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:02 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:03.227446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:03.228081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:03.234948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:03.235420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:03.236234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:03.236705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:03.378023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:03.385320 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1545d12e-9230-474c-9bd6-c8a71ddf4b3b tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.161922 Apr 30 22:03:03.385918 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3156/6417] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:03 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:04.402568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:04.403165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:04.410210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:04.410673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:04.411461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:04.411908 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:04.548232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:04.555816 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c607fa63-3bbf-495a-befe-667eeec06d27 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.157291 Apr 30 22:03:04.556468 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3262/6418] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:04 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:05.573585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:05.574212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:05.581603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:05.582112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:05.582912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:05.583376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:05.711344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:05.718879 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-99b34170-c1b3-434c-b973-c8b9e55df41a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.149309 Apr 30 22:03:05.719450 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3157/6419] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:05 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:06.740411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:06.741037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:06.747859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:06.748319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:06.749108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:06.749555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:06.875934 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:06.883310 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01cc35c0-1ede-426a-a836-32ce97124e63 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.146796 Apr 30 22:03:06.883885 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3263/6420] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:06 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:07.901014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:07.901647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:07.909229 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:07.909788 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:07.915516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:07.915516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:08.055147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:08.062598 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6fbe8b5d-42c7-4d1f-8b96-4a7cce23882a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.165526 Apr 30 22:03:08.063172 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3158/6421] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:07 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:09.079736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:09.080365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:09.087150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:09.087630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:09.088377 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:09.088823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:09.216965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:09.224354 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a7980b0-40f4-4ab1-b758-4e8163e93d43 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.148618 Apr 30 22:03:09.224927 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3264/6422] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:09 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:10.244103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:10.244656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:10.251476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:10.251949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:10.252738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:10.253195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:10.390885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:10.392502 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97b1f6bc-dad6-4b9c-a846-af06b15e2f1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.153021 Apr 30 22:03:10.393088 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3159/6423] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:10 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:11.409816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:11.410447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:11.417548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:11.418570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:11.419355 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:11.419803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:11.551747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:11.559823 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cfcf5ecf-13f8-4aed-8f5b-18aa75386d1a tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.154008 Apr 30 22:03:11.560398 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3265/6424] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:11 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:12.577595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:12.578210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:12.585283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:12.586371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:12.586726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:12.587187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:12.716830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:12.724242 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-852ffdbb-bf9b-4b1a-b235-c15e24dee158 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.151283 Apr 30 22:03:12.724812 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3160/6425] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:12 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:13.742263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:13.742880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:13.750219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:13.750689 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:13.751984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:13.752730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:13.884253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:13.892553 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cf3860f2-3cc0-4b66-9472-d2a94cd72d69 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.156002 Apr 30 22:03:13.893117 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3266/6426] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:13 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:14.910175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:14.910808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:14.917785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:14.918890 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:14.919691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:14.920155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:15.046963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:15.054438 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e398db2d-7ccb-41e5-b2b5-631ac135bf02 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.148175 Apr 30 22:03:15.055012 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3161/6427] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:14 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:16.071452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:16.072080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:16.079081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:16.079546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:16.080336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:16.080786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:16.212554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:16.220629 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d52fd9f-a910-4e93-ad08-9077761b221d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.153133 Apr 30 22:03:16.221221 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3267/6428] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:16 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:17.237693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:17.238360 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:17.245139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:17.245607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:17.246424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:17.246883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:17.376157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:17.383565 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6b9a8707-026b-41b4-a387-d1ec3a18c9c7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1519 microversion: 2.1 time: 0.149823 Apr 30 22:03:17.387619 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3162/6429] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:17 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:18.401030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:18.401653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:18.409296 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:18.409773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:18.410564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:18.411008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:18.605322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:18.613873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-01e4b6ff-968b-447c-93ce-1180eca85b0e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1518 microversion: 2.1 time: 0.216655 Apr 30 22:03:18.615892 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3268/6430] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:18 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:19.631351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:19.631913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:19.639081 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:19.639561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:19.640366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:19.640827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:19.776914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:19.785109 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b6fa31c-5e20-4914-a2a2-b73612239fec tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1516 microversion: 2.1 time: 0.157845 Apr 30 22:03:19.785684 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3163/6431] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:19 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:20.802345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:20.802972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:20.810545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:20.811011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:20.811804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:20.812252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:20.954380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:20.961842 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa710386-7ff0-4bcf-a8e9-7be805e6b020 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1516 microversion: 2.1 time: 0.163453 Apr 30 22:03:20.962426 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3269/6432] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:20 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:21.557343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-82ce0fa9-155b-47bc-98c4-03766c9fe659 req-0ddf022e-f795-4c1c-8227-f4e572322665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0873a873-a29c-4c1c-9f96-af605b386b1d", "name": "network-vif-unplugged", "status": "completed", "tag": "97923c07-7d28-4a3f-bbfb-88d17719ac2f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:21.566815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-82ce0fa9-155b-47bc-98c4-03766c9fe659 req-0ddf022e-f795-4c1c-8227-f4e572322665 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:21.567280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-82ce0fa9-155b-47bc-98c4-03766c9fe659 req-0ddf022e-f795-4c1c-8227-f4e572322665 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:21.579809 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-82ce0fa9-155b-47bc-98c4-03766c9fe659 req-0ddf022e-f795-4c1c-8227-f4e572322665 service nova] Creating event network-vif-unplugged:97923c07-7d28-4a3f-bbfb-88d17719ac2f for instance 0873a873-a29c-4c1c-9f96-af605b386b1d on nch1-master-1 Apr 30 22:03:21.585397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-82ce0fa9-155b-47bc-98c4-03766c9fe659 req-0ddf022e-f795-4c1c-8227-f4e572322665 service nova] Instance 0873a873-a29c-4c1c-9f96-af605b386b1d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:03:21.591883 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-82ce0fa9-155b-47bc-98c4-03766c9fe659 req-0ddf022e-f795-4c1c-8227-f4e572322665 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038324 Apr 30 22:03:21.592673 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3164/6433] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:03:21.978763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:21.979384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:21.986711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:21.987162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:21.987931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:21.988373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:22.114721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:22.122632 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b1dd7f79-49de-4e65-9342-32dced682a9e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1513 microversion: 2.1 time: 0.147868 Apr 30 22:03:22.123202 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3270/6434] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:21 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:22.139627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-babc78e4-5476-4269-aa55-c3aa4af234e7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:22.140402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-babc78e4-5476-4269-aa55-c3aa4af234e7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:22.146798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-babc78e4-5476-4269-aa55-c3aa4af234e7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:22.147279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-babc78e4-5476-4269-aa55-c3aa4af234e7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:22.148077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-babc78e4-5476-4269-aa55-c3aa4af234e7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:22.148544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-babc78e4-5476-4269-aa55-c3aa4af234e7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:22.323917 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-babc78e4-5476-4269-aa55-c3aa4af234e7 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "POST /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d/action" status: 204 len: 0 microversion: 2.1 time: 0.188585 Apr 30 22:03:22.324643 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3165/6435] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:03:22 2022] POST /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d/action => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:03:22.333135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:22.333854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:22.340408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:22.340864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:22.341646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:22.342112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:22.473777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:22.482182 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-86ca6360-bf1b-4fe7-a893-ca8be3686936 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1513 microversion: 2.1 time: 0.153065 Apr 30 22:03:22.482769 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3271/6436] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:22 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:03:23.501653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:23.502320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:23.508776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:23.509251 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:23.510087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:23.510549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:23.653628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-f41c3ebc-3450-41bf-8949-712006772b61 req-59642dc9-3827-4f75-815b-f8a5df31a5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0873a873-a29c-4c1c-9f96-af605b386b1d", "name": "network-vif-plugged", "status": "completed", "tag": "97923c07-7d28-4a3f-bbfb-88d17719ac2f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:23.659281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:23.664389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f41c3ebc-3450-41bf-8949-712006772b61 req-59642dc9-3827-4f75-815b-f8a5df31a5a9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:23.665257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-f41c3ebc-3450-41bf-8949-712006772b61 req-59642dc9-3827-4f75-815b-f8a5df31a5a9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:23.667379 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f72a700-f8b4-4e28-9136-ae9876e0965d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1513 microversion: 2.1 time: 0.171577 Apr 30 22:03:23.668663 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3166/6437] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:23 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:23.678054 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-f41c3ebc-3450-41bf-8949-712006772b61 req-59642dc9-3827-4f75-815b-f8a5df31a5a9 service nova] Creating event network-vif-plugged:97923c07-7d28-4a3f-bbfb-88d17719ac2f for instance 0873a873-a29c-4c1c-9f96-af605b386b1d on nch1-master-1 Apr 30 22:03:23.683503 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-f41c3ebc-3450-41bf-8949-712006772b61 req-59642dc9-3827-4f75-815b-f8a5df31a5a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035182 Apr 30 22:03:23.683882 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3272/6438] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:03:24.685144 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:24.685691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:24.692571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:24.693046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:24.693889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:24.694382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:24.820307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:24.827701 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc946e38-48f5-4f4c-8c04-f22497a45be1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1505 microversion: 2.1 time: 0.147081 Apr 30 22:03:24.828264 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3167/6439] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:24 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:24.845071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:24.845824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:24.852017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:24.852512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:24.853297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:24.853748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:24.990284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:24.997826 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f60692b8-c487-4165-ad40-29c46d18f3bb tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1505 microversion: 2.1 time: 0.157971 Apr 30 22:03:24.998425 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3273/6440] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:24 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:25.014240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:25.014875 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:25.020703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.021173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.021986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.022441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.147544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:25.154918 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75775b6a-1d4a-40f2-a8ef-b58de222e9ce tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1505 microversion: 2.1 time: 0.145316 Apr 30 22:03:25.155489 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3168/6441] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:25 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:25.171018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:25.171687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:25.177802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.178273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.179053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.179500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.207651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:03:25.490258 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c86be892-a709-452d-8dfa-377abb42767e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 204 len: 0 microversion: 2.1 time: 0.322657 Apr 30 22:03:25.490755 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3274/6442] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:03:25 2022] DELETE /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:03:25.508267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:25.508882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:25.519182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.519685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.520570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.521039 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.553361 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:03:25.663050 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.compute.api [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Instance is already in deleting state, ignoring this request Apr 30 22:03:25.663904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-458a6526-060d-4a6d-bbc5-8756c4aa9aed tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 204 len: 0 microversion: 2.1 time: 0.159775 Apr 30 22:03:25.664478 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3169/6443] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:03:25 2022] DELETE /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:03:25.673100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:25.674195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:25.679740 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.680194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.680975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:25.681416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:25.813552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:25.820949 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-864feabd-1eb7-4d5a-8a4b-166ea269cb1e tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1511 microversion: 2.1 time: 0.152161 Apr 30 22:03:25.821524 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3275/6444] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:25 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:26.840367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:26.841007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:26.847811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:26.848308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:26.849094 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:26.849548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:26.974905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:26.982842 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7558b9f8-e8fe-4b61-9453-af1ebf62671d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1511 microversion: 2.1 time: 0.146439 Apr 30 22:03:26.983420 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3170/6445] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:26 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:27.567036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-82f269c6-b2fd-43d7-befc-db29bcd1a46c req-7559716c-a8a9-49e4-bd79-acc1ac821baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0873a873-a29c-4c1c-9f96-af605b386b1d", "name": "network-vif-deleted", "tag": "97923c07-7d28-4a3f-bbfb-88d17719ac2f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:27.575630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-82f269c6-b2fd-43d7-befc-db29bcd1a46c req-7559716c-a8a9-49e4-bd79-acc1ac821baa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:27.576108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-82f269c6-b2fd-43d7-befc-db29bcd1a46c req-7559716c-a8a9-49e4-bd79-acc1ac821baa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:27.587602 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-82f269c6-b2fd-43d7-befc-db29bcd1a46c req-7559716c-a8a9-49e4-bd79-acc1ac821baa service nova] Creating event network-vif-deleted:97923c07-7d28-4a3f-bbfb-88d17719ac2f for instance 0873a873-a29c-4c1c-9f96-af605b386b1d on nch1-master-1 Apr 30 22:03:27.593093 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-82f269c6-b2fd-43d7-befc-db29bcd1a46c req-7559716c-a8a9-49e4-bd79-acc1ac821baa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094836 Apr 30 22:03:27.593706 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3276/6446] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:03:27.999662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:28.000755 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:28.011973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:28.012449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:28.014046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:28.014514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:28.044990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:28.045473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:28.045986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lazy-loading 'fault' on Instance uuid 0873a873-a29c-4c1c-9f96-af605b386b1d {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:03:28.085555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de908a2758a4489b9a3ef80078f2b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65065d04e6dc45cb9798be1c9703ad2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:28.093531 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f82410ac-393c-482b-aeb9-0a6ed4785624 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 200 len: 1305 microversion: 2.1 time: 0.097966 Apr 30 22:03:28.094135 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3171/6447] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:27 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:29.112312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:29.113022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 0873a873-a29c-4c1c-9f96-af605b386b1d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:29.119232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:29.119690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:29.120470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:29.120916 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:29.134669 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] HTTP exception thrown: Instance 0873a873-a29c-4c1c-9f96-af605b386b1d could not be found. Apr 30 22:03:29.135263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Returning 404 to user: Instance 0873a873-a29c-4c1c-9f96-af605b386b1d could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:03:29.136082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c89fd254-3a23-45b4-a6a2-4084390bfa4d tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d" status: 404 len: 111 microversion: 2.1 time: 0.029073 Apr 30 22:03:29.136629 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3277/6448] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:29 2022] GET /compute/v2.1/servers/0873a873-a29c-4c1c-9f96-af605b386b1d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:03:29.145497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:29.146052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:29.152799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:29.153274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:29.154104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:29.154567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:29.170247 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] HTTP exception thrown: Instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 could not be found. Apr 30 22:03:29.170854 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Returning 404 to user: Instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:03:29.171692 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a4163b4d-c100-4fd2-b1b8-f3e200c3e702 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "DELETE /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 404 len: 111 microversion: 2.1 time: 0.030100 Apr 30 22:03:29.172220 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3172/6449] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:03:29 2022] DELETE /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:03:29.180034 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:29.180659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] [instance: 087d4e4b-4f7a-444e-bda3-d3782178b4b0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:29.187163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:29.187618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:29.188419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:29.188864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:29.202850 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] HTTP exception thrown: Instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 could not be found. Apr 30 22:03:29.203441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] Returning 404 to user: Instance 087d4e4b-4f7a-444e-bda3-d3782178b4b0 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:03:29.204267 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ffa1d14d-f782-4ea1-a58b-02f147b3eeb1 tempest-ServerDiskConfigTestJSON-2076705734 tempest-ServerDiskConfigTestJSON-2076705734-project] 10.222.0.23 "GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0" status: 404 len: 111 microversion: 2.1 time: 0.028096 Apr 30 22:03:29.204794 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3278/6450] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:29 2022] GET /compute/v2.1/servers/087d4e4b-4f7a-444e-bda3-d3782178b4b0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:03:37.061559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5860878e-4ddf-4944-baed-461fbb852289 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'create', calling method: .version_select at 0x7fdc13eea5e0>, body: {"keypair": {"name": "tempest-keypair-2017920746"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:37.075740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-5860878e-4ddf-4944-baed-461fbb852289 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:03:37.081130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-5860878e-4ddf-4944-baed-461fbb852289 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:03:37.255718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-5860878e-4ddf-4944-baed-461fbb852289 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:03:37.260836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-5860878e-4ddf-4944-baed-461fbb852289 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:03:37.276905 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5860878e-4ddf-4944-baed-461fbb852289 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.333427 Apr 30 22:03:37.282728 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3173/6451] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:03:36 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:39.550864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2132407616", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "802fca98-979c-4c01-80ef-f6f7a1aef1e2"}], "security_groups": [{"name": "tempest-securitygroup--1332427744"}], "key_name": "tempest-keypair-2017920746", "user_data": "}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:39.677742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] validate_networks() for [('802fca98-979c-4c01-80ef-f6f7a1aef1e2', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:03:40.078168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:03:40.078606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:03:40.079094 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:03:40.079517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:03:40.079966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:03:40.089406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:40.089909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:40.090732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:40.091178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:40.109631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:03:40.115059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:03:40.127999 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:03:40.130357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:03:40.273978 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2b5628a3-5ba9-4ba7-9d6f-0496a5293db8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.730628 Apr 30 22:03:40.274642 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3279/6452] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:03:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:03:40.287382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-972488fc-762d-4de1-afb3-f57ed9eb2283 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:40.294024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-972488fc-762d-4de1-afb3-f57ed9eb2283 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:40.352347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-972488fc-762d-4de1-afb3-f57ed9eb2283 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:40.359793 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-972488fc-762d-4de1-afb3-f57ed9eb2283 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1239 microversion: 2.1 time: 0.078533 Apr 30 22:03:40.360357 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3174/6453] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:40 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:03:41.377523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:41.379932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:41.385248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:41.385711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:41.386550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:41.387186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:41.449000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:41.457103 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3efe6c7c-face-470e-b5c7-28eb56cb3d7f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1243 microversion: 2.1 time: 0.084493 Apr 30 22:03:41.457680 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3280/6454] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:41 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1243 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:42.475514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:42.476252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:42.484309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:42.484934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:42.485746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:42.486221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:42.572376 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:42.580532 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d91b789d-e3c5-4f33-8584-ddc4ad3f540c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1309 microversion: 2.1 time: 0.109666 Apr 30 22:03:42.581110 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3175/6455] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:42 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:43.597739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:43.598306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:43.605014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:43.605475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:43.606518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:43.608725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:43.759366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:43.767127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-abf2b830-9d70-4a2e-9775-b60e0f65ee56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1365 microversion: 2.1 time: 0.173450 Apr 30 22:03:43.767724 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3281/6456] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:43 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:44.127044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-0e16884b-c999-4afe-a6e2-9a3661d5cf9f req-6463fae7-a1b1-4d1b-acf9-37cd83db335d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d48d75b-cd66-4a03-af53-8058d68cee29", "tag": "03e71e6a-c177-49b2-98c4-a1ee4f8c1071"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:44.136308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0e16884b-c999-4afe-a6e2-9a3661d5cf9f req-6463fae7-a1b1-4d1b-acf9-37cd83db335d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:44.141522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-0e16884b-c999-4afe-a6e2-9a3661d5cf9f req-6463fae7-a1b1-4d1b-acf9-37cd83db335d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:44.149421 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-0e16884b-c999-4afe-a6e2-9a3661d5cf9f req-6463fae7-a1b1-4d1b-acf9-37cd83db335d service nova] Creating event network-changed:03e71e6a-c177-49b2-98c4-a1ee4f8c1071 for instance 5d48d75b-cd66-4a03-af53-8058d68cee29 on nch2-master-1 Apr 30 22:03:44.155823 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-0e16884b-c999-4afe-a6e2-9a3661d5cf9f req-6463fae7-a1b1-4d1b-acf9-37cd83db335d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032456 Apr 30 22:03:44.156437 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3176/6457] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:03:44.787047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:44.787991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:44.794786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:44.795246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:44.796027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:44.796475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:44.925680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:44.933213 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f388e281-9a1f-4b2d-9c32-27543839404f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1365 microversion: 2.1 time: 0.150151 Apr 30 22:03:44.933853 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3282/6458] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:44 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:45.952284 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:45.953174 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:45.959438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:45.961742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:45.961742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:45.961742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:46.100733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:46.108735 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e7a717a2-1aee-41e3-8920-a4b623e4fb0f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1365 microversion: 2.1 time: 0.161640 Apr 30 22:03:46.109301 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3177/6459] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:45 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:47.125118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:47.125738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:47.132694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:47.133238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:47.134041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:47.134482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:47.263383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:47.271782 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d14d1416-f00f-4234-ac9d-f0e191ad1947 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1365 microversion: 2.1 time: 0.151087 Apr 30 22:03:47.272375 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3283/6460] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:47 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:48.288525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:48.289285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:48.298043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:48.298521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:48.299322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:48.299779 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:48.437113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:48.444670 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f624166c-1f2c-4fb1-87e7-317acd978f2d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1365 microversion: 2.1 time: 0.160150 Apr 30 22:03:48.445234 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3178/6461] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:48 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:49.462527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:49.463144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:49.469625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:49.470101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:49.470879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:49.471384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:49.562078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c0e44399-42ec-4691-8a6e-2d174d853d5a req-3ec04700-cf04-4f7f-a1c4-e193331e3ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d48d75b-cd66-4a03-af53-8058d68cee29", "name": "network-vif-plugged", "status": "completed", "tag": "03e71e6a-c177-49b2-98c4-a1ee4f8c1071"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:49.572745 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c0e44399-42ec-4691-8a6e-2d174d853d5a req-3ec04700-cf04-4f7f-a1c4-e193331e3ebb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:49.573315 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c0e44399-42ec-4691-8a6e-2d174d853d5a req-3ec04700-cf04-4f7f-a1c4-e193331e3ebb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:49.584787 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c0e44399-42ec-4691-8a6e-2d174d853d5a req-3ec04700-cf04-4f7f-a1c4-e193331e3ebb service nova] Creating event network-vif-plugged:03e71e6a-c177-49b2-98c4-a1ee4f8c1071 for instance 5d48d75b-cd66-4a03-af53-8058d68cee29 on nch2-master-1 Apr 30 22:03:49.589942 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c0e44399-42ec-4691-8a6e-2d174d853d5a req-3ec04700-cf04-4f7f-a1c4-e193331e3ebb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032580 Apr 30 22:03:49.590546 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3179/6462] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:03:49.608543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:49.617553 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef946a46-9f2e-4a99-b531-71564b90a761 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1365 microversion: 2.1 time: 0.158786 Apr 30 22:03:49.618628 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3284/6463] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:49 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:50.637448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:50.638214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:50.644577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:50.645055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:50.645887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:50.646353 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:50.776383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:50.784361 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e8bc7c1-8594-451a-96ca-5a657e7c1d42 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1365 microversion: 2.1 time: 0.152389 Apr 30 22:03:50.784937 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3180/6464] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:50 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:51.800445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:51.801211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:51.808071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:51.808527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:51.809306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:51.809777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:51.938391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:51.945972 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-23c7ff73-249e-45e9-a7a4-aa67dade60c5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1551 microversion: 2.1 time: 0.149360 Apr 30 22:03:51.946590 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3285/6465] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:51 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:51.962680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a85bcd60-9a2f-4b57-8173-bbf683854cf5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:51.963207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a85bcd60-9a2f-4b57-8173-bbf683854cf5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:51.970641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85bcd60-9a2f-4b57-8173-bbf683854cf5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:51.971118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85bcd60-9a2f-4b57-8173-bbf683854cf5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:51.971909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85bcd60-9a2f-4b57-8173-bbf683854cf5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:51.972371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85bcd60-9a2f-4b57-8173-bbf683854cf5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:52.053549 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a85bcd60-9a2f-4b57-8173-bbf683854cf5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094776 Apr 30 22:03:52.054212 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3181/6466] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 22:03:51 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:03:53.385160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:53.385922 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:53.388331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-2a33a9b5-78ed-423d-b2b8-47e29d3e1511 req-28bebe57-1e94-43a3-86eb-d7f25726df0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d48d75b-cd66-4a03-af53-8058d68cee29", "tag": "03e71e6a-c177-49b2-98c4-a1ee4f8c1071"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:53.393662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:53.394399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:53.395196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:53.395830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:53.399183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2a33a9b5-78ed-423d-b2b8-47e29d3e1511 req-28bebe57-1e94-43a3-86eb-d7f25726df0f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:53.399911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-2a33a9b5-78ed-423d-b2b8-47e29d3e1511 req-28bebe57-1e94-43a3-86eb-d7f25726df0f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:53.412669 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-2a33a9b5-78ed-423d-b2b8-47e29d3e1511 req-28bebe57-1e94-43a3-86eb-d7f25726df0f service nova] Creating event network-changed:03e71e6a-c177-49b2-98c4-a1ee4f8c1071 for instance 5d48d75b-cd66-4a03-af53-8058d68cee29 on nch2-master-1 Apr 30 22:03:53.417924 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-2a33a9b5-78ed-423d-b2b8-47e29d3e1511 req-28bebe57-1e94-43a3-86eb-d7f25726df0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034948 Apr 30 22:03:53.421531 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3182/6467] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:03:53.617122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:53.628154 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-de9f4536-e697-4ba1-9601-13191e6178ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1551 microversion: 2.1 time: 0.245532 Apr 30 22:03:53.629805 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3286/6468] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:53 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1551 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:53.647901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:53.648705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:53.655302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:53.655847 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:53.656724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:53.657269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:53.848751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:53.856612 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-62f2ae53-afd4-4e56-84d3-dc26e03f7a52 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1551 microversion: 2.1 time: 0.212942 Apr 30 22:03:53.866272 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3183/6469] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:53 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1551 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:54.874079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:54.874777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:54.881465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:54.881965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:54.882746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:54.883194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:55.014733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:55.022103 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6d7b3eee-409a-474f-be53-e3d14578a221 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1670 microversion: 2.1 time: 0.152118 Apr 30 22:03:55.022683 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3287/6470] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:54 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:55.038462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:55.039093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:55.045786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:55.046256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:55.047041 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:55.047495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:55.174082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:55.181466 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-10205459-17ed-4c95-ac97-aac013be0eab tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1670 microversion: 2.1 time: 0.146825 Apr 30 22:03:55.182079 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3184/6471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:55 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:55.198008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:03:55.199088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:55.205742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:55.206232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:55.207015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:55.207467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:55.234809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:55.240496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Old instance type m1.heat2, new instance type m1.heat {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:03:55.246630 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:03:55.247066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:03:55.247552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:03:55.248484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:03:55.248907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:03:55.463703 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-232c5ff3-b9a1-46d5-b5fd-d9cb42874edc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29/action" status: 202 len: 0 microversion: 2.1 time: 0.269668 Apr 30 22:03:55.467517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3288/6472] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:03:55 2022] POST /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:03:55.473170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:55.473849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:55.480255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:55.491622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:55.491622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:55.491622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:55.615378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:55.623987 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98d1517a-b95e-4a8f-816f-91fdba8653d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1679 microversion: 2.1 time: 0.154763 Apr 30 22:03:55.627634 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3185/6473] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:55 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:03:56.645495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:56.646311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:56.657501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:56.657994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:56.658768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:56.659204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:56.788190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:56.796753 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26edd582-3a06-4df5-9191-24cecda0855b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1679 microversion: 2.1 time: 0.155329 Apr 30 22:03:56.797341 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3289/6474] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:56 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:57.814412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:57.815100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:57.821932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:57.822403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:57.823184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:57.823639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:58.040989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:58.048646 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-75b85415-87f7-49e3-ace6-c248c560fd64 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1679 microversion: 2.1 time: 0.238232 Apr 30 22:03:58.049361 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3186/6475] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:57 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:03:59.066383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:03:59.067009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:03:59.073879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:59.074338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:59.075150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:03:59.075596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:03:59.209115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:03:59.216631 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0be6450-d522-499b-8eb6-f0151c730cb2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.154294 Apr 30 22:03:59.217209 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3290/6476] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:03:59 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:00.234485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:00.235125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:00.242012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:00.242489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:00.243283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:00.243747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:00.370919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:00.378467 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-466c5581-8e6a-4637-bcd7-e94574e23da2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.148439 Apr 30 22:04:00.379046 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3187/6477] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:00 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:01.399792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:01.400437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:01.407866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:01.408320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:01.409518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:01.409518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:01.541316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:01.549445 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-77ce313a-f95a-4e54-8a0e-b26b56829cdf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.153582 Apr 30 22:04:01.550054 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3291/6478] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:01 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:02.567377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:02.567960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:02.574133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:02.574607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:02.575398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:02.576493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:02.700517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:02.709244 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b36a210e-65b5-453f-a481-3d5856d67895 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.146025 Apr 30 22:04:02.709870 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3188/6479] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:02 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:03.726825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:03.727732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:03.735708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:03.736169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:03.736957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:03.737402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:03.866627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:03.874687 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4ef2011-b123-445d-a0e0-b8f344d7435a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.152056 Apr 30 22:04:03.875255 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3292/6480] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:03 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:04.892286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:04.892840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:04.899658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:04.900124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:04.900908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:04.901364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:05.030867 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:05.038379 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f3965d0e-da4a-4f3a-975d-f11f383ec64f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.150133 Apr 30 22:04:05.038959 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3189/6481] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:04 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:06.056288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:06.056917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:06.064356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:06.064823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:06.065615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:06.066100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:06.200378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:06.207873 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6de350e-6e97-457f-a8d3-f4945db62282 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.155562 Apr 30 22:04:06.208467 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3293/6482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:06 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:07.226014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:07.226705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:07.234121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:07.234596 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:07.235399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:07.235857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:07.364781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:07.372371 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-78c19bf2-d736-49e2-8622-41327f3bfa68 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.150395 Apr 30 22:04:07.372950 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3190/6483] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:07 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:08.388709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:08.389321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:08.396117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:08.413812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:08.413812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:08.413812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:08.525389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:08.537318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-88711f77-c14f-4919-9d62-dcd57747a344 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.148389 Apr 30 22:04:08.537318 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3294/6484] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:08 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:09.550242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:09.550794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:09.557551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:09.558053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:09.558846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:09.559300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:09.691320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:09.698748 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ceb285a-bdc8-418b-9525-061760545327 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.152626 Apr 30 22:04:09.699322 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3191/6485] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:09 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:10.717113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:10.717742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:10.724661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:10.725122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:10.725938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:10.726387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:10.857252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:10.864819 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9539e81a-5b23-4f9c-bae1-4ea72e42a9b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.152408 Apr 30 22:04:10.865397 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3295/6486] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:10 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:11.882641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:11.883267 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:11.891028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:11.891509 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:11.892306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:11.892771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:12.018299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:12.026313 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2888d806-d49a-45fb-b8a1-244180846918 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.147585 Apr 30 22:04:12.026891 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3192/6487] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:11 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:13.044133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:13.044749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:13.051760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:13.052215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:13.052987 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:13.053429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:13.183384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:13.191296 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b3a9566-90e2-47c0-9f46-977b3c392642 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.151097 Apr 30 22:04:13.191870 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3296/6488] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:13 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:14.209017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:14.209666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:14.217197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:14.217674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:14.218500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:14.219038 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:14.344974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:14.352775 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e6c78ce-f7a3-4ce2-a849-9f1df20adcf0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.147749 Apr 30 22:04:14.353345 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3193/6489] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:14 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:14.786307 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:04:14.786949 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:04:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:04:15.370095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:15.370712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:15.377559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:15.378032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:15.378800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:15.379243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:15.508341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:15.516053 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7c8c4f9a-934d-48a2-aea3-7a1bee29adc8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.149899 Apr 30 22:04:15.516624 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3297/6490] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:15 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:16.534037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:16.534654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:16.541334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:16.541831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:16.542768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:16.543226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:16.670649 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:16.678099 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ea8a9568-cd82-4f77-9e0a-084b8a91a0c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.148802 Apr 30 22:04:16.678675 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3194/6491] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:16 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:17.697818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:17.698673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:17.705750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:17.706237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:17.707022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:17.707448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:17.840686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:17.848644 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-97ec2328-801f-4c72-b66c-cca2cd0a8a4d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.157344 Apr 30 22:04:17.849218 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3298/6492] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:17 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:18.866633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:18.867270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:18.874729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:18.875198 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:18.875983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:18.876442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:19.005533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:19.013591 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ffb21c8-8355-4b1f-b294-6a048e75009c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.150892 Apr 30 22:04:19.014486 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3195/6493] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:18 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:20.031569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:20.032219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:20.039211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:20.039670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:20.040445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:20.040892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:20.212678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:20.220213 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4b117d30-c265-4b11-97d9-0dcb5eefd37d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1684 microversion: 2.1 time: 0.192647 Apr 30 22:04:20.220788 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3299/6494] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:20 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1684 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:21.086906 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7f2d7729-33dd-4fd2-af11-e33b76da6348 req-e6df4ced-6be4-4585-9f0a-5d6ff37be5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d48d75b-cd66-4a03-af53-8058d68cee29", "name": "network-vif-unplugged", "status": "completed", "tag": "03e71e6a-c177-49b2-98c4-a1ee4f8c1071"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:21.096417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7f2d7729-33dd-4fd2-af11-e33b76da6348 req-e6df4ced-6be4-4585-9f0a-5d6ff37be5aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:21.096884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7f2d7729-33dd-4fd2-af11-e33b76da6348 req-e6df4ced-6be4-4585-9f0a-5d6ff37be5aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:21.108562 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7f2d7729-33dd-4fd2-af11-e33b76da6348 req-e6df4ced-6be4-4585-9f0a-5d6ff37be5aa service nova] Creating event network-vif-unplugged:03e71e6a-c177-49b2-98c4-a1ee4f8c1071 for instance 5d48d75b-cd66-4a03-af53-8058d68cee29 on nch1-master-1 Apr 30 22:04:21.113907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-7f2d7729-33dd-4fd2-af11-e33b76da6348 req-e6df4ced-6be4-4585-9f0a-5d6ff37be5aa service nova] Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:04:21.125261 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7f2d7729-33dd-4fd2-af11-e33b76da6348 req-e6df4ced-6be4-4585-9f0a-5d6ff37be5aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042222 Apr 30 22:04:21.125881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3196/6495] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:04:21.238242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:21.239032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:21.252341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:21.252881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:21.253680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:21.254162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:21.502064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:21.510175 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ffb61fbb-7fc3-48e9-aeac-47180a9453f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1683 microversion: 2.1 time: 0.275910 Apr 30 22:04:21.510568 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3300/6496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:21 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1683 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:22.530575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:22.531343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:22.537594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:22.538134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:22.544500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:22.544500 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:22.672006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:22.679547 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-be0cb6c7-b028-40c8-a8ac-86d478919dfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1683 microversion: 2.1 time: 0.154866 Apr 30 22:04:22.680119 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3197/6497] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:22 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:23.140484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-14dff59c-13c6-4849-86c9-34b4a762a47a req-200fa02d-9e44-4962-a487-fbb1d5b3a4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d48d75b-cd66-4a03-af53-8058d68cee29", "tag": "03e71e6a-c177-49b2-98c4-a1ee4f8c1071"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:23.149322 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-14dff59c-13c6-4849-86c9-34b4a762a47a req-200fa02d-9e44-4962-a487-fbb1d5b3a4b6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:23.150015 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-14dff59c-13c6-4849-86c9-34b4a762a47a req-200fa02d-9e44-4962-a487-fbb1d5b3a4b6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:23.164307 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-14dff59c-13c6-4849-86c9-34b4a762a47a req-200fa02d-9e44-4962-a487-fbb1d5b3a4b6 service nova] Creating event network-changed:03e71e6a-c177-49b2-98c4-a1ee4f8c1071 for instance 5d48d75b-cd66-4a03-af53-8058d68cee29 on nch1-master-1 Apr 30 22:04:23.169627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-14dff59c-13c6-4849-86c9-34b4a762a47a req-200fa02d-9e44-4962-a487-fbb1d5b3a4b6 service nova] Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:04:23.180946 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-14dff59c-13c6-4849-86c9-34b4a762a47a req-200fa02d-9e44-4962-a487-fbb1d5b3a4b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045068 Apr 30 22:04:23.181554 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3301/6498] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:04:23.698427 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:23.699093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:23.705837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:23.706275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:23.707066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:23.707524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:23.912571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:23.920572 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-de91b483-8dfd-4f33-9dd8-4cfb9c1e74b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1681 microversion: 2.1 time: 0.226112 Apr 30 22:04:23.921155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3198/6499] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:23 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:24.939354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:24.939976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:24.946544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:24.947005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:24.947885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:24.948363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:25.082340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:25.089702 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2baba7ca-9064-43c2-bf64-65e90dc53fa0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1678 microversion: 2.1 time: 0.156164 Apr 30 22:04:25.090297 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3302/6500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:24 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:25.106300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3e877b51-b4c8-4c08-bf4c-15c386068384 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:25.106846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3e877b51-b4c8-4c08-bf4c-15c386068384 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:25.114220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e877b51-b4c8-4c08-bf4c-15c386068384 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:25.114693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e877b51-b4c8-4c08-bf4c-15c386068384 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:25.115479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e877b51-b4c8-4c08-bf4c-15c386068384 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:25.115939 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3e877b51-b4c8-4c08-bf4c-15c386068384 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:25.288446 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3e877b51-b4c8-4c08-bf4c-15c386068384 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29/action" status: 204 len: 0 microversion: 2.1 time: 0.185800 Apr 30 22:04:25.314201 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3199/6501] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:04:25 2022] POST /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29/action => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:04:25.314359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:25.314359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:25.314359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:25.314359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:25.314359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:25.314359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:25.434619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:25.442991 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f5cc6c8-ddbe-4102-a5b5-c2df3eeddb40 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1678 microversion: 2.1 time: 0.149158 Apr 30 22:04:25.443604 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3303/6502] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:25 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:26.462120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:26.463899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:26.469266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:26.469734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:26.470553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:26.471008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:26.611184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:26.618674 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7580b32f-fa99-437b-880d-3e9a0a7851ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1678 microversion: 2.1 time: 0.161857 Apr 30 22:04:26.619246 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3200/6503] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:26 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:27.636130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:27.636952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:27.644676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:27.645145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:27.645976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:27.646428 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:27.781721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:27.787200 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d835cbc0-4921-41fb-a155-5b6551f607cf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1670 microversion: 2.1 time: 0.155148 Apr 30 22:04:27.787787 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3304/6504] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:27 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:27.803647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:27.804286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:27.811085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:27.811557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:27.812372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:27.812820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:27.887794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-72e88587-2e2b-4d1d-be9c-12b904b58584 req-04a3b0e7-1188-4a06-a10e-e4027f21cfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d48d75b-cd66-4a03-af53-8058d68cee29", "name": "network-vif-plugged", "status": "completed", "tag": "03e71e6a-c177-49b2-98c4-a1ee4f8c1071"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:27.897359 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-72e88587-2e2b-4d1d-be9c-12b904b58584 req-04a3b0e7-1188-4a06-a10e-e4027f21cfe6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:27.898473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-72e88587-2e2b-4d1d-be9c-12b904b58584 req-04a3b0e7-1188-4a06-a10e-e4027f21cfe6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:27.913403 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-72e88587-2e2b-4d1d-be9c-12b904b58584 req-04a3b0e7-1188-4a06-a10e-e4027f21cfe6 service nova] Creating event network-vif-plugged:03e71e6a-c177-49b2-98c4-a1ee4f8c1071 for instance 5d48d75b-cd66-4a03-af53-8058d68cee29 on nch1-master-1 Apr 30 22:04:27.919227 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-72e88587-2e2b-4d1d-be9c-12b904b58584 req-04a3b0e7-1188-4a06-a10e-e4027f21cfe6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035894 Apr 30 22:04:27.920066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3305/6505] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:04:27.964946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:27.973142 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a0d8104d-4bbd-4baa-b01f-50bedc568009 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1670 microversion: 2.1 time: 0.173404 Apr 30 22:04:27.973735 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3201/6506] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:27 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:27.990885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:27.991649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:27.997961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:27.999681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:27.999681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:27.999893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:28.129668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:28.137484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-082d7daa-d813-4cb1-9028-5d982fe8c809 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1670 microversion: 2.1 time: 0.151837 Apr 30 22:04:28.138219 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3306/6507] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:27 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:28.154191 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:28.154713 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:28.160599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:28.161071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:28.161887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:28.162345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:28.186846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:04:28.489420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-97770058-7e26-4ca4-996e-7067a0bc4b36 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 204 len: 0 microversion: 2.1 time: 0.338684 Apr 30 22:04:28.490305 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3202/6508] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:04:28 2022] DELETE /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:04:28.499816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:28.500437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:28.506638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:28.507099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:28.507880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:28.508328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:28.636068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:28.644626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-52d99d3f-4c01-4e15-86cd-f863595be47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1676 microversion: 2.1 time: 0.149674 Apr 30 22:04:28.645231 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3307/6509] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:28 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:29.662516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:29.663165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:29.670659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:29.671143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:29.671946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:29.672412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:29.806133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:29.813817 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b5b16378-e690-4ad0-8944-2217e1ef37b0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1676 microversion: 2.1 time: 0.155703 Apr 30 22:04:29.814394 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3203/6510] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:29 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:30.831594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:30.832419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:30.839674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:30.840243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:30.841036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:30.841486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:30.914426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:30.923524 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-85caa8a0-e7d7-4734-a4ec-21aa5bac77e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 200 len: 1608 microversion: 2.1 time: 0.095837 Apr 30 22:04:30.924340 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3308/6511] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:30 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 1608 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:30.966485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3530763b-c8b4-404d-b4d6-d22983443abf req-79a2c5ee-29c8-4b65-b449-9783d80e9295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d48d75b-cd66-4a03-af53-8058d68cee29", "name": "network-vif-deleted", "tag": "03e71e6a-c177-49b2-98c4-a1ee4f8c1071"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:30.981421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3530763b-c8b4-404d-b4d6-d22983443abf req-79a2c5ee-29c8-4b65-b449-9783d80e9295 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:30.982111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3530763b-c8b4-404d-b4d6-d22983443abf req-79a2c5ee-29c8-4b65-b449-9783d80e9295 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:30.993698 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3530763b-c8b4-404d-b4d6-d22983443abf req-79a2c5ee-29c8-4b65-b449-9783d80e9295 service nova] Creating event network-vif-deleted:03e71e6a-c177-49b2-98c4-a1ee4f8c1071 for instance 5d48d75b-cd66-4a03-af53-8058d68cee29 on nch1-master-1 Apr 30 22:04:30.998884 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3530763b-c8b4-404d-b4d6-d22983443abf req-79a2c5ee-29c8-4b65-b449-9783d80e9295 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036487 Apr 30 22:04:30.999728 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3204/6512] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:04:31.941341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:31.941992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:31.948107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:31.948567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:31.949349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:31.949850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:31.965934 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. Apr 30 22:04:31.966541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:04:31.967416 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd576d16-98b2-48fc-bf7b-9809b7459e49 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 404 len: 111 microversion: 2.1 time: 0.030361 Apr 30 22:04:31.967957 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3309/6513] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:31 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 22:04:31.988682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:31.988682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:31.990642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:31.991121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:31.991917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:31.992378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:32.007048 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. Apr 30 22:04:32.007664 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:04:32.008533 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-85069909-1e01-4738-8f4b-91ba0fb32dcf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 404 len: 111 microversion: 2.1 time: 0.029657 Apr 30 22:04:32.009104 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3205/6514] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:31 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:04:32.058768 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1961250682", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "802fca98-979c-4c01-80ef-f6f7a1aef1e2"}], "security_groups": [{"name": "tempest-securitygroup--1332427744"}], "key_name": "tempest-keypair-2017920746", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:32.161946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] validate_networks() for [('802fca98-979c-4c01-80ef-f6f7a1aef1e2', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:04:32.520810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:04:32.521250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:04:32.521738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:04:32.522196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:04:32.522624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:04:32.532048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:32.532523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:32.533349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:32.533827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:32.552061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:04:32.557324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:04:32.569933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:04:32.572241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:04:32.667886 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-319d6a2c-4625-4205-adb1-9610b9f6fc85 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.613067 Apr 30 22:04:32.668608 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3310/6515] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:04:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:04:32.679468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-93ababaa-1540-460b-a10d-1e12b53d0955 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:32.680230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-93ababaa-1540-460b-a10d-1e12b53d0955 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:32.737018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-93ababaa-1540-460b-a10d-1e12b53d0955 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:32.743825 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-93ababaa-1540-460b-a10d-1e12b53d0955 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1239 microversion: 2.1 time: 0.068436 Apr 30 22:04:32.744401 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3206/6516] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:32 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:33.761142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:33.762075 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:33.768214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:33.768674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:33.769461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:33.770023 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:33.836873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:33.839459 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-720d3e78-3650-48c4-8f42-46b651467997 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1235 microversion: 2.1 time: 0.083038 Apr 30 22:04:33.840051 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3311/6517] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:33 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:34.856625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:34.857844 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:34.865691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:34.866190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:34.866993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:34.867450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:34.938117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:34.945557 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67d9caad-9640-4b6f-bcba-a8e287f5e9f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1297 microversion: 2.1 time: 0.092930 Apr 30 22:04:34.946247 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3207/6518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:34 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:35.964656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:35.965477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:35.974297 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:35.974971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:35.976114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:35.976692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:36.120467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-1691888a-b2d7-45b5-bf37-64f420f25595 req-463fab98-c938-4bbe-9a9a-0bc21ab0490e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf", "tag": "1647dd44-f24c-4548-bb70-863a0731ed2e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:36.136082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1691888a-b2d7-45b5-bf37-64f420f25595 req-463fab98-c938-4bbe-9a9a-0bc21ab0490e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:36.140362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1691888a-b2d7-45b5-bf37-64f420f25595 req-463fab98-c938-4bbe-9a9a-0bc21ab0490e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:36.157173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-1691888a-b2d7-45b5-bf37-64f420f25595 req-463fab98-c938-4bbe-9a9a-0bc21ab0490e service nova] Creating event network-changed:1647dd44-f24c-4548-bb70-863a0731ed2e for instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf on nch1-master-1 Apr 30 22:04:36.162518 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-1691888a-b2d7-45b5-bf37-64f420f25595 req-463fab98-c938-4bbe-9a9a-0bc21ab0490e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047142 Apr 30 22:04:36.166411 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3208/6519] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:04:36.185112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:36.194484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c47063a9-e958-4197-8434-10ca2ef0b673 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1365 microversion: 2.1 time: 0.234977 Apr 30 22:04:36.195400 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3312/6520] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:35 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:37.212538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:37.213260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:37.220506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:37.220979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:37.221786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:37.222253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:37.349623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:37.357020 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f197a39e-a33b-43c7-8fc7-d6583190d5f6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1365 microversion: 2.1 time: 0.148734 Apr 30 22:04:37.357620 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3209/6521] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:37 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:38.374444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:38.375101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:38.382177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:38.382638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:38.383712 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:38.383888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:38.510721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:38.519396 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5114c168-e0c5-4868-bf37-3426c2b9e49f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1365 microversion: 2.1 time: 0.148926 Apr 30 22:04:38.520007 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3313/6522] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:38 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:39.537131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:39.537687 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:39.545330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:39.545835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:39.546642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:39.547134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:39.679103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:39.686519 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8396af0d-18b8-408d-bad9-901b874ed9d6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1365 microversion: 2.1 time: 0.153582 Apr 30 22:04:39.687106 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3210/6523] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:39 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:40.704068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:40.704668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:40.711561 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:40.712016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:40.712793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:40.713259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:40.838789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:40.846186 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5f31aaab-c881-4c20-bbed-4870f6c94494 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1365 microversion: 2.1 time: 0.146562 Apr 30 22:04:40.846811 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3314/6524] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:40 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:41.865069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:41.865920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:41.873572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:41.875602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:41.875602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:41.875602 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:41.960019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-781395c6-dcbf-4da1-809f-9b5e33a49e2c req-40a24ca5-97fd-421b-96ec-5c4ce9235d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf", "name": "network-vif-plugged", "status": "completed", "tag": "1647dd44-f24c-4548-bb70-863a0731ed2e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:41.972316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-781395c6-dcbf-4da1-809f-9b5e33a49e2c req-40a24ca5-97fd-421b-96ec-5c4ce9235d4d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:41.972849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-781395c6-dcbf-4da1-809f-9b5e33a49e2c req-40a24ca5-97fd-421b-96ec-5c4ce9235d4d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:41.984271 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-781395c6-dcbf-4da1-809f-9b5e33a49e2c req-40a24ca5-97fd-421b-96ec-5c4ce9235d4d service nova] Creating event network-vif-plugged:1647dd44-f24c-4548-bb70-863a0731ed2e for instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf on nch1-master-1 Apr 30 22:04:41.989531 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-781395c6-dcbf-4da1-809f-9b5e33a49e2c req-40a24ca5-97fd-421b-96ec-5c4ce9235d4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033675 Apr 30 22:04:41.990161 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3315/6525] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:04:42.013609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:42.020595 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6c1b3c6d-bcbc-4a12-ac25-26335e7ff59f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1365 microversion: 2.1 time: 0.159647 Apr 30 22:04:42.021360 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3211/6526] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:41 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:04:43.040402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:43.041111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:43.048045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:43.048504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:43.049281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:43.049730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:43.181423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:43.188895 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2e455c6e-3978-499f-9973-783581e7ee32 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1365 microversion: 2.1 time: 0.153630 Apr 30 22:04:43.189488 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3316/6527] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:43 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:44.206572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:44.207207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:44.214344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:44.214817 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:44.215614 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:44.216078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:44.341364 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:44.348858 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1083b58e-d22f-43b9-813e-703c7274a148 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1552 microversion: 2.1 time: 0.146254 Apr 30 22:04:44.349427 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3212/6528] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:44 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:44.366032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f46fbba2-e340-487b-bda9-c31fab30ce8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:44.366569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f46fbba2-e340-487b-bda9-c31fab30ce8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:44.374279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f46fbba2-e340-487b-bda9-c31fab30ce8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:44.374747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f46fbba2-e340-487b-bda9-c31fab30ce8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:44.375531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f46fbba2-e340-487b-bda9-c31fab30ce8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:44.375983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f46fbba2-e340-487b-bda9-c31fab30ce8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:44.450866 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f46fbba2-e340-487b-bda9-c31fab30ce8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088813 Apr 30 22:04:44.451515 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3317/6529] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 22:04:44 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:04:45.763111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55159ad3-007f-44eb-8a59-2eef81e4971c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:45.766284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5c9b1abe-a3fe-49a3-8a74-7dda2c9e010e req-0e44ae76-e6af-478c-a7bc-3a13e1cc4875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf", "tag": "1647dd44-f24c-4548-bb70-863a0731ed2e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:04:45.770709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55159ad3-007f-44eb-8a59-2eef81e4971c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:45.771193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55159ad3-007f-44eb-8a59-2eef81e4971c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:45.774761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5c9b1abe-a3fe-49a3-8a74-7dda2c9e010e req-0e44ae76-e6af-478c-a7bc-3a13e1cc4875 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:45.775422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5c9b1abe-a3fe-49a3-8a74-7dda2c9e010e req-0e44ae76-e6af-478c-a7bc-3a13e1cc4875 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:45.787525 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5c9b1abe-a3fe-49a3-8a74-7dda2c9e010e req-0e44ae76-e6af-478c-a7bc-3a13e1cc4875 service nova] Creating event network-changed:1647dd44-f24c-4548-bb70-863a0731ed2e for instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf on nch1-master-1 Apr 30 22:04:45.792736 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5c9b1abe-a3fe-49a3-8a74-7dda2c9e010e req-0e44ae76-e6af-478c-a7bc-3a13e1cc4875 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031404 Apr 30 22:04:45.793719 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3318/6530] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:04:45.796217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-55159ad3-007f-44eb-8a59-2eef81e4971c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Going to try to stop instance {{(pid=130670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 22:04:45.927699 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55159ad3-007f-44eb-8a59-2eef81e4971c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action" status: 202 len: 0 microversion: 2.1 time: 0.168149 Apr 30 22:04:45.931584 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3213/6531] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:04:45 2022] POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:04:45.938499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:45.939478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:45.947174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:45.952329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:45.952329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:45.952329 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:46.156597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:46.166712 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f72a285b-8d90-4275-ad07-077069d38c97 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1562 microversion: 2.1 time: 0.233428 Apr 30 22:04:46.167967 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3319/6532] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:45 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:47.189542 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:47.190304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:47.197327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:47.197834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:47.198640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:47.199109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:47.340639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:47.348761 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-77067149-5666-4000-aed3-917d3dba4799 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.163688 Apr 30 22:04:47.349333 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3214/6533] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:47 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:48.366141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:48.366761 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:48.373576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:48.374063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:48.374842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:48.375292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:48.503292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:48.510861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-14145424-fff6-4975-af19-b62fda1801c7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.148728 Apr 30 22:04:48.511704 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3320/6534] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:48 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:49.528517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:49.529220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:49.536372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:49.536842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:49.537650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:49.538133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:49.668257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:49.676233 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-575a9792-f8db-4268-85c8-4d9bc33f0974 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.152699 Apr 30 22:04:49.676811 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3215/6535] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:49 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:50.693863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:50.694516 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:50.702059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:50.702517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:50.703295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:50.703741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:50.836968 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:50.844731 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a6617731-88df-49b7-ae3a-bca41f253481 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.154822 Apr 30 22:04:50.845304 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3321/6536] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:50 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:51.872107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:51.872650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:51.879565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:51.880213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:51.880826 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:51.881287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:52.021105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:52.029265 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-81f752fb-cec4-44bd-b627-8ae4326fe9b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.160553 Apr 30 22:04:52.029866 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3216/6537] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:51 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:53.046384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:53.047009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:53.053939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:53.054402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:53.055185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:53.055631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:53.185690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:53.193097 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-63a215cf-1e5c-4ba9-9d32-0b20c1775524 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.151362 Apr 30 22:04:53.193675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3322/6538] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:53 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:54.211069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:54.211704 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:54.218568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:54.219044 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:54.219838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:54.220297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:54.348378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:54.355870 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-86aad840-d0aa-428c-add2-1948ab7fa74b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.148775 Apr 30 22:04:54.356488 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3217/6539] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:54 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:55.373564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:55.374217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:55.381158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:55.381617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:55.382431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:55.382881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:55.520110 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:55.533525 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43c01272-6980-4eac-8835-6ea804f6de45 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.163162 Apr 30 22:04:55.533525 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3323/6540] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:55 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:56.549474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:56.550138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:56.557021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:56.557493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:56.558311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:56.558815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:56.689199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:56.696640 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-005fd6ff-91d3-4e75-be69-7c0641d381da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.151100 Apr 30 22:04:56.697214 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3218/6541] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:56 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:57.714670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:57.715301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:57.722856 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:57.723323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:57.724109 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:57.724560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:57.850782 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:57.858251 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6a7ce282-e085-4f54-8d66-efd0cf08233c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.147553 Apr 30 22:04:57.858833 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3324/6542] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:57 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:04:58.876193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:04:58.876835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:04:58.883776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:58.884252 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:58.885055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:04:58.885521 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:04:59.015586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:04:59.023144 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f0093856-010d-4890-b381-e1c3fc6f52ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.150983 Apr 30 22:04:59.023723 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3219/6543] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:04:58 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:00.040955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:00.041571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:00.048626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:00.049080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:00.049889 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:00.050332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:00.176225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:00.183725 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1b89b2c1-adb8-46f0-b984-4b0b3a0826ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.146737 Apr 30 22:05:00.184294 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3325/6544] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:00 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:01.200869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:01.201507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:01.208260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:01.208730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:01.209516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:01.209998 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:01.339426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:01.347357 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-70b194ec-0f04-4ba5-8d8e-7da58f49d70d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.150485 Apr 30 22:05:01.347929 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3220/6545] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:01 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:02.364530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:02.365177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:02.371467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:02.372495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:02.372709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:02.373150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:02.501920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:02.509493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-70727fc2-a82f-4443-bbf4-8e742981c47b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.148945 Apr 30 22:05:02.510104 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3326/6546] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:02 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:03.527494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:03.528676 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:03.535125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:03.535536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:03.536323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:03.536782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:03.661632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:03.669044 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24921757-4cc4-4ba9-ae07-bbf11d7f1d82 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.145677 Apr 30 22:05:03.669626 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3221/6547] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:03 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:04.686141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:04.686707 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:04.693540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:04.694025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:04.694804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:04.695247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:04.827005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:04.834369 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d84a2a87-d985-4d23-887f-a5ef3f2c1b94 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.152246 Apr 30 22:05:04.834946 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3327/6548] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:04 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:05.852067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:05.852732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:05.859522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:05.859995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:05.860783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:05.861263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:05.993553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:06.001525 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f773bcd0-9339-4d07-996a-f6d0a51e56e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.153417 Apr 30 22:05:06.002351 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3222/6549] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:05 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:07.019461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:07.020082 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:07.026961 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:07.027413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:07.028799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:07.029239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:07.157737 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:07.165097 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43e1683c-745c-4789-9874-5d04fed9b72d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.149546 Apr 30 22:05:07.165672 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3328/6550] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:07 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:08.182269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:08.182954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:08.190423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:08.190892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:08.191682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:08.192137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:08.319114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:08.326524 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4200f390-18fa-4439-b9d2-6e277035bb28 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.148278 Apr 30 22:05:08.327097 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3223/6551] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:08 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:09.343590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:09.344211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:09.351183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:09.351637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:09.352417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:09.352861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:09.483072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:09.490730 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0c1d44c4-3d6d-465b-94ea-d2d2a9acb58f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.150943 Apr 30 22:05:09.491307 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3329/6552] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:09 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:10.508803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:10.509439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:10.518441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:10.518919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:10.519729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:10.520195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:10.647863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:10.655267 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-15269c61-e5ef-40ec-818e-9a0279e4633a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.150656 Apr 30 22:05:10.655831 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3224/6553] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:10 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:11.672649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:11.673195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:11.680077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:11.680532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:11.681309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:11.681779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:11.809099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:11.816587 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-426d5513-7f89-4a01-a04a-2abf9be98b22 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1658 microversion: 2.1 time: 0.148614 Apr 30 22:05:11.817165 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3330/6554] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:11 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1658 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:11.832932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:11.833965 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:11.841430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:11.841947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:11.842749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:11.843214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:11.871077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:11.876782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Old instance type m1.heat2, new instance type m1.heat {{(pid=130670) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:05:11.882979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:05:11.883426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:05:11.883926 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:05:11.884470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:05:11.884910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:05:12.051957 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bf20be65-b820-412d-9d99-0e3736735f01 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action" status: 202 len: 0 microversion: 2.1 time: 0.222605 Apr 30 22:05:12.052581 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3225/6555] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:05:11 2022] POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:05:12.061663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:12.062361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:12.069091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:12.069547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:12.070411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:12.070861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:12.207535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:12.215205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fe06d373-ee13-412d-901f-f1214db6bc34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.158360 Apr 30 22:05:12.216449 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3331/6556] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:12 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:13.232573 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:13.233239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:13.240205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:13.244432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:13.244432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:13.244432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:13.371077 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:13.379313 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-67c23720-97c2-453c-b278-9f620b38802c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.150747 Apr 30 22:05:13.379899 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3226/6557] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:13 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:14.396438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:14.397146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:14.404853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:14.405396 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:14.406226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:14.406673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:14.603142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:14.610723 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d3363c1a-8203-4a73-a168-e76c746b6390 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1681 microversion: 2.1 time: 0.218242 Apr 30 22:05:14.611351 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3332/6558] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:14 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:15.628074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:15.628672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:15.635794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:15.636270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:15.637063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:15.637561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:15.768076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:15.775465 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-48a5f2c3-6ac7-4735-8db1-0be16256defc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1686 microversion: 2.1 time: 0.151430 Apr 30 22:05:15.776047 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3227/6559] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:15 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:16.793634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:16.794292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:16.801802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:16.802286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:16.803057 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:16.803510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:16.971455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:16.982011 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-749dba3a-283b-42ac-967b-c6e4b5158266 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1686 microversion: 2.1 time: 0.189453 Apr 30 22:05:16.982011 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3333/6560] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:16 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:17.817103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-738a1a66-d19b-48eb-af0f-c6c7b91e0115 req-3f3c4c51-7609-49b6-9d8c-400634f1f909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf", "name": "network-vif-unplugged", "status": "completed", "tag": "1647dd44-f24c-4548-bb70-863a0731ed2e"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:17.826575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-738a1a66-d19b-48eb-af0f-c6c7b91e0115 req-3f3c4c51-7609-49b6-9d8c-400634f1f909 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:17.827073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-738a1a66-d19b-48eb-af0f-c6c7b91e0115 req-3f3c4c51-7609-49b6-9d8c-400634f1f909 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:17.846471 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-738a1a66-d19b-48eb-af0f-c6c7b91e0115 req-3f3c4c51-7609-49b6-9d8c-400634f1f909 service nova] Creating event network-vif-unplugged:1647dd44-f24c-4548-bb70-863a0731ed2e for instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf on nch2-master-1 Apr 30 22:05:17.852055 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-738a1a66-d19b-48eb-af0f-c6c7b91e0115 req-3f3c4c51-7609-49b6-9d8c-400634f1f909 service nova] Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:05:17.864069 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-738a1a66-d19b-48eb-af0f-c6c7b91e0115 req-3f3c4c51-7609-49b6-9d8c-400634f1f909 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050727 Apr 30 22:05:17.864916 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3228/6561] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:05:17.996875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:17.997602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:18.004789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:18.005393 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:18.006234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:18.006681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:18.241357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:18.249557 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43ccae47-2c6d-4427-9ab9-02bb10aa6c56 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1685 microversion: 2.1 time: 0.256984 Apr 30 22:05:18.251134 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3334/6562] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:17 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1685 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:19.269371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:19.270125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:19.276555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:19.277035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:19.277866 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:19.278332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:19.408911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:19.416813 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e98f1a22-a15d-4a5f-ae44-b8f8d09ecf33 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1683 microversion: 2.1 time: 0.152525 Apr 30 22:05:19.417384 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3229/6563] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:19 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:19.878246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-c6a7bd8c-e3c2-48c0-93d9-69b42920c5d5 req-1e03b088-b1f3-4624-9f88-fbae0438e177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf", "tag": "1647dd44-f24c-4548-bb70-863a0731ed2e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:19.887337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c6a7bd8c-e3c2-48c0-93d9-69b42920c5d5 req-1e03b088-b1f3-4624-9f88-fbae0438e177 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:19.887783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-c6a7bd8c-e3c2-48c0-93d9-69b42920c5d5 req-1e03b088-b1f3-4624-9f88-fbae0438e177 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:19.899033 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-c6a7bd8c-e3c2-48c0-93d9-69b42920c5d5 req-1e03b088-b1f3-4624-9f88-fbae0438e177 service nova] Creating event network-changed:1647dd44-f24c-4548-bb70-863a0731ed2e for instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf on nch2-master-1 Apr 30 22:05:19.904756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-c6a7bd8c-e3c2-48c0-93d9-69b42920c5d5 req-1e03b088-b1f3-4624-9f88-fbae0438e177 service nova] Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:05:19.915524 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-c6a7bd8c-e3c2-48c0-93d9-69b42920c5d5 req-1e03b088-b1f3-4624-9f88-fbae0438e177 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041024 Apr 30 22:05:19.916099 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3335/6564] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:05:20.435289 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:20.436272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:20.443340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:20.445548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:20.445548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:20.445548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:20.837812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:20.845679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a8d7783-4927-4d34-b833-18d89376dc1b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1683 microversion: 2.1 time: 0.414900 Apr 30 22:05:20.847829 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3230/6565] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:20 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1683 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:21.864711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:21.868895 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:21.871640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:21.872099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:21.872899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:21.873349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:22.011087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:22.019406 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-742c7ff2-bdfa-45d0-9604-a7bed63db382 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1679 microversion: 2.1 time: 0.159899 Apr 30 22:05:22.020053 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3336/6566] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:21 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:22.036203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-292abc06-cfa7-4b5b-877c-69d91241cfe6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:22.036762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-292abc06-cfa7-4b5b-877c-69d91241cfe6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:22.043498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-292abc06-cfa7-4b5b-877c-69d91241cfe6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:22.043969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-292abc06-cfa7-4b5b-877c-69d91241cfe6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:22.044783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-292abc06-cfa7-4b5b-877c-69d91241cfe6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:22.045244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-292abc06-cfa7-4b5b-877c-69d91241cfe6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:22.225501 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-292abc06-cfa7-4b5b-877c-69d91241cfe6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action" status: 204 len: 0 microversion: 2.1 time: 0.192875 Apr 30 22:05:22.226202 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3231/6567] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:05:22 2022] POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:05:22.234389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:22.235112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:22.241880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:22.242433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:22.243294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:22.243818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:22.405547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:22.413363 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d6db31b9-0fce-49b0-ae77-afc567e81e4f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1679 microversion: 2.1 time: 0.182857 Apr 30 22:05:22.414006 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3337/6568] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:22 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:23.432910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:23.433627 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:23.439872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:23.440346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:23.441121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:23.441579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:23.576923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:23.584497 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3b07c09a-0d8a-40c8-997b-3b13a239e82b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1679 microversion: 2.1 time: 0.156793 Apr 30 22:05:23.585070 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3232/6569] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:23 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:23.911518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-09459d0a-dd5f-4aa2-b344-e0123079c1eb req-8b4e473c-c750-475c-84b7-4bb33ff544e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf", "name": "network-vif-plugged", "status": "completed", "tag": "1647dd44-f24c-4548-bb70-863a0731ed2e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:23.920945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-09459d0a-dd5f-4aa2-b344-e0123079c1eb req-8b4e473c-c750-475c-84b7-4bb33ff544e7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:23.921398 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-09459d0a-dd5f-4aa2-b344-e0123079c1eb req-8b4e473c-c750-475c-84b7-4bb33ff544e7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:23.932601 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-09459d0a-dd5f-4aa2-b344-e0123079c1eb req-8b4e473c-c750-475c-84b7-4bb33ff544e7 service nova] Creating event network-vif-plugged:1647dd44-f24c-4548-bb70-863a0731ed2e for instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf on nch2-master-1 Apr 30 22:05:23.938353 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-09459d0a-dd5f-4aa2-b344-e0123079c1eb req-8b4e473c-c750-475c-84b7-4bb33ff544e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 Apr 30 22:05:23.938936 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3338/6570] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:05:24.601996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:24.602547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:24.609996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:24.610474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:24.611300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:24.611781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:24.737830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:24.745255 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a89c3cf-1c1e-4a7e-8ae4-1795e8188842 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1658 microversion: 2.1 time: 0.147360 Apr 30 22:05:24.745947 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3233/6571] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:24 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1658 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:24.762083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:24.762779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:24.769486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:24.769975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:24.770739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:24.771176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:24.909376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:24.917470 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4bc5096c-8f69-4fe7-9b6d-3426e7e5ee91 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1658 microversion: 2.1 time: 0.159818 Apr 30 22:05:24.918128 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3339/6572] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:24 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1658 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:24.933524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c774a281-9a18-489c-98ee-0b50ea7ec314 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:24.939571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c774a281-9a18-489c-98ee-0b50ea7ec314 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:24.940042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c774a281-9a18-489c-98ee-0b50ea7ec314 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:24.964478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c774a281-9a18-489c-98ee-0b50ea7ec314 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Going to try to start instance {{(pid=130670) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 30 22:05:25.130740 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c774a281-9a18-489c-98ee-0b50ea7ec314 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action" status: 202 len: 0 microversion: 2.1 time: 0.200883 Apr 30 22:05:25.131367 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3234/6573] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:05:24 2022] POST /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:05:25.140837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:25.141530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:25.150016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:25.150482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:25.151802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:25.152577 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:25.292476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:25.300006 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6e067c66-de83-45c4-843a-952bd51456d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1667 microversion: 2.1 time: 0.163765 Apr 30 22:05:25.300586 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3340/6574] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:25 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:26.319453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:26.320173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:26.326813 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:26.327288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:26.328083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:26.328545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:26.463599 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:26.471926 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1f1aebf4-84e1-4870-8f9a-b01776704f9c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1667 microversion: 2.1 time: 0.158635 Apr 30 22:05:26.472501 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3235/6575] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:26 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:27.489283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:27.489936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:27.496770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:27.497252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:27.498029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:27.498477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:27.629440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:27.637227 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-87973d94-1d61-466e-b88f-d45b59b2a5b3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1671 microversion: 2.1 time: 0.151919 Apr 30 22:05:27.637824 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3341/6576] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:27 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:27.653958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:27.654989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:27.661747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:27.662245 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:27.663032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:27.663485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:27.687631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:05:27.939654 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98b5821e-47c7-4d3d-a0db-e1c9f515357d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 204 len: 0 microversion: 2.1 time: 0.289344 Apr 30 22:05:27.940498 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3236/6577] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:05:27 2022] DELETE /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:05:27.948403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:27.949056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:27.955612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:27.956073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:27.956871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:27.957302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:28.086457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:28.093797 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f0af399-7eb9-4f71-92d3-28c2a71c7145 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1677 microversion: 2.1 time: 0.149214 Apr 30 22:05:28.094377 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3342/6578] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:27 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:29.112013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:29.112855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:29.119681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:29.120163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:29.120958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:29.121418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:29.277981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:29.285568 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e61b465-da3f-4d36-adca-9be72df9979a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1677 microversion: 2.1 time: 0.178351 Apr 30 22:05:29.286190 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3237/6579] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:29 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:30.167071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-dab3b036-d734-4517-910f-32c549986774 req-0b15028c-d332-40d4-8139-1795f0805cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf", "name": "network-vif-deleted", "tag": "1647dd44-f24c-4548-bb70-863a0731ed2e"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:30.176021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dab3b036-d734-4517-910f-32c549986774 req-0b15028c-d332-40d4-8139-1795f0805cee service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:30.176508 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-dab3b036-d734-4517-910f-32c549986774 req-0b15028c-d332-40d4-8139-1795f0805cee service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:30.187831 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-dab3b036-d734-4517-910f-32c549986774 req-0b15028c-d332-40d4-8139-1795f0805cee service nova] Creating event network-vif-deleted:1647dd44-f24c-4548-bb70-863a0731ed2e for instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf on nch2-master-1 Apr 30 22:05:30.192839 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-dab3b036-d734-4517-910f-32c549986774 req-0b15028c-d332-40d4-8139-1795f0805cee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029699 Apr 30 22:05:30.193675 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3343/6580] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:05:30.305051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:30.305686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:30.313983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:30.314608 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:30.315633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:30.316299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:30.387692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:30.397374 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5f588542-ecc5-4e59-8be0-d349230ce36c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 200 len: 1324 microversion: 2.1 time: 0.097385 Apr 30 22:05:30.415020 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3238/6581] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:30 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 1324 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:31.416505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:31.417222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:31.423617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:31.424081 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:31.424870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:31.425320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:31.438626 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. Apr 30 22:05:31.439229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:05:31.440096 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5a30485c-e09b-4d53-9633-8084ef14140f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 404 len: 111 microversion: 2.1 time: 0.028741 Apr 30 22:05:31.440628 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3344/6582] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:31 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:05:31.460125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:31.460770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:31.468340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:31.472712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:31.472712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:31.472712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:31.484034 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. Apr 30 22:05:31.484749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:05:31.485688 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1b98f32e-6aa5-45be-92f6-dcb5124495d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 404 len: 111 microversion: 2.1 time: 0.029461 Apr 30 22:05:31.486275 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3239/6583] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:31 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 22:05:31.536928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1400456916", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "802fca98-979c-4c01-80ef-f6f7a1aef1e2"}], "security_groups": [{"name": "tempest-securitygroup--1332427744"}], "key_name": "tempest-keypair-2017920746", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:31.637040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] validate_networks() for [('802fca98-979c-4c01-80ef-f6f7a1aef1e2', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:05:32.001439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:05:32.001935 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:05:32.002431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:05:32.002855 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:05:32.003278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:05:32.012660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:32.013708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:32.014559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:32.015002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:32.034806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:05:32.040009 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:05:32.053138 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:05:32.055456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:05:32.163820 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8ab96444-e5ef-46cd-a91c-bbd05de2315a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.630914 Apr 30 22:05:32.164470 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3345/6584] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:05:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:05:32.175563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7d107753-519e-4bbd-89ed-90497df35cad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:32.176211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7d107753-519e-4bbd-89ed-90497df35cad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:32.228387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7d107753-519e-4bbd-89ed-90497df35cad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:32.235683 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7d107753-519e-4bbd-89ed-90497df35cad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1239 microversion: 2.1 time: 0.064319 Apr 30 22:05:32.236260 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3240/6585] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:32 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:05:33.253719 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:33.254392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:33.264590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:33.265050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:33.265896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:33.266440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:33.327734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:33.335156 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-47a6c5b7-bf6c-4684-9d88-bdfc506842d5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1235 microversion: 2.1 time: 0.086238 Apr 30 22:05:33.335744 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3346/6586] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:33 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:34.352616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:34.353279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:34.366305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:34.367217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:34.368674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:34.369512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:34.447611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:34.455567 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d43297ad-8336-4519-876c-a87329b7872c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1297 microversion: 2.1 time: 0.106938 Apr 30 22:05:34.456142 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3241/6587] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:34 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:35.475122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:35.475122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:35.482725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:35.483474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:35.484668 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:35.485125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:35.641166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:35.648839 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b41a5141-97b3-45dd-8513-c0cc28172734 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1365 microversion: 2.1 time: 0.179348 Apr 30 22:05:35.649430 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3347/6588] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:35 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:35.685825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-814d7c5e-55b2-4022-bba2-108c4b88fa1a req-1181b8f7-91b5-4ba5-ac78-03a0caf54a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:35.694723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-814d7c5e-55b2-4022-bba2-108c4b88fa1a req-1181b8f7-91b5-4ba5-ac78-03a0caf54a04 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:35.695186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-814d7c5e-55b2-4022-bba2-108c4b88fa1a req-1181b8f7-91b5-4ba5-ac78-03a0caf54a04 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:35.709487 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-814d7c5e-55b2-4022-bba2-108c4b88fa1a req-1181b8f7-91b5-4ba5-ac78-03a0caf54a04 service nova] Creating event network-changed:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch1-master-1 Apr 30 22:05:35.711818 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-814d7c5e-55b2-4022-bba2-108c4b88fa1a req-1181b8f7-91b5-4ba5-ac78-03a0caf54a04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029678 Apr 30 22:05:35.712543 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3242/6589] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:05:36.666706 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:36.667365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:36.674773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:36.675178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:36.675952 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:36.676399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:36.807901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:36.815897 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2799fc78-9ba7-4889-894e-9b41c892a8a8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1365 microversion: 2.1 time: 0.153185 Apr 30 22:05:36.816462 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3348/6590] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:36 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:37.834437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:37.835157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:37.841957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:37.842433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:37.843223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:37.843685 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:37.972279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:37.979633 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82e24b65-3221-4e86-a82d-abc7ea49dbf4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1365 microversion: 2.1 time: 0.150321 Apr 30 22:05:37.980200 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3243/6591] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:37 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:39.000859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:39.001559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:39.008437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:39.013061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:39.013061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:39.013061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:39.141576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:39.149151 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e4b067e9-844e-4088-8deb-48344857f94d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1365 microversion: 2.1 time: 0.153019 Apr 30 22:05:39.149733 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3349/6592] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:38 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:40.166754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:40.167233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:40.174782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:40.175260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:40.176063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:40.176526 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:40.306478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:40.313782 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9ae6598e-1e5e-4479-9094-0e4c96bfbb59 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1365 microversion: 2.1 time: 0.151280 Apr 30 22:05:40.314378 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3244/6593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:40 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:41.331147 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:41.331799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:41.338642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:41.339097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:41.339864 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:41.340303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:41.480957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:41.482633 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ea99bd1-67b1-4216-823c-b4e9c25d8efa tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1365 microversion: 2.1 time: 0.155433 Apr 30 22:05:41.483215 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3350/6594] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:41 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:42.093053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-54acfaf3-cb0c-4057-b05d-81a2241a702a req-bc9bf007-f344-4821-8faa-53144a77b26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "name": "network-vif-plugged", "status": "completed", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:42.102112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-54acfaf3-cb0c-4057-b05d-81a2241a702a req-bc9bf007-f344-4821-8faa-53144a77b26d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:42.102582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-54acfaf3-cb0c-4057-b05d-81a2241a702a req-bc9bf007-f344-4821-8faa-53144a77b26d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:42.113590 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-54acfaf3-cb0c-4057-b05d-81a2241a702a req-bc9bf007-f344-4821-8faa-53144a77b26d service nova] Creating event network-vif-plugged:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch1-master-1 Apr 30 22:05:42.118741 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-54acfaf3-cb0c-4057-b05d-81a2241a702a req-bc9bf007-f344-4821-8faa-53144a77b26d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029935 Apr 30 22:05:42.119364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3245/6595] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:05:42.500736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:42.501491 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:42.508549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:42.509065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:42.509886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:42.510605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:42.638120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:42.645455 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-45c0982d-2993-4be5-9f25-1ee4445ba031 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1365 microversion: 2.1 time: 0.149216 Apr 30 22:05:42.646059 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3351/6596] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:42 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:43.663558 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:43.664441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:43.672110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:43.672580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:43.673370 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:43.673889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:43.812712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:43.820194 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-456bb426-ebbf-47dd-8bbc-70f33116f7a3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1552 microversion: 2.1 time: 0.160989 Apr 30 22:05:43.820769 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3246/6597] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:43 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:05:43.837026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4163a63c-4c26-4d7a-abaa-a3123275d829 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:43.837543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4163a63c-4c26-4d7a-abaa-a3123275d829 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:43.844791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4163a63c-4c26-4d7a-abaa-a3123275d829 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:43.845244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4163a63c-4c26-4d7a-abaa-a3123275d829 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:43.846036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4163a63c-4c26-4d7a-abaa-a3123275d829 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:43.846477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4163a63c-4c26-4d7a-abaa-a3123275d829 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:43.924382 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4163a63c-4c26-4d7a-abaa-a3123275d829 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091290 Apr 30 22:05:43.925042 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3352/6598] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 22:05:43 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:05:45.269736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:45.270863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:45.272849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-050b4fac-3e42-4f42-8a76-91b0d228968a req-b9174147-829f-4d6b-92b8-5c737bdb8b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:05:45.283989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-050b4fac-3e42-4f42-8a76-91b0d228968a req-b9174147-829f-4d6b-92b8-5c737bdb8b81 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:45.284667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-050b4fac-3e42-4f42-8a76-91b0d228968a req-b9174147-829f-4d6b-92b8-5c737bdb8b81 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:45.285898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:45.286646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:45.287465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:45.287930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:45.297128 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-050b4fac-3e42-4f42-8a76-91b0d228968a req-b9174147-829f-4d6b-92b8-5c737bdb8b81 service nova] Creating event network-changed:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch1-master-1 Apr 30 22:05:45.302380 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-050b4fac-3e42-4f42-8a76-91b0d228968a req-b9174147-829f-4d6b-92b8-5c737bdb8b81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034222 Apr 30 22:05:45.303060 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3353/6599] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:05:45.318188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:45.324302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Old instance type m1.heat2, new instance type m1.heat {{(pid=130670) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:05:45.330892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:05:45.331369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:05:45.331874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:05:45.332313 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:05:45.332753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:05:45.532498 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d650a48-81a6-479f-a441-f6e1f81ebfcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe/action" status: 202 len: 0 microversion: 2.1 time: 0.267061 Apr 30 22:05:45.533915 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3247/6600] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:05:45 2022] POST /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:05:45.547738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:45.547738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:45.550221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:45.550683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:45.551714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:45.552338 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:45.777881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:45.787843 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-667b89f5-3114-4986-aaa6-be1402b409ad tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1561 microversion: 2.1 time: 0.249713 Apr 30 22:05:45.792584 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3354/6601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:45 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1561 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:46.806931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:46.807569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:46.814085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:46.814559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:46.815377 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:46.815815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:46.949970 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:46.958361 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0c528e51-8086-41da-b28b-132afc47ca08 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1680 microversion: 2.1 time: 0.156482 Apr 30 22:05:46.958934 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3248/6602] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:46 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:47.976315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:47.977000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:47.984547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:47.985014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:47.985830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:47.986284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:48.166801 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:48.174935 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-411a5c71-c3f5-4dea-9b52-57e81c0876ac tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1680 microversion: 2.1 time: 0.202672 Apr 30 22:05:48.175526 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3355/6603] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:47 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:49.193505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:49.194175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:49.201102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:49.202163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:49.203489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:49.203952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:49.350381 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:49.360059 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-95341f90-ceab-459f-a935-e5150643eb8d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.170529 Apr 30 22:05:49.360647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3249/6604] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:49 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:50.378344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:50.378966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:50.386052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:50.386510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:50.387288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:50.387728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:50.523066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:50.535257 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8b67d136-8f1e-4d01-8816-56091df28001 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.157346 Apr 30 22:05:50.535257 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3356/6605] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:50 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:51.549261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:51.549924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:51.556925 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:51.557398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:51.558213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:51.558671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:51.687825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:51.695278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ed3515fb-55f4-42eb-a685-4ff18a05fd1f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.150746 Apr 30 22:05:51.695853 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3250/6606] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:51 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:52.712599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:52.713225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:52.720119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:52.720578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:52.721360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:52.721828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:52.859578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:52.867421 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8ce2d93-7dfd-4e41-b6df-76b7bc3f35ff tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.158696 Apr 30 22:05:52.868086 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3357/6607] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:52 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:53.885424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:53.886095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:53.893541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:53.894056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:53.894860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:53.895323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:54.021422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:54.028848 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f67063df-5f13-422f-b14e-fb85fcb6dc0d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.147663 Apr 30 22:05:54.029448 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3251/6608] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:53 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:55.046268 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:55.046893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:55.053974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:55.054504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:55.055238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:55.055685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:55.187346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:55.194884 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-88367326-6556-4525-b7b8-fca75626e5f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.152693 Apr 30 22:05:55.195459 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3358/6609] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:55 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:56.212566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:56.213202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:56.220653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:56.221126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:56.221946 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:56.222409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:56.351751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:56.359292 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e046cee4-039f-4b03-a23b-20e979187fcc tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.150779 Apr 30 22:05:56.359861 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3252/6610] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:56 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:57.377150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:57.377925 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:57.386631 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:57.387084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:57.387860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:57.388301 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:57.517573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:57.525248 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5dab9b95-ef2d-40b7-a9bc-46d3931a57b6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.152593 Apr 30 22:05:57.525845 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3359/6611] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:57 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:58.543096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:58.543691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:58.550834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:58.551305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:58.552093 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:58.552552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:58.685635 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:58.693712 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-46186184-b3b5-420e-a4cc-ebfcff529887 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.154902 Apr 30 22:05:58.694321 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3253/6612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:58 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:05:59.711556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:05:59.712233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:05:59.719174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:59.719636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:59.720410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:05:59.720854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:05:59.848442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:05:59.856170 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a51366e9-5208-4a92-8224-871b5cdc4af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.148528 Apr 30 22:05:59.856744 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3360/6613] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:05:59 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:00.873743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:00.874428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:00.881718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:00.882219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:00.883030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:00.883483 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:01.015062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:01.023171 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ccc78c32-01ad-4920-97e7-2b3acf63927c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.153358 Apr 30 22:06:01.023749 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3254/6614] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:00 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:06:02.040497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:02.041096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:02.047239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:02.048233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:02.049007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:02.049448 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:02.177776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:02.185225 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d73a12e2-c548-4b06-93cd-3617e2a60f5b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.148759 Apr 30 22:06:02.185864 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3361/6615] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:02 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:03.203327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:03.204547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:03.210661 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:03.211131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:03.211911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:03.212366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:03.341859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:03.349292 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad80e6fe-bb0a-43f6-abcb-5f8b8f89cdb5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.150274 Apr 30 22:06:03.349881 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3255/6616] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:03 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:04.366533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:04.367188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:04.374217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:04.374679 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:04.376058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:04.376523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:04.505827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:04.513658 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-74017ee9-67be-474a-883c-e671fcf60647 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.151049 Apr 30 22:06:04.514263 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3362/6617] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:04 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:05.531010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:05.531582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:05.538930 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:05.539405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:05.540196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:05.540658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:05.667496 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:05.675654 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4be38993-4a7e-4825-ba22-8378d9f7b611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.148703 Apr 30 22:06:05.676227 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3256/6618] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:05 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:06.692767 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:06.693392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:06.700330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:06.700786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:06.701565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:06.702049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:06.832534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:06.839968 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-304b374d-386f-4b27-b368-ff1b655edc47 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.151212 Apr 30 22:06:06.840542 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3363/6619] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:06 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:06:07.856410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:07.857049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:07.863961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:07.864435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:07.865255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:07.865715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:07.994371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:08.001988 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cff6648f-2dee-4ba7-a873-b720f9647c5e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.149483 Apr 30 22:06:08.004057 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3257/6620] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:07 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:09.020562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:09.021172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:09.028017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:09.028473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:09.029252 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:09.029699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:09.163331 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:09.170907 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-060b1721-6bc5-4670-995c-686c93e0db11 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.154905 Apr 30 22:06:09.171492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3364/6621] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:09 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:10.187351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:10.187989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:10.194834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:10.195311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:10.196109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:10.196574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:10.324116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:10.332173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-459f6c6c-63b1-4360-8ced-1d94b97452b2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.148370 Apr 30 22:06:10.332750 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3258/6622] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:10 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:11.349221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:11.349879 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:11.356678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:11.357158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:11.357972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:11.358414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:11.486244 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:11.493831 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9bf770a4-159b-4c36-b8b6-292a5985baea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.148442 Apr 30 22:06:11.494428 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3365/6623] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:11 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:12.512282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:12.512914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:12.520458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:12.520940 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:12.521763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:12.522321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:12.653008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:12.661066 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab37ab4f-2d86-49ba-bc70-06d3bca085e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.153086 Apr 30 22:06:12.661656 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3259/6624] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:12 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:13.679031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:13.679572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:13.686426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:13.686880 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:13.687650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:13.688089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:13.814043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:13.821386 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9e87f520-30ba-4c5e-980e-2bc02514eb43 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.147000 Apr 30 22:06:13.821982 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3366/6625] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:13 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:14.838749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:14.839396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:14.846215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:14.846691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:14.848182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:14.848643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:14.990887 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:14.998241 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e1a558ab-efe0-4068-b20c-ba100b898e75 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.163500 Apr 30 22:06:14.998819 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3260/6626] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:14 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:16.015289 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:16.015914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:16.022802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:16.023263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:16.024043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:16.024488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:16.155052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:16.163375 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b081d5a-72ab-4890-96b8-630f309393c8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.152024 Apr 30 22:06:16.163970 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3367/6627] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:16 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:17.180047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:17.180667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:17.187517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:17.187985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:17.188768 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:17.189224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:17.319654 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:17.327301 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-345d4b7a-bd05-42ec-a159-fee8c639da00 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.151161 Apr 30 22:06:17.327902 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3261/6628] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:17 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:18.344820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:18.345505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:18.352475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:18.352940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:18.353716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:18.354197 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:18.481430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:18.489431 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e2507ab5-5659-47cd-aa45-671cb14d5fd3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.148551 Apr 30 22:06:18.490064 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3368/6629] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:18 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:19.506657 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:19.507306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:19.514786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:19.515258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:19.516153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:19.516620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:19.643350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:19.651377 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-74737372-7fa3-430f-af54-0b2829b830d8 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.148711 Apr 30 22:06:19.651953 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3262/6630] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:19 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:20.668593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:20.669253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:20.676686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:20.677146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:20.678000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:20.678462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:20.808180 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:20.816383 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-824e7a00-821f-4e98-b3e7-c9693a3c5ac2 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1685 microversion: 2.1 time: 0.151669 Apr 30 22:06:20.816977 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3369/6631] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:20 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:21.421384 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-afa88700-80fa-44d4-81af-1915750d884f req-a109509a-cbfd-4d61-aa45-9b53004b6f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "name": "network-vif-unplugged", "status": "completed", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:21.438857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-afa88700-80fa-44d4-81af-1915750d884f req-a109509a-cbfd-4d61-aa45-9b53004b6f74 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:21.438857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-afa88700-80fa-44d4-81af-1915750d884f req-a109509a-cbfd-4d61-aa45-9b53004b6f74 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:21.444479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-afa88700-80fa-44d4-81af-1915750d884f req-a109509a-cbfd-4d61-aa45-9b53004b6f74 service nova] Creating event network-vif-unplugged:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch2-master-1 Apr 30 22:06:21.450133 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-afa88700-80fa-44d4-81af-1915750d884f req-a109509a-cbfd-4d61-aa45-9b53004b6f74 service nova] Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:06:21.461539 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-afa88700-80fa-44d4-81af-1915750d884f req-a109509a-cbfd-4d61-aa45-9b53004b6f74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044137 Apr 30 22:06:21.466527 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3263/6632] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:21.833547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:21.834292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:21.843000 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:21.843785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:21.845146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:21.845853 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:22.027490 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:22.035542 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1306893-8b21-4ee3-b321-9f068d1c387d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1684 microversion: 2.1 time: 0.205941 Apr 30 22:06:22.036131 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3370/6633] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:21 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1684 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:23.055415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:23.056063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:23.062334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:23.062811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:23.063616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:23.064082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:23.192157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:23.199806 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-84843f96-ee71-4e81-bca8-86da29df7a4a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1682 microversion: 2.1 time: 0.149977 Apr 30 22:06:23.200393 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3264/6634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:23 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:23.476038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-78d8a4bb-e985-433c-979f-3761bdb59966 req-c0a8ad7e-229a-4fc1-8e44-3a338f1b00a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:23.485001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-78d8a4bb-e985-433c-979f-3761bdb59966 req-c0a8ad7e-229a-4fc1-8e44-3a338f1b00a7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:23.485456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-78d8a4bb-e985-433c-979f-3761bdb59966 req-c0a8ad7e-229a-4fc1-8e44-3a338f1b00a7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:23.499866 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-78d8a4bb-e985-433c-979f-3761bdb59966 req-c0a8ad7e-229a-4fc1-8e44-3a338f1b00a7 service nova] Creating event network-changed:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch2-master-1 Apr 30 22:06:23.505626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-78d8a4bb-e985-433c-979f-3761bdb59966 req-c0a8ad7e-229a-4fc1-8e44-3a338f1b00a7 service nova] Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:06:23.516658 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-78d8a4bb-e985-433c-979f-3761bdb59966 req-c0a8ad7e-229a-4fc1-8e44-3a338f1b00a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044403 Apr 30 22:06:23.517328 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3371/6635] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:24.218153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:24.218716 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:24.228010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:24.228487 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:24.229308 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:24.229801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:24.735538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:24.743010 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2542a20f-fecd-4a49-a151-13b80a15c530 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1682 microversion: 2.1 time: 0.529174 Apr 30 22:06:24.743587 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3265/6636] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:24 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1682 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:25.761930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:25.762652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:25.768991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:25.770070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:25.770884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:25.771318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:25.898072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:25.905460 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8f56371-b971-450f-943f-390e1fc64c1c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1679 microversion: 2.1 time: 0.148986 Apr 30 22:06:25.906072 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3372/6637] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:25 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:25.921667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:25.922256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:25.929412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:25.929921 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:25.930698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:25.931153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:25.970071 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:25.970538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:25.971355 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:25.971812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:25.991781 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:06:25.999203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:06:26.365614 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3502682d-d66c-4e12-83c7-130b3389d2da tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe/action" status: 202 len: 0 microversion: 2.1 time: 0.447624 Apr 30 22:06:26.366280 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3266/6638] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:06:25 2022] POST /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:06:26.374447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:26.375068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:26.381237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:26.381696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:26.382502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:26.382940 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:26.549567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:26.558493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d93cf64e-177a-4dce-8854-ad7fc2d14611 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1678 microversion: 2.1 time: 0.187874 Apr 30 22:06:26.561825 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3373/6639] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:26 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:27.577194 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:27.577956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:27.584328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:27.584835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:27.585626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:27.586117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:27.717322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:27.724708 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f459c7a3-9168-4055-9625-f362b71d75a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1678 microversion: 2.1 time: 0.152736 Apr 30 22:06:27.725280 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3267/6640] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:27 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:28.255504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-6f5a4df4-0bb4-48fb-b57f-13636bd013a8 req-83ee1544-2baa-4ede-807c-bd096c14a2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "name": "network-vif-plugged", "status": "completed", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:28.264567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6f5a4df4-0bb4-48fb-b57f-13636bd013a8 req-83ee1544-2baa-4ede-807c-bd096c14a2ff service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:28.266818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-6f5a4df4-0bb4-48fb-b57f-13636bd013a8 req-83ee1544-2baa-4ede-807c-bd096c14a2ff service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:28.277840 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-6f5a4df4-0bb4-48fb-b57f-13636bd013a8 req-83ee1544-2baa-4ede-807c-bd096c14a2ff service nova] Creating event network-vif-plugged:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch2-master-1 Apr 30 22:06:28.283281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-6f5a4df4-0bb4-48fb-b57f-13636bd013a8 req-83ee1544-2baa-4ede-807c-bd096c14a2ff service nova] Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:06:28.294675 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-6f5a4df4-0bb4-48fb-b57f-13636bd013a8 req-83ee1544-2baa-4ede-807c-bd096c14a2ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042932 Apr 30 22:06:28.295285 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3374/6641] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:28.742555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:28.743179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:28.750130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:28.750607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:28.751403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:28.751865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:28.881485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:28.889306 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6a6bf4e4-19b3-4cb6-a6d0-8b7480385dbb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1678 microversion: 2.1 time: 0.151004 Apr 30 22:06:28.889913 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3268/6642] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:28 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:29.908421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:29.909036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:29.915854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:29.916311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:29.917084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:29.917520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:30.119416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-979e8f9f-638d-4b0e-b00c-85ddfe257885 req-7c6575b0-4dc3-4ed7-9168-be10c9e9291b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "name": "network-vif-unplugged", "status": "completed", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:30.127608 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:30.128468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-979e8f9f-638d-4b0e-b00c-85ddfe257885 req-7c6575b0-4dc3-4ed7-9168-be10c9e9291b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:30.129519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-979e8f9f-638d-4b0e-b00c-85ddfe257885 req-7c6575b0-4dc3-4ed7-9168-be10c9e9291b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:30.136314 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f99a9d6e-df68-4596-9d48-025e4866d587 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1678 microversion: 2.1 time: 0.232985 Apr 30 22:06:30.136955 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3375/6643] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:29 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:30.142186 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-979e8f9f-638d-4b0e-b00c-85ddfe257885 req-7c6575b0-4dc3-4ed7-9168-be10c9e9291b service nova] Creating event network-vif-unplugged:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch1-master-1 Apr 30 22:06:30.148375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-979e8f9f-638d-4b0e-b00c-85ddfe257885 req-7c6575b0-4dc3-4ed7-9168-be10c9e9291b service nova] Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:06:30.159224 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-979e8f9f-638d-4b0e-b00c-85ddfe257885 req-7c6575b0-4dc3-4ed7-9168-be10c9e9291b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043466 Apr 30 22:06:30.159766 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3269/6644] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:06:31.154539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:31.155195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:31.162678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:31.163144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:31.163933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:31.164387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:31.300385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:31.307872 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-17e7011a-f9f3-4498-ab6a-f386278551fd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1678 microversion: 2.1 time: 0.157352 Apr 30 22:06:31.308444 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3376/6645] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:31 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:32.174792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-6e073b85-8cfd-4b3e-9310-89f7a7a16ac6 req-9054322b-67b8-4002-9de6-c5a2485cff8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:32.183105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6e073b85-8cfd-4b3e-9310-89f7a7a16ac6 req-9054322b-67b8-4002-9de6-c5a2485cff8d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:32.183567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-6e073b85-8cfd-4b3e-9310-89f7a7a16ac6 req-9054322b-67b8-4002-9de6-c5a2485cff8d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:32.194917 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-6e073b85-8cfd-4b3e-9310-89f7a7a16ac6 req-9054322b-67b8-4002-9de6-c5a2485cff8d service nova] Creating event network-changed:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch1-master-1 Apr 30 22:06:32.200099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-6e073b85-8cfd-4b3e-9310-89f7a7a16ac6 req-9054322b-67b8-4002-9de6-c5a2485cff8d service nova] Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:06:32.211716 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-6e073b85-8cfd-4b3e-9310-89f7a7a16ac6 req-9054322b-67b8-4002-9de6-c5a2485cff8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041937 Apr 30 22:06:32.212390 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3270/6646] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:32.324602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:32.325148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:32.331576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:32.332587 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:32.333375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:32.333848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:32.642733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:32.651109 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5cbdf4d9-703f-4476-9ec4-fdb12ce2a543 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1678 microversion: 2.1 time: 0.330477 Apr 30 22:06:32.651691 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3377/6647] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:32 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1678 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:33.669049 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:33.669722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:33.676711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:33.677179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:33.678003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:33.678459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:33.809562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:33.817639 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0e4f43aa-41b5-4ee0-b7e0-9510d7e803be tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1671 microversion: 2.1 time: 0.152961 Apr 30 22:06:33.818256 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3271/6648] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:33 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:33.834356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:33.834982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:33.841735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:33.842226 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:33.843010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:33.843457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:33.969287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:33.976872 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b2c8f4b7-43c7-4559-986a-ed10af26679b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1671 microversion: 2.1 time: 0.146986 Apr 30 22:06:33.977517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3378/6649] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:33 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:33.992864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:33.993503 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:33.999551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:34.000027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:34.000846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:34.001307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:34.124765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:34.132770 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0d792e39-2113-4ada-862d-eba88b99afca tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1671 microversion: 2.1 time: 0.143768 Apr 30 22:06:34.133349 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3272/6650] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:33 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1671 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:34.149790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:34.150310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:34.156207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:34.156659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:34.157425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:34.157899 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:34.185568 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:06:34.423888 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eac68ecd-5510-4606-baf5-5d8d2377aa05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 204 len: 0 microversion: 2.1 time: 0.277704 Apr 30 22:06:34.424487 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3379/6651] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:06:34 2022] DELETE /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 22:06:34.433815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:34.434433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:34.440891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:34.442051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:34.442973 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:34.443565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:34.575461 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:34.583876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-41d0a6a7-8159-4518-8806-9cb7368add05 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1677 microversion: 2.1 time: 0.154414 Apr 30 22:06:34.584495 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3273/6652] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:34 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:06:35.601766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:35.602409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:35.609166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:35.609624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:35.610427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:35.610871 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:35.738152 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:35.745484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d5c7138-a7af-4b2c-ae9b-65d0df16463b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1677 microversion: 2.1 time: 0.148698 Apr 30 22:06:35.746094 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3380/6653] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:35 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:36.763702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:36.764347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:36.771729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:36.772203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:36.773016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:36.773476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:37.001721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:37.009541 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-83bf899b-7faf-4e14-960a-cf564e5e4695 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1609 microversion: 2.1 time: 0.249582 Apr 30 22:06:37.010154 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3274/6654] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:36 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1609 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:37.071601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e5c4c73d-767a-4206-8014-199ca4ca378e req-7a93aab0-d381-486a-86fc-2cf45862f746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a2837f-ef58-44ff-bee5-69d47cd473fe", "name": "network-vif-deleted", "tag": "0f68ba1f-aee0-47c9-939c-aa29a31d8a58"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:37.081067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e5c4c73d-767a-4206-8014-199ca4ca378e req-7a93aab0-d381-486a-86fc-2cf45862f746 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:37.081614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e5c4c73d-767a-4206-8014-199ca4ca378e req-7a93aab0-d381-486a-86fc-2cf45862f746 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:37.092900 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e5c4c73d-767a-4206-8014-199ca4ca378e req-7a93aab0-d381-486a-86fc-2cf45862f746 service nova] Creating event network-vif-deleted:0f68ba1f-aee0-47c9-939c-aa29a31d8a58 for instance 00a2837f-ef58-44ff-bee5-69d47cd473fe on nch1-master-1 Apr 30 22:06:37.098388 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e5c4c73d-767a-4206-8014-199ca4ca378e req-7a93aab0-d381-486a-86fc-2cf45862f746 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030584 Apr 30 22:06:37.098996 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3381/6655] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:38.026833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:38.028110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:38.034934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:38.035409 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:38.036212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:38.036672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:38.068881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:38.069366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:38.069878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lazy-loading 'fault' on Instance uuid 00a2837f-ef58-44ff-bee5-69d47cd473fe {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:06:38.111390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:38.119659 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-68d1c6ae-aa27-4ec5-903a-2ca0aa0a47b7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 200 len: 1329 microversion: 2.1 time: 0.096798 Apr 30 22:06:38.120244 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3275/6656] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:38 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:39.138567 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:39.139286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:39.146274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:39.146736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:39.147523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:39.147975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:39.161237 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. Apr 30 22:06:39.161860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:06:39.162702 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab030e97-c0f5-46a0-b2df-115196eec0d3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 404 len: 111 microversion: 2.1 time: 0.029573 Apr 30 22:06:39.163234 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3382/6657] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:39 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:06:39.183405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:39.184046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:39.191332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:39.191805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:39.192598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:39.193054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:39.206279 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. Apr 30 22:06:39.207476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:06:39.208429 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ad8f7d65-28f3-4959-9937-b3a7ca1c5cfb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 404 len: 111 microversion: 2.1 time: 0.029091 Apr 30 22:06:39.208965 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3276/6658] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:39 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:06:39.252977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-485399156", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "802fca98-979c-4c01-80ef-f6f7a1aef1e2"}], "security_groups": [{"name": "tempest-securitygroup--1332427744"}], "key_name": "tempest-keypair-2017920746", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:39.357926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] validate_networks() for [('802fca98-979c-4c01-80ef-f6f7a1aef1e2', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:06:39.755626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:06:39.756056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:06:39.756537 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:06:39.756978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:06:39.757402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:06:39.766447 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:39.766904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:39.767724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:39.768169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:39.785024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:06:39.790323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:06:39.803167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:06:39.805417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:06:39.916307 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42f06089-84bc-4691-b294-5f7a9f4f6f95 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.667214 Apr 30 22:06:39.916959 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3383/6659] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:06:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:06:39.928324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8e4878d6-7187-499a-858a-e57647c913df tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:39.928989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8e4878d6-7187-499a-858a-e57647c913df tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:39.996478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8e4878d6-7187-499a-858a-e57647c913df tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:40.011640 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8e4878d6-7187-499a-858a-e57647c913df tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1238 microversion: 2.1 time: 0.085085 Apr 30 22:06:40.011640 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3277/6660] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:39 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:41.035759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:41.036412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:41.043335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:41.043819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:41.044604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:41.045055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:41.106816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:41.115244 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e5f230f1-7c2f-44c8-b601-e3ce5e94c6bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1234 microversion: 2.1 time: 0.084304 Apr 30 22:06:41.115821 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3384/6661] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:41 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:42.133266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:42.134275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:42.142115 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:42.144623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:42.144623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:42.144922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:42.220598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:42.228287 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-da1f2638-676b-4f1e-b970-d2dd152fbcf3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1296 microversion: 2.1 time: 0.099107 Apr 30 22:06:42.228858 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3278/6662] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:42 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:43.244933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:43.245559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:43.252747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:43.253991 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:43.254931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:43.255489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:43.300125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4a4b323c-6730-47f5-8cef-a3f9b104738e req-e8cc16ae-195f-4103-b7ed-4e7e6d3cd239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:43.310800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4a4b323c-6730-47f5-8cef-a3f9b104738e req-e8cc16ae-195f-4103-b7ed-4e7e6d3cd239 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:43.311280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4a4b323c-6730-47f5-8cef-a3f9b104738e req-e8cc16ae-195f-4103-b7ed-4e7e6d3cd239 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:43.324580 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4a4b323c-6730-47f5-8cef-a3f9b104738e req-e8cc16ae-195f-4103-b7ed-4e7e6d3cd239 service nova] Creating event network-changed:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch2-master-1 Apr 30 22:06:43.330592 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4a4b323c-6730-47f5-8cef-a3f9b104738e req-e8cc16ae-195f-4103-b7ed-4e7e6d3cd239 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Apr 30 22:06:43.335198 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3279/6663] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:43.527395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:43.535492 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-556b58d3-9ee3-4bfc-8d47-2ec06eb4f9e6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1364 microversion: 2.1 time: 0.293919 Apr 30 22:06:43.536082 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3385/6664] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:43 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:44.554011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:44.554659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:44.561706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:44.562215 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:44.563008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:44.563467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:44.717983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:44.726204 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fd5d27ee-007b-4461-bf9b-749ecc7d0aee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1364 microversion: 2.1 time: 0.177256 Apr 30 22:06:44.727014 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3280/6665] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:44 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:06:45.744610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:45.745224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:45.752089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:45.752545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:45.753959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:45.754403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:45.882771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:45.890346 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8430afbc-27c1-4375-be7b-51ff6708dcb1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1364 microversion: 2.1 time: 0.149675 Apr 30 22:06:45.890925 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3386/6666] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:45 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:46.907811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:46.908456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:46.915476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:46.915891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:46.916691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:46.917158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:47.044365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:47.052198 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a7d7a474-26eb-4242-bac8-e38f8c0de51d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1364 microversion: 2.1 time: 0.148387 Apr 30 22:06:47.052767 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3281/6667] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:46 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:48.070275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:48.070890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:48.077671 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:48.080430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:48.080430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:48.080430 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:48.213255 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:48.220815 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-408ebd37-0ed4-4bde-aded-b4b3447022a9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1364 microversion: 2.1 time: 0.154994 Apr 30 22:06:48.221587 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3387/6668] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:48 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:48.308711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-64f423b7-6c15-4ce6-a503-00a4a94a38d5 req-afea7ab4-c114-47c3-b21a-2847b2a80de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "name": "network-vif-plugged", "status": "completed", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:48.317445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-64f423b7-6c15-4ce6-a503-00a4a94a38d5 req-afea7ab4-c114-47c3-b21a-2847b2a80de3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:48.317944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-64f423b7-6c15-4ce6-a503-00a4a94a38d5 req-afea7ab4-c114-47c3-b21a-2847b2a80de3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:48.332358 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-64f423b7-6c15-4ce6-a503-00a4a94a38d5 req-afea7ab4-c114-47c3-b21a-2847b2a80de3 service nova] Creating event network-vif-plugged:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch2-master-1 Apr 30 22:06:48.337148 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-64f423b7-6c15-4ce6-a503-00a4a94a38d5 req-afea7ab4-c114-47c3-b21a-2847b2a80de3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Apr 30 22:06:48.337743 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3282/6669] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:49.237610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:49.238266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:49.246720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:49.247184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:49.247975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:49.248416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:49.385347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:49.392839 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1da6cfe3-ed68-4b18-b42e-28271059d30c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1364 microversion: 2.1 time: 0.159258 Apr 30 22:06:49.393414 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3388/6670] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:49 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:50.413006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:50.413751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:50.419994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:50.420448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:50.421235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:50.421690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:50.551180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:50.558927 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae952e64-5cb8-4d4b-82fd-7741b6abc759 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1550 microversion: 2.1 time: 0.151879 Apr 30 22:06:50.559498 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3283/6671] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:50 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:50.576645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fa70dd76-8b87-4bd7-be59-bfec1b28a073 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:50.577190 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fa70dd76-8b87-4bd7-be59-bfec1b28a073 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:50.586530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa70dd76-8b87-4bd7-be59-bfec1b28a073 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:50.586530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa70dd76-8b87-4bd7-be59-bfec1b28a073 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:50.586857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa70dd76-8b87-4bd7-be59-bfec1b28a073 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:50.587299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fa70dd76-8b87-4bd7-be59-bfec1b28a073 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:50.669493 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fa70dd76-8b87-4bd7-be59-bfec1b28a073 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096681 Apr 30 22:06:50.670156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3389/6672] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 22:06:50 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:51.658100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-090712d7-195e-4980-b63e-e8a01bff82ca req-906b51bb-35b8-4617-82df-cece7ae4a766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:51.668517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-090712d7-195e-4980-b63e-e8a01bff82ca req-906b51bb-35b8-4617-82df-cece7ae4a766 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:51.669184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-090712d7-195e-4980-b63e-e8a01bff82ca req-906b51bb-35b8-4617-82df-cece7ae4a766 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:51.681455 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-090712d7-195e-4980-b63e-e8a01bff82ca req-906b51bb-35b8-4617-82df-cece7ae4a766 service nova] Creating event network-changed:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch2-master-1 Apr 30 22:06:51.686796 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-090712d7-195e-4980-b63e-e8a01bff82ca req-906b51bb-35b8-4617-82df-cece7ae4a766 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032431 Apr 30 22:06:51.687932 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3284/6673] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:53.331214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:53.331874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:53.337979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:53.338440 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:53.339221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:53.339670 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:53.536236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:53.543786 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-63d4deb5-dfc3-4ab0-a2da-4ea459be31cd tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1669 microversion: 2.1 time: 0.217376 Apr 30 22:06:53.544490 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3390/6674] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:53 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1669 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:53.563186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18f0c32d-3895-4b23-9fbb-d968e889b7c0"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:53.564372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:53.570686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:53.571167 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:53.571969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:53.572436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:54.285078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726351 Apr 30 22:06:54.286658 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3285/6675] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 22:06:53 2022] POST /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:06:57.556650 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:06:57.560618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:57.564545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:57.565001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:57.566361 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:57.566861 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:57.594796 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:57.600849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Old instance type m1.heat2, new instance type m1.heat {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:06:57.607556 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:06:57.607980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:06:57.608459 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:06:57.608869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:06:57.609284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:06:57.764326 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9677865e-749f-475a-a3d9-e6e85cd4cb92 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/action" status: 202 len: 0 microversion: 2.1 time: 0.211679 Apr 30 22:06:57.764937 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3391/6676] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:06:57 2022] POST /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:06:57.774576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:57.776280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:57.782420 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:57.782837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:57.783640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:57.784637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:57.917416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:57.926026 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fafc3a03-c371-44c0-9346-e326fc2517ee tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1724 microversion: 2.1 time: 0.156559 Apr 30 22:06:57.926633 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3286/6677] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:57 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:06:58.944718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:06:58.945482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:06:58.952117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:58.952619 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:58.953383 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:06:58.953847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:06:59.085272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:06:59.093374 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-411b2f6e-e985-4a7f-88ee-c40ffb45e39a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1724 microversion: 2.1 time: 0.154057 Apr 30 22:06:59.093990 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3392/6678] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:06:58 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:07:00.110880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:00.111628 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:00.118845 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:00.119331 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:00.120143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:00.120610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:00.346470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:00.354482 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-31fcb668-f4e0-4f7b-a6c7-5a8c1f4511a5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1724 microversion: 2.1 time: 0.247570 Apr 30 22:07:00.355068 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3287/6679] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:00 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:01.371774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:01.372399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:01.379323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:01.379785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:01.380598 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:01.381050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:01.510832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:01.519369 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56388802-e0f9-4ba7-bb3a-afa2e3723e80 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.151489 Apr 30 22:07:01.519946 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3393/6680] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:01 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:02.536784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:02.537372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:02.543929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:02.551013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:02.551013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:02.551013 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:02.675337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:02.683316 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd8a7b75-d5d2-433c-b7fb-02c187cc3495 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.150775 Apr 30 22:07:02.683885 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3288/6681] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:02 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:03.700730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:03.701350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:03.708788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:03.709241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:03.710048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:03.710487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:03.841241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:03.849145 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c6c2731b-14b4-4cd2-87c9-34e103d4b62e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.152313 Apr 30 22:07:03.849713 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3394/6682] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:03 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:04.866059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:04.866690 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:04.873524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:04.874040 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:04.874832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:04.875290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:05.002120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:05.010292 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-806e78d0-3e89-4d9b-aa30-c5e905e9c169 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.148804 Apr 30 22:07:05.010856 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3289/6683] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:04 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:06.027979 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:06.028605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:06.036198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:06.036661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:06.037439 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:06.037918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:06.168597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:06.176552 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6f78a6b0-c755-4e72-84cf-1a9013e08d09 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.152539 Apr 30 22:07:06.177129 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3395/6684] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:06 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:07.193051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:07.193691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:07.200681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:07.201156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:07.202017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:07.202497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:07.329784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:07.338204 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0f205411-f933-4adb-9289-d1f1d23a4f34 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.149055 Apr 30 22:07:07.338779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3290/6685] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:07 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:08.355807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:08.356429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:08.364151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:08.364953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:08.366231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:08.367031 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:08.501547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:08.510106 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-11cb9f0c-ffc2-432b-8875-778846e8a5bf tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.158139 Apr 30 22:07:08.510695 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3396/6686] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:08 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:09.527125 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:09.527784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:09.534759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:09.535170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:09.535961 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:09.536417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:09.663290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:09.671136 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b52b8064-f4b1-45df-81bb-62d22bb1f86d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.147921 Apr 30 22:07:09.671707 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3291/6687] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:09 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:10.689176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:10.689803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:10.697260 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:10.697720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:10.698611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:10.699086 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:10.830213 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:10.838152 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca3ffc31-4bb1-4c3b-8951-4c5c7c0e9c7a tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.153286 Apr 30 22:07:10.838736 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3397/6688] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:10 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:11.855794 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:11.856438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:11.863415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:11.863891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:11.864686 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:11.865148 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:12.338053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:12.350684 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5baa8e46-cbcc-4e99-a590-e1bcc5b615d0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.498712 Apr 30 22:07:12.351297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3292/6689] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:11 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:13.367627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:13.368241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:13.375033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:13.375489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:13.376272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:13.376714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:13.505915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:13.514136 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-43186285-7e8a-4922-af93-00a88a1bb2ea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.150463 Apr 30 22:07:13.514701 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3398/6690] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:13 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:14.530453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:14.530999 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:14.537962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:14.538442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:14.539240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:14.539699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:14.668884 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:14.677421 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8ea02ba1-435c-46b5-aa30-2b322d5ab48b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.151035 Apr 30 22:07:14.678038 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3293/6691] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:14 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:15.694640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:15.695262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:15.702159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:15.702613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:15.703386 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:15.703824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:15.830860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:15.838853 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d394618-2fd4-464d-85af-61354a5e3d07 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.148185 Apr 30 22:07:15.839430 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3399/6692] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:15 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:16.855367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:16.856008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:16.862873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:16.863350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:16.864147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:16.864611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:16.998511 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:17.007109 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0a921a9f-c16f-4229-a1e3-885c82f940f5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.155742 Apr 30 22:07:17.007704 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3294/6693] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:16 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:18.024616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:18.025230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:18.032038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:18.032495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:18.034072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:18.034524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:18.161246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:18.169360 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d2677956-9dca-4194-8243-cec5d5be3f4b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.148660 Apr 30 22:07:18.169968 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3400/6694] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:18 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:19.186613 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:19.187275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:19.194706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:19.195178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:19.195972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:19.196425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:19.323219 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:19.331099 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-77cb77c3-9435-47ad-8c84-d4a0114a306f tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.148470 Apr 30 22:07:19.331715 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3295/6695] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:19 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:20.347943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:20.348566 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:20.355546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:20.356002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:20.356778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:20.357224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:20.496004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:20.506124 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5fc654dc-ff57-4f86-b002-248c829737e5 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.162059 Apr 30 22:07:20.507308 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3401/6696] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:20 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:21.524123 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:21.524709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:21.531530 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:21.532007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:21.532801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:21.533268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:21.660660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:21.668575 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ecddf467-ccf6-4483-bfc2-c9afa17a746c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.148636 Apr 30 22:07:21.669143 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3296/6697] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:21 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:22.686282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:22.686857 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:22.693675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:22.694160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:22.694936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:22.695378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:22.829696 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:22.837675 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-433f228c-2dc0-4ee9-af85-4de9cab233ef tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1729 microversion: 2.1 time: 0.155341 Apr 30 22:07:22.838284 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3402/6698] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:22 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:23.855555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:23.856297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:23.863311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:23.863789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:23.864616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:23.865092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:24.105149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:24.113087 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-712c86bb-23c5-4cef-a8f7-edde3626623e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1728 microversion: 2.1 time: 0.261598 Apr 30 22:07:24.113887 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3297/6699] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:23 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1728 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:24.215215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-02eeeead-92ed-408d-8ff8-0253fc024f6c req-42e1f87c-07b6-4337-8e15-9586b2312aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "name": "network-vif-unplugged", "status": "completed", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:24.224236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-02eeeead-92ed-408d-8ff8-0253fc024f6c req-42e1f87c-07b6-4337-8e15-9586b2312aef service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:24.225263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-02eeeead-92ed-408d-8ff8-0253fc024f6c req-42e1f87c-07b6-4337-8e15-9586b2312aef service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:24.236854 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-02eeeead-92ed-408d-8ff8-0253fc024f6c req-42e1f87c-07b6-4337-8e15-9586b2312aef service nova] Creating event network-vif-unplugged:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch1-master-1 Apr 30 22:07:24.242834 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-02eeeead-92ed-408d-8ff8-0253fc024f6c req-42e1f87c-07b6-4337-8e15-9586b2312aef service nova] Instance df2749c6-70f0-4543-9d2d-ad0da61f906a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:07:24.253744 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-02eeeead-92ed-408d-8ff8-0253fc024f6c req-42e1f87c-07b6-4337-8e15-9586b2312aef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042194 Apr 30 22:07:24.254519 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3403/6700] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:07:25.132493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:25.133395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:25.140382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:25.140868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:25.141674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:25.142169 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:25.337486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:25.345531 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5d46d2e5-a2a2-43e5-8f49-e6625f69a9a4 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1728 microversion: 2.1 time: 0.217699 Apr 30 22:07:25.346142 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3298/6701] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:25 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:26.272117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-242f7ee3-9d90-4b8e-b141-755a2fe263cc req-6784b87d-6467-4b76-86ca-7c4a436938bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:26.281366 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-242f7ee3-9d90-4b8e-b141-755a2fe263cc req-6784b87d-6467-4b76-86ca-7c4a436938bb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:26.282118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-242f7ee3-9d90-4b8e-b141-755a2fe263cc req-6784b87d-6467-4b76-86ca-7c4a436938bb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:26.295246 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-242f7ee3-9d90-4b8e-b141-755a2fe263cc req-6784b87d-6467-4b76-86ca-7c4a436938bb service nova] Creating event network-changed:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch1-master-1 Apr 30 22:07:26.301994 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-242f7ee3-9d90-4b8e-b141-755a2fe263cc req-6784b87d-6467-4b76-86ca-7c4a436938bb service nova] Instance df2749c6-70f0-4543-9d2d-ad0da61f906a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:07:26.315909 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-242f7ee3-9d90-4b8e-b141-755a2fe263cc req-6784b87d-6467-4b76-86ca-7c4a436938bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049997 Apr 30 22:07:26.315909 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3404/6702] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:07:26.362642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:26.363276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:26.372153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:26.372623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:26.373421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:26.373941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:26.678312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:26.686611 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-55db74c4-b2fd-4093-b01c-4734871bc42b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1726 microversion: 2.1 time: 0.327836 Apr 30 22:07:26.696722 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3299/6703] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:26 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1726 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:27.705901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:27.706614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:27.713313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:27.713792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:27.714583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:27.715084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:27.846977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:27.855134 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad8af4c1-8e0a-47f1-abe2-b418b558290b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1726 microversion: 2.1 time: 0.154503 Apr 30 22:07:27.855726 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3405/6704] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:27 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:28.872478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:28.873157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:28.880152 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:28.880611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:28.882064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:28.882522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:29.012450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:29.020515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47daf262-317f-4ba3-8b9a-67f2b8da765b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1726 microversion: 2.1 time: 0.152021 Apr 30 22:07:29.021108 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3300/6705] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:28 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:30.038108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:30.038730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:30.045529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:30.046028 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:30.046805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:30.047250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:30.183847 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:30.192264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac17b414-f6fc-4051-a0fa-95e629a426f1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1726 microversion: 2.1 time: 0.158587 Apr 30 22:07:30.193047 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3406/6706] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:30 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:31.209175 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:31.209901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:31.216638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.217110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.217920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.218375 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.345901 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:31.353881 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-545a3bf6-bf04-4eb9-8f2d-d91f3bfcb11d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1723 microversion: 2.1 time: 0.148672 Apr 30 22:07:31.354454 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3301/6707] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:31 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:31.370701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:31.371257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:31.378232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.378693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.379477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.379926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.417695 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.418173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.418983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.419425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.439725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:07:31.444928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Getting quotas for user 303501939f1f44069213c3ef0166497d and project 2fad6f6856db4b229be0837d3874a1f5. Resources: {'ram', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:07:31.775513 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8c75723c-a932-44ce-a2d6-e55c151a78e7 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "POST /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/action" status: 202 len: 0 microversion: 2.1 time: 0.408527 Apr 30 22:07:31.776032 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3407/6708] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:07:31 2022] POST /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 22:07:31.784241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:31.784892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:31.791006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.791479 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.792290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:31.792744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:31.966117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:31.974317 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0ec9cf25-70c4-4e52-ad8c-3d960924101c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.194055 Apr 30 22:07:31.974898 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3302/6709] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:31 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:32.993983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:32.994699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:33.001858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:33.002309 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:33.003071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:33.003507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:33.131348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:33.139916 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1423c930-0da5-4a93-a5c1-9e34956081fb tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.151264 Apr 30 22:07:33.140494 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3408/6710] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:32 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:34.158218 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:34.158856 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:34.165730 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:34.166237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:34.167027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:34.167488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:34.298195 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:34.306654 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e06d8f4a-aecf-426b-a01b-c957cc1b48c1 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.152579 Apr 30 22:07:34.307233 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3303/6711] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:34 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:34.575429 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-5d5c8062-b394-4b2d-baa5-11a6f8719bd3 req-1af8ec85-d1cb-4876-b97f-5c4620504447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "name": "network-vif-plugged", "status": "completed", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:34.585665 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5d5c8062-b394-4b2d-baa5-11a6f8719bd3 req-1af8ec85-d1cb-4876-b97f-5c4620504447 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:34.586148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-5d5c8062-b394-4b2d-baa5-11a6f8719bd3 req-1af8ec85-d1cb-4876-b97f-5c4620504447 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:34.598074 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-5d5c8062-b394-4b2d-baa5-11a6f8719bd3 req-1af8ec85-d1cb-4876-b97f-5c4620504447 service nova] Creating event network-vif-plugged:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch1-master-1 Apr 30 22:07:34.603458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-5d5c8062-b394-4b2d-baa5-11a6f8719bd3 req-1af8ec85-d1cb-4876-b97f-5c4620504447 service nova] Instance df2749c6-70f0-4543-9d2d-ad0da61f906a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:07:34.614088 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-5d5c8062-b394-4b2d-baa5-11a6f8719bd3 req-1af8ec85-d1cb-4876-b97f-5c4620504447 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042351 Apr 30 22:07:34.615024 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3409/6712] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:07:34.794966 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:07:34.795225 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:07:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:07:35.323958 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:35.324699 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:35.331754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:35.333468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:35.333468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:35.334263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:35.465190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:35.473604 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2e9c12f3-dfdc-4946-a0e9-1a45ef0e3f8c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.153724 Apr 30 22:07:35.474741 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3304/6713] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:35 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:36.248616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a5395136-030d-4882-8273-fe71b3f8633b req-f1e88cd2-411e-4a75-a255-9e68a7c47a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "name": "network-vif-unplugged", "status": "completed", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:36.258026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a5395136-030d-4882-8273-fe71b3f8633b req-f1e88cd2-411e-4a75-a255-9e68a7c47a33 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:36.258475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a5395136-030d-4882-8273-fe71b3f8633b req-f1e88cd2-411e-4a75-a255-9e68a7c47a33 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:36.270520 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a5395136-030d-4882-8273-fe71b3f8633b req-f1e88cd2-411e-4a75-a255-9e68a7c47a33 service nova] Creating event network-vif-unplugged:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch2-master-1 Apr 30 22:07:36.276736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-a5395136-030d-4882-8273-fe71b3f8633b req-f1e88cd2-411e-4a75-a255-9e68a7c47a33 service nova] Instance df2749c6-70f0-4543-9d2d-ad0da61f906a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:07:36.287232 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a5395136-030d-4882-8273-fe71b3f8633b req-f1e88cd2-411e-4a75-a255-9e68a7c47a33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043682 Apr 30 22:07:36.292280 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3410/6714] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:07:36.492682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:36.493334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:36.500473 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:36.503101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:36.503101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:36.503101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:36.705957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:36.713990 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0329961c-9159-42d0-8610-15dda1e61e61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.226920 Apr 30 22:07:36.714572 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3305/6715] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:36 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:37.732633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:37.733349 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:37.739703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:37.740112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:37.740893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:37.741337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:37.873222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:37.881205 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c883cb5b-f362-4b1f-ab88-e4b2870d3bb3 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.153689 Apr 30 22:07:37.882004 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3411/6716] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:37 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:38.303128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a0a7b3f6-1421-4268-832f-ad7be208b369 req-d44634cd-178f-4b1a-a12a-4e1668606912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:38.311893 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a0a7b3f6-1421-4268-832f-ad7be208b369 req-d44634cd-178f-4b1a-a12a-4e1668606912 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:38.312507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a0a7b3f6-1421-4268-832f-ad7be208b369 req-d44634cd-178f-4b1a-a12a-4e1668606912 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:38.325430 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a0a7b3f6-1421-4268-832f-ad7be208b369 req-d44634cd-178f-4b1a-a12a-4e1668606912 service nova] Creating event network-changed:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch2-master-1 Apr 30 22:07:38.331883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-a0a7b3f6-1421-4268-832f-ad7be208b369 req-d44634cd-178f-4b1a-a12a-4e1668606912 service nova] Instance df2749c6-70f0-4543-9d2d-ad0da61f906a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:07:38.344499 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a0a7b3f6-1421-4268-832f-ad7be208b369 req-d44634cd-178f-4b1a-a12a-4e1668606912 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046920 Apr 30 22:07:38.345423 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3306/6717] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:07:38.898312 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:38.898953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:38.905750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:38.906237 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:38.907112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:38.907559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:39.183474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:39.192113 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20678148-4da4-4bd3-a00b-2f5826050806 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.297609 Apr 30 22:07:39.201927 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3412/6718] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:38 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:40.209835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:40.210885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:40.217592 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:40.218105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:40.218909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:40.219402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:40.352633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:40.360663 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1adba437-527f-4569-b3e9-fd22448165c0 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.155734 Apr 30 22:07:40.361239 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3307/6719] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:40 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:41.377414 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:41.378104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:41.385179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:41.385660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:41.386458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:41.386905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:41.529105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:41.537710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-502bc29c-dea6-480a-9d59-35ed52c99816 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1722 microversion: 2.1 time: 0.164136 Apr 30 22:07:41.538308 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3413/6720] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:41 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:42.556836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:42.564587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:42.564587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:42.564850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:42.565618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:42.566110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:42.695367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:42.703493 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a3a3971-de3f-4374-aa3a-5e7631441af6 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1715 microversion: 2.1 time: 0.151328 Apr 30 22:07:42.704072 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3308/6721] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:42 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:42.719612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:42.720229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:42.727595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:42.728048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:42.728816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:42.729254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:42.863406 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:42.872195 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bcece1b8-d032-43ba-96d5-c6711d6dd86b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1715 microversion: 2.1 time: 0.156395 Apr 30 22:07:42.872791 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3414/6722] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:42 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:42.899155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:42.899795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:42.905985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:42.906463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:42.907264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:42.907726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:43.034117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:43.042558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98ed95de-cbfe-4634-b531-22a9337db7f9 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1715 microversion: 2.1 time: 0.147446 Apr 30 22:07:43.043133 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3309/6723] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:42 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:43.058998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:43.059452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:43.065318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:43.065814 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:43.066600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:43.067045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:43.091498 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:07:43.411475 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 204 len: 0 microversion: 2.1 time: 0.355954 Apr 30 22:07:43.412541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3415/6724] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:07:43 2022] DELETE /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:07:43.420722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:43.422931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:43.427475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:43.427954 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:43.428751 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:43.429211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:43.562785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:43.572077 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7b509685-766d-4047-a3e3-8603bbbc1086 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1721 microversion: 2.1 time: 0.155242 Apr 30 22:07:43.572662 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3310/6725] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:43 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:44.586230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-daf3d9aa-fd12-4c13-9af2-bd1f7fabb5e7 req-f624df83-d926-4c7f-b3cf-8aa842fe2897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "name": "network-vif-plugged", "status": "completed", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:44.588476 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:44.589129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:44.595313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-daf3d9aa-fd12-4c13-9af2-bd1f7fabb5e7 req-f624df83-d926-4c7f-b3cf-8aa842fe2897 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:44.595752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-daf3d9aa-fd12-4c13-9af2-bd1f7fabb5e7 req-f624df83-d926-4c7f-b3cf-8aa842fe2897 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:44.596007 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:44.596488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:44.598140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:44.598797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:44.606592 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-daf3d9aa-fd12-4c13-9af2-bd1f7fabb5e7 req-f624df83-d926-4c7f-b3cf-8aa842fe2897 service nova] Creating event network-vif-plugged:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch2-master-1 Apr 30 22:07:44.612013 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-daf3d9aa-fd12-4c13-9af2-bd1f7fabb5e7 req-f624df83-d926-4c7f-b3cf-8aa842fe2897 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095752 Apr 30 22:07:44.615226 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3416/6726] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:07:44.735247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:44.743764 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d573d91c-ef29-4f88-86d4-6fb9f65cfaea tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1721 microversion: 2.1 time: 0.159207 Apr 30 22:07:44.744333 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3311/6727] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:44 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:07:45.763513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:45.765605 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:45.773047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:45.773496 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:45.774316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:45.774760 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:45.888741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:45.896709 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e92cf067-4046-4082-a572-c4e185ef815e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1653 microversion: 2.1 time: 0.139776 Apr 30 22:07:45.897316 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3417/6728] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:45 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1653 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:45.983725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7d48f6b9-d823-494f-b284-c13d2980c516 req-6988aabd-8c48-4153-9fb7-e83475f84341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2749c6-70f0-4543-9d2d-ad0da61f906a", "name": "network-vif-deleted", "tag": "395a0d10-0ffb-41de-9b49-1aa52f762138"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:45.994186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7d48f6b9-d823-494f-b284-c13d2980c516 req-6988aabd-8c48-4153-9fb7-e83475f84341 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:45.995626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7d48f6b9-d823-494f-b284-c13d2980c516 req-6988aabd-8c48-4153-9fb7-e83475f84341 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:46.006876 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7d48f6b9-d823-494f-b284-c13d2980c516 req-6988aabd-8c48-4153-9fb7-e83475f84341 service nova] Creating event network-vif-deleted:395a0d10-0ffb-41de-9b49-1aa52f762138 for instance df2749c6-70f0-4543-9d2d-ad0da61f906a on nch2-master-1 Apr 30 22:07:46.012477 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7d48f6b9-d823-494f-b284-c13d2980c516 req-6988aabd-8c48-4153-9fb7-e83475f84341 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032531 Apr 30 22:07:46.013446 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3312/6729] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:07:46.914219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:46.914844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:46.922456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:46.922918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:46.923721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:46.924167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:46.963426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:46.964059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:46.964532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lazy-loading 'fault' on Instance uuid df2749c6-70f0-4543-9d2d-ad0da61f906a {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:07:47.011913 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303501939f1f44069213c3ef0166497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fad6f6856db4b229be0837d3874a1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:47.020914 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d40bf32-6646-4335-bc31-e2fe139aa28b tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 200 len: 1374 microversion: 2.1 time: 0.110547 Apr 30 22:07:47.021492 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3418/6730] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:46 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 1374 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:07:48.039472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:48.040233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:48.046519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:48.046992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:48.047780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:48.048243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:48.062181 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. Apr 30 22:07:48.062792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:48.063646 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d1140939-d17a-41fc-bdc3-e1679e274184 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 404 len: 111 microversion: 2.1 time: 0.029880 Apr 30 22:07:48.064187 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3313/6731] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:48 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:48.119105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:48.120008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:48.126749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:48.127210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:48.128014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:48.128576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:48.141401 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. Apr 30 22:07:48.144193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:48.144193 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f6b9a91d-85c6-4af1-b6eb-bd37334e9261 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028860 Apr 30 22:07:48.144193 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3419/6732] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 22:07:48 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.557707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.558247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.565128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.565601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.566417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.566876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.580428 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. Apr 30 22:07:51.582491 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.582491 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d567965f-5e78-4536-8a52-922a8ac7bf30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 404 len: 111 microversion: 2.1 time: 0.028211 Apr 30 22:07:51.582491 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3314/6733] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:07:51 2022] DELETE /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.591118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.591730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: df2749c6-70f0-4543-9d2d-ad0da61f906a] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.598588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.599043 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.599818 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.600258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.615412 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. Apr 30 22:07:51.616155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance df2749c6-70f0-4543-9d2d-ad0da61f906a could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.617017 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3c3c287a-9a10-44e1-817d-ec0d158f3b30 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a" status: 404 len: 111 microversion: 2.1 time: 0.029734 Apr 30 22:07:51.617727 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3420/6734] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:51 2022] GET /compute/v2.1/servers/df2749c6-70f0-4543-9d2d-ad0da61f906a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.625638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.626254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.632237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.633822 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.634346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.634804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.649285 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. Apr 30 22:07:51.649952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.650802 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-219d03a0-54ec-425b-af38-1c9aa8548480 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 404 len: 111 microversion: 2.1 time: 0.029097 Apr 30 22:07:51.651356 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3315/6735] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:07:51 2022] DELETE /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.659464 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.660176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 00a2837f-ef58-44ff-bee5-69d47cd473fe] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.666437 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.666894 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.667678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.668119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.682123 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. Apr 30 22:07:51.682844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 00a2837f-ef58-44ff-bee5-69d47cd473fe could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.683624 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-85208fdf-20de-465c-9521-8157a62e962c tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe" status: 404 len: 111 microversion: 2.1 time: 0.028262 Apr 30 22:07:51.684156 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3421/6736] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:51 2022] GET /compute/v2.1/servers/00a2837f-ef58-44ff-bee5-69d47cd473fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 22:07:51.692217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.696223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.700234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.700707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.701507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.702118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.716840 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. Apr 30 22:07:51.717459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.718360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fe2a9bda-f6b4-4734-bb44-d7ae4f50c97e tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 404 len: 111 microversion: 2.1 time: 0.030083 Apr 30 22:07:51.720259 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3316/6737] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:07:51 2022] DELETE /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.726865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.727482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.733512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.734002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.734777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.735224 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.748577 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. Apr 30 22:07:51.749169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.750021 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-14f09177-c456-44e8-adbd-cc20ce2fbf9d tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf" status: 404 len: 111 microversion: 2.1 time: 0.026999 Apr 30 22:07:51.750551 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3422/6738] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:51 2022] GET /compute/v2.1/servers/4dbf01eb-fcfe-43f0-a2f8-31f2cbcecfaf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.759363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.759881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.765810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.766288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.767080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.767537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.783409 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. Apr 30 22:07:51.783949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.784785 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b0aca3f1-526a-447f-a4f4-76af313cac39 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 404 len: 111 microversion: 2.1 time: 0.030132 Apr 30 22:07:51.785297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3317/6739] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:07:51 2022] DELETE /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.793150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.793840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] [instance: 5d48d75b-cd66-4a03-af53-8058d68cee29] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:51.800064 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.800517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.801290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:51.801728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:51.815138 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] HTTP exception thrown: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. Apr 30 22:07:51.815726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Returning 404 to user: Instance 5d48d75b-cd66-4a03-af53-8058d68cee29 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:07:51.816540 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c40a31f-d631-41f0-ad00-925210b4fc61 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29" status: 404 len: 111 microversion: 2.1 time: 0.027306 Apr 30 22:07:51.817052 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3423/6740] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:51 2022] GET /compute/v2.1/servers/5d48d75b-cd66-4a03-af53-8058d68cee29 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:07:51.825505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ee5c8d2-5f68-404c-8475-62e01a853928 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] Calling method '.version_select at 0x7fdc20a748b0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:51.880252 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ee5c8d2-5f68-404c-8475-62e01a853928 tempest-ServerActionsTestJSON-1299757710 tempest-ServerActionsTestJSON-1299757710-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017920746" status: 202 len: 0 microversion: 2.1 time: 0.058500 Apr 30 22:07:51.880820 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3318/6741] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 22:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017920746 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:07:59.052878 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-348540950", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "51df1f06-9dd5-4520-a810-2858a49a5ae4"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:07:59.104640 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] validate_networks() for [('51df1f06-9dd5-4520-a810-2858a49a5ae4', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:07:59.446691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:07:59.447130 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:07:59.447617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:07:59.448039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:07:59.448460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:07:59.457253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:59.457720 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:59.458576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:07:59.459029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:07:59.475982 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Getting quotas for project 3f727643ff9b47fcab67ab5e3ef4db86. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:07:59.481920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Getting quotas for user 55cbd9baa3484ef492ba23f07470f7db and project 3f727643ff9b47fcab67ab5e3ef4db86. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:07:59.494177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:07:59.496460 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:07:59.635684 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-11d69a80-2153-4d7b-ada6-62d3be5328c1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700684 Apr 30 22:07:59.636615 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3424/6742] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:07:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:07:59.648468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-71a55d37-d66b-4e27-9410-5e77c9a13ee8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:07:59.649134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-71a55d37-d66b-4e27-9410-5e77c9a13ee8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:07:59.703211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-71a55d37-d66b-4e27-9410-5e77c9a13ee8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:07:59.710024 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-71a55d37-d66b-4e27-9410-5e77c9a13ee8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1216 microversion: 2.1 time: 0.067008 Apr 30 22:07:59.711472 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3319/6743] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:07:59 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:00.728800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:00.729711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:00.736788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:00.737247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:00.738085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:00.738557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:00.799941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:00.807954 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53e6d755-8f8f-4715-87c2-922979d5e02c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1220 microversion: 2.1 time: 0.084602 Apr 30 22:08:00.808524 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3425/6744] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:00 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:01.826164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:01.829518 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:01.833821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:01.834369 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:01.835266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:01.835799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:01.914870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:01.923258 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c58267a9-0458-415f-b087-9ca270da3fc7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1276 microversion: 2.1 time: 0.101377 Apr 30 22:08:01.923888 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3320/6745] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:01 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:02.940571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:02.941328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:02.948473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:02.948995 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:02.949713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:02.950183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:03.141615 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:03.149727 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dc46ec81-b82d-464a-85a9-4ff071338ad8 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1316 microversion: 2.1 time: 0.213203 Apr 30 22:08:03.150660 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3426/6746] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:02 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:03.378784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4a0449d3-04c9-4a7e-b4a4-4623a42b1e71 req-f6f3f41e-3aa5-4672-8148-cb888a1a1252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0772205-96c6-4a12-84e3-8d489d9acd23", "tag": "d4d1cc63-6ac4-4e0b-8ad2-f434007c23de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:03.388638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4a0449d3-04c9-4a7e-b4a4-4623a42b1e71 req-f6f3f41e-3aa5-4672-8148-cb888a1a1252 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:03.389108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4a0449d3-04c9-4a7e-b4a4-4623a42b1e71 req-f6f3f41e-3aa5-4672-8148-cb888a1a1252 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:03.401484 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4a0449d3-04c9-4a7e-b4a4-4623a42b1e71 req-f6f3f41e-3aa5-4672-8148-cb888a1a1252 service nova] Creating event network-changed:d4d1cc63-6ac4-4e0b-8ad2-f434007c23de for instance a0772205-96c6-4a12-84e3-8d489d9acd23 on nch1-master-1 Apr 30 22:08:03.406585 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4a0449d3-04c9-4a7e-b4a4-4623a42b1e71 req-f6f3f41e-3aa5-4672-8148-cb888a1a1252 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031842 Apr 30 22:08:03.407206 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3321/6747] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:08:04.167337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:04.167993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:04.174980 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:04.175432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:04.176202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:04.176639 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:04.308103 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:04.315403 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e101d9d3-0438-42fa-b9f0-6a6bb0f6ce82 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1316 microversion: 2.1 time: 0.152666 Apr 30 22:08:04.315974 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3427/6748] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:04 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:05.333806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:05.334531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:05.341001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:05.341508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:05.342380 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:05.342843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:05.474907 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:05.482904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f94dadc7-3503-42d6-8e11-dac7c675f27f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1316 microversion: 2.1 time: 0.154247 Apr 30 22:08:05.483471 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3322/6749] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:05 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:06.499475 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:06.500295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:06.507482 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:06.508555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:06.509344 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:06.509805 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:06.651795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:06.659432 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6831b619-6698-4240-b06a-62bfbee240ad tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1316 microversion: 2.1 time: 0.163865 Apr 30 22:08:06.665839 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3428/6750] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:06 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:07.676724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:07.677301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:07.684777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:07.685285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:07.686128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:07.686597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:07.817157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:07.824630 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1a02d52d-e681-4700-bfd3-fd6e1cd76a0a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1316 microversion: 2.1 time: 0.151963 Apr 30 22:08:07.825215 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3323/6751] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:07 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:08.699557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a38a0962-889d-4ec8-b81c-68c4feb38d1d req-ef61c00f-f1a4-4904-9a9c-4ccc03419635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0772205-96c6-4a12-84e3-8d489d9acd23", "name": "network-vif-plugged", "status": "completed", "tag": "d4d1cc63-6ac4-4e0b-8ad2-f434007c23de"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:08.708748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a38a0962-889d-4ec8-b81c-68c4feb38d1d req-ef61c00f-f1a4-4904-9a9c-4ccc03419635 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:08.709205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a38a0962-889d-4ec8-b81c-68c4feb38d1d req-ef61c00f-f1a4-4904-9a9c-4ccc03419635 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:08.720031 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a38a0962-889d-4ec8-b81c-68c4feb38d1d req-ef61c00f-f1a4-4904-9a9c-4ccc03419635 service nova] Creating event network-vif-plugged:d4d1cc63-6ac4-4e0b-8ad2-f434007c23de for instance a0772205-96c6-4a12-84e3-8d489d9acd23 on nch1-master-1 Apr 30 22:08:08.724921 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a38a0962-889d-4ec8-b81c-68c4feb38d1d req-ef61c00f-f1a4-4904-9a9c-4ccc03419635 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029679 Apr 30 22:08:08.727565 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3429/6752] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:08:08.841568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:08.842278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:08.849346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:08.849843 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:08.850640 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:08.851096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:08.987571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:08.995624 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc1353fe-0cc6-4374-98e5-0059590e2370 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1316 microversion: 2.1 time: 0.158761 Apr 30 22:08:08.996193 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3324/6753] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:08 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:10.014014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:10.014781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:10.021586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:10.022078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:10.022865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:10.023310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:10.151172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:10.158614 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d4a5b641-6e90-484a-8178-4daf0f2a2d4f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1316 microversion: 2.1 time: 0.149691 Apr 30 22:08:10.159176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3430/6754] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:10 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:11.176248 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:11.176942 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:11.183802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:11.184274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:11.185185 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:11.185650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:11.315786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:11.323772 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e2a4255-d091-4638-9825-9fa1709553c9 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1505 microversion: 2.1 time: 0.151533 Apr 30 22:08:11.324359 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3325/6755] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:11 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:11.376505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-23311446", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "51df1f06-9dd5-4520-a810-2858a49a5ae4"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:11.427920 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] validate_networks() for [('51df1f06-9dd5-4520-a810-2858a49a5ae4', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:08:11.773659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:08:11.774102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:08:11.774582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:08:11.774997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:08:11.775413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:08:11.784199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:11.784654 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:11.785469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:11.786024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:11.802335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Getting quotas for project 3f727643ff9b47fcab67ab5e3ef4db86. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:08:11.808227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Getting quotas for user 55cbd9baa3484ef492ba23f07470f7db and project 3f727643ff9b47fcab67ab5e3ef4db86. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:08:11.821085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:08:11.823385 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:08:11.944149 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d42f852-d31e-4880-99c6-aea9f72fd590 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571420 Apr 30 22:08:11.944805 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3431/6756] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:08:11.954680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-84daad62-336e-4267-9ca2-fd59f05e3283 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:11.955323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-84daad62-336e-4267-9ca2-fd59f05e3283 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:12.007859 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-84daad62-336e-4267-9ca2-fd59f05e3283 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:12.014488 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-84daad62-336e-4267-9ca2-fd59f05e3283 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1215 microversion: 2.1 time: 0.063715 Apr 30 22:08:12.015044 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3326/6757] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:11 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:13.032211 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:13.032884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:13.039656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:13.040139 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:13.040947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:13.041384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:13.101601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:13.109159 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eaff4447-b97b-46d1-9ec2-41a0e9bf5703 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1211 microversion: 2.1 time: 0.081773 Apr 30 22:08:13.109733 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3432/6758] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:13 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:14.127631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:14.128387 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:14.136636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:14.137121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:14.137955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:14.138415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:14.221882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:14.229374 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9bbb7b18-2e91-47ae-8312-4fcb18ee315c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1273 microversion: 2.1 time: 0.105730 Apr 30 22:08:14.229986 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3327/6759] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:14 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:15.246422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:15.247037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:15.253842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:15.254287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:15.255084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:15.255529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:15.439022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:15.446370 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20a6cc73-db57-4353-ba5c-227e9f303b79 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1315 microversion: 2.1 time: 0.203844 Apr 30 22:08:15.446938 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3433/6760] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:15 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:15.574684 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-825e4fe2-fafd-4f06-9380-6405bfc9fd35 req-ced8d4a9-731f-4138-b73e-943a5b36b1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1173a1-4c78-44d9-82fd-f934737b6599", "tag": "1054cddb-5ba9-491f-9958-7a16e0739abe"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:15.583805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-825e4fe2-fafd-4f06-9380-6405bfc9fd35 req-ced8d4a9-731f-4138-b73e-943a5b36b1f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:15.584303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-825e4fe2-fafd-4f06-9380-6405bfc9fd35 req-ced8d4a9-731f-4138-b73e-943a5b36b1f6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:15.597063 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-825e4fe2-fafd-4f06-9380-6405bfc9fd35 req-ced8d4a9-731f-4138-b73e-943a5b36b1f6 service nova] Creating event network-changed:1054cddb-5ba9-491f-9958-7a16e0739abe for instance 1c1173a1-4c78-44d9-82fd-f934737b6599 on nch2-master-1 Apr 30 22:08:15.602227 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-825e4fe2-fafd-4f06-9380-6405bfc9fd35 req-ced8d4a9-731f-4138-b73e-943a5b36b1f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032261 Apr 30 22:08:15.602862 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3328/6761] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:08:16.463950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:16.464581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:16.471667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:16.472125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:16.472905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:16.473351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:16.615143 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:16.622534 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-80fa3283-e825-43e9-86f9-7eb6fda33459 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1315 microversion: 2.1 time: 0.163236 Apr 30 22:08:16.623108 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3434/6762] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:16 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:17.639680 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:17.640399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:17.647395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:17.647862 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:17.649178 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:17.649634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:17.836641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:17.844206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dcf5487c-da4b-4fb5-aad7-d02205fab928 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1315 microversion: 2.1 time: 0.208784 Apr 30 22:08:17.844928 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3329/6763] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:17 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:18.860573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:18.861121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:18.868620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:18.869079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:18.869884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:18.870330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:19.039820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:19.047325 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-04784c6e-184d-4878-a938-f35a8aac2aca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1315 microversion: 2.1 time: 0.190828 Apr 30 22:08:19.047972 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3435/6764] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:18 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:20.064202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:20.064871 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:20.072260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:20.072736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:20.073532 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:20.074028 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:20.199902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:20.207341 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bc45861d-3dd3-4cf5-a9f4-7eb4cdb30e15 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1315 microversion: 2.1 time: 0.147157 Apr 30 22:08:20.207919 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3330/6765] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:20 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:20.760585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-729fd0a1-7fd4-43b7-8554-2d30667011e5 req-246c8e85-a1d3-4f00-a144-79f443ded5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1173a1-4c78-44d9-82fd-f934737b6599", "name": "network-vif-plugged", "status": "completed", "tag": "1054cddb-5ba9-491f-9958-7a16e0739abe"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:20.776185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-729fd0a1-7fd4-43b7-8554-2d30667011e5 req-246c8e85-a1d3-4f00-a144-79f443ded5e8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:20.776185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-729fd0a1-7fd4-43b7-8554-2d30667011e5 req-246c8e85-a1d3-4f00-a144-79f443ded5e8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:20.782951 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-729fd0a1-7fd4-43b7-8554-2d30667011e5 req-246c8e85-a1d3-4f00-a144-79f443ded5e8 service nova] Creating event network-vif-plugged:1054cddb-5ba9-491f-9958-7a16e0739abe for instance 1c1173a1-4c78-44d9-82fd-f934737b6599 on nch2-master-1 Apr 30 22:08:20.788326 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-729fd0a1-7fd4-43b7-8554-2d30667011e5 req-246c8e85-a1d3-4f00-a144-79f443ded5e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033420 Apr 30 22:08:20.789471 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3436/6766] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:08:21.224625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:21.225260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:21.232139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:21.232605 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:21.233399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:21.233880 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:21.359791 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:21.367744 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-126fabb9-f892-4290-a8c6-4e01aab222c4 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1315 microversion: 2.1 time: 0.146563 Apr 30 22:08:21.368692 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3331/6767] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:21 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:22.386088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:22.386802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:22.393160 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:22.393618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:22.394426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:22.394875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:22.609040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:22.616511 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-486d2dfc-7f91-45d8-afde-dc38cf0d709b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1504 microversion: 2.1 time: 0.236310 Apr 30 22:08:22.617081 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3437/6768] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:22 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:22.633043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:22.636842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:22.640534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:22.641014 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:22.642232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:22.643012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:22.669247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:08:22.941892 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-532e4dc4-854f-49a1-b5f3-e1b2ce6ff01e tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 204 len: 0 microversion: 2.1 time: 0.313174 Apr 30 22:08:22.942439 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3332/6769] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:08:22 2022] DELETE /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:08:22.951113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:22.951734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:22.957795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:22.962518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:22.962518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:22.962518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:23.092215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:23.099719 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c09fbbfe-23b2-4171-84f1-ffd290b5e4fa tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1510 microversion: 2.1 time: 0.152563 Apr 30 22:08:23.100296 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3438/6770] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:22 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:24.116927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:24.117641 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:24.124398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:24.124869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:24.125652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:24.126130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:24.444465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:24.453020 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7956ea77-5849-4ca9-8145-f2122cb3b011 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1510 microversion: 2.1 time: 0.340301 Apr 30 22:08:24.453706 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3333/6771] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:24 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:24.821519 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d229a3fc-51de-4e8a-93f3-d6028491ecc8 req-02dae5bc-bb23-4f75-a805-6b28989378e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1173a1-4c78-44d9-82fd-f934737b6599", "name": "network-vif-deleted", "tag": "1054cddb-5ba9-491f-9958-7a16e0739abe"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:24.830658 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d229a3fc-51de-4e8a-93f3-d6028491ecc8 req-02dae5bc-bb23-4f75-a805-6b28989378e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:24.831977 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d229a3fc-51de-4e8a-93f3-d6028491ecc8 req-02dae5bc-bb23-4f75-a805-6b28989378e5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:24.842903 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d229a3fc-51de-4e8a-93f3-d6028491ecc8 req-02dae5bc-bb23-4f75-a805-6b28989378e5 service nova] Creating event network-vif-deleted:1054cddb-5ba9-491f-9958-7a16e0739abe for instance 1c1173a1-4c78-44d9-82fd-f934737b6599 on nch2-master-1 Apr 30 22:08:24.848082 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d229a3fc-51de-4e8a-93f3-d6028491ecc8 req-02dae5bc-bb23-4f75-a805-6b28989378e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Apr 30 22:08:24.848723 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3439/6772] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:08:25.470279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:25.470916 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:25.477718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:25.478244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:25.479057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:25.479540 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:25.511287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:25.511764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:25.512269 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lazy-loading 'fault' on Instance uuid 1c1173a1-4c78-44d9-82fd-f934737b6599 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:08:25.553936 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:25.561477 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-87db7c8a-7067-4d63-b4c8-e64312d0aab3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 200 len: 1305 microversion: 2.1 time: 0.095175 Apr 30 22:08:25.562086 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3334/6773] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:25 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:26.581863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:26.582527 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:26.588703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.589155 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:26.589960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.590402 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:26.603846 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] HTTP exception thrown: Instance 1c1173a1-4c78-44d9-82fd-f934737b6599 could not be found. Apr 30 22:08:26.604446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Returning 404 to user: Instance 1c1173a1-4c78-44d9-82fd-f934737b6599 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:08:26.605275 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-37d09515-9f47-4af9-8b6a-45f1431759cd tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 404 len: 111 microversion: 2.1 time: 0.028682 Apr 30 22:08:26.605841 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3440/6774] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:26 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:08:26.614522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:26.615172 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:26.623855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.624326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:26.625137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.625782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:26.758789 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:26.766145 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e10bf4d9-7fe5-4cc5-bf8b-059f45412ff1 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1505 microversion: 2.1 time: 0.155596 Apr 30 22:08:26.766714 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3335/6775] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:26 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:26.782653 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c5e86de-5228-49c8-9bf6-185ff323ef9c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:26.783662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c5e86de-5228-49c8-9bf6-185ff323ef9c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 22a55b17-d3c3-48f0-9712-d5a3abe93541] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:26.788973 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5c5e86de-5228-49c8-9bf6-185ff323ef9c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] HTTP exception thrown: Instance 22a55b17-d3c3-48f0-9712-d5a3abe93541 could not be found. Apr 30 22:08:26.789550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c5e86de-5228-49c8-9bf6-185ff323ef9c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Returning 404 to user: Instance 22a55b17-d3c3-48f0-9712-d5a3abe93541 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:08:26.790401 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c5e86de-5228-49c8-9bf6-185ff323ef9c tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "POST /compute/v2.1/servers/22a55b17-d3c3-48f0-9712-d5a3abe93541/action" status: 404 len: 111 microversion: 2.1 time: 0.011709 Apr 30 22:08:26.790917 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3441/6776] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:08:26 2022] POST /compute/v2.1/servers/22a55b17-d3c3-48f0-9712-d5a3abe93541/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:08:26.799042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:26.799731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:26.806385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.806860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:26.807692 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.808183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:26.934782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:26.942235 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb9b2eb7-3ae9-48c6-88cb-f94ce837a9e6 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1505 microversion: 2.1 time: 0.147289 Apr 30 22:08:26.942824 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3336/6777] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:26 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:26.958941 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:26.959559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:26.966283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.966738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:26.967502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:26.967944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.097815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:27.105724 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-30cba62a-a74c-4e70-81fa-5cbec783adf7 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1505 microversion: 2.1 time: 0.150580 Apr 30 22:08:27.106314 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3442/6778] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:26 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:27.122336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "51369bd3-2d91-47a2-8b64-6dc3ddcf05e4"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:27.123374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:27.129282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.129780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.130579 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.131043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.158919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:27.164333 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] HTTP exception thrown: Flavor 51369bd3-2d91-47a2-8b64-6dc3ddcf05e4 could not be found. Apr 30 22:08:27.164938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Returning 400 to user: Flavor 51369bd3-2d91-47a2-8b64-6dc3ddcf05e4 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:08:27.165805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1e79e8ea-a8e5-406e-a660-872bb4de2cef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "POST /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23/action" status: 400 len: 107 microversion: 2.1 time: 0.047482 Apr 30 22:08:27.166366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3337/6779] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:08:27 2022] POST /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23/action => generated 107 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 22:08:27.174485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:27.175111 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:27.181625 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.182114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.184825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.185307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.315733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:27.323215 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-841a93b2-d26c-4155-9e99-a8cc017ccfc3 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1505 microversion: 2.1 time: 0.152584 Apr 30 22:08:27.323794 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3443/6780] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:27 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:27.340455 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:27.341097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:27.347034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.347514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.348314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.348782 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.474129 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:27.482201 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4848e989-2e84-4747-b2f1-36acac51bcfc tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1505 microversion: 2.1 time: 0.145676 Apr 30 22:08:27.486251 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3338/6781] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:27 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:27.500798 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-281663b2-a49b-47aa-9b11-6b91345969ca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:27.501969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-281663b2-a49b-47aa-9b11-6b91345969ca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:08:27.502776 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-281663b2-a49b-47aa-9b11-6b91345969ca tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "POST /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23/action" status: 400 len: 113 microversion: 2.1 time: 0.006013 Apr 30 22:08:27.503407 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3444/6782] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:08:27 2022] POST /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 22:08:27.512054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:27.513015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:27.521987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.522683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.526046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.526046 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.661982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:27.669395 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-56741d7a-e56c-4c40-afa3-ceca3569f841 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1505 microversion: 2.1 time: 0.161631 Apr 30 22:08:27.669997 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3339/6783] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:27 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:08:27.689690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:27.690235 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:27.697851 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.698317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.699100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.699549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.715376 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] HTTP exception thrown: Instance 1c1173a1-4c78-44d9-82fd-f934737b6599 could not be found. Apr 30 22:08:27.715970 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Returning 404 to user: Instance 1c1173a1-4c78-44d9-82fd-f934737b6599 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:08:27.716806 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c4b5846-45a6-4a28-9c8f-7ad3012fdb8a tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 404 len: 111 microversion: 2.1 time: 0.031974 Apr 30 22:08:27.717331 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3445/6784] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:08:27 2022] DELETE /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:08:27.725307 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:27.725994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: 1c1173a1-4c78-44d9-82fd-f934737b6599] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:27.731956 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.732439 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.733241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.733709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.747401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] HTTP exception thrown: Instance 1c1173a1-4c78-44d9-82fd-f934737b6599 could not be found. Apr 30 22:08:27.748010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Returning 404 to user: Instance 1c1173a1-4c78-44d9-82fd-f934737b6599 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:08:27.748854 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc7c840e-8b9f-4e83-99a7-20b73f28fe0f tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599" status: 404 len: 111 microversion: 2.1 time: 0.027464 Apr 30 22:08:27.749384 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3340/6785] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:27 2022] GET /compute/v2.1/servers/1c1173a1-4c78-44d9-82fd-f934737b6599 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:08:27.759545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:27.760055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:27.765996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.766455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.767234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:27.767676 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:27.792368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:08:28.067878 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-65042ed0-d0b7-49d9-bccf-171eadfc21ef tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 204 len: 0 microversion: 2.1 time: 0.314193 Apr 30 22:08:28.068480 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3446/6786] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:08:27 2022] DELETE /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:08:28.077298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:28.078008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:28.084157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:28.084636 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:28.085440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:28.085941 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:28.211990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:28.219480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7a162727-4c99-41b9-9164-be38fa79ca14 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1511 microversion: 2.1 time: 0.146146 Apr 30 22:08:28.220055 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3341/6787] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:28 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:29.237172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:29.237929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:29.245424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:29.245912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:29.246709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:29.247157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:29.379132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:29.386991 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-81e97ef9-0a26-4f66-94cd-90c37536431d tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1511 microversion: 2.1 time: 0.154162 Apr 30 22:08:29.387559 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3447/6788] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:29 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:30.110101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3f0d4d37-55cd-47db-9b83-f4332b346235 req-d9b42dd0-ec42-48f5-8e1b-57ef84b14677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0772205-96c6-4a12-84e3-8d489d9acd23", "name": "network-vif-deleted", "tag": "d4d1cc63-6ac4-4e0b-8ad2-f434007c23de"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:08:30.118396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3f0d4d37-55cd-47db-9b83-f4332b346235 req-d9b42dd0-ec42-48f5-8e1b-57ef84b14677 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:30.120076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3f0d4d37-55cd-47db-9b83-f4332b346235 req-d9b42dd0-ec42-48f5-8e1b-57ef84b14677 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:30.130205 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3f0d4d37-55cd-47db-9b83-f4332b346235 req-d9b42dd0-ec42-48f5-8e1b-57ef84b14677 service nova] Creating event network-vif-deleted:d4d1cc63-6ac4-4e0b-8ad2-f434007c23de for instance a0772205-96c6-4a12-84e3-8d489d9acd23 on nch1-master-1 Apr 30 22:08:30.135848 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3f0d4d37-55cd-47db-9b83-f4332b346235 req-d9b42dd0-ec42-48f5-8e1b-57ef84b14677 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088283 Apr 30 22:08:30.136433 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3342/6789] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:08:30.403792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:30.404418 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:30.411411 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:30.411904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:30.412681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:30.413156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:30.444005 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:30.444468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:30.445570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lazy-loading 'fault' on Instance uuid a0772205-96c6-4a12-84e3-8d489d9acd23 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:08:30.488784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55cbd9baa3484ef492ba23f07470f7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f727643ff9b47fcab67ab5e3ef4db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:08:30.496760 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ce2d3d4-f8ef-48c7-b31a-f8761433022b tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 200 len: 1306 microversion: 2.1 time: 0.096919 Apr 30 22:08:30.497339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3448/6790] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:30 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:08:31.521899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:08:31.522632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] [instance: a0772205-96c6-4a12-84e3-8d489d9acd23] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:08:31.530502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:31.530889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:31.531706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:08:31.532165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:08:31.556420 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] HTTP exception thrown: Instance a0772205-96c6-4a12-84e3-8d489d9acd23 could not be found. Apr 30 22:08:31.557102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] Returning 404 to user: Instance a0772205-96c6-4a12-84e3-8d489d9acd23 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:08:31.557973 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bb46159f-745c-4ada-8909-cc37023c7006 tempest-ServersNegativeTestJSON-526808328 tempest-ServersNegativeTestJSON-526808328-project] 10.222.0.23 "GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23" status: 404 len: 111 microversion: 2.1 time: 0.041209 Apr 30 22:08:31.558558 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3343/6791] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:08:31 2022] GET /compute/v2.1/servers/a0772205-96c6-4a12-84e3-8d489d9acd23 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:08:38.035824 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:08:38.039856 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:09:23.283503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-53846da2-35b7-47df-8b96-d158fd95eb6a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Action: 'create', calling method: .version_select at 0x7fdc13cfd670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1334138101"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:23.297408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-53846da2-35b7-47df-8b96-d158fd95eb6a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Getting quotas for project 29d93461dcdc458386181f7e31c7450b. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:09:23.302609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-53846da2-35b7-47df-8b96-d158fd95eb6a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Getting quotas for user 722d6f7c30804cfda68ac3dc86a643c5 and project 29d93461dcdc458386181f7e31c7450b. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:09:23.466310 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-53846da2-35b7-47df-8b96-d158fd95eb6a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Getting quotas for project 29d93461dcdc458386181f7e31c7450b. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:09:23.471388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-53846da2-35b7-47df-8b96-d158fd95eb6a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Getting quotas for user 722d6f7c30804cfda68ac3dc86a643c5 and project 29d93461dcdc458386181f7e31c7450b. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:09:23.485639 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-53846da2-35b7-47df-8b96-d158fd95eb6a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.206913 Apr 30 22:09:23.486306 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3449/6792] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:09:23 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:23.535702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-427774570", "imageRef": "1267beaa-1f41-4b97-bb12-5d1947600b39", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1334138101", "networks": [{"uuid": "cd92c096-925f-4a5a-a970-1747a8a99c59"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:23.587099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] validate_networks() for [('cd92c096-925f-4a5a-a970-1747a8a99c59', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:09:24.088624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:09:24.089066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:09:24.089559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:09:24.090023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:09:24.090452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:09:24.099660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:24.100126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:24.100945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:24.101399 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:24.118266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Getting quotas for project 29d93461dcdc458386181f7e31c7450b. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:09:24.123374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Getting quotas for user 722d6f7c30804cfda68ac3dc86a643c5 and project 29d93461dcdc458386181f7e31c7450b. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:09:24.135773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:09:24.138017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1267beaa-1f41-4b97-bb12-5d1947600b39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:09:24.275291 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bed90be8-7828-4810-86bb-d693433efc66 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743558 Apr 30 22:09:24.275938 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3344/6793] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:09:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:09:24.288612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-93709678-2cbf-453c-96d8-6b3d11e8649e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:24.289238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-93709678-2cbf-453c-96d8-6b3d11e8649e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:24.342384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-93709678-2cbf-453c-96d8-6b3d11e8649e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:24.350481 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-93709678-2cbf-453c-96d8-6b3d11e8649e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1258 microversion: 2.1 time: 0.068506 Apr 30 22:09:24.351247 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3450/6794] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:24 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:25.368505 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-45f36c5d-ce4d-44c5-a49a-8245ce8009e8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:25.369106 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-45f36c5d-ce4d-44c5-a49a-8245ce8009e8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:25.426287 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-45f36c5d-ce4d-44c5-a49a-8245ce8009e8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:25.433632 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-45f36c5d-ce4d-44c5-a49a-8245ce8009e8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1258 microversion: 2.1 time: 0.071136 Apr 30 22:09:25.434234 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3345/6795] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:25 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:26.451097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:26.451812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:26.459379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:26.459845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:26.460634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:26.461079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:26.545208 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:26.552799 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a53bec4-0467-4493-b41c-ac20a6ed986f tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1318 microversion: 2.1 time: 0.105684 Apr 30 22:09:26.553383 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3451/6796] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:26 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:27.571438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:27.572171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:27.579322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:27.579883 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:27.580775 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:27.581309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:27.733300 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:27.748439 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ff73eb9a-091e-4a3b-9b51-5438a98bfb06 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.181477 Apr 30 22:09:27.749508 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3346/6797] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:27 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:28.766595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:28.776959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:28.786552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:28.787175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:28.788008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:28.788529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:28.962860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:28.970440 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-41326383-48ff-447d-a8d4-d2bc63781437 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.207799 Apr 30 22:09:28.971011 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3452/6798] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:28 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:29.987481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:29.988136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:29.999777 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:30.000256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:30.001637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:30.002304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:30.145054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:30.154360 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5fed290c-beaf-4886-b294-eec59aba1e68 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.170790 Apr 30 22:09:30.160754 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3347/6799] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:29 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:31.171400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:31.172300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:31.179741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:31.180203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:31.181010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:31.181468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:31.336744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:31.344396 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5eae2550-8ae6-453b-89f8-a0a9a06417e9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.176941 Apr 30 22:09:31.344972 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3453/6800] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:31 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:32.362168 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:32.362915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:32.369073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:32.369555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:32.370403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:32.370873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:32.510438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:32.515904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02acbae2-7985-423a-bffe-ae0615ff45ea tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.157795 Apr 30 22:09:32.516475 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3348/6801] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:32 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:33.533293 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:33.533906 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:33.542077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:33.542532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:33.543683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:33.544127 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:33.682663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:33.691116 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8e3dea69-5c45-4e40-bebd-6be773955ae0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.162212 Apr 30 22:09:33.691960 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3454/6802] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:33 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:34.709416 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:34.710097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:34.717035 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:34.717512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:34.718337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:34.718808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:34.852155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:34.859596 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c722931-6ccc-4c4f-b9b6-fb2d4e2deaed tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.154723 Apr 30 22:09:34.860183 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3349/6803] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:34 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:35.877318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:35.879004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:35.887047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:35.887788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:35.888628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:35.889096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:36.063889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-bed9d8d9-43cc-4e4c-a616-a0d2e52fae68 req-c67be4b0-6958-46dd-a71d-88bde707ce51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78028a6-0c17-45a1-b741-c460472f73b6", "tag": "2fd20fa7-8697-4af1-abba-db3e79f1c1af"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:36.072063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-bed9d8d9-43cc-4e4c-a616-a0d2e52fae68 req-c67be4b0-6958-46dd-a71d-88bde707ce51 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:36.072538 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-bed9d8d9-43cc-4e4c-a616-a0d2e52fae68 req-c67be4b0-6958-46dd-a71d-88bde707ce51 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:36.083720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-bed9d8d9-43cc-4e4c-a616-a0d2e52fae68 req-c67be4b0-6958-46dd-a71d-88bde707ce51 service nova] Creating event network-changed:2fd20fa7-8697-4af1-abba-db3e79f1c1af for instance e78028a6-0c17-45a1-b741-c460472f73b6 on nch1-master-1 Apr 30 22:09:36.088768 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-bed9d8d9-43cc-4e4c-a616-a0d2e52fae68 req-c67be4b0-6958-46dd-a71d-88bde707ce51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098928 Apr 30 22:09:36.089375 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3350/6804] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:09:36.133259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:36.140625 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5fe50b2a-0cd5-4894-bfb2-3075e8fd426e tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.268121 Apr 30 22:09:36.141205 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3455/6805] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:35 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:37.159170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:37.159889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:37.166187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:37.166650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:37.167436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:37.167900 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:37.297279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:37.305305 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-98f0e485-2309-4d38-a652-1d26f7696582 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.151360 Apr 30 22:09:37.305896 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3351/6806] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:37 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:38.322388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:38.323011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:38.329826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:38.330288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:38.331066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:38.331513 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:38.459860 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:38.467263 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-59fc37a5-c3d8-4680-af2c-04e7379011e6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.148881 Apr 30 22:09:38.467843 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3456/6807] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:38 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:39.486470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:39.487180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:39.494922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:39.495405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:39.496211 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:39.496679 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:39.635302 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:39.642882 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b3aa5552-1bbf-4722-963b-26f8636c8b7d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.160353 Apr 30 22:09:39.643468 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3352/6808] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:39 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:40.660061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:40.660613 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:40.668148 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:40.668606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:40.669548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:40.670022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:40.797803 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:40.805234 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-72ad7f56-c576-49a8-9337-8ca05ff5beb4 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.149394 Apr 30 22:09:40.805819 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3457/6809] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:40 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:41.359250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-400e61f5-af1e-4570-9ce0-fadcd13591fb req-b52bce43-2bea-4949-b62c-65264db7663b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78028a6-0c17-45a1-b741-c460472f73b6", "name": "network-vif-plugged", "status": "completed", "tag": "2fd20fa7-8697-4af1-abba-db3e79f1c1af"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:41.367851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-400e61f5-af1e-4570-9ce0-fadcd13591fb req-b52bce43-2bea-4949-b62c-65264db7663b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:41.368321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-400e61f5-af1e-4570-9ce0-fadcd13591fb req-b52bce43-2bea-4949-b62c-65264db7663b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:41.379585 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-400e61f5-af1e-4570-9ce0-fadcd13591fb req-b52bce43-2bea-4949-b62c-65264db7663b service nova] Creating event network-vif-plugged:2fd20fa7-8697-4af1-abba-db3e79f1c1af for instance e78028a6-0c17-45a1-b741-c460472f73b6 on nch1-master-1 Apr 30 22:09:41.385353 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-400e61f5-af1e-4570-9ce0-fadcd13591fb req-b52bce43-2bea-4949-b62c-65264db7663b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078399 Apr 30 22:09:41.385988 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3353/6810] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:09:41.822579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:41.823196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:41.830158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:41.830618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:41.831387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:41.831830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:41.956080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:41.963942 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-42c5d9f8-ea3b-494c-959a-6d72d08e347a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1358 microversion: 2.1 time: 0.145847 Apr 30 22:09:41.964516 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3458/6811] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:41 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:42.982128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:42.982855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:42.989078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:42.989553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:42.990374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:42.990869 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:43.116733 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:43.124753 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b8d4b5f0-f895-4ec3-b353-3aa75b45da33 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1549 microversion: 2.1 time: 0.147879 Apr 30 22:09:43.125328 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3354/6812] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:42 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:43.141596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:43.142253 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:43.149106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:43.149579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:43.150378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:43.150822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:43.313647 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:43.321304 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-84abc4a6-8dbc-44b8-9c6a-9356aaedf598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1549 microversion: 2.1 time: 0.183493 Apr 30 22:09:43.321915 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3459/6813] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:43 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:43.337073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:43.340414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:43.341193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Searching by: {'deleted': False, 'project_id': '29d93461dcdc458386181f7e31c7450b'} {{(pid=130670) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 30 22:09:43.346815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:43.347283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:43.348103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:43.348557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:43.376424 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.multi_cell_list [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 30 22:09:43.403523 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8cfb34d5-3b2d-4095-b1c4-3778a49a9be8 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070333 Apr 30 22:09:43.404114 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3355/6814] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 22:09:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:09:43.414626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:43.415839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:43.421901 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:43.422441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:43.423304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:43.423838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:43.619816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:43.627423 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4ca3b0ea-6783-4db7-b15b-356a62ba6000 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1549 microversion: 2.1 time: 0.216890 Apr 30 22:09:43.628001 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3460/6815] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:43 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1549 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:45.514196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ca02fe47-20ba-4a22-bb46-edc7e865efcc tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51212ef3-353e-4630-969e-099dfb53b35d"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:45.515329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ca02fe47-20ba-4a22-bb46-edc7e865efcc tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:45.522255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca02fe47-20ba-4a22-bb46-edc7e865efcc tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:45.527735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca02fe47-20ba-4a22-bb46-edc7e865efcc tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:45.527735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca02fe47-20ba-4a22-bb46-edc7e865efcc tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:45.527735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ca02fe47-20ba-4a22-bb46-edc7e865efcc tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:46.155590 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ca02fe47-20ba-4a22-bb46-edc7e865efcc tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645489 Apr 30 22:09:46.156132 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3356/6816] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Apr 30 22:09:45 2022] POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:09:49.487996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:49.489800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:49.495560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:49.496019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:49.496823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:49.497271 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:49.641207 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:49.649155 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-adc7e3e1-5c0a-4277-83bf-b8cdd744bfc9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1595 microversion: 2.1 time: 0.165065 Apr 30 22:09:49.649720 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3461/6817] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:49 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:09:51.977454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-52a84064-9841-4523-b9ba-96fb95de0c38 req-64929d4b-54fb-4d30-ad3f-2474856bdd2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78028a6-0c17-45a1-b741-c460472f73b6", "tag": "2fd20fa7-8697-4af1-abba-db3e79f1c1af"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:51.986415 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-52a84064-9841-4523-b9ba-96fb95de0c38 req-64929d4b-54fb-4d30-ad3f-2474856bdd2a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:51.987004 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-52a84064-9841-4523-b9ba-96fb95de0c38 req-64929d4b-54fb-4d30-ad3f-2474856bdd2a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:51.999176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-52a84064-9841-4523-b9ba-96fb95de0c38 req-64929d4b-54fb-4d30-ad3f-2474856bdd2a service nova] Creating event network-changed:2fd20fa7-8697-4af1-abba-db3e79f1c1af for instance e78028a6-0c17-45a1-b741-c460472f73b6 on nch1-master-1 Apr 30 22:09:52.004597 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-52a84064-9841-4523-b9ba-96fb95de0c38 req-64929d4b-54fb-4d30-ad3f-2474856bdd2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Apr 30 22:09:52.005567 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3357/6818] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:09:54.189978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2086780826"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:54.190541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:54.197978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:54.198442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:54.199232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:54.199682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:54.325732 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.network.security_group_api [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Adding security group cfbcc134-5fa3-4a1b-ad6f-2590edd2432a to port 2fd20fa7-8697-4af1-abba-db3e79f1c1af Apr 30 22:09:54.771463 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-75f7af86-afec-4758-951f-23c7241b385b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/action" status: 202 len: 0 microversion: 2.1 time: 0.585394 Apr 30 22:09:54.773188 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3462/6819] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:09:54 2022] POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:09:54.781470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8c861c6b-e8d3-4eab-886e-fcdf85cf764e req-d62c71d6-bc84-4cba-a446-d1dacb9f4917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78028a6-0c17-45a1-b741-c460472f73b6", "tag": "2fd20fa7-8697-4af1-abba-db3e79f1c1af"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:09:54.787841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:09:54.794523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:09:54.807597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8c861c6b-e8d3-4eab-886e-fcdf85cf764e req-d62c71d6-bc84-4cba-a446-d1dacb9f4917 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:54.812988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8c861c6b-e8d3-4eab-886e-fcdf85cf764e req-d62c71d6-bc84-4cba-a446-d1dacb9f4917 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:54.813890 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:54.814356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:54.815165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:09:54.815599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:09:54.834955 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8c861c6b-e8d3-4eab-886e-fcdf85cf764e req-d62c71d6-bc84-4cba-a446-d1dacb9f4917 service nova] Creating event network-changed:2fd20fa7-8697-4af1-abba-db3e79f1c1af for instance e78028a6-0c17-45a1-b741-c460472f73b6 on nch1-master-1 Apr 30 22:09:54.846206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8c861c6b-e8d3-4eab-886e-fcdf85cf764e req-d62c71d6-bc84-4cba-a446-d1dacb9f4917 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068759 Apr 30 22:09:54.850119 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3358/6820] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:09:55.093354 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:09:55.102296 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef7c3fc0-ada7-40d0-b930-36a20563ee0a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1761 microversion: 2.1 time: 0.318019 Apr 30 22:09:55.102898 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3463/6821] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:09:54 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1761 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:17.941698 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:10:17.942311 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:10:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:10:18.635629 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e49119d6-9bf7-4c57-8287-4e884038cfdf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:10:18.636631 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e49119d6-9bf7-4c57-8287-4e884038cfdf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:18.643295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e49119d6-9bf7-4c57-8287-4e884038cfdf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:18.643796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e49119d6-9bf7-4c57-8287-4e884038cfdf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:18.644585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e49119d6-9bf7-4c57-8287-4e884038cfdf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:18.645042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e49119d6-9bf7-4c57-8287-4e884038cfdf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:18.875521 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e49119d6-9bf7-4c57-8287-4e884038cfdf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/action" status: 202 len: 0 microversion: 2.1 time: 0.244795 Apr 30 22:10:18.876169 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3359/6822] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:10:18 2022] POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:10:18.884645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:18.885276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:18.892507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:18.892891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:18.893687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:18.894173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:19.072910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:19.088042 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1ac99cfe-14fa-4f5d-9b5d-58c7b9c39292 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1753 microversion: 2.1 time: 0.207289 Apr 30 22:10:19.088668 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3464/6823] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:18 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:20.108648 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:20.109408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:20.117855 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:20.118328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:20.119111 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:20.119564 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:20.265309 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:20.273359 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-39c5461a-7b94-41cf-996f-401ccffaf0c5 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.170474 Apr 30 22:10:20.274297 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3360/6824] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:20 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:21.291413 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:21.292061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:21.301683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:21.302170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:21.302975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:21.303417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:21.452469 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:21.461218 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-cb561f51-b57b-4858-8cfc-be7ea377b175 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.173620 Apr 30 22:10:21.462611 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3465/6825] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:21 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:22.478346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:22.478967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:22.486432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:22.496971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:22.496971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:22.496971 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:22.634771 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:22.643449 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-468a6296-da51-44aa-8d9b-b154963f4124 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.169078 Apr 30 22:10:22.644013 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3361/6826] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:22 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:23.660425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:23.661052 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:23.667888 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:23.668348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:23.669128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:23.669573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:23.809680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:23.818150 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3967c60-eb95-46d8-8e72-22ad9fe53b2a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.161723 Apr 30 22:10:23.818731 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3466/6827] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:23 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:24.836108 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:24.836738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:24.844239 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:24.844708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:24.845537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:24.846016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:24.993583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:25.001605 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c4675472-0d8a-4e5f-be87-5427381965bf tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.169552 Apr 30 22:10:25.002209 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3362/6828] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:24 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:26.019245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:26.019875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:26.026835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:26.027300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:26.028089 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:26.028541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:26.171509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:26.179568 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a1354243-df7f-4e8c-9a22-19a741f0f28b tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.164210 Apr 30 22:10:26.180149 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3467/6829] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:26 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:27.196766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:27.197400 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:27.204830 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:27.205305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:27.206124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:27.206587 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:27.347171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:27.355445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d2ce1574-00fa-4ef9-aef7-f720bf26d45d tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.162583 Apr 30 22:10:27.356044 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3363/6830] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:27 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:28.373276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:28.373964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:28.381699 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:28.382187 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:28.382978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:28.383403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:28.527107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:28.535282 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-509a39b7-d0b8-47cd-815e-bfe288e7a3f6 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.165938 Apr 30 22:10:28.535806 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3468/6831] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:28 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:29.552450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:29.552994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:29.560120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:29.560328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:29.561127 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:29.561586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:29.704015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:29.711903 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e74ae09-67f5-4594-b524-bd73b0291598 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1758 microversion: 2.1 time: 0.163491 Apr 30 22:10:29.712473 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3364/6832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:29 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:10:30.728555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:10:30.729199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:10:30.736637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:30.740664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:30.740664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:10:30.740664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:10:30.883119 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:10:30.891080 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2321056b-3e36-483f-8105-31793be36ce7 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1761 microversion: 2.1 time: 0.166494 Apr 30 22:10:30.891652 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3469/6833] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:10:30 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:01.357424 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:11:01.358097 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:11:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:11:03.179157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2086780826"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:03.179761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:03.186098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:03.186565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:03.187351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:03.187804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:03.317731 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.network.security_group_api [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Removing security group cfbcc134-5fa3-4a1b-ad6f-2590edd2432a from port 2fd20fa7-8697-4af1-abba-db3e79f1c1af Apr 30 22:11:03.721865 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6e507486-bff3-42c3-ad84-4652a10a8435 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/action" status: 202 len: 0 microversion: 2.1 time: 0.546641 Apr 30 22:11:03.732150 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-17f17c70-9bd5-4021-ad9e-788c5715de02 req-e015a1e5-bfda-4247-8bc1-d2e69ea63291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78028a6-0c17-45a1-b741-c460472f73b6", "tag": "2fd20fa7-8697-4af1-abba-db3e79f1c1af"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:03.742504 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3365/6834] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:11:03 2022] POST /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:11:03.749239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-17f17c70-9bd5-4021-ad9e-788c5715de02 req-e015a1e5-bfda-4247-8bc1-d2e69ea63291 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:03.750096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-17f17c70-9bd5-4021-ad9e-788c5715de02 req-e015a1e5-bfda-4247-8bc1-d2e69ea63291 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:03.785015 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-17f17c70-9bd5-4021-ad9e-788c5715de02 req-e015a1e5-bfda-4247-8bc1-d2e69ea63291 service nova] Creating event network-changed:2fd20fa7-8697-4af1-abba-db3e79f1c1af for instance e78028a6-0c17-45a1-b741-c460472f73b6 on nch1-master-1 Apr 30 22:11:03.792143 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-17f17c70-9bd5-4021-ad9e-788c5715de02 req-e015a1e5-bfda-4247-8bc1-d2e69ea63291 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064031 Apr 30 22:11:03.793177 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3470/6835] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:11:05.521217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:05.521799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:05.527792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:05.528264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:05.529052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:05.529508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:05.612015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lazy-loading 'services' on Instance uuid e78028a6-0c17-45a1-b741-c460472f73b6 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:11:05.778942 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-223cd35b-010e-420b-8322-85b2bcf9f0f9 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments/51212ef3-353e-4630-969e-099dfb53b35d" status: 202 len: 0 microversion: 2.1 time: 0.263006 Apr 30 22:11:05.779548 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3366/6836] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 22:11:05 2022] DELETE /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments/51212ef3-353e-4630-969e-099dfb53b35d => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:11:05.789627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-16375748-0ad9-46e4-a8b2-1b1255708968 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:05.791517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-16375748-0ad9-46e4-a8b2-1b1255708968 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:05.804236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16375748-0ad9-46e4-a8b2-1b1255708968 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:05.804698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16375748-0ad9-46e4-a8b2-1b1255708968 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:05.805578 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16375748-0ad9-46e4-a8b2-1b1255708968 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:05.806073 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-16375748-0ad9-46e4-a8b2-1b1255708968 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:05.815392 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-14f8b5c6-5f5f-45f1-9abd-c8eb90b27172 req-e3e260ba-7359-413a-a75d-0be861b920fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78028a6-0c17-45a1-b741-c460472f73b6", "tag": "2fd20fa7-8697-4af1-abba-db3e79f1c1af"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:05.834262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-14f8b5c6-5f5f-45f1-9abd-c8eb90b27172 req-e3e260ba-7359-413a-a75d-0be861b920fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:05.834949 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-14f8b5c6-5f5f-45f1-9abd-c8eb90b27172 req-e3e260ba-7359-413a-a75d-0be861b920fc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:05.845747 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-16375748-0ad9-46e4-a8b2-1b1255708968 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061330 Apr 30 22:11:05.846638 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3471/6837] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 22:11:05 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:11:05.851803 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-14f8b5c6-5f5f-45f1-9abd-c8eb90b27172 req-e3e260ba-7359-413a-a75d-0be861b920fc service nova] Creating event network-changed:2fd20fa7-8697-4af1-abba-db3e79f1c1af for instance e78028a6-0c17-45a1-b741-c460472f73b6 on nch1-master-1 Apr 30 22:11:05.852854 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-14f8b5c6-5f5f-45f1-9abd-c8eb90b27172 req-e3e260ba-7359-413a-a75d-0be861b920fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041581 Apr 30 22:11:05.853672 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3367/6838] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:11:06.859238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2ed6b64c-f9f5-48e5-8365-fb2f956407f0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:06.860571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2ed6b64c-f9f5-48e5-8365-fb2f956407f0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:06.867442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed6b64c-f9f5-48e5-8365-fb2f956407f0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:06.867893 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed6b64c-f9f5-48e5-8365-fb2f956407f0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:06.868659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed6b64c-f9f5-48e5-8365-fb2f956407f0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:06.869095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2ed6b64c-f9f5-48e5-8365-fb2f956407f0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:06.898423 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2ed6b64c-f9f5-48e5-8365-fb2f956407f0 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043845 Apr 30 22:11:06.898903 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3472/6839] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 22:11:06 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 22:11:06.910408 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:06.911019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:06.917718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:06.918217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:06.919190 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:06.919647 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:06.992078 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] HTTP exception thrown: Instance e78028a6-0c17-45a1-b741-c460472f73b6 is not attached to volume 51212ef3-353e-4630-969e-099dfb53b35d Apr 30 22:11:06.992702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Returning 404 to user: Instance e78028a6-0c17-45a1-b741-c460472f73b6 is not attached to volume 51212ef3-353e-4630-969e-099dfb53b35d {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:11:06.993587 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5dbb0373-adfb-45b0-9046-9e74d0ae72ce tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments/51212ef3-353e-4630-969e-099dfb53b35d" status: 404 len: 154 microversion: 2.1 time: 0.088529 Apr 30 22:11:06.994171 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3368/6840] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Apr 30 22:11:06 2022] DELETE /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6/os-volume_attachments/51212ef3-353e-4630-969e-099dfb53b35d => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:11:11.446493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:11.447022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:11.454336 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:11.454800 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:11.455571 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:11.456012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:11.480891 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:11:11.740066 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-727023ff-79a6-42d8-a6ee-4f348f514b81 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 204 len: 0 microversion: 2.1 time: 0.297243 Apr 30 22:11:11.740656 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3473/6841] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:11:11 2022] DELETE /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:11:11.748850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:11.749488 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:11.760410 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:11.760881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:11.761719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:11.762202 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:11.888609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:11.896452 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8c142ed0-2f51-4105-92ab-41588ac79a92 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1555 microversion: 2.1 time: 0.151461 Apr 30 22:11:11.897039 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3369/6842] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:11 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:12.914590 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:12.915319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:12.925550 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:12.926030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:12.926812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:12.927258 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:13.055098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:13.062717 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d49355bc-55df-493a-969a-975c27e9826a tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1555 microversion: 2.1 time: 0.152555 Apr 30 22:11:13.063300 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3474/6843] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:12 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:14.080607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:14.081254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:14.088160 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:14.088639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:14.089494 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:14.089994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:14.271025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-86814ca4-c323-490e-bd34-9ee39022f530 req-7ced2f05-f695-4048-9ea3-ea5325c5fd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78028a6-0c17-45a1-b741-c460472f73b6", "name": "network-vif-deleted", "tag": "2fd20fa7-8697-4af1-abba-db3e79f1c1af"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:14.284275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-86814ca4-c323-490e-bd34-9ee39022f530 req-7ced2f05-f695-4048-9ea3-ea5325c5fd68 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:14.284275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-86814ca4-c323-490e-bd34-9ee39022f530 req-7ced2f05-f695-4048-9ea3-ea5325c5fd68 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:14.295151 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-86814ca4-c323-490e-bd34-9ee39022f530 req-7ced2f05-f695-4048-9ea3-ea5325c5fd68 service nova] Creating event network-vif-deleted:2fd20fa7-8697-4af1-abba-db3e79f1c1af for instance e78028a6-0c17-45a1-b741-c460472f73b6 on nch1-master-1 Apr 30 22:11:14.299637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722d6f7c30804cfda68ac3dc86a643c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d93461dcdc458386181f7e31c7450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:14.301161 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-86814ca4-c323-490e-bd34-9ee39022f530 req-7ced2f05-f695-4048-9ea3-ea5325c5fd68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Apr 30 22:11:14.301793 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3475/6844] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:11:14.308477 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-edfe6963-d213-44f8-aa39-dad0a2856150 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 200 len: 1555 microversion: 2.1 time: 0.231815 Apr 30 22:11:14.318537 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3370/6845] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:14 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:15.326307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:15.327036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] [instance: e78028a6-0c17-45a1-b741-c460472f73b6] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:15.334480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:15.338525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:15.338525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:15.338525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:15.350439 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] HTTP exception thrown: Instance e78028a6-0c17-45a1-b741-c460472f73b6 could not be found. Apr 30 22:11:15.351029 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Returning 404 to user: Instance e78028a6-0c17-45a1-b741-c460472f73b6 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:11:15.351852 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-26242257-f09c-436f-9eca-1d96a59abe40 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6" status: 404 len: 111 microversion: 2.1 time: 0.029954 Apr 30 22:11:15.352471 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3476/6846] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:15 2022] GET /compute/v2.1/servers/e78028a6-0c17-45a1-b741-c460472f73b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:11:15.360833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae5d4cd8-7274-474a-8cf5-6801a5006056 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] Calling method '.version_select at 0x7fdc207e8160>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:15.454851 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae5d4cd8-7274-474a-8cf5-6801a5006056 tempest-TestMinimumBasicScenario-597789740 tempest-TestMinimumBasicScenario-597789740-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1334138101" status: 202 len: 0 microversion: 2.1 time: 0.097849 Apr 30 22:11:15.455447 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3371/6847] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Apr 30 22:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1334138101 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:11:27.445708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1dcd312a-1917-49eb-b955-f453ae45eed9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: .version_select at 0x7fdc2041fb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1704876189"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:27.462573 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1dcd312a-1917-49eb-b955-f453ae45eed9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:11:27.468738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1dcd312a-1917-49eb-b955-f453ae45eed9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:11:27.994387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1dcd312a-1917-49eb-b955-f453ae45eed9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:11:27.999330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-1dcd312a-1917-49eb-b955-f453ae45eed9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:11:28.014447 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1dcd312a-1917-49eb-b955-f453ae45eed9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.737066 Apr 30 22:11:28.015020 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3477/6848] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:11:27 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:36.193662 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1550888749", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "9c9eda40-cc48-419c-a2f8-ad6f40d376a2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1704876189", "security_groups": [{"name": "tempest-secgroup-smoke-1736410551"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:36.337720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] validate_networks() for [('9c9eda40-cc48-419c-a2f8-ad6f40d376a2', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:11:36.779138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:11:36.779872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:11:36.780374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:11:36.780809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:11:36.781405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:11:36.797351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:36.797850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:36.798688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:36.799149 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:36.817223 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:11:36.823504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:11:36.839136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:11:36.842499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:11:36.987292 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-32851d25-6813-4cb2-9705-1489657b9867 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798182 Apr 30 22:11:36.987960 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3372/6849] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:11:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:11:37.000158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-168da0bc-f2dd-432f-8f56-49e2f79ea844 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:37.000882 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-168da0bc-f2dd-432f-8f56-49e2f79ea844 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:37.073457 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-168da0bc-f2dd-432f-8f56-49e2f79ea844 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:37.083990 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-168da0bc-f2dd-432f-8f56-49e2f79ea844 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1267 microversion: 2.1 time: 0.089216 Apr 30 22:11:37.095067 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3478/6850] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:36 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:11:38.103206 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-82aa1067-28de-45af-8d7f-436b7e125d49 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:38.103934 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-82aa1067-28de-45af-8d7f-436b7e125d49 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:38.160085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-82aa1067-28de-45af-8d7f-436b7e125d49 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:38.167389 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-82aa1067-28de-45af-8d7f-436b7e125d49 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1267 microversion: 2.1 time: 0.068191 Apr 30 22:11:38.168071 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3373/6851] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:38 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1267 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:39.184543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:39.185233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:39.193300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:39.193789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:39.194722 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:39.195177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:39.276405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:39.286763 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e682217f-a4b1-45a9-91bc-5cae8d2f3444 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1319 microversion: 2.1 time: 0.105988 Apr 30 22:11:39.287694 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3479/6852] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:39 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:40.303882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:40.304667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:40.311912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:40.312510 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:40.313796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:40.314326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:40.552181 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:40.559659 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-743b97d8-ead4-421c-addd-e34d2026b36d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.259726 Apr 30 22:11:40.560237 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3374/6853] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:40 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:41.081806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-b3ed8feb-0482-44fb-a9e4-b4c7061d95af req-8989a8ce-1c53-405c-89d9-d4f0edb5b9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81daa03d-71dc-4deb-8c9a-1df4f88f095d", "tag": "d9902372-4c37-4382-99ce-2c1efce2f541"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:41.095921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b3ed8feb-0482-44fb-a9e4-b4c7061d95af req-8989a8ce-1c53-405c-89d9-d4f0edb5b9b5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:41.096810 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-b3ed8feb-0482-44fb-a9e4-b4c7061d95af req-8989a8ce-1c53-405c-89d9-d4f0edb5b9b5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:41.111667 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-b3ed8feb-0482-44fb-a9e4-b4c7061d95af req-8989a8ce-1c53-405c-89d9-d4f0edb5b9b5 service nova] Creating event network-changed:d9902372-4c37-4382-99ce-2c1efce2f541 for instance 81daa03d-71dc-4deb-8c9a-1df4f88f095d on nch2-master-1 Apr 30 22:11:41.117609 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-b3ed8feb-0482-44fb-a9e4-b4c7061d95af req-8989a8ce-1c53-405c-89d9-d4f0edb5b9b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040278 Apr 30 22:11:41.120040 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3480/6854] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:11:41.576556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:41.577305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:41.585253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:41.585728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:41.586770 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:41.587238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:41.812283 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:41.819843 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aff59a40-2460-4810-b949-2b67375619b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.247257 Apr 30 22:11:41.820415 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3375/6855] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:41 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:42.837328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:42.838063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:42.845246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:42.845701 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:42.846998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:42.847442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:42.975405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:42.983008 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0b1cf8ca-c2c6-44a9-b677-b5c56875ff99 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.149856 Apr 30 22:11:42.983593 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3481/6856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:42 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:44.000467 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:44.001105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:44.008504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:44.008977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:44.009793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:44.010255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:44.137010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:44.144571 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a85f5a81-26cf-4298-9b8e-3d2d0657d869 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.148050 Apr 30 22:11:44.145142 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3376/6857] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:43 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:45.162661 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:45.163220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:45.170037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:45.170500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:45.171286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:45.171726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:45.307468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:45.314958 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-82cd43ea-1dfc-4f78-bd16-dad34b8e67b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.156921 Apr 30 22:11:45.319108 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3482/6858] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:45 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:46.332189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:46.332827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:46.339681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:46.340163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:46.340957 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:46.341417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:46.477468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:46.485374 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f51f6ab-a04b-4421-855f-7198e289c7bb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.157129 Apr 30 22:11:46.485996 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3377/6859] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:46 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:47.504018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:47.504682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:47.511937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:47.512389 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:47.513178 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:47.513616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:47.539151 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-77a0e249-24c8-4f76-a261-c28cb331e0d7 req-e217f29f-8bf4-4dd8-ae10-75d013107e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81daa03d-71dc-4deb-8c9a-1df4f88f095d", "name": "network-vif-plugged", "status": "completed", "tag": "d9902372-4c37-4382-99ce-2c1efce2f541"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:47.548673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-77a0e249-24c8-4f76-a261-c28cb331e0d7 req-e217f29f-8bf4-4dd8-ae10-75d013107e27 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:47.549810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-77a0e249-24c8-4f76-a261-c28cb331e0d7 req-e217f29f-8bf4-4dd8-ae10-75d013107e27 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:47.561750 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-77a0e249-24c8-4f76-a261-c28cb331e0d7 req-e217f29f-8bf4-4dd8-ae10-75d013107e27 service nova] Creating event network-vif-plugged:d9902372-4c37-4382-99ce-2c1efce2f541 for instance 81daa03d-71dc-4deb-8c9a-1df4f88f095d on nch2-master-1 Apr 30 22:11:47.567757 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-77a0e249-24c8-4f76-a261-c28cb331e0d7 req-e217f29f-8bf4-4dd8-ae10-75d013107e27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 Apr 30 22:11:47.568366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3378/6860] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:11:47.686563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:47.694664 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8c64ff3-b2af-42f4-8247-eb8f1b7d1247 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.195300 Apr 30 22:11:47.695267 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3483/6861] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:47 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:48.712861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:48.713577 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:48.719802 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:48.720271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:48.721567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:48.722059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:48.856968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:48.865173 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3b74dbd4-988e-404c-9909-d7dd2c3e2def tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1393 microversion: 2.1 time: 0.157522 Apr 30 22:11:48.865779 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3379/6862] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:48 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:49.882812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:49.883375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:49.890290 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:49.890756 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:49.891540 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:49.891983 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:50.022646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:50.030060 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-33dca64d-b454-4479-b68b-ff08826f8460 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1565 microversion: 2.1 time: 0.151330 Apr 30 22:11:50.030642 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3484/6863] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:49 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:50.046735 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:50.047367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:50.054138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:50.054595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:50.055388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:50.055924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:50.185238 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:50.193250 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f4afce3a-6ddd-4d49-9ed9-aeaef3bb75a8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1565 microversion: 2.1 time: 0.150454 Apr 30 22:11:50.193838 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3380/6864] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:50 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:11:52.549249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:11:52.549907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:11:52.556962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:52.557408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:52.558254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:52.558383 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-26e7d011-48c4-4003-a977-d20454d7e039 req-1f125334-78ea-4297-9ce3-6fd96ac786aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81daa03d-71dc-4deb-8c9a-1df4f88f095d", "tag": "d9902372-4c37-4382-99ce-2c1efce2f541"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:11:52.558802 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:52.571107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-26e7d011-48c4-4003-a977-d20454d7e039 req-1f125334-78ea-4297-9ce3-6fd96ac786aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:11:52.571584 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-26e7d011-48c4-4003-a977-d20454d7e039 req-1f125334-78ea-4297-9ce3-6fd96ac786aa service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:11:52.584453 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-26e7d011-48c4-4003-a977-d20454d7e039 req-1f125334-78ea-4297-9ce3-6fd96ac786aa service nova] Creating event network-changed:d9902372-4c37-4382-99ce-2c1efce2f541 for instance 81daa03d-71dc-4deb-8c9a-1df4f88f095d on nch2-master-1 Apr 30 22:11:52.589798 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-26e7d011-48c4-4003-a977-d20454d7e039 req-1f125334-78ea-4297-9ce3-6fd96ac786aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035096 Apr 30 22:11:52.590974 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3381/6865] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:11:52.802002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:11:52.809781 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-608ccf49-018f-445f-8194-e30d2951d653 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1565 microversion: 2.1 time: 0.264594 Apr 30 22:11:52.810681 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3485/6866] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:11:52 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1565 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:14.070464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18bfacb3-c6fa-4078-9c66-d1ceaa5703ed tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:14.071595 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-18bfacb3-c6fa-4078-9c66-d1ceaa5703ed tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:14.077988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18bfacb3-c6fa-4078-9c66-d1ceaa5703ed tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:14.081819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18bfacb3-c6fa-4078-9c66-d1ceaa5703ed tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:14.081819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18bfacb3-c6fa-4078-9c66-d1ceaa5703ed tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:14.081819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-18bfacb3-c6fa-4078-9c66-d1ceaa5703ed tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:14.128546 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18bfacb3-c6fa-4078-9c66-d1ceaa5703ed tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action" status: 200 len: 24571 microversion: 2.1 time: 0.063984 Apr 30 22:12:14.129956 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3382/6867] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:12:14 2022] POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:12:25.044480 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d32fdc90-db72-4e79-be8f-58a4caca94eb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:25.045168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d32fdc90-db72-4e79-be8f-58a4caca94eb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:25.051277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32fdc90-db72-4e79-be8f-58a4caca94eb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:25.051738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32fdc90-db72-4e79-be8f-58a4caca94eb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:25.053026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32fdc90-db72-4e79-be8f-58a4caca94eb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:25.053470 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d32fdc90-db72-4e79-be8f-58a4caca94eb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:25.227647 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d32fdc90-db72-4e79-be8f-58a4caca94eb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action" status: 202 len: 0 microversion: 2.1 time: 0.187014 Apr 30 22:12:25.228323 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3486/6868] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:12:25 2022] POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:12:25.237114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:25.238025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:25.246180 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:25.246659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:25.247458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:25.247947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:25.382948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:25.390389 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-64b7fa41-d7f2-4368-8c2f-2aa9de80933e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1689 microversion: 2.1 time: 0.157620 Apr 30 22:12:25.390951 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3383/6869] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:25 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:26.410330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:26.411063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:26.417302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:26.417780 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:26.418563 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:26.419008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:26.556764 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:26.564317 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0367f0bc-118f-4512-9c36-5b812f775949 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1669 microversion: 2.1 time: 0.159216 Apr 30 22:12:26.564887 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3487/6870] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:26 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:27.996130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6f8dc0c7-884f-4020-9023-cab20a5743af tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:27.997075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6f8dc0c7-884f-4020-9023-cab20a5743af tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:28.008059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f8dc0c7-884f-4020-9023-cab20a5743af tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:28.011436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f8dc0c7-884f-4020-9023-cab20a5743af tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:28.011436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f8dc0c7-884f-4020-9023-cab20a5743af tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:28.011436 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6f8dc0c7-884f-4020-9023-cab20a5743af tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:28.057630 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6f8dc0c7-884f-4020-9023-cab20a5743af tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action" status: 200 len: 32641 microversion: 2.1 time: 0.065357 Apr 30 22:12:28.058576 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3384/6871] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:12:27 2022] POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action => generated 32641 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:12:28.069655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a3075520-47de-40f0-92b7-3736477f61ea tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:28.070228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a3075520-47de-40f0-92b7-3736477f61ea tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:28.077122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3075520-47de-40f0-92b7-3736477f61ea tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:28.077575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3075520-47de-40f0-92b7-3736477f61ea tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:28.078405 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3075520-47de-40f0-92b7-3736477f61ea tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:28.078844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a3075520-47de-40f0-92b7-3736477f61ea tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:28.274473 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a3075520-47de-40f0-92b7-3736477f61ea tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action" status: 202 len: 0 microversion: 2.1 time: 0.208651 Apr 30 22:12:28.275384 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3488/6872] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:12:28 2022] POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:12:28.284084 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:28.284805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:28.292846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:28.293320 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:28.294145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:28.294607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:28.430199 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:28.437729 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-03e3c558-62d2-4dda-8092-80e6a0bffeeb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1676 microversion: 2.1 time: 0.158027 Apr 30 22:12:28.438329 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3385/6873] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:28 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:29.457662 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:29.458931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:29.465174 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:29.465632 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:29.466442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:29.466886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:29.601468 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:29.609036 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eafe2812-87df-4509-98c5-27b1493fef03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1684 microversion: 2.1 time: 0.156484 Apr 30 22:12:29.609612 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3489/6874] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:29 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:29.699042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2a856b2-c722-401e-b58e-ba38c11922aa tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:29.700000 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2a856b2-c722-401e-b58e-ba38c11922aa tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:29.707706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a856b2-c722-401e-b58e-ba38c11922aa tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:29.708712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a856b2-c722-401e-b58e-ba38c11922aa tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:29.709507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a856b2-c722-401e-b58e-ba38c11922aa tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:29.710002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2a856b2-c722-401e-b58e-ba38c11922aa tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:29.761339 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2a856b2-c722-401e-b58e-ba38c11922aa tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action" status: 200 len: 38466 microversion: 2.1 time: 0.066097 Apr 30 22:12:29.762017 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3386/6875] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:12:29 2022] POST /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d/action => generated 38466 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 22:12:30.805058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:30.810693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ba648410-8e9b-4c7e-97c5-9cb331fefafa req-5959432e-cc93-44e5-8ec1-2867eda57f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81daa03d-71dc-4deb-8c9a-1df4f88f095d", "tag": "d9902372-4c37-4382-99ce-2c1efce2f541"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:30.814461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:30.821553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:30.822295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:30.823348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:30.824104 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:30.829477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ba648410-8e9b-4c7e-97c5-9cb331fefafa req-5959432e-cc93-44e5-8ec1-2867eda57f92 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:30.829477 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ba648410-8e9b-4c7e-97c5-9cb331fefafa req-5959432e-cc93-44e5-8ec1-2867eda57f92 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:30.841658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ba648410-8e9b-4c7e-97c5-9cb331fefafa req-5959432e-cc93-44e5-8ec1-2867eda57f92 service nova] Creating event network-changed:d9902372-4c37-4382-99ce-2c1efce2f541 for instance 81daa03d-71dc-4deb-8c9a-1df4f88f095d on nch2-master-1 Apr 30 22:12:30.847416 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ba648410-8e9b-4c7e-97c5-9cb331fefafa req-5959432e-cc93-44e5-8ec1-2867eda57f92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040768 Apr 30 22:12:30.848392 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3387/6876] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:12:30.852525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:12:31.138524 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-937e6ad3-69a9-40b2-8ae7-6fcd8b8d0a74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 204 len: 0 microversion: 2.1 time: 0.336964 Apr 30 22:12:31.139303 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3490/6877] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:12:30 2022] DELETE /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:12:31.148799 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:31.151683 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:31.156234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:31.156718 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:31.157524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:31.158011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:31.300312 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:31.308747 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-19809e29-572d-4e56-bcc3-0eb501787e80 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1690 microversion: 2.1 time: 0.164881 Apr 30 22:12:31.309529 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3388/6878] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:31 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:32.327246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:32.327972 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:32.334759 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:32.335222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:32.336006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:32.336455 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:32.534230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:32.542075 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1d3ff4c3-f23f-4a92-ae5b-36cd4017aaee tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1690 microversion: 2.1 time: 0.219214 Apr 30 22:12:32.542688 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3491/6879] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:32 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1690 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:33.198878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-18a41a93-881b-4e12-bd00-372aad429d8a req-a922843a-b63a-4850-8e11-f258179ec61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81daa03d-71dc-4deb-8c9a-1df4f88f095d", "name": "network-vif-deleted", "tag": "d9902372-4c37-4382-99ce-2c1efce2f541"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:33.207698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-18a41a93-881b-4e12-bd00-372aad429d8a req-a922843a-b63a-4850-8e11-f258179ec61e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:33.208170 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-18a41a93-881b-4e12-bd00-372aad429d8a req-a922843a-b63a-4850-8e11-f258179ec61e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:33.219847 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-18a41a93-881b-4e12-bd00-372aad429d8a req-a922843a-b63a-4850-8e11-f258179ec61e service nova] Creating event network-vif-deleted:d9902372-4c37-4382-99ce-2c1efce2f541 for instance 81daa03d-71dc-4deb-8c9a-1df4f88f095d on nch2-master-1 Apr 30 22:12:33.225142 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-18a41a93-881b-4e12-bd00-372aad429d8a req-a922843a-b63a-4850-8e11-f258179ec61e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030233 Apr 30 22:12:33.226870 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3389/6880] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:12:33.559236 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:33.564774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:33.567404 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:33.567859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:33.568648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:33.569091 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:33.603962 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:33.605158 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:33.605624 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lazy-loading 'fault' on Instance uuid 81daa03d-71dc-4deb-8c9a-1df4f88f095d {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:12:33.651749 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:33.659321 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9a944034-65fc-4588-b89e-0ccddf3072bc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 200 len: 1357 microversion: 2.1 time: 0.104048 Apr 30 22:12:33.659881 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3492/6881] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:33 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:34.678548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:34.679201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 81daa03d-71dc-4deb-8c9a-1df4f88f095d] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:34.685421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:34.685937 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:34.686739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:34.687200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:34.701176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] HTTP exception thrown: Instance 81daa03d-71dc-4deb-8c9a-1df4f88f095d could not be found. Apr 30 22:12:34.701815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Returning 404 to user: Instance 81daa03d-71dc-4deb-8c9a-1df4f88f095d could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:12:34.702658 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8ec3e8c2-d6af-4048-b94c-63748d980576 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d" status: 404 len: 111 microversion: 2.1 time: 0.029872 Apr 30 22:12:34.703190 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3390/6882] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:34 2022] GET /compute/v2.1/servers/81daa03d-71dc-4deb-8c9a-1df4f88f095d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:12:38.639085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c97bb106-eb8b-430a-b340-8a9652099e89 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '.version_select at 0x7fdc13d44820>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:38.720353 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c97bb106-eb8b-430a-b340-8a9652099e89 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1704876189" status: 202 len: 0 microversion: 2.1 time: 0.085281 Apr 30 22:12:38.720947 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3493/6883] 10.222.0.23 () {58 vars in 1283 bytes} [Sat Apr 30 22:12:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1704876189 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:12:38.746589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-18806ed9-5ece-40f8-bdc9-00fad490dba6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: .version_select at 0x7fdc13f51e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1581862100"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:38.763161 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-18806ed9-5ece-40f8-bdc9-00fad490dba6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:12:38.768274 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-18806ed9-5ece-40f8-bdc9-00fad490dba6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:12:38.960673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-18806ed9-5ece-40f8-bdc9-00fad490dba6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:12:38.965784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-18806ed9-5ece-40f8-bdc9-00fad490dba6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:12:38.980854 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-18806ed9-5ece-40f8-bdc9-00fad490dba6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.238214 Apr 30 22:12:38.981444 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3391/6884] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:12:38 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:46.742452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-504340405", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "a8378968-f301-455d-ace1-f906ff38b1af"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1581862100", "security_groups": [{"name": "tempest-secgroup-smoke-933057562"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:46.879938 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] validate_networks() for [('a8378968-f301-455d-ace1-f906ff38b1af', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:12:47.402203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:12:47.402638 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:12:47.403125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:12:47.403541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:12:47.403955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:12:47.413185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:47.413677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:47.414929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:47.415531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:47.436747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:12:47.442698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:12:47.455176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:12:47.457518 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:12:47.579585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0bdcc562-4be5-4916-a870-4a13efbd46a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.841028 Apr 30 22:12:47.580542 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3494/6885] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:12:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:12:47.595173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-052abd05-8a5c-416f-8bee-0d4cdb4b743a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:47.604992 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-052abd05-8a5c-416f-8bee-0d4cdb4b743a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:47.683766 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-052abd05-8a5c-416f-8bee-0d4cdb4b743a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:47.691302 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-052abd05-8a5c-416f-8bee-0d4cdb4b743a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1266 microversion: 2.1 time: 0.101964 Apr 30 22:12:47.692676 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3392/6886] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:47 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:12:48.709790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:48.711693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:48.731432 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:48.732144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:48.733446 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:48.734233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:48.813395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:48.813594 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f3457aaa-c26e-4513-8fa0-3b407c11f4a4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1270 microversion: 2.1 time: 0.108583 Apr 30 22:12:48.814076 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3495/6887] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:48 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:49.831601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:49.832247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:49.844136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:49.844728 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:49.845582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:49.846072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:49.932945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:49.940563 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9c5eea4a-c749-4942-954e-3305e6bfca93 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1326 microversion: 2.1 time: 0.113386 Apr 30 22:12:49.941216 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3393/6888] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:49 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:50.960077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:50.960711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:50.967572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:50.968039 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:50.968833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:50.969283 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:51.165085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:51.172705 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c54a0968-088e-4645-b8f7-76ac9d73f3b9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.216566 Apr 30 22:12:51.173286 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3496/6889] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:50 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:51.622205 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-35b2f218-0a4d-4aaa-8265-a7900480b50e req-c95a9997-38d7-460f-88ee-0f69dc2f4711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c60cd6-642d-440b-9d89-cdb4f770cf33", "tag": "2b6bf262-9692-4ce8-a35e-e57bdd50ea87"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:51.634633 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-35b2f218-0a4d-4aaa-8265-a7900480b50e req-c95a9997-38d7-460f-88ee-0f69dc2f4711 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:51.638282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-35b2f218-0a4d-4aaa-8265-a7900480b50e req-c95a9997-38d7-460f-88ee-0f69dc2f4711 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:51.655472 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-35b2f218-0a4d-4aaa-8265-a7900480b50e req-c95a9997-38d7-460f-88ee-0f69dc2f4711 service nova] Creating event network-changed:2b6bf262-9692-4ce8-a35e-e57bdd50ea87 for instance 41c60cd6-642d-440b-9d89-cdb4f770cf33 on nch1-master-1 Apr 30 22:12:51.663184 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-35b2f218-0a4d-4aaa-8265-a7900480b50e req-c95a9997-38d7-460f-88ee-0f69dc2f4711 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047471 Apr 30 22:12:51.664819 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3394/6890] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:12:52.190494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:52.191116 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:52.198539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:52.199001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:52.199837 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:52.200347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:52.399257 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:52.406922 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d72ea1f8-8792-4ad6-8b34-ea3b51830adf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.220963 Apr 30 22:12:52.407508 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3497/6891] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:52 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:53.425328 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:53.426282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:53.434334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:53.434807 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:53.435612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:53.436104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:53.581885 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:53.589911 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4fed4ecd-3b27-42d7-86ed-03597e3e3b44 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.169024 Apr 30 22:12:53.590497 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3395/6892] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:53 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:54.607823 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:54.608358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:54.615763 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:54.616215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:54.616984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:54.617424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:54.747347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:54.754968 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6d7e31c2-d65b-480f-ac92-3550d62d1a94 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.152112 Apr 30 22:12:54.755535 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3498/6893] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:54 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:12:55.771742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:55.772378 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:55.779295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:55.779773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:55.780581 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:55.781018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:55.909536 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:55.916931 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-13470e28-0595-4dd0-8aaf-18778dc12a8f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.149116 Apr 30 22:12:55.917510 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3396/6894] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:55 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:56.934368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:56.935002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:56.942370 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:56.942829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:56.943610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:56.944056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:57.073675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:57.081340 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a3c7439-5469-426f-b00f-0c2c5dbe16b4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.150656 Apr 30 22:12:57.081947 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3499/6895] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:56 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:12:58.097836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:58.098464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:58.105207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:58.105677 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:58.106632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:58.107158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:58.483421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ca5c9d8e-9000-4b61-ad2f-f50f5c035625 req-5f3a84a6-764b-4834-89ac-3c4f382881c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c60cd6-642d-440b-9d89-cdb4f770cf33", "name": "network-vif-plugged", "status": "completed", "tag": "2b6bf262-9692-4ce8-a35e-e57bdd50ea87"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:12:58.493652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ca5c9d8e-9000-4b61-ad2f-f50f5c035625 req-5f3a84a6-764b-4834-89ac-3c4f382881c7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:58.494217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ca5c9d8e-9000-4b61-ad2f-f50f5c035625 req-5f3a84a6-764b-4834-89ac-3c4f382881c7 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:58.506837 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ca5c9d8e-9000-4b61-ad2f-f50f5c035625 req-5f3a84a6-764b-4834-89ac-3c4f382881c7 service nova] Creating event network-vif-plugged:2b6bf262-9692-4ce8-a35e-e57bdd50ea87 for instance 41c60cd6-642d-440b-9d89-cdb4f770cf33 on nch1-master-1 Apr 30 22:12:58.512756 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ca5c9d8e-9000-4b61-ad2f-f50f5c035625 req-5f3a84a6-764b-4834-89ac-3c4f382881c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033348 Apr 30 22:12:58.513481 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3500/6896] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:12:58.605024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:58.614943 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8763b480-56d1-4340-aeef-9dc138808698 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.521052 Apr 30 22:12:58.616248 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3397/6897] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:58 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:12:59.633883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:12:59.634575 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:12:59.641680 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:59.642181 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:59.642975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:12:59.643427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:12:59.777693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:12:59.785618 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1c4de49-284a-468c-9f81-b9947a64c5f7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1391 microversion: 2.1 time: 0.156135 Apr 30 22:12:59.786244 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3501/6898] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:12:59 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:00.802336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:00.841480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:00.841480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:00.841480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:00.841480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:00.841480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:00.941173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:00.949258 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-717f86dd-0afd-4ab1-87ab-d5299c8251c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1561 microversion: 2.1 time: 0.150908 Apr 30 22:13:00.949852 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3398/6899] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:00 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:00.965120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:00.965738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:00.972483 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:00.972945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:00.973773 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:00.974215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:01.105501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:01.112877 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-64b19831-ae29-4408-a0ba-98fa1780a002 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1561 microversion: 2.1 time: 0.151655 Apr 30 22:13:01.113451 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3502/6900] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:00 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:03.084502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:03.085137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:03.090343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-bb734e21-6662-4a41-84e8-2141c957b05b req-e19b083c-68b0-4e50-bf7f-e176ba818266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c60cd6-642d-440b-9d89-cdb4f770cf33", "tag": "2b6bf262-9692-4ce8-a35e-e57bdd50ea87"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:13:03.091695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:03.092236 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:03.093800 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:03.094352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:03.100195 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bb734e21-6662-4a41-84e8-2141c957b05b req-e19b083c-68b0-4e50-bf7f-e176ba818266 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:03.100766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bb734e21-6662-4a41-84e8-2141c957b05b req-e19b083c-68b0-4e50-bf7f-e176ba818266 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:03.111849 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-bb734e21-6662-4a41-84e8-2141c957b05b req-e19b083c-68b0-4e50-bf7f-e176ba818266 service nova] Creating event network-changed:2b6bf262-9692-4ce8-a35e-e57bdd50ea87 for instance 41c60cd6-642d-440b-9d89-cdb4f770cf33 on nch1-master-1 Apr 30 22:13:03.118026 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-bb734e21-6662-4a41-84e8-2141c957b05b req-e19b083c-68b0-4e50-bf7f-e176ba818266 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037813 Apr 30 22:13:03.118934 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3503/6901] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:13:03.318099 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:03.325750 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-47e96d6a-b0e7-457d-83eb-c81bd991f26d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1561 microversion: 2.1 time: 0.248343 Apr 30 22:13:03.326299 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3399/6902] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:03 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:26.591133 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5ca7fec3-2c6d-44b2-867c-4924daa16d9a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:13:26.592066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5ca7fec3-2c6d-44b2-867c-4924daa16d9a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:26.598299 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca7fec3-2c6d-44b2-867c-4924daa16d9a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:26.598790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca7fec3-2c6d-44b2-867c-4924daa16d9a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:26.599564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca7fec3-2c6d-44b2-867c-4924daa16d9a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:26.600007 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5ca7fec3-2c6d-44b2-867c-4924daa16d9a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:26.650025 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5ca7fec3-2c6d-44b2-867c-4924daa16d9a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33/action" status: 200 len: 24571 microversion: 2.1 time: 0.063847 Apr 30 22:13:26.650678 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3504/6903] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:13:26 2022] POST /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:13:37.756001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4ef8c57d-0684-4233-8517-3b9405cb3b08 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:13:37.756980 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4ef8c57d-0684-4233-8517-3b9405cb3b08 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:37.763196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ef8c57d-0684-4233-8517-3b9405cb3b08 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:37.763669 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ef8c57d-0684-4233-8517-3b9405cb3b08 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:37.764462 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ef8c57d-0684-4233-8517-3b9405cb3b08 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:37.764919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4ef8c57d-0684-4233-8517-3b9405cb3b08 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:38.008332 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4ef8c57d-0684-4233-8517-3b9405cb3b08 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33/action" status: 202 len: 0 microversion: 2.1 time: 0.257100 Apr 30 22:13:38.008982 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3400/6904] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:13:37 2022] POST /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:13:38.020467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:38.021175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:38.028265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:38.028724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:38.029507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:38.030010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:38.045973 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:13:38.046184 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:13:38.289877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:38.297745 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-04e580d8-55ae-4477-a3df-f48a3c8b0f03 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1672 microversion: 2.1 time: 0.281642 Apr 30 22:13:38.298502 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3505/6905] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:38 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1672 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:39.317841 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:39.318565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:39.324810 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:39.325335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:39.326162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:39.326621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:39.510423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:39.518019 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f5ea29a5-d37b-4561-9941-68b5a9871a40 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.206092 Apr 30 22:13:39.518592 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3401/6906] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:39 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:40.536079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:40.536637 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:40.544234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:40.544694 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:40.545473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:40.545953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:40.672239 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:40.680360 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3d95ee0e-71ac-4b74-b7d8-7257f8076770 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.148376 Apr 30 22:13:40.680936 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3506/6907] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:40 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:41.698344 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:41.699003 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:41.705812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:41.706288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:41.707107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:41.707561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:41.840296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:41.848178 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e5ec625c-5f77-43c3-9466-4063b159fff0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.153794 Apr 30 22:13:41.848740 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3402/6908] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:41 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:42.866444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:42.867060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:42.873892 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:42.874347 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:42.875115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:42.875841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:43.003011 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:43.011052 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6cbdc643-dedc-4891-a026-c3b7da8234fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.149037 Apr 30 22:13:43.011630 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3507/6909] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:42 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:44.028279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:44.028914 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:44.035682 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:44.036153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:44.037454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:44.037944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:44.168423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:44.176129 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0aec9a5e-e5a6-4646-be12-13e522cd3f31 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.151784 Apr 30 22:13:44.176713 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3403/6910] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:44 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:45.192988 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:45.194198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:45.201019 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:45.201478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:45.202295 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:45.202742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:45.334507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:45.341932 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8d3921ef-4d00-4237-82c6-152cc79c40d6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.152857 Apr 30 22:13:45.342504 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3508/6911] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:45 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:46.359034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:46.359666 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:46.366816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:46.367460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:46.368264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:46.368727 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:46.497330 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:46.505115 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c119ec49-d59f-40e2-9e91-8214325abd2c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.150030 Apr 30 22:13:46.506243 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3404/6912] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:46 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:47.523873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:47.524495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:47.531341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:47.531741 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:47.532528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:47.532971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:47.664948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:47.672409 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4f0de733-0fae-4db5-93be-54a02401f0d4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.153063 Apr 30 22:13:47.672986 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3509/6913] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:47 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:48.688575 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:48.689210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:48.697110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:48.697580 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:48.698430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:48.698897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:48.894945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:48.903367 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-210ed580-38e4-47d8-9687-5fa9adb77875 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.218807 Apr 30 22:13:48.903928 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3405/6914] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:48 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:49.921476 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:49.922077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:49.929663 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:49.930141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:49.930915 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:49.931356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:50.060839 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:50.068895 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-381ed773-5952-445b-83cd-4b8b7803f544 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.151495 Apr 30 22:13:50.069517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3510/6915] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:49 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:51.086554 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:51.087217 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:51.094088 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:51.094560 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:51.095347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:51.095803 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:51.234388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:51.235777 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f69fd5f1-5e47-42ce-985e-bffbc15345be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.153732 Apr 30 22:13:51.236350 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3406/6916] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:51 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:52.253533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:52.254202 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:52.261555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:52.262051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:52.263394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:52.264199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:52.396926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:52.404377 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4cd5fbac-9409-457b-aef6-dd709ea8e9c3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.155189 Apr 30 22:13:52.404952 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3511/6917] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:52 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:53.420865 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:53.421501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:53.428881 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:53.429352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:53.430176 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:53.430642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:53.565272 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:53.573516 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0b4b5649-cba2-4add-9f4e-c771b6afb5c8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.156739 Apr 30 22:13:53.574125 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3407/6918] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:53 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:13:54.590499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:54.591122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:54.598292 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:54.603274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:54.603274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:54.603274 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:54.746047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:54.756527 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-133686d3-3df4-4604-8492-f84adfc80489 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1677 microversion: 2.1 time: 0.169847 Apr 30 22:13:54.757121 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3512/6919] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:54 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:13:55.774429 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:13:55.775095 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:13:55.783839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:55.784318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:55.785154 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:13:55.785621 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:13:55.917232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:13:55.924679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b3d1e2cf-1181-4879-a5b1-a0fddf4dd125 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1680 microversion: 2.1 time: 0.154621 Apr 30 22:13:55.925247 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3408/6920] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:13:55 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:20.114559 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fbede5c2-f228-4f8f-adfa-d33e61b8c039 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:20.115588 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fbede5c2-f228-4f8f-adfa-d33e61b8c039 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:20.122642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbede5c2-f228-4f8f-adfa-d33e61b8c039 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:20.123112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbede5c2-f228-4f8f-adfa-d33e61b8c039 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:20.123900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbede5c2-f228-4f8f-adfa-d33e61b8c039 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:20.124379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fbede5c2-f228-4f8f-adfa-d33e61b8c039 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:20.178140 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fbede5c2-f228-4f8f-adfa-d33e61b8c039 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33/action" status: 200 len: 69046 microversion: 2.1 time: 0.067526 Apr 30 22:14:20.179458 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3513/6921] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:14:20 2022] POST /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33/action => generated 69046 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 22:14:27.653750 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:27.654317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:27.660753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:27.661426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:27.662353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-d264a390-198d-4040-bdcc-c94e2bde8a00 req-999114d5-c6c4-40c4-b8ff-324ed767aba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c60cd6-642d-440b-9d89-cdb4f770cf33", "tag": "2b6bf262-9692-4ce8-a35e-e57bdd50ea87"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:27.662811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:27.662987 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:27.671931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d264a390-198d-4040-bdcc-c94e2bde8a00 req-999114d5-c6c4-40c4-b8ff-324ed767aba8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:27.672378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-d264a390-198d-4040-bdcc-c94e2bde8a00 req-999114d5-c6c4-40c4-b8ff-324ed767aba8 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:27.689797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:14:27.694655 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-d264a390-198d-4040-bdcc-c94e2bde8a00 req-999114d5-c6c4-40c4-b8ff-324ed767aba8 service nova] Creating event network-changed:2b6bf262-9692-4ce8-a35e-e57bdd50ea87 for instance 41c60cd6-642d-440b-9d89-cdb4f770cf33 on nch1-master-1 Apr 30 22:14:27.700024 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-d264a390-198d-4040-bdcc-c94e2bde8a00 req-999114d5-c6c4-40c4-b8ff-324ed767aba8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041467 Apr 30 22:14:27.700886 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3514/6922] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:14:28.009767 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-13a65b65-3a66-42f9-9936-d833569855ce tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 204 len: 0 microversion: 2.1 time: 0.359870 Apr 30 22:14:28.011005 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3409/6923] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:14:27 2022] DELETE /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:14:28.020505 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:28.021219 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:28.027795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:28.028264 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:28.029062 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:28.029511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:28.207948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:28.215883 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e86419e0-39f7-4ee2-af4b-0ca45eb176b7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1686 microversion: 2.1 time: 0.199862 Apr 30 22:14:28.216772 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3515/6924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:28 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1686 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:29.234967 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:29.235703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:29.242601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:29.243078 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:29.243870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:29.244333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:29.432725 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:29.440287 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb64849a-011a-447f-a8fe-01e980688196 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1686 microversion: 2.1 time: 0.209742 Apr 30 22:14:29.440864 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3410/6925] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:29 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1686 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:30.159206 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-619701ef-f5bc-4c6b-b273-3438a6acece4 req-76052af5-7483-4648-86f6-c17c8d9768bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c60cd6-642d-440b-9d89-cdb4f770cf33", "name": "network-vif-deleted", "tag": "2b6bf262-9692-4ce8-a35e-e57bdd50ea87"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:30.168835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-619701ef-f5bc-4c6b-b273-3438a6acece4 req-76052af5-7483-4648-86f6-c17c8d9768bb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:30.172358 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-619701ef-f5bc-4c6b-b273-3438a6acece4 req-76052af5-7483-4648-86f6-c17c8d9768bb service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:30.180361 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-619701ef-f5bc-4c6b-b273-3438a6acece4 req-76052af5-7483-4648-86f6-c17c8d9768bb service nova] Creating event network-vif-deleted:2b6bf262-9692-4ce8-a35e-e57bdd50ea87 for instance 41c60cd6-642d-440b-9d89-cdb4f770cf33 on nch1-master-1 Apr 30 22:14:30.185484 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-619701ef-f5bc-4c6b-b273-3438a6acece4 req-76052af5-7483-4648-86f6-c17c8d9768bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030040 Apr 30 22:14:30.186176 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3516/6926] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:14:30.459675 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:30.461734 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:30.469015 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:30.470027 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:30.471072 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:30.471537 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:30.512838 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:30.513316 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:30.513818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lazy-loading 'fault' on Instance uuid 41c60cd6-642d-440b-9d89-cdb4f770cf33 {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:14:30.557597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:30.565336 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ae1168fc-a2eb-4b13-b9a0-94512fba2cd4 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 200 len: 1356 microversion: 2.1 time: 0.110718 Apr 30 22:14:30.566151 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3411/6927] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:30 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:31.584243 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:31.584953 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 41c60cd6-642d-440b-9d89-cdb4f770cf33] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:31.591364 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:31.591822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:31.592600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:31.593059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:31.606354 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] HTTP exception thrown: Instance 41c60cd6-642d-440b-9d89-cdb4f770cf33 could not be found. Apr 30 22:14:31.608204 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Returning 404 to user: Instance 41c60cd6-642d-440b-9d89-cdb4f770cf33 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:14:31.608204 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f574071c-69d3-444a-8a6d-bd5e2d74fe68 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33" status: 404 len: 111 microversion: 2.1 time: 0.028824 Apr 30 22:14:31.608498 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3517/6928] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:31 2022] GET /compute/v2.1/servers/41c60cd6-642d-440b-9d89-cdb4f770cf33 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:14:35.468759 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f38f3f8d-a9b8-4ad7-b31a-cc0ebea5a72d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '.version_select at 0x7fdc13edbca0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:35.546777 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f38f3f8d-a9b8-4ad7-b31a-cc0ebea5a72d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1581862100" status: 202 len: 0 microversion: 2.1 time: 0.082210 Apr 30 22:14:35.547376 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3412/6929] 10.222.0.23 () {58 vars in 1283 bytes} [Sat Apr 30 22:14:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1581862100 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:14:35.574704 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c8d1b4b5-3dd4-4bb3-8557-36221f487f37 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: .version_select at 0x7fdc21d43310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-304402412"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:35.590030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c8d1b4b5-3dd4-4bb3-8557-36221f487f37 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:14:35.596056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c8d1b4b5-3dd4-4bb3-8557-36221f487f37 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:14:35.810652 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c8d1b4b5-3dd4-4bb3-8557-36221f487f37 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:14:35.815774 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-c8d1b4b5-3dd4-4bb3-8557-36221f487f37 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:14:35.830521 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c8d1b4b5-3dd4-4bb3-8557-36221f487f37 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.259840 Apr 30 22:14:35.831122 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3518/6930] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:14:35 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:44.023852 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2129206863", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "90d38a5f-5332-49b3-b6e5-23c7eaf174cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-304402412", "security_groups": [{"name": "tempest-secgroup-smoke-634472091"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:44.134749 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] validate_networks() for [('90d38a5f-5332-49b3-b6e5-23c7eaf174cd', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:14:44.555336 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:14:44.555784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:14:44.556314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:14:44.556743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:14:44.557303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:14:44.566286 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:44.566758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:44.567625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:44.568126 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:44.586280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:14:44.591490 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:14:44.604525 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:14:44.606876 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:14:44.743273 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-afba95ad-a710-46ad-9a8c-58268950281c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725693 Apr 30 22:14:44.743950 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3413/6931] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:14:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:14:44.756276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f00e221b-e16b-44a8-901b-ba0fb7c60e5e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:44.758054 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f00e221b-e16b-44a8-901b-ba0fb7c60e5e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:44.817417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f00e221b-e16b-44a8-901b-ba0fb7c60e5e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:44.824957 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f00e221b-e16b-44a8-901b-ba0fb7c60e5e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1266 microversion: 2.1 time: 0.073453 Apr 30 22:14:44.825541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3519/6932] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:44 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:45.842625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:45.843260 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:45.850346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:45.850825 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:45.851678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:45.852138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:45.923388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:45.948195 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-747b57c4-ce31-4b59-9e65-faa1b3f097be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1270 microversion: 2.1 time: 0.109754 Apr 30 22:14:45.951627 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3414/6933] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:45 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:46.968932 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:46.969649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:46.978199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:46.978511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:46.979596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:46.980263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:47.063911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:47.073385 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8dfd41ba-21e9-4797-90e4-e9b34c984965 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1336 microversion: 2.1 time: 0.108698 Apr 30 22:14:47.074109 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3520/6934] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:46 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:48.091757 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:48.092547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:48.100145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:48.101030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:48.102444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:48.103113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:48.290952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:48.298795 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-333a4d7c-77eb-4375-b950-f9b0272282c7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1391 microversion: 2.1 time: 0.211664 Apr 30 22:14:48.299375 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3415/6935] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:48 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:48.531045 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-ee02344c-2fda-440e-a8c1-108786e6914d req-d0c7c08d-094b-4dbb-86a0-6a5e9f2f712b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:48.539595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ee02344c-2fda-440e-a8c1-108786e6914d req-d0c7c08d-094b-4dbb-86a0-6a5e9f2f712b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:48.540055 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-ee02344c-2fda-440e-a8c1-108786e6914d req-d0c7c08d-094b-4dbb-86a0-6a5e9f2f712b service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:48.552934 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-ee02344c-2fda-440e-a8c1-108786e6914d req-d0c7c08d-094b-4dbb-86a0-6a5e9f2f712b service nova] Creating event network-changed:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch2-master-1 Apr 30 22:14:48.558292 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-ee02344c-2fda-440e-a8c1-108786e6914d req-d0c7c08d-094b-4dbb-86a0-6a5e9f2f712b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119244 Apr 30 22:14:48.558906 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3521/6936] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:14:49.316104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:49.316740 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:49.324079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:49.324555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:49.325351 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:49.325873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:49.453924 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:49.461878 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6e1ae8f-c1d2-48f1-839b-43e5a4ba57c0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1391 microversion: 2.1 time: 0.149755 Apr 30 22:14:49.462473 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3416/6937] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:49 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:50.480209 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:50.480918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:50.487360 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:50.487905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:50.488718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:50.489162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:50.625101 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:50.633127 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5c346da0-839a-43e9-ada5-df773ff81c81 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1391 microversion: 2.1 time: 0.158100 Apr 30 22:14:50.633703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3522/6938] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:50 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:51.650372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:51.651005 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:51.657839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:51.658311 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:51.659101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:51.659557 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:51.794112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:51.801397 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5a158921-a8e3-4b30-9711-49061f55fbf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1391 microversion: 2.1 time: 0.155605 Apr 30 22:14:51.802002 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3417/6939] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:51 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:52.818495 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:52.819037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:52.826964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:52.827426 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:52.828216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:52.828664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:52.959340 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:52.966943 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9f376d91-1208-4b8e-b881-a7318445cb70 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1391 microversion: 2.1 time: 0.152575 Apr 30 22:14:52.967528 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3523/6940] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:52 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:53.984440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:53.985075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:53.992793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:53.993502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:53.994612 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:53.995067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:54.133719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:54.141206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-db1e8855-1762-4d99-bb76-dbba15d0effc tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1391 microversion: 2.1 time: 0.160716 Apr 30 22:14:54.141798 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3418/6941] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:53 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:54.513394 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-38ddfd5a-4a29-4349-a5d2-909799e520b6 req-4ca24d79-8803-46d8-aade-17270508718f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "name": "network-vif-plugged", "status": "completed", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:54.524865 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-38ddfd5a-4a29-4349-a5d2-909799e520b6 req-4ca24d79-8803-46d8-aade-17270508718f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:54.525931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-38ddfd5a-4a29-4349-a5d2-909799e520b6 req-4ca24d79-8803-46d8-aade-17270508718f service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:54.552291 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-38ddfd5a-4a29-4349-a5d2-909799e520b6 req-4ca24d79-8803-46d8-aade-17270508718f service nova] Creating event network-vif-plugged:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch2-master-1 Apr 30 22:14:54.559415 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-38ddfd5a-4a29-4349-a5d2-909799e520b6 req-4ca24d79-8803-46d8-aade-17270508718f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110211 Apr 30 22:14:54.560048 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3524/6942] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:14:55.159242 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:55.159882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:55.166922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:55.167395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:55.168200 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:55.168660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:55.313441 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:55.322061 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5fae1c22-d808-4e6e-b6f7-39efc817f75a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1391 microversion: 2.1 time: 0.167502 Apr 30 22:14:55.322665 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3419/6943] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:55 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:14:56.340316 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:56.341022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:56.347298 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:56.347752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:56.348531 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:56.348960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:56.499095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:56.507755 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-86116ddb-757f-4d4f-b045-64336c137354 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1564 microversion: 2.1 time: 0.171842 Apr 30 22:14:56.508425 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3525/6944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:56 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:56.524226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:56.524882 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:56.531651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:56.532062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:56.532848 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:56.533321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:56.663120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:56.674199 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ebc86721-bd88-47ba-a489-2af7fa4a68dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1564 microversion: 2.1 time: 0.153914 Apr 30 22:14:56.674842 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3420/6945] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:56 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:14:58.608056 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:14:58.608778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:14:58.615745 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:58.616614 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:58.617738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:58.618210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:58.722137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-7e430ae1-124d-4806-966b-a99eff49f051 req-2d4a5890-1132-4358-9142-f92d766f4dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:14:58.728804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7e430ae1-124d-4806-966b-a99eff49f051 req-2d4a5890-1132-4358-9142-f92d766f4dc6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:14:58.729363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-7e430ae1-124d-4806-966b-a99eff49f051 req-2d4a5890-1132-4358-9142-f92d766f4dc6 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:14:58.740914 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-7e430ae1-124d-4806-966b-a99eff49f051 req-2d4a5890-1132-4358-9142-f92d766f4dc6 service nova] Creating event network-changed:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch2-master-1 Apr 30 22:14:58.746159 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-7e430ae1-124d-4806-966b-a99eff49f051 req-2d4a5890-1132-4358-9142-f92d766f4dc6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085162 Apr 30 22:14:58.746735 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3421/6946] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:14:58.764165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:14:58.772305 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9bc345cc-d97f-4226-963f-310b0db9d310 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1564 microversion: 2.1 time: 0.168378 Apr 30 22:14:58.773889 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3526/6947] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:14:58 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:21.132637 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:15:21.133420 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:15:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:15:22.026264 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-72a48167-3274-4a26-b73e-6879d778bc13 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:15:22.027362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-72a48167-3274-4a26-b73e-6879d778bc13 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:22.033625 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72a48167-3274-4a26-b73e-6879d778bc13 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:22.034140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72a48167-3274-4a26-b73e-6879d778bc13 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:22.034933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72a48167-3274-4a26-b73e-6879d778bc13 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:22.035397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-72a48167-3274-4a26-b73e-6879d778bc13 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:22.083407 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-72a48167-3274-4a26-b73e-6879d778bc13 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action" status: 200 len: 24569 microversion: 2.1 time: 0.062329 Apr 30 22:15:22.084298 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3422/6948] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:15:22 2022] POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action => generated 24569 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:15:28.478843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:15:28.479821 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:28.486240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:28.486705 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:28.487484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:28.487931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:28.530826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:28.537917 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Old instance type m1.heat2, new instance type m1.heat {{(pid=130671) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 30 22:15:28.546238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:15:28.546238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:15:28.546238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:15:28.546238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:15:28.546747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:15:28.753458 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b709507e-4d4f-48ed-a8f1-9986c7869d41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action" status: 202 len: 0 microversion: 2.1 time: 0.279068 Apr 30 22:15:28.754106 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3527/6949] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:15:28 2022] POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:15:28.763021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:28.763780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:28.771241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:28.772253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:28.773051 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:28.773514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:28.935266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:28.942931 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cd319187-c728-4fe3-9ae8-7a5d3f789bf8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1691 microversion: 2.1 time: 0.184176 Apr 30 22:15:28.944009 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3423/6950] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:28 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:29.960507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:29.961183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:29.968229 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:29.968687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:29.969463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:29.969933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:30.096730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:30.104779 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4e73893-436b-4b69-b144-315ca877082c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1691 microversion: 2.1 time: 0.148247 Apr 30 22:15:30.105344 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3528/6951] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:29 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:31.122435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:31.123070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:31.131546 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:31.132678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:31.133475 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:31.133972 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:31.266073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:31.273594 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c165d97a-6472-4a57-ab24-1354079729b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1691 microversion: 2.1 time: 0.155087 Apr 30 22:15:31.274402 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3424/6952] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:31 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:32.291014 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:32.291643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:32.298037 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:32.298501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:32.299286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:32.299735 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:32.426445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:32.434415 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8008c79c-b72f-4916-b885-61548c0bf330 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1691 microversion: 2.1 time: 0.147696 Apr 30 22:15:32.437517 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3529/6953] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:32 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:33.452329 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:33.452960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:33.460271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:33.460739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:33.461531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:33.462010 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:33.598362 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:33.606773 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b2770974-ea38-4fd7-8649-f841749fd2a7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1691 microversion: 2.1 time: 0.158437 Apr 30 22:15:33.607356 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3425/6954] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:33 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:34.623848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:34.624811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:34.631733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:34.632262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:34.633083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:34.633545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:34.768752 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:34.777155 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef8b52f9-894a-414a-ae2a-96d31a9c53ca tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1691 microversion: 2.1 time: 0.157313 Apr 30 22:15:34.777790 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3530/6955] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:34 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:35.794482 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:35.795112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:35.801929 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:35.802401 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:35.803811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:35.804270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:35.990864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:35.998290 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-61dbb93d-66e0-4091-bce8-849d5970d0df tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1691 microversion: 2.1 time: 0.207690 Apr 30 22:15:35.998864 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3426/6956] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:35 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:37.016330 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:37.016937 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:37.024175 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:37.024629 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:37.025395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:37.025863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:37.159528 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:37.167857 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d6ebdb78-62f9-42bf-a70f-42bc08730417 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.155427 Apr 30 22:15:37.168423 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3531/6957] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:37 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:38.194948 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:38.195616 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:38.202603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:38.203103 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:38.203892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:38.204352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:38.334601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:38.342196 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-33d5f2ce-036a-4a7d-b178-ab90d7197877 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.151769 Apr 30 22:15:38.342766 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3427/6958] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:38 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:39.358789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:39.359408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:39.366311 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:39.366771 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:39.367547 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:39.367993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:39.496564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:39.504355 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be489813-e8f9-491b-af53-b53509fb790f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.149474 Apr 30 22:15:39.504932 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3532/6959] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:39 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:40.521598 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:40.522372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:40.529310 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:40.529868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:40.530622 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:40.531090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:40.676367 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:40.684362 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-040b5cbc-5d32-4972-8a1b-365c12f6ad47 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.166884 Apr 30 22:15:40.684935 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3428/6960] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:40 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:41.701936 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:41.702557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:41.709433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:41.709950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:41.710732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:41.711170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:41.838093 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:41.845469 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7f59fdca-56a5-4904-8171-663628405690 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.147455 Apr 30 22:15:41.846078 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3533/6961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:41 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:42.868201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:42.868834 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:42.876207 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:42.876688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:42.877547 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:42.878026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:43.010101 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:43.018444 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-76c03c93-4bb4-4ed2-9968-c66f6a040d10 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.154716 Apr 30 22:15:43.018444 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3429/6962] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:42 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:44.035474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:44.036033 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:44.042884 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:44.043343 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:44.044118 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:44.044584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:44.185797 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:44.193308 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dd1a15cd-b215-44c0-a386-f9827d085b05 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.161868 Apr 30 22:15:44.194421 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3534/6963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:44 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:45.211824 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:45.212445 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:45.219304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:45.222796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:45.222796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:45.222796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:45.355873 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:45.363424 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-228bf892-d5ee-4dfc-a265-db8da8419035 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.156106 Apr 30 22:15:45.364004 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3430/6964] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:45 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:46.381193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:46.381825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:46.388609 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:46.389088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:46.389886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:46.390327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:46.520479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:46.528611 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-56115b24-ae3e-41aa-b80a-3969208beb5a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.151293 Apr 30 22:15:46.529243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3535/6965] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:46 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:47.546385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:47.546931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:47.554385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:47.554861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:47.555658 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:47.556124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:47.687506 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:47.695597 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4da00113-c817-429f-8ddb-beaae5d3aa74 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.153208 Apr 30 22:15:47.696502 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3431/6966] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:47 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:48.712788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:48.713408 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:48.720177 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:48.720633 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:48.721401 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:48.721863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:48.858600 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:48.866347 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-50d0815b-18ee-4b47-b36d-6eaf6c340359 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.157828 Apr 30 22:15:48.867042 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3536/6967] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:48 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:49.884576 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:49.885201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:49.892270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:49.892746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:49.893562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:49.894042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:50.023196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:50.030751 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cc3cb81e-e143-4449-b955-53d35b703b60 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.150736 Apr 30 22:15:50.031494 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3432/6968] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:49 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:51.047974 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:51.048584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:51.055965 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:51.056427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:51.057214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:51.057664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:51.196326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:51.203985 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-02d39d1b-220c-4fa6-8317-b03a95f38ff7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.159974 Apr 30 22:15:51.204560 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3537/6969] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:51 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:52.220585 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:52.221210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:52.228784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:52.229253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:52.230063 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:52.230519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:52.395386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:52.402831 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-032cd44d-6de6-4948-9f6d-9bc40dc1d80a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1696 microversion: 2.1 time: 0.186308 Apr 30 22:15:52.403399 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3433/6970] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:52 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:53.419911 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:53.420538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:53.427499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:53.427992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:53.428775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:53.429222 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:53.576717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:53.585217 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7cef4f79-0fbd-43bd-8fa6-d5e0b34e8f24 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1695 microversion: 2.1 time: 0.169308 Apr 30 22:15:53.593335 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3538/6971] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:53 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:53.956428 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cc6cadd7-c1c4-401c-8684-e1658455b76a req-82dd9357-d8f5-421a-a809-8f41907fbfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "name": "network-vif-unplugged", "status": "completed", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:15:53.965468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cc6cadd7-c1c4-401c-8684-e1658455b76a req-82dd9357-d8f5-421a-a809-8f41907fbfa1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:53.965931 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cc6cadd7-c1c4-401c-8684-e1658455b76a req-82dd9357-d8f5-421a-a809-8f41907fbfa1 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:53.978308 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cc6cadd7-c1c4-401c-8684-e1658455b76a req-82dd9357-d8f5-421a-a809-8f41907fbfa1 service nova] Creating event network-vif-unplugged:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch1-master-1 Apr 30 22:15:53.983586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [req-cc6cadd7-c1c4-401c-8684-e1658455b76a req-82dd9357-d8f5-421a-a809-8f41907fbfa1 service nova] Instance 8affdd64-3b33-4869-81da-c4bb111501e0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130670) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:15:53.995131 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cc6cadd7-c1c4-401c-8684-e1658455b76a req-82dd9357-d8f5-421a-a809-8f41907fbfa1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042504 Apr 30 22:15:53.995723 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3434/6972] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:15:54.603186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:54.604425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:54.612084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:54.612541 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:54.613492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:54.614106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:54.860380 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:54.867958 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-83372598-bd5f-4a7b-ad3e-6a8a763d2602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1695 microversion: 2.1 time: 0.269037 Apr 30 22:15:54.868618 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3539/6973] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:54 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1695 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:55.886913 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:55.887569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:55.894262 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:55.894744 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:55.895566 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:55.896037 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:56.009287 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-85804287-c034-487c-8135-6a41110892e9 req-b4b3be23-a51c-43ae-b7c1-94628fd092dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:15:56.018375 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-85804287-c034-487c-8135-6a41110892e9 req-b4b3be23-a51c-43ae-b7c1-94628fd092dc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:56.019079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-85804287-c034-487c-8135-6a41110892e9 req-b4b3be23-a51c-43ae-b7c1-94628fd092dc service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:56.030967 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-85804287-c034-487c-8135-6a41110892e9 req-b4b3be23-a51c-43ae-b7c1-94628fd092dc service nova] Creating event network-changed:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch1-master-1 Apr 30 22:15:56.036492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [req-85804287-c034-487c-8135-6a41110892e9 req-b4b3be23-a51c-43ae-b7c1-94628fd092dc service nova] Instance 8affdd64-3b33-4869-81da-c4bb111501e0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130671) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 30 22:15:56.037652 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:56.045268 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d1683e77-ce9c-424a-b484-834a4cea74dd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1693 microversion: 2.1 time: 0.163686 Apr 30 22:15:56.045874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3435/6974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:55 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:56.048550 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-85804287-c034-487c-8135-6a41110892e9 req-b4b3be23-a51c-43ae-b7c1-94628fd092dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042972 Apr 30 22:15:56.049151 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3540/6975] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:15:57.063811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:57.064451 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:57.071912 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:57.072363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:57.073177 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:57.073639 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:57.212422 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:57.225434 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b756a329-4693-446a-87ae-e68961134f73 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1693 microversion: 2.1 time: 0.164784 Apr 30 22:15:57.235174 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3436/6976] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:57 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:58.244196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:58.246006 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:58.253829 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.254294 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:58.255083 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.255523 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:58.388058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:58.395471 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d40d25c4-2b95-47da-9a57-a7856f8c0029 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1690 microversion: 2.1 time: 0.156287 Apr 30 22:15:58.396033 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3541/6977] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:58 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:58.412724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-503a0441-a224-4b7c-bce1-dad562f5286c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:15:58.413285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-503a0441-a224-4b7c-bce1-dad562f5286c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:58.420104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-503a0441-a224-4b7c-bce1-dad562f5286c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.420582 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-503a0441-a224-4b7c-bce1-dad562f5286c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:58.421393 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-503a0441-a224-4b7c-bce1-dad562f5286c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.421892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-503a0441-a224-4b7c-bce1-dad562f5286c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:58.628915 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-503a0441-a224-4b7c-bce1-dad562f5286c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action" status: 204 len: 0 microversion: 2.1 time: 0.220483 Apr 30 22:15:58.629569 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3437/6978] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:15:58 2022] POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:15:58.637904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:58.638525 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:58.644770 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.645225 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:58.646032 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.646984 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:58.783390 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:58.792199 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9ddd374d-c30e-4ac0-8e8c-4d2056a98470 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1690 microversion: 2.1 time: 0.158295 Apr 30 22:15:58.792898 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3542/6979] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:58 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:15:58.809006 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:15:58.809964 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:15:58.816352 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.817153 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:58.817667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:15:58.818163 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:15:59.024293 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:15:59.031754 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-965cb750-31ff-4641-8183-c1bd394ead3e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1690 microversion: 2.1 time: 0.226986 Apr 30 22:15:59.032339 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3438/6980] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:15:58 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1690 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:00.049555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:00.050132 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:00.057092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:00.057545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:00.058353 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:00.058792 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:00.203144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:00.207847 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-15c9a7f9-4cef-4484-95af-56b05402b304 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1690 microversion: 2.1 time: 0.162214 Apr 30 22:16:00.208461 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3543/6981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:00 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:01.224502 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:01.225137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:01.232522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:01.233030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:01.233857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:01.234322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:01.367395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:01.375252 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8f3418b1-46a8-4db9-983f-763b8b45dd90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1682 microversion: 2.1 time: 0.154721 Apr 30 22:16:01.375980 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3439/6982] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:01 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:01.504145 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-7c780e63-4bbd-42ef-9abb-4434ab1787c6 req-056d4960-c9c6-409d-b363-ff24186dd218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "name": "network-vif-plugged", "status": "completed", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:01.513004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7c780e63-4bbd-42ef-9abb-4434ab1787c6 req-056d4960-c9c6-409d-b363-ff24186dd218 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:01.513549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7c780e63-4bbd-42ef-9abb-4434ab1787c6 req-056d4960-c9c6-409d-b363-ff24186dd218 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:01.524474 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-7c780e63-4bbd-42ef-9abb-4434ab1787c6 req-056d4960-c9c6-409d-b363-ff24186dd218 service nova] Creating event network-vif-plugged:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch1-master-1 Apr 30 22:16:01.529565 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-7c780e63-4bbd-42ef-9abb-4434ab1787c6 req-056d4960-c9c6-409d-b363-ff24186dd218 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029368 Apr 30 22:16:01.530249 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3544/6983] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:16:23.566156 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0de96cb5-38f6-4505-9e06-8a85683b2f57 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:23.567097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0de96cb5-38f6-4505-9e06-8a85683b2f57 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:23.575137 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0de96cb5-38f6-4505-9e06-8a85683b2f57 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:23.575620 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0de96cb5-38f6-4505-9e06-8a85683b2f57 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:23.576443 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0de96cb5-38f6-4505-9e06-8a85683b2f57 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:23.576895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0de96cb5-38f6-4505-9e06-8a85683b2f57 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:23.628059 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0de96cb5-38f6-4505-9e06-8a85683b2f57 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action" status: 200 len: 24577 microversion: 2.1 time: 0.065672 Apr 30 22:16:23.628650 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3440/6984] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:16:23 2022] POST /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0/action => generated 24577 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:16:30.798957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:30.799557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:30.800454 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9951818e-569c-4d1d-808d-b1a765babb66 req-497bc91f-2a29-4cdc-8ef8-508e4fcdacb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:30.807346 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:30.807804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:30.808595 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:30.809041 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:30.810820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9951818e-569c-4d1d-808d-b1a765babb66 req-497bc91f-2a29-4cdc-8ef8-508e4fcdacb4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:30.811507 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9951818e-569c-4d1d-808d-b1a765babb66 req-497bc91f-2a29-4cdc-8ef8-508e4fcdacb4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:30.823764 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9951818e-569c-4d1d-808d-b1a765babb66 req-497bc91f-2a29-4cdc-8ef8-508e4fcdacb4 service nova] Creating event network-changed:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch1-master-1 Apr 30 22:16:30.829074 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9951818e-569c-4d1d-808d-b1a765babb66 req-497bc91f-2a29-4cdc-8ef8-508e4fcdacb4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032834 Apr 30 22:16:30.829670 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3441/6985] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:16:30.837018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:16:31.136697 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1f993fda-da2d-4f7c-80f9-2ff3d93e623f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 204 len: 0 microversion: 2.1 time: 0.342945 Apr 30 22:16:31.137632 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3545/6986] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:16:30 2022] DELETE /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:16:31.150812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:31.150812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:31.154827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:31.155306 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:31.156301 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:31.156920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:31.320723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:31.328397 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e62123fb-0d7a-4f14-964d-9693ac745cc9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1688 microversion: 2.1 time: 0.186354 Apr 30 22:16:31.328980 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3442/6987] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:31 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:32.346815 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:32.347526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:32.354804 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:32.355265 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:32.356051 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:32.356493 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:32.494378 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:32.502058 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-eb4c398c-67dc-4878-b8c4-a8b9cc421713 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1688 microversion: 2.1 time: 0.159566 Apr 30 22:16:32.502631 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3546/6988] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:32 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:33.184155 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-1112710b-6e43-47fd-aed6-0a2e08165211 req-30835b55-63b2-4aeb-bdf2-612b25e30ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8affdd64-3b33-4869-81da-c4bb111501e0", "name": "network-vif-deleted", "tag": "47171e1c-3e26-4f75-927b-da4563d87b2d"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:33.192600 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1112710b-6e43-47fd-aed6-0a2e08165211 req-30835b55-63b2-4aeb-bdf2-612b25e30ebd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:33.193100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-1112710b-6e43-47fd-aed6-0a2e08165211 req-30835b55-63b2-4aeb-bdf2-612b25e30ebd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:33.204748 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-1112710b-6e43-47fd-aed6-0a2e08165211 req-30835b55-63b2-4aeb-bdf2-612b25e30ebd service nova] Creating event network-vif-deleted:47171e1c-3e26-4f75-927b-da4563d87b2d for instance 8affdd64-3b33-4869-81da-c4bb111501e0 on nch1-master-1 Apr 30 22:16:33.209720 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-1112710b-6e43-47fd-aed6-0a2e08165211 req-30835b55-63b2-4aeb-bdf2-612b25e30ebd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 Apr 30 22:16:33.210322 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3443/6989] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:16:33.519721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:33.520313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:33.527827 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:33.532509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:33.532509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:33.532509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:33.569321 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:33.569956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:33.570427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lazy-loading 'fault' on Instance uuid 8affdd64-3b33-4869-81da-c4bb111501e0 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:16:33.615603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:33.624450 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ed862eb-3182-4a98-b173-f47dc73a106c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 200 len: 1356 microversion: 2.1 time: 0.108569 Apr 30 22:16:33.625104 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3547/6990] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:33 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:34.643338 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:34.643991 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 8affdd64-3b33-4869-81da-c4bb111501e0] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:34.650842 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:34.651318 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:34.652113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:34.652574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:34.666530 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] HTTP exception thrown: Instance 8affdd64-3b33-4869-81da-c4bb111501e0 could not be found. Apr 30 22:16:34.667259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Returning 404 to user: Instance 8affdd64-3b33-4869-81da-c4bb111501e0 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:16:34.668110 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-e4fffe91-4da6-4d35-8e71-9f7418a52780 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0" status: 404 len: 111 microversion: 2.1 time: 0.030056 Apr 30 22:16:34.668647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3444/6991] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:34 2022] GET /compute/v2.1/servers/8affdd64-3b33-4869-81da-c4bb111501e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:16:38.540651 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-39108790-9c51-48fe-9b1c-2f32223b79fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '.version_select at 0x7fdc134f1940>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:38.631318 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-39108790-9c51-48fe-9b1c-2f32223b79fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-304402412" status: 202 len: 0 microversion: 2.1 time: 0.095344 Apr 30 22:16:38.631816 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3548/6992] 10.222.0.23 () {58 vars in 1280 bytes} [Sat Apr 30 22:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-304402412 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:16:38.659495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fb3765d5-029b-4544-b56c-2868772076ab tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: .version_select at 0x7fdc13fb8f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2039967472"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:38.674448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb3765d5-029b-4544-b56c-2868772076ab tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:16:38.680366 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb3765d5-029b-4544-b56c-2868772076ab tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:16:38.974927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb3765d5-029b-4544-b56c-2868772076ab tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:16:38.980643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-fb3765d5-029b-4544-b56c-2868772076ab tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:16:38.995433 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fb3765d5-029b-4544-b56c-2868772076ab tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.339855 Apr 30 22:16:38.996040 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3445/6993] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:16:38 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:47.056580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1744792254", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "43917ffc-ace2-46f9-a7a4-b7f29eb0a588"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2039967472", "security_groups": [{"name": "tempest-secgroup-smoke-1184325995"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:47.170189 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] validate_networks() for [('43917ffc-ace2-46f9-a7a4-b7f29eb0a588', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:16:47.567249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:16:47.568058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:16:47.569334 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:16:47.570112 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:16:47.570441 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:16:47.580975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:47.581522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:47.582602 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:47.583044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:47.603928 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:16:47.610176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:16:47.625951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:16:47.629108 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:16:47.730749 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-060205cd-96d7-47c2-bdc5-4ab1cdbd7fe3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.679555 Apr 30 22:16:47.731815 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3549/6994] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:16:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:16:47.742784 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fa27e533-677d-444e-991b-4f19844d9af1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:47.745402 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fa27e533-677d-444e-991b-4f19844d9af1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:47.818485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fa27e533-677d-444e-991b-4f19844d9af1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:47.832765 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fa27e533-677d-444e-991b-4f19844d9af1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1267 microversion: 2.1 time: 0.094127 Apr 30 22:16:47.835785 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3446/6995] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:47 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:48.853017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:48.854678 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:48.862976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:48.864545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:48.864799 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:48.865604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:48.954628 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:48.962464 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-233cf97d-fc94-4228-a51b-067a92252c77 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1271 microversion: 2.1 time: 0.115143 Apr 30 22:16:48.963063 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3550/6996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:48 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:49.979650 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:49.980385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:49.991382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:49.991857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:49.992827 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:49.993321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:50.065210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:50.073590 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6d2c3348-a279-4d4e-bd36-ed79184fee26 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1327 microversion: 2.1 time: 0.098006 Apr 30 22:16:50.074748 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3447/6997] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:49 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:51.092080 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:51.092618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:51.099467 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:51.099921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:51.100697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:51.101140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:51.329835 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:51.337893 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3eaa765f-9565-4697-8ea8-c97a3f8029be tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.249781 Apr 30 22:16:51.338469 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3551/6998] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:51 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:51.836908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a8caa775-1fdf-4dc7-914c-bd4a7499dbf2 req-6f8a27ed-b938-4a3a-b523-843a6835594c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fed7dc-aafa-40ce-aa15-0592d96ec96c", "tag": "6d1ca7b8-047c-4e1f-987d-d004ee761252"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:51.848792 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a8caa775-1fdf-4dc7-914c-bd4a7499dbf2 req-6f8a27ed-b938-4a3a-b523-843a6835594c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:51.849261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a8caa775-1fdf-4dc7-914c-bd4a7499dbf2 req-6f8a27ed-b938-4a3a-b523-843a6835594c service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:51.865125 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a8caa775-1fdf-4dc7-914c-bd4a7499dbf2 req-6f8a27ed-b938-4a3a-b523-843a6835594c service nova] Creating event network-changed:6d1ca7b8-047c-4e1f-987d-d004ee761252 for instance 06fed7dc-aafa-40ce-aa15-0592d96ec96c on nch2-master-1 Apr 30 22:16:51.871821 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a8caa775-1fdf-4dc7-914c-bd4a7499dbf2 req-6f8a27ed-b938-4a3a-b523-843a6835594c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039245 Apr 30 22:16:51.875197 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3448/6999] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:16:52.355954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:52.356612 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:52.363352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:52.363806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:52.364582 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:52.365024 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:52.590192 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:52.597891 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d10930e6-bbbc-43b5-9990-ecd78221e76c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.246594 Apr 30 22:16:52.598481 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3552/7000] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:52 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:53.616425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:53.617203 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:53.625130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:53.625819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:53.626624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:53.627124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:53.757915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:53.765398 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-202dc85f-ea0e-450c-880a-ca0a58fade48 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.153424 Apr 30 22:16:53.765992 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3449/7001] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:53 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:54.783176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:54.783907 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:54.790825 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:54.791285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:54.792071 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:54.792520 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:54.929337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:54.937381 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-9212b2cb-cde1-4cb1-83b4-bc517bf84778 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.158149 Apr 30 22:16:54.937992 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3553/7002] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:54 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:55.954279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:55.954919 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:55.961818 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:55.962297 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:55.963092 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:55.963552 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:56.092102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:56.099417 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ec418ae1-9807-4973-acf2-25fe2764d6ac tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.149151 Apr 30 22:16:56.099996 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3450/7003] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:55 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:57.116492 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:57.117117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:57.125069 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:57.125517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:57.126317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:57.126757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:57.264412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:57.274636 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b70bc2c-a311-485b-97a8-85c5e6021621 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.162246 Apr 30 22:16:57.278209 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3554/7004] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:57 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:58.291710 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:58.292357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:58.299237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:58.299715 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:58.300522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:58.300990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:58.437136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:58.444581 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b6ad99b8-a436-4e22-9036-b54f461eda95 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.156869 Apr 30 22:16:58.445158 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3451/7005] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:58 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:16:59.077241 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-bed7200b-6029-4bb2-af0c-8ff58c50d4e1 req-aeda9def-f5e6-411a-91d7-1ab7461eaedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fed7dc-aafa-40ce-aa15-0592d96ec96c", "name": "network-vif-plugged", "status": "completed", "tag": "6d1ca7b8-047c-4e1f-987d-d004ee761252"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:16:59.086585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bed7200b-6029-4bb2-af0c-8ff58c50d4e1 req-aeda9def-f5e6-411a-91d7-1ab7461eaedf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:59.087040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-bed7200b-6029-4bb2-af0c-8ff58c50d4e1 req-aeda9def-f5e6-411a-91d7-1ab7461eaedf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:59.101820 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-bed7200b-6029-4bb2-af0c-8ff58c50d4e1 req-aeda9def-f5e6-411a-91d7-1ab7461eaedf service nova] Creating event network-vif-plugged:6d1ca7b8-047c-4e1f-987d-d004ee761252 for instance 06fed7dc-aafa-40ce-aa15-0592d96ec96c on nch2-master-1 Apr 30 22:16:59.107424 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-bed7200b-6029-4bb2-af0c-8ff58c50d4e1 req-aeda9def-f5e6-411a-91d7-1ab7461eaedf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037617 Apr 30 22:16:59.108098 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3555/7006] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:16:59.462812 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:16:59.463464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:16:59.470589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:59.471070 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:59.471892 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:16:59.472345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:16:59.613076 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:16:59.620565 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1ac485b2-8525-4c7d-9c3e-92eb8040fbf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1393 microversion: 2.1 time: 0.162193 Apr 30 22:16:59.621147 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3452/7007] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:16:59 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:00.639151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:00.639788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:00.646220 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:00.646677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:00.647461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:00.647909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:00.784076 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:00.791974 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-89b3115f-7a45-452a-89cd-2bc7feab7437 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1565 microversion: 2.1 time: 0.158173 Apr 30 22:17:00.792542 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3556/7008] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:00 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:00.808216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:00.808857 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:00.816026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:00.816497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:00.817298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:00.817778 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:00.950463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:00.957930 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-083027d6-2441-4608-9956-1cea3bee40e5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1565 microversion: 2.1 time: 0.153644 Apr 30 22:17:00.958505 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3453/7009] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:00 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:02.890983 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-439a3e51-f525-41f6-95db-14c13ee90a0b req-3dc09c09-5cd5-4b47-b14d-06e377151fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fed7dc-aafa-40ce-aa15-0592d96ec96c", "tag": "6d1ca7b8-047c-4e1f-987d-d004ee761252"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:17:02.895905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:02.896539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:02.905238 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:02.905697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:02.906552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:02.906997 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:02.913698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-439a3e51-f525-41f6-95db-14c13ee90a0b req-3dc09c09-5cd5-4b47-b14d-06e377151fac service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:02.914197 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-439a3e51-f525-41f6-95db-14c13ee90a0b req-3dc09c09-5cd5-4b47-b14d-06e377151fac service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:02.927364 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-439a3e51-f525-41f6-95db-14c13ee90a0b req-3dc09c09-5cd5-4b47-b14d-06e377151fac service nova] Creating event network-changed:6d1ca7b8-047c-4e1f-987d-d004ee761252 for instance 06fed7dc-aafa-40ce-aa15-0592d96ec96c on nch2-master-1 Apr 30 22:17:02.932679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-439a3e51-f525-41f6-95db-14c13ee90a0b req-3dc09c09-5cd5-4b47-b14d-06e377151fac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045472 Apr 30 22:17:02.933490 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3454/7010] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:17:03.139317 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:03.146839 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc63eb89-6bf4-4d5d-ba88-1d20cf15eb83 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1565 microversion: 2.1 time: 0.263311 Apr 30 22:17:03.150869 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3557/7011] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:02 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1565 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:26.390018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ecab2621-7a92-4cd5-bddc-0d7787d9d85e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:17:26.391054 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ecab2621-7a92-4cd5-bddc-0d7787d9d85e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:26.397232 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecab2621-7a92-4cd5-bddc-0d7787d9d85e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:26.397705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecab2621-7a92-4cd5-bddc-0d7787d9d85e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:26.398529 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecab2621-7a92-4cd5-bddc-0d7787d9d85e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:26.398988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ecab2621-7a92-4cd5-bddc-0d7787d9d85e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:26.451520 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ecab2621-7a92-4cd5-bddc-0d7787d9d85e tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action" status: 200 len: 24570 microversion: 2.1 time: 0.067488 Apr 30 22:17:26.452180 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3455/7012] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:17:26 2022] POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:17:37.479486 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-754b98b0-7658-4501-8f1e-60e138caa438 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:17:37.485903 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-754b98b0-7658-4501-8f1e-60e138caa438 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:37.486357 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-754b98b0-7658-4501-8f1e-60e138caa438 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:37.508592 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-754b98b0-7658-4501-8f1e-60e138caa438 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Going to try to stop instance {{(pid=130671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 30 22:17:37.659014 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-754b98b0-7658-4501-8f1e-60e138caa438 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action" status: 202 len: 0 microversion: 2.1 time: 0.183084 Apr 30 22:17:37.659484 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3558/7013] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:17:37 2022] POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 22:17:37.668371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:37.669104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:37.676396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:37.676878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:37.677722 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:37.678213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:38.156224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:38.163612 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c390c792-4cc4-4fa1-b170-273c91ccd214 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.499671 Apr 30 22:17:38.164179 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3456/7014] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:37 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:39.185270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:39.186049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:39.192422 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:39.192875 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:39.193646 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:39.194121 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:39.325248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:39.332727 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0f3f0ed3-fd25-4003-9792-8e4844de78a5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.153916 Apr 30 22:17:39.333303 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3559/7015] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:39 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:40.349840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:40.350504 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:40.358025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:40.358498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:40.359282 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:40.359741 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:40.488920 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:40.496862 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7822aeb3-5ca2-4df5-8d47-b5e3eb9a85e8 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.150948 Apr 30 22:17:40.497685 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3457/7016] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:40 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:41.514585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:41.515214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:41.522063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:41.522526 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:41.523308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:41.523757 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:41.651589 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:41.659057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1108f483-1c09-41af-86a8-c2d12f027dd6 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.148885 Apr 30 22:17:41.659635 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3560/7017] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:41 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:42.676356 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:42.676969 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:42.683874 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:42.684350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:42.685145 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:42.685609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:42.817059 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:42.824591 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a78550f1-6aa1-4bdd-8a43-8bfd2885bca9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.152325 Apr 30 22:17:42.825159 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3458/7018] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:42 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:43.841841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:43.842466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:43.849306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:43.849778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:43.850564 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:43.851038 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:43.986729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:43.994986 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6c768458-8429-457c-8cf5-5e29a5b15589 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.156382 Apr 30 22:17:43.995563 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3561/7019] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:43 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:45.013275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:45.013935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:45.020879 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:45.021350 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:45.022164 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:45.022626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:45.153012 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:45.160373 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2d56b826-56e8-489c-b93f-5f56f8170acf tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.151820 Apr 30 22:17:45.160949 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3459/7020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:45 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:46.176849 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:46.177381 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:46.184816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:46.185275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:46.186079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:46.186534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:46.321221 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:46.328932 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e94e1524-9ed7-440f-a882-72749cae25a3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.156050 Apr 30 22:17:46.329600 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3562/7021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:46 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:47.346559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:47.347196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:47.354695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:47.355171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:47.355959 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:47.356426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:47.486275 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:47.495241 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a564264-96e5-40e9-a721-4fc2865f0d69 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.152674 Apr 30 22:17:47.496535 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3460/7022] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:47 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:48.531848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:48.532392 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:48.539376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:48.539833 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:48.540616 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:48.541063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:48.677870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:48.686023 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e8e29d11-dbfb-48bd-ad81-b666b9bcb788 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.158136 Apr 30 22:17:48.686624 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3563/7023] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:48 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:49.703703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:49.704343 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:49.711280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:49.711753 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:49.712535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:49.713578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:49.844187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:49.851581 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-283db9a2-f967-4a43-a860-003575b8a34b tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.151804 Apr 30 22:17:49.852179 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3461/7024] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:49 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:50.869161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:50.869691 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:50.876494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:50.876954 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:50.877730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:50.878200 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:51.014826 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:51.022742 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d88c358a-e97f-49f3-aec8-2decb9204cc0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.157915 Apr 30 22:17:51.023313 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3564/7025] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:50 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:52.039821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:52.040459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:52.047493 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:52.047986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:52.048773 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:52.049234 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:52.209435 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:52.217564 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9d956143-cb5d-45f7-bda4-2766768a8122 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1694 microversion: 2.1 time: 0.181780 Apr 30 22:17:52.218207 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3462/7026] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:52 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:53.236548 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:53.237168 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:53.245176 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:53.245634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:53.246708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:53.247538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:53.379713 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:53.387944 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19f45a22-5b56-4ea8-bf5a-04ac44ede791 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1671 microversion: 2.1 time: 0.156476 Apr 30 22:17:53.388534 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3565/7027] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:53 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:54.482119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a58c10c2-0a7c-48f0-8fac-129ea98c0b29 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:17:54.483075 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a58c10c2-0a7c-48f0-8fac-129ea98c0b29 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:54.490045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a58c10c2-0a7c-48f0-8fac-129ea98c0b29 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:54.490524 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a58c10c2-0a7c-48f0-8fac-129ea98c0b29 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:54.491323 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a58c10c2-0a7c-48f0-8fac-129ea98c0b29 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:54.491785 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a58c10c2-0a7c-48f0-8fac-129ea98c0b29 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:54.541904 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a58c10c2-0a7c-48f0-8fac-129ea98c0b29 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action" status: 200 len: 38437 microversion: 2.1 time: 0.064143 Apr 30 22:17:54.542744 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3463/7028] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:17:54 2022] POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action => generated 38437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:17:54.554425 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-398f1aec-aa35-4890-bccd-6e8a30afb602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:17:54.561275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-398f1aec-aa35-4890-bccd-6e8a30afb602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:54.561728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-398f1aec-aa35-4890-bccd-6e8a30afb602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:54.588003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-398f1aec-aa35-4890-bccd-6e8a30afb602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Going to try to start instance {{(pid=130671) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 30 22:17:54.775107 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-398f1aec-aa35-4890-bccd-6e8a30afb602 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action" status: 202 len: 0 microversion: 2.1 time: 0.224305 Apr 30 22:17:54.775648 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3566/7029] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:17:54 2022] POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:17:54.785196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:54.785945 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:54.793138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:54.793609 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:54.795110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:54.795586 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:54.929793 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:54.938176 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-86365348-53e3-4d75-87a9-1be85be1c103 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1680 microversion: 2.1 time: 0.157170 Apr 30 22:17:54.938874 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3464/7030] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:54 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:55.957509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:55.958247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:55.965276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:55.965738 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:55.966549 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:55.966998 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:56.098351 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:56.106743 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f7f9e801-b37d-484c-9d10-e505d50747fb tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1680 microversion: 2.1 time: 0.153627 Apr 30 22:17:56.107339 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3567/7031] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:55 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:17:57.125079 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:17:57.125714 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:17:57.132535 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:57.133008 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:57.133932 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:17:57.134398 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:17:57.268452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:17:57.276057 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12a64ac8-6459-4d36-b6d1-a14d390a5274 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1684 microversion: 2.1 time: 0.155703 Apr 30 22:17:57.276592 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3465/7032] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:17:57 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:21.458789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3433206a-6f0f-448e-ab98-36f0f6fa7f6d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:18:21.459729 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3433206a-6f0f-448e-ab98-36f0f6fa7f6d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:21.466845 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3433206a-6f0f-448e-ab98-36f0f6fa7f6d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:21.467307 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3433206a-6f0f-448e-ab98-36f0f6fa7f6d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:21.468087 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3433206a-6f0f-448e-ab98-36f0f6fa7f6d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:21.468534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3433206a-6f0f-448e-ab98-36f0f6fa7f6d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:21.519838 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3433206a-6f0f-448e-ab98-36f0f6fa7f6d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action" status: 200 len: 62956 microversion: 2.1 time: 0.064782 Apr 30 22:18:21.520510 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3568/7033] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:18:21 2022] POST /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c/action => generated 62956 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:18:28.756074 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:28.756720 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:28.758254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9bd3412c-9267-4ebb-9495-e4280a425cc8 req-a7eb6f96-a73d-4337-b0f7-a0ac162ec122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fed7dc-aafa-40ce-aa15-0592d96ec96c", "tag": "6d1ca7b8-047c-4e1f-987d-d004ee761252"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:18:28.764346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:28.765030 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:28.765977 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:28.766520 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:28.767921 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9bd3412c-9267-4ebb-9495-e4280a425cc8 req-a7eb6f96-a73d-4337-b0f7-a0ac162ec122 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:28.768554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9bd3412c-9267-4ebb-9495-e4280a425cc8 req-a7eb6f96-a73d-4337-b0f7-a0ac162ec122 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:28.780382 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9bd3412c-9267-4ebb-9495-e4280a425cc8 req-a7eb6f96-a73d-4337-b0f7-a0ac162ec122 service nova] Creating event network-changed:6d1ca7b8-047c-4e1f-987d-d004ee761252 for instance 06fed7dc-aafa-40ce-aa15-0592d96ec96c on nch2-master-1 Apr 30 22:18:28.786147 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9bd3412c-9267-4ebb-9495-e4280a425cc8 req-a7eb6f96-a73d-4337-b0f7-a0ac162ec122 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032049 Apr 30 22:18:28.786732 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3569/7034] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:18:28.795440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:18:29.096007 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5297a060-02ee-465a-aaab-441df28d7c35 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 204 len: 0 microversion: 2.1 time: 0.344027 Apr 30 22:18:29.096784 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3466/7035] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:18:28 2022] DELETE /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:18:29.106279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:29.107581 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:29.114061 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:29.114533 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:29.115323 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:29.115775 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:29.283214 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:29.291685 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a77e0b14-27fb-4dfe-bf6b-447d6484f5d5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1690 microversion: 2.1 time: 0.190240 Apr 30 22:18:29.292266 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3570/7036] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:29 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:30.313067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:30.313839 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:30.320674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:30.321157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:30.321988 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:30.322452 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:30.522962 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:30.531092 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0107d734-c46d-4a4d-8fb8-1985812b64fe tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1690 microversion: 2.1 time: 0.222964 Apr 30 22:18:30.531771 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3467/7037] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:30 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:31.134421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a7bef103-b8cd-4132-af61-874362c468aa req-dcf6bf13-045f-4c4c-9f57-52b76b18d6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fed7dc-aafa-40ce-aa15-0592d96ec96c", "name": "network-vif-deleted", "tag": "6d1ca7b8-047c-4e1f-987d-d004ee761252"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:18:31.146193 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a7bef103-b8cd-4132-af61-874362c468aa req-dcf6bf13-045f-4c4c-9f57-52b76b18d6e3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:31.146655 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a7bef103-b8cd-4132-af61-874362c468aa req-dcf6bf13-045f-4c4c-9f57-52b76b18d6e3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:31.158737 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a7bef103-b8cd-4132-af61-874362c468aa req-dcf6bf13-045f-4c4c-9f57-52b76b18d6e3 service nova] Creating event network-vif-deleted:6d1ca7b8-047c-4e1f-987d-d004ee761252 for instance 06fed7dc-aafa-40ce-aa15-0592d96ec96c on nch2-master-1 Apr 30 22:18:31.163882 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a7bef103-b8cd-4132-af61-874362c468aa req-dcf6bf13-045f-4c4c-9f57-52b76b18d6e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033143 Apr 30 22:18:31.164467 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3571/7038] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:18:31.548643 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:31.549438 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:31.556653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:31.557136 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:31.558019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:31.558553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:31.593368 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:31.593888 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:31.594371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.objects.instance [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lazy-loading 'fault' on Instance uuid 06fed7dc-aafa-40ce-aa15-0592d96ec96c {{(pid=130670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:18:31.639754 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:31.648005 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7509c50f-9e16-4253-b5f1-26a8070fb1c2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 200 len: 1357 microversion: 2.1 time: 0.103323 Apr 30 22:18:31.648520 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3468/7039] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:31 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:18:32.666166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:32.666794 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 06fed7dc-aafa-40ce-aa15-0592d96ec96c] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:32.673597 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:32.674085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:32.674869 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:32.675345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:32.689100 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] HTTP exception thrown: Instance 06fed7dc-aafa-40ce-aa15-0592d96ec96c could not be found. Apr 30 22:18:32.689724 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Returning 404 to user: Instance 06fed7dc-aafa-40ce-aa15-0592d96ec96c could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:18:32.690572 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d08a15fa-a667-44dc-b93d-37d69df76a22 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c" status: 404 len: 111 microversion: 2.1 time: 0.029801 Apr 30 22:18:32.691091 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3572/7040] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:32 2022] GET /compute/v2.1/servers/06fed7dc-aafa-40ce-aa15-0592d96ec96c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:18:36.474263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab8fc230-f8d9-41ed-893a-a10a410d7f27 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '.version_select at 0x7fdc13fb8430>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:36.543857 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab8fc230-f8d9-41ed-893a-a10a410d7f27 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2039967472" status: 202 len: 0 microversion: 2.1 time: 0.074045 Apr 30 22:18:36.544385 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3469/7041] 10.222.0.23 () {58 vars in 1283 bytes} [Sat Apr 30 22:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2039967472 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:18:36.576047 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a560fe2e-499f-4d87-b254-73d9a5dedc41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: .version_select at 0x7fdc13499d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-497712340"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:18:36.590909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a560fe2e-499f-4d87-b254-73d9a5dedc41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:18:36.596900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a560fe2e-499f-4d87-b254-73d9a5dedc41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:18:36.833372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a560fe2e-499f-4d87-b254-73d9a5dedc41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:18:36.838579 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-a560fe2e-499f-4d87-b254-73d9a5dedc41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:18:36.852803 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a560fe2e-499f-4d87-b254-73d9a5dedc41 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.281311 Apr 30 22:18:36.853342 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3573/7042] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:18:36 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:45.046763 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-555598216", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "networks": [{"uuid": "fa1f6918-4b74-4ea2-8c29-f447e1dc8d66"}], "key_name": "tempest-TestNetworkAdvancedServerOps-497712340", "security_groups": [{"name": "tempest-secgroup-smoke-607649256"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:18:45.316671 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] validate_networks() for [('fa1f6918-4b74-4ea2-8c29-f447e1dc8d66', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:18:45.704385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:18:45.704902 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:18:45.705456 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:18:45.705986 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:18:45.706431 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:18:45.715334 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:45.716011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:45.716849 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:45.717314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:45.734147 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:18:45.739437 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Getting quotas for user 55661e0ba64a400a8449a280f2ac5236 and project 8f25dc6783c0491a86c2170aed9e0817. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:18:45.752809 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:18:45.755188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:18:45.859129 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-19a79781-332b-49e4-a006-88e2c04c3fde tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816872 Apr 30 22:18:45.859836 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3470/7043] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:18:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:18:45.870078 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ae46bed0-8dc1-41ca-96c2-6972abbd7792 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:45.871286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ae46bed0-8dc1-41ca-96c2-6972abbd7792 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:45.987388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ae46bed0-8dc1-41ca-96c2-6972abbd7792 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:45.996028 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ae46bed0-8dc1-41ca-96c2-6972abbd7792 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1265 microversion: 2.1 time: 0.129753 Apr 30 22:18:45.998215 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3574/7044] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:45 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:47.016432 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:47.017065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:47.024607 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:47.025087 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:47.025944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:47.026404 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:47.119341 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:47.127405 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7e92e82c-f741-40c0-9ac5-70496ea99647 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1269 microversion: 2.1 time: 0.116244 Apr 30 22:18:47.128168 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3471/7045] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:47 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:48.143846 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:48.144473 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:48.152282 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:48.152672 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:48.153477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:48.153966 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:48.245409 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:48.254470 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f9e0e39e-33c6-4912-8f4e-cb19b3af9eb3 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1325 microversion: 2.1 time: 0.114477 Apr 30 22:18:48.255358 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3575/7046] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:48 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1325 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:49.272736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:49.273423 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:49.281253 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:49.281739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:49.282603 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:49.283258 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:49.430265 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:49.438404 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-20b15273-a31b-4821-a4a9-8668d8aa130c tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.170197 Apr 30 22:18:49.439040 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3472/7047] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:49 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:49.823412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-7d3f9afc-38fd-46b1-9c46-eb0613118df9 req-f80c894e-8f4c-4b7d-9fb9-462753e0b0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133107db-05e1-4622-8150-7217bc71bcfc", "tag": "b86348d7-b49a-434b-a12a-f0f1a9cbfaba"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:18:49.835374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7d3f9afc-38fd-46b1-9c46-eb0613118df9 req-f80c894e-8f4c-4b7d-9fb9-462753e0b0b4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:49.835946 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-7d3f9afc-38fd-46b1-9c46-eb0613118df9 req-f80c894e-8f4c-4b7d-9fb9-462753e0b0b4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:49.858918 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-7d3f9afc-38fd-46b1-9c46-eb0613118df9 req-f80c894e-8f4c-4b7d-9fb9-462753e0b0b4 service nova] Creating event network-changed:b86348d7-b49a-434b-a12a-f0f1a9cbfaba for instance 133107db-05e1-4622-8150-7217bc71bcfc on nch1-master-1 Apr 30 22:18:49.864447 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-7d3f9afc-38fd-46b1-9c46-eb0613118df9 req-f80c894e-8f4c-4b7d-9fb9-462753e0b0b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045704 Apr 30 22:18:49.865055 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3576/7048] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:18:50.458395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:50.459024 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:50.465776 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:50.466263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:50.467056 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:50.467512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:50.666457 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:50.674529 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df79dae9-b7d7-45bf-a8e1-274a9e3f9bf1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.220058 Apr 30 22:18:50.675120 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3473/7049] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:50 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:51.692788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:51.693507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:51.699850 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:51.700314 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:51.701102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:51.701555 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:51.833227 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:51.841393 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-111a006b-86a6-4e57-b4cf-40307fae7b25 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.153790 Apr 30 22:18:51.842001 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3577/7050] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:51 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:52.867527 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:52.868080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:52.875244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:52.875712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:52.876508 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:52.876966 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:53.004335 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:53.011678 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f864c008-bc4f-4e9b-adfb-25c4a490beff tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.152282 Apr 30 22:18:53.012897 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3474/7051] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:52 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:54.029059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:54.029687 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:54.036539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:54.036996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:54.037793 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:54.038245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:54.170509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:54.177842 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-19a19644-1972-46fd-9f73-126e9e4ae4d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.152804 Apr 30 22:18:54.178408 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3578/7052] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:54 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:55.194624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:55.195254 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:55.202981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:55.203448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:55.204240 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:55.204702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:55.339762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:55.347119 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c1b7eae4-8b79-4e76-ab7d-3b6295696765 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.156422 Apr 30 22:18:55.347700 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3475/7053] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:55 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:56.363025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:56.363656 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:56.370538 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:56.370989 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:56.372026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:56.372462 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:56.490411 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-190a0a21-cf95-4b28-b644-03459cd306bf req-8272db80-5b26-4503-8a77-0a13af95d95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133107db-05e1-4622-8150-7217bc71bcfc", "name": "network-vif-plugged", "status": "completed", "tag": "b86348d7-b49a-434b-a12a-f0f1a9cbfaba"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:18:56.500110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-190a0a21-cf95-4b28-b644-03459cd306bf req-8272db80-5b26-4503-8a77-0a13af95d95a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:56.502846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-190a0a21-cf95-4b28-b644-03459cd306bf req-8272db80-5b26-4503-8a77-0a13af95d95a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:56.509675 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:56.512716 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-190a0a21-cf95-4b28-b644-03459cd306bf req-8272db80-5b26-4503-8a77-0a13af95d95a service nova] Creating event network-vif-plugged:b86348d7-b49a-434b-a12a-f0f1a9cbfaba for instance 133107db-05e1-4622-8150-7217bc71bcfc on nch1-master-1 Apr 30 22:18:56.518038 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-190a0a21-cf95-4b28-b644-03459cd306bf req-8272db80-5b26-4503-8a77-0a13af95d95a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Apr 30 22:18:56.518203 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c2e6d584-e8f2-4340-87d3-f83e4c65c424 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.159036 Apr 30 22:18:56.518579 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3476/7054] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:18:56.523257 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3579/7055] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:56 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:57.536386 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:57.537107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:57.543433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:57.543908 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:57.544703 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:57.545165 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:57.675497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:57.682929 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9040c0dc-1d91-4116-babc-1b29e920ddf5 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1390 microversion: 2.1 time: 0.151666 Apr 30 22:18:57.683514 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3477/7056] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:57 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:58.699419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:58.700044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:58.707050 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:58.707512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:58.708324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:58.708776 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:58.836443 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:58.843944 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-12d397fe-fd0c-4cdd-96fb-99348f860801 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1561 microversion: 2.1 time: 0.148503 Apr 30 22:18:58.846714 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3580/7057] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:58 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:18:58.861214 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:18:58.861996 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:18:58.868897 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:58.869371 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:58.870221 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:18:58.870681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:18:59.000747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:18:59.008523 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-37e3d3ca-e943-4983-8d3d-2f36219ee7d9 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1561 microversion: 2.1 time: 0.151493 Apr 30 22:18:59.009095 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3478/7058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:18:58 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:01.365201 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:01.366048 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:01.367610 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-fe8da5d7-fd21-4c67-8f74-6d92add96569 req-23e808a2-981d-46f4-85f8-ff65df68f9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133107db-05e1-4622-8150-7217bc71bcfc", "tag": "b86348d7-b49a-434b-a12a-f0f1a9cbfaba"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:01.373535 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:01.374026 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:01.375167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:01.375664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:01.377638 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fe8da5d7-fd21-4c67-8f74-6d92add96569 req-23e808a2-981d-46f4-85f8-ff65df68f9fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:01.378321 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fe8da5d7-fd21-4c67-8f74-6d92add96569 req-23e808a2-981d-46f4-85f8-ff65df68f9fe service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:01.390550 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-fe8da5d7-fd21-4c67-8f74-6d92add96569 req-23e808a2-981d-46f4-85f8-ff65df68f9fe service nova] Creating event network-changed:b86348d7-b49a-434b-a12a-f0f1a9cbfaba for instance 133107db-05e1-4622-8150-7217bc71bcfc on nch1-master-1 Apr 30 22:19:01.395937 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-fe8da5d7-fd21-4c67-8f74-6d92add96569 req-23e808a2-981d-46f4-85f8-ff65df68f9fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032414 Apr 30 22:19:01.396746 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3479/7059] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:19:01.595250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:01.603323 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b5df99cd-6fe6-48e6-8239-1b3386322b90 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1561 microversion: 2.1 time: 0.242632 Apr 30 22:19:01.603895 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3581/7060] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:01 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1561 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:24.849259 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dab973b8-90b8-4894-81f2-b458e36426ec tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:24.850374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dab973b8-90b8-4894-81f2-b458e36426ec tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:24.856642 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab973b8-90b8-4894-81f2-b458e36426ec tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:24.857121 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab973b8-90b8-4894-81f2-b458e36426ec tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:24.858463 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab973b8-90b8-4894-81f2-b458e36426ec tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:24.858963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dab973b8-90b8-4894-81f2-b458e36426ec tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:24.914095 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dab973b8-90b8-4894-81f2-b458e36426ec tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action" status: 200 len: 24572 microversion: 2.1 time: 0.069910 Apr 30 22:19:24.914746 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3480/7061] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:19:24 2022] POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action => generated 24572 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:19:35.886421 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:35.886959 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:35.893288 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:35.893746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:35.894546 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:35.895001 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:35.917395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lazy-loading 'flavor' on Instance uuid 133107db-05e1-4622-8150-7217bc71bcfc {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:19:36.219829 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-99a6ea23-37d4-4b93-a658-f9f88bffe87a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action" status: 202 len: 0 microversion: 2.1 time: 0.337157 Apr 30 22:19:36.223565 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3582/7062] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:19:35 2022] POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:19:36.230021 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:36.230758 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:36.237905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:36.238390 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:36.239208 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:36.239665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:36.375747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:36.383401 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2c1e181-d352-44d9-8105-355a2d83d67d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1688 microversion: 2.1 time: 0.158152 Apr 30 22:19:36.383974 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3481/7063] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:36 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:37.403270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:37.403976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:37.410789 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:37.411246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:37.412020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:37.412463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:37.545318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:37.553340 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-22bfcc51-7859-4c07-bf36-ad859f73655a tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1671 microversion: 2.1 time: 0.155453 Apr 30 22:19:37.553956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3583/7064] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:37 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:38.642693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d5baf260-699f-4ffb-8d90-6ca53fc5d17d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:38.643570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d5baf260-699f-4ffb-8d90-6ca53fc5d17d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:38.653860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5baf260-699f-4ffb-8d90-6ca53fc5d17d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:38.654374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5baf260-699f-4ffb-8d90-6ca53fc5d17d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:38.655179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5baf260-699f-4ffb-8d90-6ca53fc5d17d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:38.656187 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d5baf260-699f-4ffb-8d90-6ca53fc5d17d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:38.715445 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d5baf260-699f-4ffb-8d90-6ca53fc5d17d tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action" status: 200 len: 38425 microversion: 2.1 time: 0.076727 Apr 30 22:19:38.716364 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3482/7065] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:19:38 2022] POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action => generated 38425 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 22:19:38.727721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8a02de80-5c56-4726-be6d-0f1f8c2d7361 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:38.728267 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8a02de80-5c56-4726-be6d-0f1f8c2d7361 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:38.735785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a02de80-5c56-4726-be6d-0f1f8c2d7361 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:38.736245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a02de80-5c56-4726-be6d-0f1f8c2d7361 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:38.737020 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a02de80-5c56-4726-be6d-0f1f8c2d7361 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:38.737466 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8a02de80-5c56-4726-be6d-0f1f8c2d7361 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:39.007114 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8a02de80-5c56-4726-be6d-0f1f8c2d7361 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action" status: 202 len: 0 microversion: 2.1 time: 0.283009 Apr 30 22:19:39.007745 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3584/7066] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:19:38 2022] POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 22:19:39.017045 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:39.017797 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:39.025086 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:39.025561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:39.026394 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:39.026861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:39.166397 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:39.174234 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-5b8ea867-f2eb-47b2-8c55-ffd15527f447 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1677 microversion: 2.1 time: 0.161974 Apr 30 22:19:39.174814 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3483/7067] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:39 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:40.192173 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:40.192904 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:40.200196 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:40.200648 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:40.201416 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:40.201943 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:40.339240 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:40.347345 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ab622668-d8f5-4770-99c6-62e53449a764 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1677 microversion: 2.1 time: 0.159434 Apr 30 22:19:40.347908 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3585/7068] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:40 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:41.365864 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:41.366498 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:41.373515 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:41.374665 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:41.375472 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:41.375935 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:41.504808 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:41.512278 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b13bb361-f799-4131-9c35-592dde1b1020 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1680 microversion: 2.1 time: 0.150959 Apr 30 22:19:41.512853 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3484/7069] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:41 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:41.609886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-33f1fd95-7a46-4c47-9196-3f1e17a636fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:41.610817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-33f1fd95-7a46-4c47-9196-3f1e17a636fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:41.617576 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f1fd95-7a46-4c47-9196-3f1e17a636fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:41.618068 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f1fd95-7a46-4c47-9196-3f1e17a636fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:41.618840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f1fd95-7a46-4c47-9196-3f1e17a636fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:41.619278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-33f1fd95-7a46-4c47-9196-3f1e17a636fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:41.667214 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-33f1fd95-7a46-4c47-9196-3f1e17a636fd tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action" status: 200 len: 38425 microversion: 2.1 time: 0.061176 Apr 30 22:19:41.668043 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3586/7070] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:19:41 2022] POST /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc/action => generated 38425 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:19:43.097186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-4f553ac4-129a-443a-a885-5bb066dd1955 req-98a93358-4523-4f64-a948-ee0e4676418e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133107db-05e1-4622-8150-7217bc71bcfc", "tag": "b86348d7-b49a-434b-a12a-f0f1a9cbfaba"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:43.100465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:43.100995 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:43.108317 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:43.109290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:43.110230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:43.110691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:43.114840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4f553ac4-129a-443a-a885-5bb066dd1955 req-98a93358-4523-4f64-a948-ee0e4676418e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:43.114840 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-4f553ac4-129a-443a-a885-5bb066dd1955 req-98a93358-4523-4f64-a948-ee0e4676418e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:43.127243 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-4f553ac4-129a-443a-a885-5bb066dd1955 req-98a93358-4523-4f64-a948-ee0e4676418e service nova] Creating event network-changed:b86348d7-b49a-434b-a12a-f0f1a9cbfaba for instance 133107db-05e1-4622-8150-7217bc71bcfc on nch1-master-1 Apr 30 22:19:43.132541 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-4f553ac4-129a-443a-a885-5bb066dd1955 req-98a93358-4523-4f64-a948-ee0e4676418e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039591 Apr 30 22:19:43.133124 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3587/7071] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:19:43.141363 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:19:43.450057 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1cf93434-5674-442e-b162-f00b3958d18f tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 204 len: 0 microversion: 2.1 time: 0.360072 Apr 30 22:19:43.450748 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3485/7072] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:19:43 2022] DELETE /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:19:43.460811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:43.461786 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:43.468424 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:43.468948 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:43.469841 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:43.470371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:43.643452 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:43.651057 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-315191d2-d660-4551-b3b6-810bd09123b0 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1686 microversion: 2.1 time: 0.195209 Apr 30 22:19:43.651638 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3588/7073] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:43 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1686 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:44.670113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:44.670820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:44.677578 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:44.678091 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:44.678886 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:44.679348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:44.812522 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:44.819937 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4a7f8a85-d596-4041-87e3-023ed150ffa1 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1686 microversion: 2.1 time: 0.154290 Apr 30 22:19:44.820510 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3486/7074] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:44 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:19:45.815859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-2b90d480-0d57-4b62-8f68-4810cafb91ee req-21f5fca7-064b-4628-9539-212e16617a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133107db-05e1-4622-8150-7217bc71bcfc", "name": "network-vif-deleted", "tag": "b86348d7-b49a-434b-a12a-f0f1a9cbfaba"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:19:45.825142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2b90d480-0d57-4b62-8f68-4810cafb91ee req-21f5fca7-064b-4628-9539-212e16617a09 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:45.825594 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-2b90d480-0d57-4b62-8f68-4810cafb91ee req-21f5fca7-064b-4628-9539-212e16617a09 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:45.837712 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:45.838194 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-2b90d480-0d57-4b62-8f68-4810cafb91ee req-21f5fca7-064b-4628-9539-212e16617a09 service nova] Creating event network-vif-deleted:b86348d7-b49a-434b-a12a-f0f1a9cbfaba for instance 133107db-05e1-4622-8150-7217bc71bcfc on nch1-master-1 Apr 30 22:19:45.838563 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:45.843688 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-2b90d480-0d57-4b62-8f68-4810cafb91ee req-21f5fca7-064b-4628-9539-212e16617a09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030933 Apr 30 22:19:45.844318 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3589/7075] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:19:45.846470 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:45.847512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:45.848298 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:45.848762 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:45.914256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55661e0ba64a400a8449a280f2ac5236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25dc6783c0491a86c2170aed9e0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:19:45.921859 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c9b1bce5-1456-4a46-ba99-ebf8ea074241 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 200 len: 1500 microversion: 2.1 time: 0.088304 Apr 30 22:19:45.922641 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3487/7076] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:45 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 1500 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:19:46.940912 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:46.941543 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] [instance: 133107db-05e1-4622-8150-7217bc71bcfc] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:19:46.947919 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:46.948379 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:46.949167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:19:46.949683 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:19:46.963705 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] HTTP exception thrown: Instance 133107db-05e1-4622-8150-7217bc71bcfc could not be found. Apr 30 22:19:46.967100 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Returning 404 to user: Instance 133107db-05e1-4622-8150-7217bc71bcfc could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:19:46.967100 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c7c47595-d5cb-4683-9dae-27b2c478f4e7 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc" status: 404 len: 111 microversion: 2.1 time: 0.030025 Apr 30 22:19:46.967100 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3590/7077] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:19:46 2022] GET /compute/v2.1/servers/133107db-05e1-4622-8150-7217bc71bcfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:19:50.746304 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-aa8e7d6b-beef-4262-b796-d35dd3be18d2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] Calling method '.version_select at 0x7fdc13ed1790>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:19:50.850979 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-aa8e7d6b-beef-4262-b796-d35dd3be18d2 tempest-TestNetworkAdvancedServerOps-677250847 tempest-TestNetworkAdvancedServerOps-677250847-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-497712340" status: 202 len: 0 microversion: 2.1 time: 0.108746 Apr 30 22:19:50.851509 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3488/7078] 10.222.0.23 () {58 vars in 1280 bytes} [Sat Apr 30 22:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-497712340 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:20:05.146791 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-20fb6071-56b7-4276-9620-ef4d69a12bc8 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Action: 'create', calling method: .version_select at 0x7fdc13481550>, body: {"keypair": {"name": "tempest-TestShelveInstance-818356273"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:20:05.163626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-20fb6071-56b7-4276-9620-ef4d69a12bc8 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:20:05.171703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-20fb6071-56b7-4276-9620-ef4d69a12bc8 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for user d303e4f4105348928c5697b11e69a3d1 and project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:20:05.648479 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-20fb6071-56b7-4276-9620-ef4d69a12bc8 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:20:05.653545 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-20fb6071-56b7-4276-9620-ef4d69a12bc8 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for user d303e4f4105348928c5697b11e69a3d1 and project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:20:05.668234 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-20fb6071-56b7-4276-9620-ef4d69a12bc8 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.695442 Apr 30 22:20:05.668831 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3591/7079] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:20:04 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:20:08.234567 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1859525221", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-818356273", "security_groups": [{"name": "tempest-secgroup-smoke-1328710048"}], "networks": [{"uuid": "03778a8b-a449-4615-bf38-12386fc793ea"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:20:08.349990 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] validate_networks() for [('03778a8b-a449-4615-bf38-12386fc793ea', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:20:08.850660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:20:08.851113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:20:08.851618 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:20:08.852065 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:20:08.853395 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:20:08.863349 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:08.863868 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:08.864707 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:08.865182 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:08.883426 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:20:08.889066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for user d303e4f4105348928c5697b11e69a3d1 and project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:20:08.902277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:20:08.904619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:20:09.023679 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-deb73b1e-c693-4fd2-a6c5-5517d33e7bbc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793768 Apr 30 22:20:09.024345 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3489/7080] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:20:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:20:09.035816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ee8e3373-bac0-4620-8798-aba013c892e1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:09.036431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ee8e3373-bac0-4620-8798-aba013c892e1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:09.091395 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ee8e3373-bac0-4620-8798-aba013c892e1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:09.098976 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ee8e3373-bac0-4620-8798-aba013c892e1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1246 microversion: 2.1 time: 0.068473 Apr 30 22:20:09.099635 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3592/7081] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:09 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:10.116043 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:10.116667 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:10.125396 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:10.125895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:10.126726 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:10.127193 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:10.188486 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:10.196080 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-60c91449-619b-4d0e-8753-5d84286283dd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1250 microversion: 2.1 time: 0.084044 Apr 30 22:20:10.196647 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3490/7082] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:10 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:11.213481 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:11.214134 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:11.222272 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:11.222727 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:11.223507 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:11.223964 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:11.305097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:11.312641 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ad3bf2c2-06ad-4c70-91f6-90e626a62fc5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1304 microversion: 2.1 time: 0.103013 Apr 30 22:20:11.313221 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3593/7083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:11 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:12.334105 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:12.334915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:12.341700 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:12.342230 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:12.343085 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:12.343545 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:12.540281 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:12.548474 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-1c16ea7e-8899-4598-a454-a075c8eb5aac tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1372 microversion: 2.1 time: 0.218278 Apr 30 22:20:12.549062 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3491/7084] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:12 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:12.743717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-e3cda9f1-1a16-4c6b-84c7-f2128d36cccb req-ca8372ec-0a40-49ea-ba2f-2ff54eea92a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:20:12.753280 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e3cda9f1-1a16-4c6b-84c7-f2128d36cccb req-ca8372ec-0a40-49ea-ba2f-2ff54eea92a5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:12.753736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-e3cda9f1-1a16-4c6b-84c7-f2128d36cccb req-ca8372ec-0a40-49ea-ba2f-2ff54eea92a5 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:12.767418 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-e3cda9f1-1a16-4c6b-84c7-f2128d36cccb req-ca8372ec-0a40-49ea-ba2f-2ff54eea92a5 service nova] Creating event network-changed:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch2-master-1 Apr 30 22:20:12.772692 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-e3cda9f1-1a16-4c6b-84c7-f2128d36cccb req-ca8372ec-0a40-49ea-ba2f-2ff54eea92a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101476 Apr 30 22:20:12.773616 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3594/7085] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:20:13.565994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:13.566551 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:13.573270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:13.573736 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:13.574555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:13.575009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:13.708484 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:13.715816 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4d26ce0d-5cbe-416d-8858-82ed78314f9f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1372 microversion: 2.1 time: 0.154524 Apr 30 22:20:13.716384 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3492/7086] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:13 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:14.734373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:14.735215 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:14.741419 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:14.741898 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:14.742667 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:14.743107 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:14.876692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:14.884012 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fd28b957-23c4-42bd-a79d-dced2edf9cbf tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1372 microversion: 2.1 time: 0.155335 Apr 30 22:20:14.884599 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3595/7087] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:14 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:15.900947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:15.901590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:15.908583 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:15.909073 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:15.911222 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:15.911706 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:16.049630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:16.057165 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ac0e7bcc-9e3c-4a10-9894-ae98d94f865d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1372 microversion: 2.1 time: 0.160238 Apr 30 22:20:16.057744 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3493/7088] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:15 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:17.074692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:17.075313 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:17.082909 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:17.083369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:17.084183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:17.084634 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:17.213262 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:17.220784 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-976075b9-152d-4c31-bd9c-eb0961bc470c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1372 microversion: 2.1 time: 0.149995 Apr 30 22:20:17.221354 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3596/7089] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:17 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:17.966591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-77432047-cd2f-49e1-b24e-285df7b80a66 req-b9661bdf-cffb-4703-a052-23fde781c5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "name": "network-vif-plugged", "status": "completed", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:20:17.975280 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-77432047-cd2f-49e1-b24e-285df7b80a66 req-b9661bdf-cffb-4703-a052-23fde781c5ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:17.975739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-77432047-cd2f-49e1-b24e-285df7b80a66 req-b9661bdf-cffb-4703-a052-23fde781c5ed service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:17.986489 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-77432047-cd2f-49e1-b24e-285df7b80a66 req-b9661bdf-cffb-4703-a052-23fde781c5ed service nova] Creating event network-vif-plugged:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch2-master-1 Apr 30 22:20:17.991651 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-77432047-cd2f-49e1-b24e-285df7b80a66 req-b9661bdf-cffb-4703-a052-23fde781c5ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092478 Apr 30 22:20:17.992331 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3494/7090] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:20:18.238306 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:18.238930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:18.246291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:18.246778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:18.247554 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:18.248004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:18.376870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:18.384269 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7f777c9-884b-4180-8e7b-251d3907fd8f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1372 microversion: 2.1 time: 0.149934 Apr 30 22:20:18.384847 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3597/7091] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:18 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:19.402674 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:19.404322 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:19.411124 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:19.411711 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:19.412489 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:19.412947 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:19.551116 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:19.558644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-9a1d1fb8-ca06-44c3-a842-43efef5f6619 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1557 microversion: 2.1 time: 0.161401 Apr 30 22:20:19.559229 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3495/7092] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:19 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:19.575156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:20:19.575783 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:20:19.582572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:19.583030 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:19.583806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:19.584247 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:19.711025 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:20:19.718461 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0df764c5-270c-4c82-a4af-a94e4fd7a7a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1557 microversion: 2.1 time: 0.147121 Apr 30 22:20:19.719037 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3598/7093] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:20:19 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:20:22.063270 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-72dcae50-0d4a-41ae-b0be-b0252bd45d1a req-364b4e3d-8c5b-42c5-bda2-3129dbd985a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:20:22.072499 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-72dcae50-0d4a-41ae-b0be-b0252bd45d1a req-364b4e3d-8c5b-42c5-bda2-3129dbd985a4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:20:22.073053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-72dcae50-0d4a-41ae-b0be-b0252bd45d1a req-364b4e3d-8c5b-42c5-bda2-3129dbd985a4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:20:22.084515 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-72dcae50-0d4a-41ae-b0be-b0252bd45d1a req-364b4e3d-8c5b-42c5-bda2-3129dbd985a4 service nova] Creating event network-changed:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch2-master-1 Apr 30 22:20:22.089824 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-72dcae50-0d4a-41ae-b0be-b0252bd45d1a req-364b4e3d-8c5b-42c5-bda2-3129dbd985a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030421 Apr 30 22:20:22.090499 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3496/7094] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:22:01.144762 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:22:01.145338 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:22:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:22:14.938097 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:22:14.938762 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:14.944686 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:14.953254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:14.953254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:14.953254 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:14.968811 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lazy-loading 'flavor' on Instance uuid 4402920e-a2e4-4c06-8312-1709d6369b9e {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:22:15.441209 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-280195ae-5788-4d15-9db1-6b5bc9035a49 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "POST /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.508285 Apr 30 22:22:15.441807 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3599/7095] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:22:14 2022] POST /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:22:15.449039 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 30 22:22:15.450029 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 30 22:22:15.454237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:15.454963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:15.461314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:15.461909 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:15.464110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:15.464110 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:15.604179 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:15.611962 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-fc3d707d-e68b-4745-ad5a-5a80c728d441 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.165515 Apr 30 22:22:15.612530 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3497/7096] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:15 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:16.630976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:16.631685 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:16.638781 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:16.639242 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:16.640022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:16.640477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:16.774584 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:16.782085 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dae46d0c-a53a-473c-a01e-c4b2fdff060a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.156609 Apr 30 22:22:16.782659 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3600/7097] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:16 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:17.799626 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:17.800257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:17.814749 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39868. Apr 30 22:22:17.816911 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:17.817389 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:17.818210 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:17.818663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:17.825224 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39866. Apr 30 22:22:17.959444 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:17.966947 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-94d60a93-8c24-44bf-97fe-a1a2e71b73aa tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.171467 Apr 30 22:22:17.967519 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3498/7098] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:17 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:18.984718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:18.985374 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:18.992285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:18.992746 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:18.993876 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:18.994327 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:19.123956 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:19.131362 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-088be682-7291-4885-a9d3-ee98959558a7 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.150550 Apr 30 22:22:19.131934 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3601/7099] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:18 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:20.148814 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:20.149447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:20.156497 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:20.156968 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:20.157772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:20.158233 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:20.292561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:20.300087 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0a7282e6-2f17-4359-b426-67d6b3c52e17 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.155409 Apr 30 22:22:20.300657 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3499/7100] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:20 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:21.317182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:21.317830 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:21.325315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:21.325809 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:21.326603 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:21.327053 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:21.455391 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:21.462875 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1fb3dc3d-6962-400b-8fee-e353ddb9c927 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.149499 Apr 30 22:22:21.463349 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3602/7101] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:21 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:22.479944 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:22.480571 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:22.487597 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:22.488098 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:22.488955 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:22.489417 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:22.625556 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:22.633099 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c6ba8e57-71df-4510-b4c1-dcfd2349bd43 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.157084 Apr 30 22:22:22.633683 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3500/7102] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:22 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:23.650931 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:23.651456 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:23.658326 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:23.658787 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:23.659572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:23.660017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:23.792673 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:23.800189 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ac3bdd25-80e6-4941-834d-7ae4b259597a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.153874 Apr 30 22:22:23.800759 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3603/7103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:23 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:24.816450 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:24.817113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:24.824562 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:24.825034 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:24.825846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:24.826305 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:24.959266 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:24.966673 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-23ed9df2-020f-491b-a4e3-f2401c746720 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.154157 Apr 30 22:22:24.967239 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3501/7104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:24 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:25.984442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:25.985063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:25.991955 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:25.992407 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:25.993596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:25.994059 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:26.126562 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:26.134491 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1a334702-12bf-4998-87e2-002a7c10816a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1703 microversion: 2.1 time: 0.153780 Apr 30 22:22:26.135068 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3604/7105] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:25 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1703 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:27.152492 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:27.153102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:27.160107 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:27.160574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:27.161357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:27.161837 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:27.295019 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:27.302494 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cfb718fc-582f-4764-89f6-0fc1fbd21429 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1703 microversion: 2.1 time: 0.154482 Apr 30 22:22:27.303074 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3502/7106] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:27 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1703 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:28.322144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:28.322905 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:28.329512 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:28.330060 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:28.330926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:28.331369 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:28.473557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:28.491590 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-bcb8bd2d-5050-4120-b51c-0604984f32f0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.165577 Apr 30 22:22:28.491590 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3605/7107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:28 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:22:29.499764 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:29.501083 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:29.508672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:29.509388 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:29.510405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:29.511033 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:29.667216 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:29.676614 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-df370498-0bfb-4b2b-8305-700c13b851b0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.180869 Apr 30 22:22:29.677716 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3503/7108] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:29 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:30.465583 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-be3c35c0-3853-4646-a13f-a7614f5c6607 req-723eb28e-6ac1-4a3d-8a60-5be61c40fb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "name": "network-vif-plugged", "status": "completed", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:22:30.477106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-be3c35c0-3853-4646-a13f-a7614f5c6607 req-723eb28e-6ac1-4a3d-8a60-5be61c40fb22 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:30.477822 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-be3c35c0-3853-4646-a13f-a7614f5c6607 req-723eb28e-6ac1-4a3d-8a60-5be61c40fb22 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:30.492049 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-be3c35c0-3853-4646-a13f-a7614f5c6607 req-723eb28e-6ac1-4a3d-8a60-5be61c40fb22 service nova] Creating event network-vif-plugged:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch2-master-1 Apr 30 22:22:30.498895 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-be3c35c0-3853-4646-a13f-a7614f5c6607 req-723eb28e-6ac1-4a3d-8a60-5be61c40fb22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037781 Apr 30 22:22:30.499956 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3606/7109] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:22:30.694131 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:30.695804 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:30.703543 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:30.704096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:30.705139 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:30.705831 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:30.843591 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:30.854963 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-ab123423-caac-4a58-a2b0-e5c4d35156a0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.164725 Apr 30 22:22:30.855895 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3504/7110] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:30 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:31.874487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:31.875552 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:31.883335 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:31.887926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:31.887926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:31.887926 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:32.037140 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:32.046750 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0ffd187f-509f-44cb-bb41-b03023ff5504 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.177480 Apr 30 22:22:32.057495 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3607/7111] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:31 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:33.071769 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:33.072953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:33.081122 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:33.083332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:33.083332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:33.083332 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:33.230296 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:33.238912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2f919c35-5de1-44f8-b1ed-7e2285704a88 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.171436 Apr 30 22:22:33.239683 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3505/7112] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:33 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:34.256824 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:34.257509 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:34.265276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:34.265742 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:34.266572 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:34.267022 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:34.412642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:34.420243 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-be69f2c3-7391-4b2d-ad1f-0afec9848c89 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.167385 Apr 30 22:22:34.420810 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3608/7113] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:34 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:34.815373 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:22:34.827968 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:22:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:22:35.438478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:35.439120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:35.446326 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:35.446805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:35.448228 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:35.448695 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:35.602723 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:35.611759 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-2512591a-eb01-49a2-a224-01bb2698ef76 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.177166 Apr 30 22:22:35.612532 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3506/7114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:35 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:36.629659 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:36.630250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:36.638342 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:36.638795 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:36.639607 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:36.640058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:36.797373 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:36.805281 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2843512a-ae45-4bd7-9995-240791e4b76c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.179426 Apr 30 22:22:36.814195 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3609/7115] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:36 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:37.823836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:37.824474 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:37.831345 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:37.831828 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:37.832624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:37.833112 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:37.973698 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:37.981721 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a877112e-7875-4c47-bf18-be0f2b4f586b tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.162457 Apr 30 22:22:37.986583 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3507/7116] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:37 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:38.999511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:39.000135 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:39.007067 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:39.007529 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:39.008304 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:39.008748 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:39.141350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:39.148918 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fc5f410b-4944-4fcb-b39f-1f5e99e33c6f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1698 microversion: 2.1 time: 0.153381 Apr 30 22:22:39.153040 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3610/7117] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:38 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:40.166811 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:40.167348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:40.174201 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:40.174668 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:40.175453 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:40.175903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:40.316993 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:40.324551 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0680a5e3-f8ce-4d64-9051-cf29d42c4257 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1680 microversion: 2.1 time: 0.161828 Apr 30 22:22:40.325126 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3508/7118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:40 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:41.342263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:41.342807 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:41.349714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:41.350212 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:41.350993 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:41.351442 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:41.483896 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:41.491405 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e08b5679-f88d-4db6-ad85-32597074937a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1680 microversion: 2.1 time: 0.153244 Apr 30 22:22:41.491983 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3611/7119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:41 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:42.509119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:42.509743 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:42.516550 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:42.517017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:42.517833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:42.518291 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:42.646559 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:42.653941 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a6f1be47-7c83-496b-bbb3-2a7dd98b62e6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1623 microversion: 2.1 time: 0.148710 Apr 30 22:22:42.654518 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3509/7120] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:42 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1623 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:42.671120 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c4a70a7c-3c7d-4236-a175-981b5bc7f6f6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:22:42.671693 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c4a70a7c-3c7d-4236-a175-981b5bc7f6f6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:42.678431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a70a7c-3c7d-4236-a175-981b5bc7f6f6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:42.678885 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a70a7c-3c7d-4236-a175-981b5bc7f6f6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:42.679649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a70a7c-3c7d-4236-a175-981b5bc7f6f6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:42.680085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c4a70a7c-3c7d-4236-a175-981b5bc7f6f6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:42.935528 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c4a70a7c-3c7d-4236-a175-981b5bc7f6f6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "POST /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.268751 Apr 30 22:22:42.936068 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3612/7121] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:22:42 2022] POST /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:22:42.944225 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:42.944872 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:42.951533 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:42.952011 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:42.952821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:42.953285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:43.092694 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:43.100319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-560eac4a-7ec9-42c5-a45e-240a9016cc97 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1631 microversion: 2.1 time: 0.159981 Apr 30 22:22:43.101378 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3510/7122] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:42 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1631 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:44.119744 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:44.120291 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:44.126273 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:44.126728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:44.127500 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:44.127942 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:44.258918 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:44.267259 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-6b245810-2564-4596-bc8f-f9fe3a1e7b6d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1631 microversion: 2.1 time: 0.152670 Apr 30 22:22:44.267844 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3613/7123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:44 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1631 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:44.484064 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-9e365887-077f-4ffe-9344-7db11a4e8c35 req-b2bc0420-3acb-4055-bbd8-a84f6035abb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "name": "network-vif-unplugged", "status": "completed", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:22:44.493449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9e365887-077f-4ffe-9344-7db11a4e8c35 req-b2bc0420-3acb-4055-bbd8-a84f6035abb9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:44.493953 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-9e365887-077f-4ffe-9344-7db11a4e8c35 req-b2bc0420-3acb-4055-bbd8-a84f6035abb9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:44.505577 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-9e365887-077f-4ffe-9344-7db11a4e8c35 req-b2bc0420-3acb-4055-bbd8-a84f6035abb9 service nova] Creating event network-vif-unplugged:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch1-master-1 Apr 30 22:22:44.510980 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-9e365887-077f-4ffe-9344-7db11a4e8c35 req-b2bc0420-3acb-4055-bbd8-a84f6035abb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030839 Apr 30 22:22:44.516830 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3511/7124] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:22:45.284721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:45.285376 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:45.292842 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:45.292945 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:45.294302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:45.294812 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:45.556445 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:45.567576 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5d6c95a5-fc26-45d8-ae5c-db920e3f52bc tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.286723 Apr 30 22:22:45.568096 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3614/7125] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:45 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:45.806374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-c761a9eb-cbb9-43c0-8a2d-5af69b03aa9b req-ff181df5-98ce-49b9-8164-870666bb82bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:22:45.816120 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c761a9eb-cbb9-43c0-8a2d-5af69b03aa9b req-ff181df5-98ce-49b9-8164-870666bb82bd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:45.816783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-c761a9eb-cbb9-43c0-8a2d-5af69b03aa9b req-ff181df5-98ce-49b9-8164-870666bb82bd service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:45.836805 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-c761a9eb-cbb9-43c0-8a2d-5af69b03aa9b req-ff181df5-98ce-49b9-8164-870666bb82bd service nova] Creating event network-changed:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch1-master-1 Apr 30 22:22:45.842893 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-c761a9eb-cbb9-43c0-8a2d-5af69b03aa9b req-ff181df5-98ce-49b9-8164-870666bb82bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042840 Apr 30 22:22:45.844038 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3512/7126] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:22:46.591690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:46.593002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:46.603881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:46.604341 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:46.605199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:46.606485 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:46.832172 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:46.849795 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0b73de20-4e2d-43de-9c2a-934f3911985a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.266281 Apr 30 22:22:46.851642 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3615/7127] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:46 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:47.871117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:47.871861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:47.879889 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:47.883458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:47.883458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:47.883458 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:48.037570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:48.047008 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-8b2df3ff-9c5b-404d-8167-78ba227f9af0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.181897 Apr 30 22:22:48.048301 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3513/7128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:47 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:49.065730 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:49.066494 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:49.073734 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:49.074245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:49.074996 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:49.075444 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:49.218350 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:49.226093 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1c4c6aaf-644a-4255-9e63-dfb76a92af1f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.164217 Apr 30 22:22:49.226703 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3616/7129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:49 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:50.243365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:50.244358 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:50.252519 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:50.253032 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:50.254186 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:50.254952 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:50.434171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:50.443315 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-15888db8-b774-47f0-b08a-66703f6d1151 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.203855 Apr 30 22:22:50.444809 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3514/7130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:50 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:51.462303 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:51.463079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:51.470697 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:51.471153 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:51.472010 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:51.472517 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:51.634315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:51.643064 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-31047faf-c719-4e9d-a378-2ea115968395 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.184619 Apr 30 22:22:51.643654 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3617/7131] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:51 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:52.667413 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:52.668052 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:52.675082 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:52.675561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:52.676382 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:52.676850 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:52.830448 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:52.838735 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-d218f285-e19b-4161-8058-f7fb83a7af85 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.181698 Apr 30 22:22:52.839406 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3515/7132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:52 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:53.913352 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:53.914159 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:53.920950 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:53.921410 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:53.922234 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:53.922677 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:54.079027 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:54.086710 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d8aa47ab-0d06-4401-810a-55b03cc42e41 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.177428 Apr 30 22:22:54.089120 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3618/7133] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:53 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:55.104246 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:55.104984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:55.111772 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:55.112237 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:55.113048 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:55.113501 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:55.243898 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:55.251335 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-02edf60e-39bd-4245-b728-f61726bdb1a6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.151053 Apr 30 22:22:55.251906 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3516/7134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:55 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:56.268320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:56.269681 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:56.276626 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:56.281427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:56.281427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:56.281427 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:56.450337 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:56.458264 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-da6a1436-f07d-4c38-b87b-620a29e664b4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.193666 Apr 30 22:22:56.458875 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3619/7135] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:56 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:57.476017 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:57.476659 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:57.484247 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:57.484721 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:57.485561 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:57.486057 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:57.624117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:57.631602 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0c9e12d6-dc13-464b-a33c-88f8daf3980c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.159576 Apr 30 22:22:57.632178 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3517/7136] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:57 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:58.648975 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:58.649530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:58.656866 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:58.657320 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:58.658128 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:58.658580 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:58.787248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:22:58.795349 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c0640d1f-2ee4-42cf-85c5-bb83cd6cd4c0 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.150445 Apr 30 22:22:58.795919 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3620/7137] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:58 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:22:59.613255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-87d5693b-1fcc-4d5f-b4e7-e08d6fec2d01 req-db370901-a546-4be6-b73b-19c34d7bb93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "name": "network-vif-plugged", "status": "completed", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:22:59.623303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-87d5693b-1fcc-4d5f-b4e7-e08d6fec2d01 req-db370901-a546-4be6-b73b-19c34d7bb93d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:59.623761 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-87d5693b-1fcc-4d5f-b4e7-e08d6fec2d01 req-db370901-a546-4be6-b73b-19c34d7bb93d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:59.634793 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-87d5693b-1fcc-4d5f-b4e7-e08d6fec2d01 req-db370901-a546-4be6-b73b-19c34d7bb93d service nova] Creating event network-vif-plugged:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch1-master-1 Apr 30 22:22:59.640210 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-87d5693b-1fcc-4d5f-b4e7-e08d6fec2d01 req-db370901-a546-4be6-b73b-19c34d7bb93d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030740 Apr 30 22:22:59.642901 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3518/7138] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:22:59.813532 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:22:59.814184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:22:59.821096 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:59.821560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:22:59.822368 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:22:59.822819 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:23:00.007503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:23:00.014999 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a829bdb0-3aab-4d1d-9a47-ca9b8a475a48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.206157 Apr 30 22:23:00.015583 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3621/7139] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:22:59 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:23:01.032960 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:23:01.033688 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:23:01.040861 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:23:01.041339 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:23:01.042171 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:23:01.042634 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:23:01.176226 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:23:01.183719 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-802d8035-c0fa-4851-9c4f-9626202a6dfe tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.155127 Apr 30 22:23:01.184843 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3519/7140] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:23:01 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:23:02.201249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:23:02.202002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:23:02.208065 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:23:02.208463 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:23:02.209259 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:23:02.209698 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:23:02.347769 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:23:02.355256 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-955991d6-0bca-44ba-9343-4882610b28ab tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1689 microversion: 2.1 time: 0.158815 Apr 30 22:23:02.355828 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3622/7141] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:23:02 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:23:03.373220 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:23:03.373878 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:23:03.380933 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:23:03.381403 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:23:03.382243 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:23:03.382701 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:23:03.511157 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:23:03.518616 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-134a4beb-4911-417e-a0fa-409cb499689c tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1676 microversion: 2.1 time: 0.149936 Apr 30 22:23:03.519245 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3520/7142] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:23:03 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:17.089719 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-e75e69f2-6969-40d3-bbfc-3dc6bbad8a37 req-5db22fb0-8067-4720-9a35-3a2db5387671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:24:17.093423 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:17.097210 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:17.103477 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:17.104066 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:17.105002 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:17.105119 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e75e69f2-6969-40d3-bbfc-3dc6bbad8a37 req-5db22fb0-8067-4720-9a35-3a2db5387671 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:17.105451 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:17.105569 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-e75e69f2-6969-40d3-bbfc-3dc6bbad8a37 req-5db22fb0-8067-4720-9a35-3a2db5387671 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:17.118240 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-e75e69f2-6969-40d3-bbfc-3dc6bbad8a37 req-5db22fb0-8067-4720-9a35-3a2db5387671 service nova] Creating event network-changed:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch1-master-1 Apr 30 22:24:17.123473 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-e75e69f2-6969-40d3-bbfc-3dc6bbad8a37 req-5db22fb0-8067-4720-9a35-3a2db5387671 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038550 Apr 30 22:24:17.125025 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3521/7143] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:24:17.133859 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:24:17.509342 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b376d30e-50bf-4fa3-b937-31a74a7e4862 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 204 len: 0 microversion: 2.1 time: 0.427059 Apr 30 22:24:17.510455 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3623/7144] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:24:17 2022] DELETE /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:24:17.520285 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:17.527162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:17.528832 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:17.529303 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:17.531097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:17.531495 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:17.731146 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:17.739319 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-06cccdae-89bc-409d-b988-d1544ebb465d tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.224403 Apr 30 22:24:17.739894 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3522/7145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:17 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:18.758205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:18.758914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:18.766515 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:18.766976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:18.767766 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:18.768308 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:18.964186 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:18.971925 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-08dba9f9-aa8f-4f41-bca5-210f578dc482 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1682 microversion: 2.1 time: 0.218097 Apr 30 22:24:18.972500 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3624/7146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:18 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:19.518851 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-acaa5ad0-a7e4-497a-a4ca-bc35f955b08b req-91acc303-c392-44fa-8f6b-9d45241d732a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4402920e-a2e4-4c06-8312-1709d6369b9e", "name": "network-vif-deleted", "tag": "45c27e4e-f3d0-4ccb-b626-ace9a949fa99"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:24:19.526979 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-acaa5ad0-a7e4-497a-a4ca-bc35f955b08b req-91acc303-c392-44fa-8f6b-9d45241d732a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:19.527446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-acaa5ad0-a7e4-497a-a4ca-bc35f955b08b req-91acc303-c392-44fa-8f6b-9d45241d732a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:19.538631 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-acaa5ad0-a7e4-497a-a4ca-bc35f955b08b req-91acc303-c392-44fa-8f6b-9d45241d732a service nova] Creating event network-vif-deleted:45c27e4e-f3d0-4ccb-b626-ace9a949fa99 for instance 4402920e-a2e4-4c06-8312-1709d6369b9e on nch1-master-1 Apr 30 22:24:19.543572 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-acaa5ad0-a7e4-497a-a4ca-bc35f955b08b req-91acc303-c392-44fa-8f6b-9d45241d732a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028773 Apr 30 22:24:19.544155 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3523/7147] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:24:19.991232 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:19.991900 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:19.999300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:19.999790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:20.000593 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:20.001040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:20.035978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:20.036363 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:20.036828 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lazy-loading 'fault' on Instance uuid 4402920e-a2e4-4c06-8312-1709d6369b9e {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:24:20.083095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:20.090872 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d0024665-56dc-4fba-8cc7-d4a362d3dc5a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 200 len: 1336 microversion: 2.1 time: 0.103911 Apr 30 22:24:20.091445 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3625/7148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:19 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:21.110288 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:21.111001 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 4402920e-a2e4-4c06-8312-1709d6369b9e] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:21.117459 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:21.117963 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:21.118870 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:21.119204 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:21.132413 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] HTTP exception thrown: Instance 4402920e-a2e4-4c06-8312-1709d6369b9e could not be found. Apr 30 22:24:21.133018 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Returning 404 to user: Instance 4402920e-a2e4-4c06-8312-1709d6369b9e could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:24:21.133899 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-59dafe18-7ac1-4dd9-a2a8-927d78b8fe48 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e" status: 404 len: 111 microversion: 2.1 time: 0.029148 Apr 30 22:24:21.134415 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3524/7149] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:21 2022] GET /compute/v2.1/servers/4402920e-a2e4-4c06-8312-1709d6369b9e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:24:21.364910 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e26206b1-85c4-403a-b87b-543357b37614 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '.version_select at 0x7fdc134a91f0>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:21.435702 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e26206b1-85c4-403a-b87b-543357b37614 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-818356273" status: 202 len: 0 microversion: 2.1 time: 0.074813 Apr 30 22:24:21.436322 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3626/7150] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 22:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-818356273 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:24:21.459421 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Action: 'create', calling method: .version_select at 0x7fdc10041b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1570131156"}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:24:21.473117 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:24:21.478241 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for user d303e4f4105348928c5697b11e69a3d1 and project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:24:21.491383 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [efe9c23c-6155-4977-bdb4-08e62de1101d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 22:24:22.498968 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [efe9c23c-6155-4977-bdb4-08e62de1101d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40178. Apr 30 22:24:22.702425 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:24:22.707660 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for user d303e4f4105348928c5697b11e69a3d1 and project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'key_pairs'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:24:22.722714 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-cf6a4c99-c9b7-47b4-a9ad-6b9a2d8e15cd tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.267310 Apr 30 22:24:22.723336 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3525/7151] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:24:21 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:29.828142 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1702347513", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1570131156", "security_groups": [{"name": "tempest-secgroup-smoke-1689282925"}], "networks": [{"uuid": "03778a8b-a449-4615-bf38-12386fc793ea"}], "block_device_mapping_v2": [{"uuid": "ba641aff-2e83-4e62-b722-0db065460767", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:24:29.937106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] validate_networks() for [('03778a8b-a449-4615-bf38-12386fc793ea', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:24:30.305300 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:24:30.305726 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:24:30.306249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:24:30.306660 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:24:30.307105 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:24:30.316270 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:30.316716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:30.317514 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:30.317985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:30.334838 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:24:30.340250 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Getting quotas for user d303e4f4105348928c5697b11e69a3d1 and project 7a470c13c84849f28ff3b1d4bb55c4e4. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:24:30.397417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:24:30.399553 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba641aff-2e83-4e62-b722-0db065460767',volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:24:30.737827 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d3ce055f-987b-4a40-95c2-4a3baa879d2a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.914791 Apr 30 22:24:30.738485 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3627/7152] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:24:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:24:30.749697 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b7e5f0d9-00f5-48f7-9e1a-edcf37c70f64 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:30.750359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b7e5f0d9-00f5-48f7-9e1a-edcf37c70f64 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:30.802891 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b7e5f0d9-00f5-48f7-9e1a-edcf37c70f64 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:30.809407 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b7e5f0d9-00f5-48f7-9e1a-edcf37c70f64 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1089 microversion: 2.1 time: 0.064630 Apr 30 22:24:30.810020 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3526/7153] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:30 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:31.827245 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ca610252-6eb0-45e1-8c84-658dc225f4a4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:31.828003 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ca610252-6eb0-45e1-8c84-658dc225f4a4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:31.880755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ca610252-6eb0-45e1-8c84-658dc225f4a4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:31.887570 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ca610252-6eb0-45e1-8c84-658dc225f4a4 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1089 microversion: 2.1 time: 0.065206 Apr 30 22:24:31.888135 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3628/7154] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:31 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:32.904691 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-21db536c-6593-439c-ad02-ae22ba2644b6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:32.905430 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-21db536c-6593-439c-ad02-ae22ba2644b6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:32.963066 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-21db536c-6593-439c-ad02-ae22ba2644b6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:32.970006 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-21db536c-6593-439c-ad02-ae22ba2644b6 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1089 microversion: 2.1 time: 0.069391 Apr 30 22:24:32.970748 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3527/7155] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:32 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:33.985732 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c1291842-f2f8-48e8-a421-cbe1829e4029 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:33.986365 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c1291842-f2f8-48e8-a421-cbe1829e4029 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:34.038198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-c1291842-f2f8-48e8-a421-cbe1829e4029 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:34.044678 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c1291842-f2f8-48e8-a421-cbe1829e4029 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1089 microversion: 2.1 time: 0.062843 Apr 30 22:24:34.045243 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3629/7156] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:33 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:35.060732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:35.061365 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:35.068693 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:35.069256 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:35.070102 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:35.070565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:35.130128 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:35.137479 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-af870342-31d4-4526-8310-4e302abeb802 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1139 microversion: 2.1 time: 0.080700 Apr 30 22:24:35.138088 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3528/7157] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:35 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:36.154403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:36.155021 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:36.163092 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:36.163438 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:36.164249 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:36.164692 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:36.225371 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:36.232818 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-05ba8fa2-76c7-4783-988b-c59b13c23089 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1187 microversion: 2.1 time: 0.082334 Apr 30 22:24:36.237616 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3630/7158] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:36 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:37.267213 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:37.278523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:37.289531 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:37.290276 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:37.291895 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:37.293113 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:37.491918 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:37.502678 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-11c9adec-a82d-480a-9c17-eb514d44dc28 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1273 microversion: 2.1 time: 0.255354 Apr 30 22:24:37.503479 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3529/7159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:37 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:38.195170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-fbc6c62c-0a17-49c6-823e-c3f302952d7d req-ccfe9a4c-9ede-4715-8873-33053bcf7276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7b75d4-f0ac-4040-862f-8db27e715640", "tag": "1df50351-80c7-4d86-b5f4-fd3518c1f068"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:24:38.210157 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fbc6c62c-0a17-49c6-823e-c3f302952d7d req-ccfe9a4c-9ede-4715-8873-33053bcf7276 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:38.211488 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-fbc6c62c-0a17-49c6-823e-c3f302952d7d req-ccfe9a4c-9ede-4715-8873-33053bcf7276 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:38.228284 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-fbc6c62c-0a17-49c6-823e-c3f302952d7d req-ccfe9a4c-9ede-4715-8873-33053bcf7276 service nova] Creating event network-changed:1df50351-80c7-4d86-b5f4-fd3518c1f068 for instance 3b7b75d4-f0ac-4040-862f-8db27e715640 on nch2-master-1 Apr 30 22:24:38.233387 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-fbc6c62c-0a17-49c6-823e-c3f302952d7d req-ccfe9a4c-9ede-4715-8873-33053bcf7276 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043291 Apr 30 22:24:38.234136 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3631/7160] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:24:38.521080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:38.521644 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:38.528516 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:38.528989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:38.529819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:38.530277 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:38.752796 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:38.760558 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-12bbff5f-3815-4f97-a239-47dc251c9882 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1261 microversion: 2.1 time: 0.243517 Apr 30 22:24:38.761150 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3530/7161] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:38 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:39.780115 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:39.780820 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:39.787063 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:39.787510 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:39.788277 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:39.788716 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:39.920534 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:39.928519 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d6ce0abe-1897-46f6-b9a6-4787fd0b8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1261 microversion: 2.1 time: 0.153543 Apr 30 22:24:39.929109 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3632/7162] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:39 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:24:40.945235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:40.945903 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:40.952708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:40.953184 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:40.954022 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:40.954481 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:41.098062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:41.105675 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-7bcc632d-0798-46ee-aa49-c5b923dab705 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1261 microversion: 2.1 time: 0.164438 Apr 30 22:24:41.106294 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3531/7163] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:40 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:42.122465 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:42.123114 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:42.130474 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:42.130933 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:42.131717 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:42.132162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:42.264784 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:42.272973 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d68a0e07-2691-42b5-8268-cb424813781f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1261 microversion: 2.1 time: 0.154302 Apr 30 22:24:42.274360 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3633/7164] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:42 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:43.290061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:43.290705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:43.297549 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:43.298061 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:43.298860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:43.299327 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:43.437783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:43.445378 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24003aad-ccef-4e93-bcbf-5327e6827e1e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1261 microversion: 2.1 time: 0.159225 Apr 30 22:24:43.445988 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3532/7165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:43 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:44.462586 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:44.463199 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:44.469947 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:44.470400 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:44.471167 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:44.471604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:44.602182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:44.609490 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d96d4fad-e52e-4c60-9608-fa6ce464c78f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1261 microversion: 2.1 time: 0.150763 Apr 30 22:24:44.610084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3634/7166] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:44 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:45.093783 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-4864ca5d-870b-4ae7-973d-6142106d6f1a req-8e0d7165-a7e2-4ca7-99b9-0c972cf1359a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7b75d4-f0ac-4040-862f-8db27e715640", "name": "network-vif-plugged", "status": "completed", "tag": "1df50351-80c7-4d86-b5f4-fd3518c1f068"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:24:45.103130 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4864ca5d-870b-4ae7-973d-6142106d6f1a req-8e0d7165-a7e2-4ca7-99b9-0c972cf1359a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:45.103601 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-4864ca5d-870b-4ae7-973d-6142106d6f1a req-8e0d7165-a7e2-4ca7-99b9-0c972cf1359a service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:45.115192 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-4864ca5d-870b-4ae7-973d-6142106d6f1a req-8e0d7165-a7e2-4ca7-99b9-0c972cf1359a service nova] Creating event network-vif-plugged:1df50351-80c7-4d86-b5f4-fd3518c1f068 for instance 3b7b75d4-f0ac-4040-862f-8db27e715640 on nch2-master-1 Apr 30 22:24:45.120462 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-4864ca5d-870b-4ae7-973d-6142106d6f1a req-8e0d7165-a7e2-4ca7-99b9-0c972cf1359a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030518 Apr 30 22:24:45.121055 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3533/7167] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:24:45.626170 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:45.626790 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:45.633604 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:45.634095 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:45.634877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:45.635319 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:45.766203 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:45.773622 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-03ca8618-7524-4ada-8104-ef276e82d0d1 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1261 microversion: 2.1 time: 0.151472 Apr 30 22:24:45.774224 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3635/7168] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:45 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:46.792090 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:46.792806 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:46.799655 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:46.800118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:46.800904 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:46.801357 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:46.927840 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:46.935296 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-557b48ec-d19b-41c5-9f3f-f4f1d51201fb tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1446 microversion: 2.1 time: 0.148365 Apr 30 22:24:46.935862 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3534/7169] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:46 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:46.951256 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:24:46.951881 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:24:46.958728 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:46.959182 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:46.959957 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:46.960403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:47.097969 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:24:47.105985 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4694af30-01bf-4738-8f92-f125fbd7e36a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1446 microversion: 2.1 time: 0.158595 Apr 30 22:24:47.106556 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3636/7170] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:24:46 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:24:49.380512 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-12cc466a-6e6a-4484-a47d-8e06b0de28fc req-02d52f71-de40-4863-abc3-cf82ab93d320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7b75d4-f0ac-4040-862f-8db27e715640", "tag": "1df50351-80c7-4d86-b5f4-fd3518c1f068"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:24:49.388815 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-12cc466a-6e6a-4484-a47d-8e06b0de28fc req-02d52f71-de40-4863-abc3-cf82ab93d320 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:24:49.389255 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-12cc466a-6e6a-4484-a47d-8e06b0de28fc req-02d52f71-de40-4863-abc3-cf82ab93d320 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:24:49.400315 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-12cc466a-6e6a-4484-a47d-8e06b0de28fc req-02d52f71-de40-4863-abc3-cf82ab93d320 service nova] Creating event network-changed:1df50351-80c7-4d86-b5f4-fd3518c1f068 for instance 3b7b75d4-f0ac-4040-862f-8db27e715640 on nch2-master-1 Apr 30 22:24:49.405342 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-12cc466a-6e6a-4484-a47d-8e06b0de28fc req-02d52f71-de40-4863-abc3-cf82ab93d320 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086305 Apr 30 22:24:49.406353 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3535/7171] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:25:18.063002 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:25:18.063626 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:25:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:27:01.154924 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:27:01.155533 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:27:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:27:34.824858 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:27:34.825563 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:27:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:27:41.386089 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:27:41.386612 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:28:07.147910 ncdv-master-1 devstack@n-api.service[130671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 22:28:07.148874 ncdv-master-1 devstack@n-api.service[130671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [306cf566-6014-4b35-a2ad-51934902a33f] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 22:28:07.201036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-c275e43c-3b22-4837-b7e9-8d6f91401cb5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:07.203205 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-c275e43c-3b22-4837-b7e9-8d6f91401cb5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:07.211077 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c275e43c-3b22-4837-b7e9-8d6f91401cb5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:07.216246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c275e43c-3b22-4837-b7e9-8d6f91401cb5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:07.216246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c275e43c-3b22-4837-b7e9-8d6f91401cb5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:07.216246 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-c275e43c-3b22-4837-b7e9-8d6f91401cb5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:08.157612 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40508. Apr 30 22:28:08.168810 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] [306cf566-6014-4b35-a2ad-51934902a33f] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40510. Apr 30 22:28:08.168810 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-c275e43c-3b22-4837-b7e9-8d6f91401cb5 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "POST /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640/action" status: 200 len: 24567 microversion: 2.1 time: 1.016417 Apr 30 22:28:08.168810 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3637/7172] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:28:07 2022] POST /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640/action => generated 24567 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 22:28:09.133808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a5102576-8636-4f3d-9a58-f70acbdce14a req-e9b0f6c3-fc0f-481b-b9bd-8ea506a85c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7b75d4-f0ac-4040-862f-8db27e715640", "tag": "1df50351-80c7-4d86-b5f4-fd3518c1f068"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:09.138750 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 22:28:09.139586 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 22:28:09.144446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:09.145053 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:09.153163 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a5102576-8636-4f3d-9a58-f70acbdce14a req-e9b0f6c3-fc0f-481b-b9bd-8ea506a85c40 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:09.153618 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a5102576-8636-4f3d-9a58-f70acbdce14a req-e9b0f6c3-fc0f-481b-b9bd-8ea506a85c40 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:09.154109 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:09.154737 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:09.155553 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:09.156025 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:09.165490 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a5102576-8636-4f3d-9a58-f70acbdce14a req-e9b0f6c3-fc0f-481b-b9bd-8ea506a85c40 service nova] Creating event network-changed:1df50351-80c7-4d86-b5f4-fd3518c1f068 for instance 3b7b75d4-f0ac-4040-862f-8db27e715640 on nch2-master-1 Apr 30 22:28:09.170548 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a5102576-8636-4f3d-9a58-f70acbdce14a req-e9b0f6c3-fc0f-481b-b9bd-8ea506a85c40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041561 Apr 30 22:28:09.171139 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3638/7173] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:28:09.185348 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Going to try to terminate instance {{(pid=130670) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:28:09.514871 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6a57174a-96a2-4e99-939f-dbdd95c9e63f tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 204 len: 0 microversion: 2.1 time: 0.387980 Apr 30 22:28:09.515577 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3536/7174] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:28:09 2022] DELETE /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:28:09.525146 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:09.525887 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:09.533144 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:09.533596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:09.534412 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:09.534854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:09.671431 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:09.679941 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-db8c0e06-f3ec-4c5d-bc0f-31cc69bb8793 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1571 microversion: 2.1 time: 0.159693 Apr 30 22:28:09.680565 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3639/7175] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:09 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 22:28:10.700729 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:10.701466 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:10.712820 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:10.713299 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:10.714143 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:10.714611 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:10.719376 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40528. Apr 30 22:28:10.721814 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40530. Apr 30 22:28:10.855047 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:10.862859 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-76b55603-70a0-4d6b-ab7d-9b356489880a tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1571 microversion: 2.1 time: 0.166702 Apr 30 22:28:10.863431 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3537/7176] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:10 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:11.685286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-193d1824-55d4-4f99-affe-624c118588c1 req-e609195e-56b2-4645-ae41-174202f18322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7b75d4-f0ac-4040-862f-8db27e715640", "name": "network-vif-deleted", "tag": "1df50351-80c7-4d86-b5f4-fd3518c1f068"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:11.693522 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-193d1824-55d4-4f99-affe-624c118588c1 req-e609195e-56b2-4645-ae41-174202f18322 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:11.694040 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-193d1824-55d4-4f99-affe-624c118588c1 req-e609195e-56b2-4645-ae41-174202f18322 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:11.709154 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-193d1824-55d4-4f99-affe-624c118588c1 req-e609195e-56b2-4645-ae41-174202f18322 service nova] Creating event network-vif-deleted:1df50351-80c7-4d86-b5f4-fd3518c1f068 for instance 3b7b75d4-f0ac-4040-862f-8db27e715640 on nch2-master-1 Apr 30 22:28:11.714158 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-193d1824-55d4-4f99-affe-624c118588c1 req-e609195e-56b2-4645-ae41-174202f18322 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082894 Apr 30 22:28:11.714798 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3640/7177] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:28:11.879816 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:11.880485 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:11.887359 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:11.887836 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:11.888663 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:11.889405 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:11.964780 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd303e4f4105348928c5697b11e69a3d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a470c13c84849f28ff3b1d4bb55c4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:11.973268 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-26ab34e8-42ab-4f36-971d-0e25381b3e4e tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 200 len: 1220 microversion: 2.1 time: 0.097461 Apr 30 22:28:11.973875 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3538/7178] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:11 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:12.992266 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:12.992976 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] [instance: 3b7b75d4-f0ac-4040-862f-8db27e715640] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:12.999281 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:12.999743 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:13.000524 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:13.000971 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:13.014553 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.wsgi [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] HTTP exception thrown: Instance 3b7b75d4-f0ac-4040-862f-8db27e715640 could not be found. Apr 30 22:28:13.015185 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Returning 404 to user: Instance 3b7b75d4-f0ac-4040-862f-8db27e715640 could not be found. {{(pid=130671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:28:13.016041 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e6062a7e-b198-4fd4-bb0f-af8586f5f1df tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640" status: 404 len: 111 microversion: 2.1 time: 0.028891 Apr 30 22:28:13.016566 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3641/7179] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:12 2022] GET /compute/v2.1/servers/3b7b75d4-f0ac-4040-862f-8db27e715640 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:28:13.231594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4230ce5b-b337-4a2f-9f92-2c29a88ad7c9 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] Calling method '.version_select at 0x7fdc20032af0>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:13.333197 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4230ce5b-b337-4a2f-9f92-2c29a88ad7c9 tempest-TestShelveInstance-184288386 tempest-TestShelveInstance-184288386-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1570131156" status: 202 len: 0 microversion: 2.1 time: 0.105468 Apr 30 22:28:13.333827 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3539/7180] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 22:28:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1570131156 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:28:35.377569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7ca7427c-b139-4c59-af6d-26fa0ee6df4b tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Action: 'create', calling method: .version_select at 0x7fdc22e89160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-921526492"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:35.392570 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7ca7427c-b139-4c59-af6d-26fa0ee6df4b tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:28:35.398711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7ca7427c-b139-4c59-af6d-26fa0ee6df4b tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for user c7b2e90478f846f6adb5bd5630e97293 and project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:28:35.635333 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7ca7427c-b139-4c59-af6d-26fa0ee6df4b tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:28:35.640747 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-7ca7427c-b139-4c59-af6d-26fa0ee6df4b tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for user c7b2e90478f846f6adb5bd5630e97293 and project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'key_pairs'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:28:35.657039 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7ca7427c-b139-4c59-af6d-26fa0ee6df4b tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.457006 Apr 30 22:28:35.657641 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3642/7181] 10.222.0.23 () {60 vars in 1157 bytes} [Sat Apr 30 22:28:35 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:38.071230 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:28:38.071691 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:28:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:28:38.083016 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-273019644", "imageRef": "a5b0850f-3b24-4bcb-b0a7-351c3216b27d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-921526492", "security_groups": [{"name": "tempest-secgroup-smoke-701458678"}], "networks": [{"uuid": "8804c295-ff20-4872-8362-6c333cf4f440"}]}} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:38.191224 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.network.neutron [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] validate_networks() for [('8804c295-ff20-4872-8362-6c333cf4f440', None, None, None, None, None)] {{(pid=130670) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:28:38.664590 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Flavor limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:28:38.665067 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Image limits 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:28:38.665565 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Flavor pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:28:38.666042 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Image pref 0:0:0 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:28:38.666478 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.virt.hardware [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:28:38.675442 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:38.675917 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:38.676747 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:38.677212 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:38.694905 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:28:38.700279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.quota [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for user c7b2e90478f846f6adb5bd5630e97293 and project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'ram', 'instances', 'cores'} {{(pid=130670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:28:38.713623 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Going to run 1 instances... {{(pid=130670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:28:38.715981 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5b0850f-3b24-4bcb-b0a7-351c3216b27d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:28:38.823978 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-254ed1f4-3cde-4e6c-af3b-3397e7f64b2a tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745384 Apr 30 22:28:38.829986 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3540/7182] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:28:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:28:38.836622 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-ef58914a-b306-4730-a7d2-67907db15577 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:38.837263 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-ef58914a-b306-4730-a7d2-67907db15577 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:38.910489 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-ef58914a-b306-4730-a7d2-67907db15577 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:38.917225 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-ef58914a-b306-4730-a7d2-67907db15577 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1247 microversion: 2.1 time: 0.085887 Apr 30 22:28:38.918084 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3643/7183] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:38 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1247 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:39.934738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-6342ab7f-e6e3-4ca7-8f55-2ff0eb2306b5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:39.935464 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-6342ab7f-e6e3-4ca7-8f55-2ff0eb2306b5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:39.991541 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-6342ab7f-e6e3-4ca7-8f55-2ff0eb2306b5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:39.999004 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-6342ab7f-e6e3-4ca7-8f55-2ff0eb2306b5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1247 microversion: 2.1 time: 0.068379 Apr 30 22:28:39.999659 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3541/7184] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:39 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:41.015544 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:41.016765 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:41.024755 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:41.025216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:41.026690 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:41.027248 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:41.095325 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:41.103449 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a4d64673-4863-4641-a801-6acd205406ad tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1307 microversion: 2.1 time: 0.091872 Apr 30 22:28:41.104039 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3644/7185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:41 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:42.120732 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:42.121273 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:42.128235 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:42.130765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:42.130765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:42.130765 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:42.322118 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:42.329908 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-855f8a58-c91d-46f6-bf12-c57feddea3e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1372 microversion: 2.1 time: 0.213072 Apr 30 22:28:42.331366 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3542/7186] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:42 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:42.787074 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-9e40da6d-e7ae-4ef6-bd73-7e1c415d1f5c req-353a81cb-4119-48c3-8b33-cf4ac386a2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f41c3ec-c1e0-4774-8957-1c9f857c43c2", "tag": "21c7c060-a2ef-4830-b401-b20129814dd0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:42.796642 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9e40da6d-e7ae-4ef6-bd73-7e1c415d1f5c req-353a81cb-4119-48c3-8b33-cf4ac386a2c3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:42.797098 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-9e40da6d-e7ae-4ef6-bd73-7e1c415d1f5c req-353a81cb-4119-48c3-8b33-cf4ac386a2c3 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:42.815862 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-9e40da6d-e7ae-4ef6-bd73-7e1c415d1f5c req-353a81cb-4119-48c3-8b33-cf4ac386a2c3 service nova] Creating event network-changed:21c7c060-a2ef-4830-b401-b20129814dd0 for instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 on nch2-master-1 Apr 30 22:28:42.821719 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-9e40da6d-e7ae-4ef6-bd73-7e1c415d1f5c req-353a81cb-4119-48c3-8b33-cf4ac386a2c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038110 Apr 30 22:28:42.822434 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3645/7187] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:28:43.348333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:43.349023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:43.356104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:43.356574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:43.357835 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:43.358292 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:43.555630 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:43.562328 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-bab8fd1e-695a-44ea-8240-3a57720765c1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1372 microversion: 2.1 time: 0.218903 Apr 30 22:28:43.562896 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3543/7188] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:43 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:44.581162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:44.581914 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:44.588275 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:44.588736 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:44.589521 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:44.590004 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:44.735649 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:44.743971 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1dee865-edc4-49e5-9c40-281b1beb6df7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1372 microversion: 2.1 time: 0.167917 Apr 30 22:28:44.744550 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3646/7189] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:44 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:45.760570 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:45.761196 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:45.768002 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:45.768471 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:45.769257 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:45.769709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:45.896709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:45.905852 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-19e81a4a-f34f-4b9f-99b9-e2d272c32ae4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1372 microversion: 2.1 time: 0.149141 Apr 30 22:28:45.906419 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3544/7190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:45 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:46.923858 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:46.924478 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:46.931324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:46.931779 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:46.932557 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:46.933008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:47.062348 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:47.070237 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1e3fff9a-76e6-4bb7-b073-08e25fe933ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1372 microversion: 2.1 time: 0.150765 Apr 30 22:28:47.070800 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3647/7191] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:46 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:48.087290 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:48.087923 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:48.095183 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:48.095656 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:48.096449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:48.096910 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:48.205930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-a7da5193-b7c3-4e1d-9f2b-ac075e5b91c5 req-338e5cb5-9abe-4640-be7b-b12a341c71ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f41c3ec-c1e0-4774-8957-1c9f857c43c2", "name": "network-vif-plugged", "status": "completed", "tag": "21c7c060-a2ef-4830-b401-b20129814dd0"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:48.215725 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a7da5193-b7c3-4e1d-9f2b-ac075e5b91c5 req-338e5cb5-9abe-4640-be7b-b12a341c71ac service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:48.216179 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-a7da5193-b7c3-4e1d-9f2b-ac075e5b91c5 req-338e5cb5-9abe-4640-be7b-b12a341c71ac service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:48.229562 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-a7da5193-b7c3-4e1d-9f2b-ac075e5b91c5 req-338e5cb5-9abe-4640-be7b-b12a341c71ac service nova] Creating event network-vif-plugged:21c7c060-a2ef-4830-b401-b20129814dd0 for instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 on nch2-master-1 Apr 30 22:28:48.234069 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:48.236396 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-a7da5193-b7c3-4e1d-9f2b-ac075e5b91c5 req-338e5cb5-9abe-4640-be7b-b12a341c71ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103549 Apr 30 22:28:48.237866 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3648/7192] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 22:28:48.244330 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-704195d8-8e5c-4c12-8fe9-92893ae37427 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1372 microversion: 2.1 time: 0.160529 Apr 30 22:28:48.245360 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3545/7193] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:48 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:49.266703 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:49.268017 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:49.277674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:49.277674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:49.277674 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:49.278099 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:49.419817 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:49.428001 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4faeae25-9f73-4a90-a958-0b58baacf4f1 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1372 microversion: 2.1 time: 0.171108 Apr 30 22:28:49.428595 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3649/7194] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:49 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:50.445114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:50.445746 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:50.452555 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:50.457574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:50.457574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:50.457574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:50.587801 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:50.595018 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4cae0683-986b-448a-822b-9fd4567a3426 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1558 microversion: 2.1 time: 0.153771 Apr 30 22:28:50.595659 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3546/7195] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:50 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:50.612806 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:28:50.613645 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:28:50.620539 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:50.620985 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:50.621778 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:50.622217 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:50.753318 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:28:50.760719 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-8adedc50-9a36-4d47-bea0-3f05e8ef03c4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1558 microversion: 2.1 time: 0.153054 Apr 30 22:28:50.761283 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3650/7196] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:28:50 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:28:53.021678 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-cefbaaef-7ea2-4c25-acd3-a1726992fb1b req-017e1d42-4d67-4bda-8bfc-6e7cf63a9059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f41c3ec-c1e0-4774-8957-1c9f857c43c2", "tag": "21c7c060-a2ef-4830-b401-b20129814dd0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:28:53.030060 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cefbaaef-7ea2-4c25-acd3-a1726992fb1b req-017e1d42-4d67-4bda-8bfc-6e7cf63a9059 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:28:53.030624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-cefbaaef-7ea2-4c25-acd3-a1726992fb1b req-017e1d42-4d67-4bda-8bfc-6e7cf63a9059 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:28:53.045804 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-cefbaaef-7ea2-4c25-acd3-a1726992fb1b req-017e1d42-4d67-4bda-8bfc-6e7cf63a9059 service nova] Creating event network-changed:21c7c060-a2ef-4830-b401-b20129814dd0 for instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 on nch2-master-1 Apr 30 22:28:53.048753 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-cefbaaef-7ea2-4c25-acd3-a1726992fb1b req-017e1d42-4d67-4bda-8bfc-6e7cf63a9059 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037316 Apr 30 22:28:53.049385 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3547/7197] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:30:21.163117 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:30:21.163723 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:30:48.286141 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3dafb6d9-3a65-4169-abae-6e8bb7255c21 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-711321346"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:30:48.287230 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3dafb6d9-3a65-4169-abae-6e8bb7255c21 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:30:48.293251 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dafb6d9-3a65-4169-abae-6e8bb7255c21 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:30:48.293702 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dafb6d9-3a65-4169-abae-6e8bb7255c21 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:30:48.294506 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dafb6d9-3a65-4169-abae-6e8bb7255c21 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:30:48.294944 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3dafb6d9-3a65-4169-abae-6e8bb7255c21 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:30:48.855897 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3dafb6d9-3a65-4169-abae-6e8bb7255c21 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "POST /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2/action" status: 202 len: 0 microversion: 2.1 time: 0.574695 Apr 30 22:30:48.856448 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3651/7198] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:30:48 2022] POST /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 22:30:52.608239 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 30 22:30:52.610272 ncdv-master-1 devstack@n-api.service[130670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 30 22:30:52.614523 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-be62a82c-ccd1-4e2e-8072-4309290cffe4 req-3d7248fb-f37b-44b3-bc60-f7229a2d9477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f41c3ec-c1e0-4774-8957-1c9f857c43c2", "name": "network-vif-plugged", "status": "completed", "tag": "21c7c060-a2ef-4830-b401-b20129814dd0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:30:52.622637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-be62a82c-ccd1-4e2e-8072-4309290cffe4 req-3d7248fb-f37b-44b3-bc60-f7229a2d9477 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:30:52.623100 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-be62a82c-ccd1-4e2e-8072-4309290cffe4 req-3d7248fb-f37b-44b3-bc60-f7229a2d9477 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:30:52.633868 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-be62a82c-ccd1-4e2e-8072-4309290cffe4 req-3d7248fb-f37b-44b3-bc60-f7229a2d9477 service nova] Creating event network-vif-plugged:21c7c060-a2ef-4830-b401-b20129814dd0 for instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 on nch2-master-1 Apr 30 22:30:52.638921 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-be62a82c-ccd1-4e2e-8072-4309290cffe4 req-3d7248fb-f37b-44b3-bc60-f7229a2d9477 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Apr 30 22:30:52.639494 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3548/7199] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:31:04.467854 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1385791162", "imageRef": "7ed50fe0-3e13-4e4b-afbd-d007f976675b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-921526492", "security_groups": [{"name": "tempest-secgroup-smoke-701458678"}], "networks": [{"uuid": "8804c295-ff20-4872-8362-6c333cf4f440"}]}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:31:04.572088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.network.neutron [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] validate_networks() for [('8804c295-ff20-4872-8362-6c333cf4f440', None, None, None, None, None)] {{(pid=130671) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} Apr 30 22:31:04.980228 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Flavor limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 30 22:31:04.980682 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Image limits 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 30 22:31:04.981154 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Flavor pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 30 22:31:04.981569 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Image pref 0:0:0 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 30 22:31:04.982036 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.virt.hardware [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 30 22:31:04.992106 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:04.992560 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:04.993372 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:04.993870 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:05.014286 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 30 22:31:05.020461 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.quota [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Getting quotas for user c7b2e90478f846f6adb5bd5630e97293 and project c4862e1bc1ce438aa0618a97d585b7b5. Resources: {'ram', 'instances', 'cores'} {{(pid=130671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 30 22:31:05.035863 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Going to run 1 instances... {{(pid=130671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 30 22:31:05.038785 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ed50fe0-3e13-4e4b-afbd-d007f976675b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 30 22:31:05.180855 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-3a85eb19-ecbe-4119-8bcc-6637f89c16e3 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718161 Apr 30 22:31:05.181723 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3652/7200] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 22:31:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 22:31:05.198607 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8b822ae-5ec9-40c1-b31b-92ec6035d459] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41000. Apr 30 22:31:05.208295 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-24da62de-8860-4d2d-9e0d-ee24a3359151 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:05.209009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-24da62de-8860-4d2d-9e0d-ee24a3359151 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:05.213663 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee91a811-7af0-4ea3-936b-09e3fcbada2a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40998. Apr 30 22:31:05.324104 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-24da62de-8860-4d2d-9e0d-ee24a3359151 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:05.331957 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-24da62de-8860-4d2d-9e0d-ee24a3359151 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1248 microversion: 2.1 time: 0.143875 Apr 30 22:31:05.332531 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3549/7201] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:05 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1248 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:06.348503 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:06.349122 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:06.360049 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:06.360511 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:06.361285 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:06.361733 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:06.423233 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:06.431292 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-2f4bbbfd-3021-4494-9269-fa7413d218f6 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1252 microversion: 2.1 time: 0.086771 Apr 30 22:31:06.431857 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3653/7202] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:06 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1252 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:06.659938 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-a4a4f07f-937c-4455-b8f9-24ca06c6b01a req-ee310eb3-0042-4cdb-bc3e-e5237baca2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f41c3ec-c1e0-4774-8957-1c9f857c43c2", "name": "network-vif-unplugged", "status": "completed", "tag": "21c7c060-a2ef-4830-b401-b20129814dd0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:31:06.669446 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a4a4f07f-937c-4455-b8f9-24ca06c6b01a req-ee310eb3-0042-4cdb-bc3e-e5237baca2ce service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:06.670023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-a4a4f07f-937c-4455-b8f9-24ca06c6b01a req-ee310eb3-0042-4cdb-bc3e-e5237baca2ce service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:06.681984 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-a4a4f07f-937c-4455-b8f9-24ca06c6b01a req-ee310eb3-0042-4cdb-bc3e-e5237baca2ce service nova] Creating event network-vif-unplugged:21c7c060-a2ef-4830-b401-b20129814dd0 for instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 on nch2-master-1 Apr 30 22:31:06.686950 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-a4a4f07f-937c-4455-b8f9-24ca06c6b01a req-ee310eb3-0042-4cdb-bc3e-e5237baca2ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031648 Apr 30 22:31:06.687527 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3550/7203] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:31:07.448484 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:07.449166 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:07.456084 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:07.457131 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:07.457960 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:07.458403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:07.532433 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:07.540339 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e8edaa12-fe4d-41e1-8904-98b79f112529 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1308 microversion: 2.1 time: 0.095544 Apr 30 22:31:07.541116 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3654/7204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:07 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:08.566340 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:08.567994 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:08.576468 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:08.577188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:08.578244 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:08.578927 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:08.771798 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:08.781049 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-35d07a79-aace-4023-9622-b36d4b55a38f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.226953 Apr 30 22:31:08.781640 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3551/7205] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:08 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:09.798504 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:09.799113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:09.807487 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:09.807981 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:09.809198 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:09.809714 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:09.949125 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:09.959265 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-09c12a52-8a08-4617-bcd6-25031a0a3e90 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.164676 Apr 30 22:31:09.960876 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3655/7206] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:09 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:10.977324 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:10.978009 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:10.985268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:10.985742 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:10.986574 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:10.987860 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:11.495795 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:11.506550 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-a5b45423-53b7-41b1-a748-d95ff6aff4c7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.532634 Apr 30 22:31:11.507616 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3552/7207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:10 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:12.524085 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:12.524623 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:12.531644 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:12.532102 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:12.532886 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:12.533328 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:12.684501 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:12.692397 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-fedb4484-3933-42b6-9513-76d3ea92e8a7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.172192 Apr 30 22:31:12.692963 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3656/7208] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:12 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:13.708982 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:13.709681 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:13.719314 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:13.719819 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:13.720637 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:13.721097 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:13.900572 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:13.908650 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-3a92338d-5479-444b-8d1d-a5412c503709 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.203778 Apr 30 22:31:13.909285 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3553/7209] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:13 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:14.927345 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:14.928117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:14.936877 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:14.937278 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:14.938113 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:14.938565 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:15.088963 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:15.097503 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-187bf6da-b858-4602-81b9-b09d3d84a997 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.175659 Apr 30 22:31:15.098318 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3657/7210] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:14 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:16.119372 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:16.120188 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:16.129534 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:16.130050 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:16.131227 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:16.131739 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:16.278347 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:16.285999 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-0c63de09-865f-469b-bc5f-465402fd524c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.175182 Apr 30 22:31:16.286572 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3554/7211] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:16 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:17.166161 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [req-38437abf-b82b-45b1-ae12-98742f129e48 req-7d2232cb-c697-4a9d-a035-07ca14b4592e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50085f64-b199-4cb4-a3c6-18027d793a75", "tag": "0b732e66-9350-46f8-8a19-413b12b9bc7f"}]} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:31:17.177194 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-38437abf-b82b-45b1-ae12-98742f129e48 req-7d2232cb-c697-4a9d-a035-07ca14b4592e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:17.178008 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [req-38437abf-b82b-45b1-ae12-98742f129e48 req-7d2232cb-c697-4a9d-a035-07ca14b4592e service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:17.197322 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.compute.server_external_events [req-38437abf-b82b-45b1-ae12-98742f129e48 req-7d2232cb-c697-4a9d-a035-07ca14b4592e service nova] Creating event network-changed:0b732e66-9350-46f8-8a19-413b12b9bc7f for instance 50085f64-b199-4cb4-a3c6-18027d793a75 on nch1-master-1 Apr 30 22:31:17.197670 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [req-38437abf-b82b-45b1-ae12-98742f129e48 req-7d2232cb-c697-4a9d-a035-07ca14b4592e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034796 Apr 30 22:31:17.198479 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3658/7212] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:31:17.311672 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:17.317189 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:17.319514 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:17.319985 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:17.320821 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:17.321279 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:17.532096 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:17.540320 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-4501a594-8ee8-4a2a-ab39-33f0bff598ff tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.241127 Apr 30 22:31:17.540901 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3555/7213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:17 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:18.556992 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:18.557643 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:18.564606 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:18.565611 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:18.566403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:18.566844 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:18.697978 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:18.705309 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-4593a493-fd74-4887-afc2-d77d12c8ce64 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.152580 Apr 30 22:31:18.706541 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3659/7214] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:18 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:19.723708 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:19.724346 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:19.731173 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:19.731646 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:19.732449 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:19.733158 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:19.878414 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:19.885745 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-05aa68d9-77a1-412c-83f2-8994920a2103 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.166700 Apr 30 22:31:19.886354 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3556/7215] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:19 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:20.903284 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:20.903816 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:20.910708 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:20.911169 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:20.911951 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:20.912399 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:21.041151 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:21.050819 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-5255f780-dac0-4d8f-b044-4d04ac2db293 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.151492 Apr 30 22:31:21.051391 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3660/7216] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:20 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:22.069651 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:22.070337 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:22.077114 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:22.077594 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:22.078440 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:22.078899 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:22.210846 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:22.218183 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-c2966d6a-c248-4e6e-9764-26e5830aaa0f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.152513 Apr 30 22:31:22.218756 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3557/7217] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:22 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:23.303497 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:23.304117 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:23.310930 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:23.311387 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:23.312162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:23.312601 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:23.450156 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:23.458055 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b00ba0ad-85e7-47d1-aca0-01fe61c1e60f tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.159031 Apr 30 22:31:23.458676 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3661/7218] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:23 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:23.813062 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-3b257bf6-1265-4edc-9d01-21c8e73e0d94 req-0277f0ef-ffc6-42fd-81a7-0a21cb47a33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50085f64-b199-4cb4-a3c6-18027d793a75", "name": "network-vif-plugged", "status": "completed", "tag": "0b732e66-9350-46f8-8a19-413b12b9bc7f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:31:23.822469 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3b257bf6-1265-4edc-9d01-21c8e73e0d94 req-0277f0ef-ffc6-42fd-81a7-0a21cb47a33d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:23.822915 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-3b257bf6-1265-4edc-9d01-21c8e73e0d94 req-0277f0ef-ffc6-42fd-81a7-0a21cb47a33d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:23.834482 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-3b257bf6-1265-4edc-9d01-21c8e73e0d94 req-0277f0ef-ffc6-42fd-81a7-0a21cb47a33d service nova] Creating event network-vif-plugged:0b732e66-9350-46f8-8a19-413b12b9bc7f for instance 50085f64-b199-4cb4-a3c6-18027d793a75 on nch1-master-1 Apr 30 22:31:23.839644 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-3b257bf6-1265-4edc-9d01-21c8e73e0d94 req-0277f0ef-ffc6-42fd-81a7-0a21cb47a33d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030387 Apr 30 22:31:23.840256 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3558/7219] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:31:24.475417 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:24.476070 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:24.483184 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:24.483585 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:24.484388 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:24.484832 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:24.621164 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:24.628585 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-b87f8bc7-4196-4758-a226-16ad9615b9e4 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1373 microversion: 2.1 time: 0.157539 Apr 30 22:31:24.629168 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3662/7220] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:24 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:25.646023 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:25.646653 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:25.653619 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:25.654134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:25.654922 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:25.655379 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:25.784433 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:25.791928 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-b6df5d97-d3c6-493b-bd8e-3de625267f70 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1558 microversion: 2.1 time: 0.150325 Apr 30 22:31:25.792510 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3559/7221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:25 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:25.808709 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:31:25.809332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:31:25.816620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:25.817079 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:25.817883 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:25.818332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:25.946044 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:31:25.953467 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-dcbee2c6-0261-413f-9088-aaaad91c0b82 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1558 microversion: 2.1 time: 0.148683 Apr 30 22:31:25.954066 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3663/7222] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:31:25 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:31:27.884480 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-ea8bc7be-0341-4b73-9cdc-01d6862a78cf req-7bce9428-a98f-448e-922e-1e94cdaf1086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50085f64-b199-4cb4-a3c6-18027d793a75", "tag": "0b732e66-9350-46f8-8a19-413b12b9bc7f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:31:27.895261 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ea8bc7be-0341-4b73-9cdc-01d6862a78cf req-7bce9428-a98f-448e-922e-1e94cdaf1086 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:31:27.900731 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-ea8bc7be-0341-4b73-9cdc-01d6862a78cf req-7bce9428-a98f-448e-922e-1e94cdaf1086 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:31:27.910581 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-ea8bc7be-0341-4b73-9cdc-01d6862a78cf req-7bce9428-a98f-448e-922e-1e94cdaf1086 service nova] Creating event network-changed:0b732e66-9350-46f8-8a19-413b12b9bc7f for instance 50085f64-b199-4cb4-a3c6-18027d793a75 on nch1-master-1 Apr 30 22:31:27.916111 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-ea8bc7be-0341-4b73-9cdc-01d6862a78cf req-7bce9428-a98f-448e-922e-1e94cdaf1086 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035785 Apr 30 22:31:27.916681 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3560/7223] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:31:58.088043 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:31:58.088814 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:32:56.179627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-0441ab78-09b0-4088-ba69-5c58354106aa tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-786698209"}} {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:32:56.180718 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-0441ab78-09b0-4088-ba69-5c58354106aa tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:32:56.186777 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0441ab78-09b0-4088-ba69-5c58354106aa tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:32:56.187231 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0441ab78-09b0-4088-ba69-5c58354106aa tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:32:56.188012 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0441ab78-09b0-4088-ba69-5c58354106aa tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:32:56.188458 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-0441ab78-09b0-4088-ba69-5c58354106aa tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:32:56.700031 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-0441ab78-09b0-4088-ba69-5c58354106aa tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "POST /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75/action" status: 202 len: 0 microversion: 2.1 time: 0.525284 Apr 30 22:32:56.700671 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3664/7224] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Apr 30 22:32:56 2022] POST /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 30 22:33:02.110724 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-59287931-9b47-4a1b-bc08-988a44856c1d req-e7367b4d-2996-4d8d-ba6d-a4c17128cbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50085f64-b199-4cb4-a3c6-18027d793a75", "name": "network-vif-plugged", "status": "completed", "tag": "0b732e66-9350-46f8-8a19-413b12b9bc7f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:33:02.124385 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-59287931-9b47-4a1b-bc08-988a44856c1d req-e7367b4d-2996-4d8d-ba6d-a4c17128cbaf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:02.125140 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-59287931-9b47-4a1b-bc08-988a44856c1d req-e7367b4d-2996-4d8d-ba6d-a4c17128cbaf service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:02.144553 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-59287931-9b47-4a1b-bc08-988a44856c1d req-e7367b4d-2996-4d8d-ba6d-a4c17128cbaf service nova] Creating event network-vif-plugged:0b732e66-9350-46f8-8a19-413b12b9bc7f for instance 50085f64-b199-4cb4-a3c6-18027d793a75 on nch1-master-1 Apr 30 22:33:02.151032 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-59287931-9b47-4a1b-bc08-988a44856c1d req-e7367b4d-2996-4d8d-ba6d-a4c17128cbaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046182 Apr 30 22:33:02.153684 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3561/7225] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:33:13.030660 ncdv-master-1 devstack@n-api.service[130671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [306cf566-6014-4b35-a2ad-51934902a33f] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 22:33:13.031602 ncdv-master-1 devstack@n-api.service[130671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 22:33:13.035499 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:13.036188 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:13.043596 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:13.044183 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:13.045058 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:13.045599 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:13.073530 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:33:13.114134 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-8594d3d6-0490-4f3d-b1e7-c0a49a266a70 req-13a837fc-ccee-4460-a633-8b4896e61ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50085f64-b199-4cb4-a3c6-18027d793a75", "tag": "0b732e66-9350-46f8-8a19-413b12b9bc7f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:33:13.122632 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8594d3d6-0490-4f3d-b1e7-c0a49a266a70 req-13a837fc-ccee-4460-a633-8b4896e61ad2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:13.124138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-8594d3d6-0490-4f3d-b1e7-c0a49a266a70 req-13a837fc-ccee-4460-a633-8b4896e61ad2 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:13.134431 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-8594d3d6-0490-4f3d-b1e7-c0a49a266a70 req-13a837fc-ccee-4460-a633-8b4896e61ad2 service nova] Creating event network-changed:0b732e66-9350-46f8-8a19-413b12b9bc7f for instance 50085f64-b199-4cb4-a3c6-18027d793a75 on nch1-master-1 Apr 30 22:33:13.139508 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-8594d3d6-0490-4f3d-b1e7-c0a49a266a70 req-13a837fc-ccee-4460-a633-8b4896e61ad2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107684 Apr 30 22:33:13.140109 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3562/7226] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:33:13.371861 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-d1b825a6-3759-4ff7-9bb7-d1130f863de7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 204 len: 0 microversion: 2.1 time: 0.342379 Apr 30 22:33:13.372668 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3665/7227] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:33:13 2022] DELETE /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:33:13.381374 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:13.382080 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:13.388786 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:13.388974 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:13.389805 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:13.390278 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:13.523548 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:33:13.531178 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-dd3a5706-21c8-4847-859e-61cb920cc94c tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1682 microversion: 2.1 time: 0.154087 Apr 30 22:33:13.531756 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3563/7228] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:13 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:33:14.550016 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:14.550636 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:14.560384 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:14.560843 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:14.561617 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:14.562088 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:14.569498 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] [306cf566-6014-4b35-a2ad-51934902a33f] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41328. Apr 30 22:33:14.582404 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] [37fe2cc0-b65e-4d9c-8c54-461241ec54ec] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41330. Apr 30 22:33:14.704929 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:33:14.712599 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-1bebbe6d-6db0-4559-8d9d-a3d73710b2e5 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1682 microversion: 2.1 time: 0.167008 Apr 30 22:33:14.713180 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3666/7229] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:14 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:33:15.729627 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:15.730271 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-39c831ce-e67d-427b-8bee-fe421f3ba999 req-e08d5831-8906-4966-a52c-ccfaef88b1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50085f64-b199-4cb4-a3c6-18027d793a75", "name": "network-vif-deleted", "tag": "0b732e66-9350-46f8-8a19-413b12b9bc7f"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:33:15.730902 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:15.737436 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:15.737939 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:15.738263 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-39c831ce-e67d-427b-8bee-fe421f3ba999 req-e08d5831-8906-4966-a52c-ccfaef88b1c4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:15.738721 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:15.738833 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-39c831ce-e67d-427b-8bee-fe421f3ba999 req-e08d5831-8906-4966-a52c-ccfaef88b1c4 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:15.739165 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:15.750225 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-39c831ce-e67d-427b-8bee-fe421f3ba999 req-e08d5831-8906-4966-a52c-ccfaef88b1c4 service nova] Creating event network-vif-deleted:0b732e66-9350-46f8-8a19-413b12b9bc7f for instance 50085f64-b199-4cb4-a3c6-18027d793a75 on nch1-master-1 Apr 30 22:33:15.756989 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-39c831ce-e67d-427b-8bee-fe421f3ba999 req-e08d5831-8906-4966-a52c-ccfaef88b1c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084269 Apr 30 22:33:15.757854 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3564/7230] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:33:15.806502 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:33:15.813987 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-78c0ec6f-7bc4-4b2e-951a-4675b0d6df54 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 200 len: 1497 microversion: 2.1 time: 0.088148 Apr 30 22:33:15.814556 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3667/7231] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:15 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 1497 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:33:16.832709 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:16.833465 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 50085f64-b199-4cb4-a3c6-18027d793a75] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:16.840544 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:16.841026 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:16.841863 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:16.842333 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:16.856967 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] HTTP exception thrown: Instance 50085f64-b199-4cb4-a3c6-18027d793a75 could not be found. Apr 30 22:33:16.857589 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Returning 404 to user: Instance 50085f64-b199-4cb4-a3c6-18027d793a75 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:33:16.858480 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-09b114ae-b20a-4b70-b427-2e85581f3812 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75" status: 404 len: 111 microversion: 2.1 time: 0.031383 Apr 30 22:33:16.859115 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3565/7232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:16 2022] GET /compute/v2.1/servers/50085f64-b199-4cb4-a3c6-18027d793a75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:33:19.109739 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:19.110279 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:19.114568 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-fb820f78-ff87-4a9a-b196-bedcd1ec0f7f req-a700e505-837b-4494-9b12-4c2222e9bdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f41c3ec-c1e0-4774-8957-1c9f857c43c2", "tag": "21c7c060-a2ef-4830-b401-b20129814dd0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:33:19.117788 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:19.118315 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:19.119324 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:19.119848 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:19.124162 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fb820f78-ff87-4a9a-b196-bedcd1ec0f7f req-a700e505-837b-4494-9b12-4c2222e9bdf9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:19.124624 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-fb820f78-ff87-4a9a-b196-bedcd1ec0f7f req-a700e505-837b-4494-9b12-4c2222e9bdf9 service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:19.136912 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-fb820f78-ff87-4a9a-b196-bedcd1ec0f7f req-a700e505-837b-4494-9b12-4c2222e9bdf9 service nova] Creating event network-changed:21c7c060-a2ef-4830-b401-b20129814dd0 for instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 on nch2-master-1 Apr 30 22:33:19.142206 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-fb820f78-ff87-4a9a-b196-bedcd1ec0f7f req-a700e505-837b-4494-9b12-4c2222e9bdf9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031545 Apr 30 22:33:19.142801 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3566/7233] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:33:19.146750 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Going to try to terminate instance {{(pid=130671) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 30 22:33:19.389308 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-a60ad6ef-80f1-416e-8830-d9ecdab43adb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 204 len: 0 microversion: 2.1 time: 0.283089 Apr 30 22:33:19.393074 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3668/7234] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 22:33:19 2022] DELETE /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 22:33:19.399418 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:19.400138 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:19.406984 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:19.407447 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:19.408250 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:19.408702 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:19.542896 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.policy [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130670) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:33:19.550579 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-08ba4360-7905-4b06-b269-f8c0598b85eb tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1683 microversion: 2.1 time: 0.155902 Apr 30 22:33:19.551149 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3567/7235] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:19 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:33:20.569276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:20.570018 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:20.576873 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:20.577332 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:20.578711 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:20.579162 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:20.738302 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:33:20.746388 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-e7888200-cb22-460b-bed1-d816d47b3381 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1683 microversion: 2.1 time: 0.181968 Apr 30 22:33:20.750756 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3669/7236] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:20 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:33:21.436231 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [req-00409814-1aef-4254-b3a5-dedfce65847e req-9b7c7b92-3a18-40f5-ba58-c0f380d0019d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f41c3ec-c1e0-4774-8957-1c9f857c43c2", "name": "network-vif-deleted", "tag": "21c7c060-a2ef-4830-b401-b20129814dd0"}]} {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 22:33:21.445738 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-00409814-1aef-4254-b3a5-dedfce65847e req-9b7c7b92-3a18-40f5-ba58-c0f380d0019d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:21.446268 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [req-00409814-1aef-4254-b3a5-dedfce65847e req-9b7c7b92-3a18-40f5-ba58-c0f380d0019d service nova] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:21.457052 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.compute.server_external_events [req-00409814-1aef-4254-b3a5-dedfce65847e req-9b7c7b92-3a18-40f5-ba58-c0f380d0019d service nova] Creating event network-vif-deleted:21c7c060-a2ef-4830-b401-b20129814dd0 for instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 on nch2-master-1 Apr 30 22:33:21.462337 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [req-00409814-1aef-4254-b3a5-dedfce65847e req-9b7c7b92-3a18-40f5-ba58-c0f380d0019d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 Apr 30 22:33:21.462920 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3568/7237] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Apr 30 22:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 22:33:21.764216 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:21.764808 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.compute.api [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130671) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:21.771973 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:21.772610 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:21.773403 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:21.773874 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:21.807620 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:21.808072 ncdv-master-1 devstack@n-api.service[130671]: DEBUG oslo_concurrency.lockutils [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:21.810356 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.objects.instance [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lazy-loading 'fault' on Instance uuid 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 {{(pid=130671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 30 22:33:21.851664 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.policy [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b2e90478f846f6adb5bd5630e97293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4862e1bc1ce438aa0618a97d585b7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130671) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 22:33:21.860269 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-7d4a3c56-a91f-47a2-84cc-87067d95d5d7 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 200 len: 1337 microversion: 2.1 time: 0.099748 Apr 30 22:33:21.865153 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3670/7238] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:21 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 22:33:22.878673 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '>' {{(pid=130670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:22.879412 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.compute.api [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] [instance: 2f41c3ec-c1e0-4774-8957-1c9f857c43c2] Fetching instance by UUID {{(pid=130670) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 30 22:33:22.886989 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:22.887460 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:22.888249 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 30 22:33:22.888705 ncdv-master-1 devstack@n-api.service[130670]: DEBUG oslo_concurrency.lockutils [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Lock "a79cdb58-89e7-4a84-81e2-51e402cc5dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 30 22:33:22.902922 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.wsgi [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] HTTP exception thrown: Instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 could not be found. Apr 30 22:33:22.903517 ncdv-master-1 devstack@n-api.service[130670]: DEBUG nova.api.openstack.wsgi [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Returning 404 to user: Instance 2f41c3ec-c1e0-4774-8957-1c9f857c43c2 could not be found. {{(pid=130670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 30 22:33:22.904344 ncdv-master-1 devstack@n-api.service[130670]: INFO nova.api.openstack.requestlog [None req-f21d6098-f6cd-446b-9f5b-b982317b8ea9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2" status: 404 len: 111 microversion: 2.1 time: 0.030000 Apr 30 22:33:22.904868 ncdv-master-1 devstack@n-api.service[130670]: [pid: 130670|app: 0|req: 3569/7239] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 22:33:22 2022] GET /compute/v2.1/servers/2f41c3ec-c1e0-4774-8957-1c9f857c43c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 22:33:23.125276 ncdv-master-1 devstack@n-api.service[130671]: DEBUG nova.api.openstack.wsgi [None req-f618ffba-f2cd-47e9-9d92-ef3ff9d52df9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] Calling method '.version_select at 0x7fdc1362c040>' {{(pid=130671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 22:33:23.195105 ncdv-master-1 devstack@n-api.service[130671]: INFO nova.api.openstack.requestlog [None req-f618ffba-f2cd-47e9-9d92-ef3ff9d52df9 tempest-TestSnapshotPattern-1007452703 tempest-TestSnapshotPattern-1007452703-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-921526492" status: 202 len: 0 microversion: 2.1 time: 0.073702 Apr 30 22:33:23.195718 ncdv-master-1 devstack@n-api.service[130671]: [pid: 130671|app: 0|req: 3671/7240] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 22:33:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-921526492 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 22:33:37.970184 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:33:37.970787 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:33:41.171574 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:33:41.172176 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:33:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:35:18.095977 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:35:18.096611 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:35:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:35:37.172687 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:35:37.173422 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:35:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:35:54.839722 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:35:54.840284 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:36:01.399655 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:36:01.400287 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:36:57.978266 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:36:57.978871 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:36:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:37:01.180417 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:37:01.181017 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:37:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:38:38.109679 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:38:38.110287 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:38:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:38:57.180725 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:38:57.181444 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:38:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:39:14.848061 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:39:14.848916 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:39:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:39:21.408719 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:39:21.409301 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:39:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:40:17.986077 ncdv-master-1 devstack@n-api.service[130670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:40:17.986654 ncdv-master-1 devstack@n-api.service[130670]: Sat Apr 30 22:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 22:40:21.190261 ncdv-master-1 devstack@n-api.service[130671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 22:40:21.190838 ncdv-master-1 devstack@n-api.service[130671]: Sat Apr 30 22:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!